[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:16:43.892174 13122 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.208.190:46177
I20260709 13:16:43.893702 13122 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:16:43.894848 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:43.912111 13131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:43.912104 13128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:43.912477 13129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:43.913365 13122 server_base.cc:1061] running on GCE node
I20260709 13:16:45.171599 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:45.171893 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:45.172185 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603005172156 us; error 0 us; skew 500 ppm
I20260709 13:16:45.173171 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:45.180871 13122 webserver.cc:533] Webserver started at http://127.12.208.190:43335/ using document root <none> and password file <none>
I20260709 13:16:45.181933 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:45.182191 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:45.182713 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:45.189270 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/master-0-root/instance:
uuid: "48fc02e1b2cc40299dc52f3cd6b06949"
format_stamp: "Formatted at 2026-07-09 13:16:45 on dist-test-slave-ll1f"
I20260709 13:16:45.198137 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:16:45.203893 13137 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:45.205019 13122 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:16:45.205389 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/master-0-root
uuid: "48fc02e1b2cc40299dc52f3cd6b06949"
format_stamp: "Formatted at 2026-07-09 13:16:45 on dist-test-slave-ll1f"
I20260709 13:16:45.205695 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:45.305578 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:45.307256 13122 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:16:45.307749 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:45.381973 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.190:46177
I20260709 13:16:45.382103 13188 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.190:46177 every 8 connection(s)
I20260709 13:16:45.389951 13189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.412114 13189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949: Bootstrap starting.
I20260709 13:16:45.418335 13189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.420305 13189 log.cc:826] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949: Log is configured to *not* fsync() on all Append() calls
I20260709 13:16:45.425055 13189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949: No bootstrap required, opened a new log
I20260709 13:16:45.445721 13189 raft_consensus.cc:359] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fc02e1b2cc40299dc52f3cd6b06949" member_type: VOTER }
I20260709 13:16:45.446326 13189 raft_consensus.cc:385] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.446617 13189 raft_consensus.cc:740] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48fc02e1b2cc40299dc52f3cd6b06949, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.447654 13189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fc02e1b2cc40299dc52f3cd6b06949" member_type: VOTER }
I20260709 13:16:45.448176 13189 raft_consensus.cc:399] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:45.448490 13189 raft_consensus.cc:493] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:45.448853 13189 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.453234 13189 raft_consensus.cc:515] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fc02e1b2cc40299dc52f3cd6b06949" member_type: VOTER }
I20260709 13:16:45.454156 13189 leader_election.cc:304] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48fc02e1b2cc40299dc52f3cd6b06949; no voters: 
I20260709 13:16:45.455946 13189 leader_election.cc:290] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:45.456355 13192 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.459102 13192 raft_consensus.cc:697] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [term 1 LEADER]: Becoming Leader. State: Replica: 48fc02e1b2cc40299dc52f3cd6b06949, State: Running, Role: LEADER
I20260709 13:16:45.459988 13192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fc02e1b2cc40299dc52f3cd6b06949" member_type: VOTER }
I20260709 13:16:45.460534 13189 sys_catalog.cc:565] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:45.471449 13194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48fc02e1b2cc40299dc52f3cd6b06949. Latest consensus state: current_term: 1 leader_uuid: "48fc02e1b2cc40299dc52f3cd6b06949" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fc02e1b2cc40299dc52f3cd6b06949" member_type: VOTER } }
I20260709 13:16:45.472067 13194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:45.472056 13193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48fc02e1b2cc40299dc52f3cd6b06949" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48fc02e1b2cc40299dc52f3cd6b06949" member_type: VOTER } }
I20260709 13:16:45.472891 13193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:45.477279 13201 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:45.488884 13201 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:45.491288 13122 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:45.505970 13201 catalog_manager.cc:1383] Generated new cluster ID: 628ecedbb88c41a8b9a152722bd9d3bb
I20260709 13:16:45.506315 13201 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:45.544173 13201 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:45.545957 13201 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:45.558611 13201 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949: Generated new TSK 0
I20260709 13:16:45.559587 13201 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:45.623422 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:45.633275 13211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:45.634490 13212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:45.639456 13122 server_base.cc:1061] running on GCE node
W20260709 13:16:45.640070 13214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:45.641141 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:45.641361 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:45.641621 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603005641579 us; error 0 us; skew 500 ppm
I20260709 13:16:45.642496 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:45.647697 13122 webserver.cc:533] Webserver started at http://127.12.208.129:39407/ using document root <none> and password file <none>
I20260709 13:16:45.648348 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:45.648597 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:45.648959 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:45.650458 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-0-root/instance:
uuid: "e3ebc7f240de4b83a92a971740d2a377"
format_stamp: "Formatted at 2026-07-09 13:16:45 on dist-test-slave-ll1f"
I20260709 13:16:45.657713 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:45.663350 13219 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:45.664374 13122 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:16:45.664723 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-0-root
uuid: "e3ebc7f240de4b83a92a971740d2a377"
format_stamp: "Formatted at 2026-07-09 13:16:45 on dist-test-slave-ll1f"
I20260709 13:16:45.665071 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:45.708323 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:45.710033 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:45.712837 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:45.718343 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:45.718626 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:45.718977 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:45.719172 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:45.838707 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.129:39519
I20260709 13:16:45.838804 13281 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.129:39519 every 8 connection(s)
I20260709 13:16:45.847079 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:45.862542 13286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:45.864029 13287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:45.877526 13289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:45.877882 13122 server_base.cc:1061] running on GCE node
I20260709 13:16:45.878372 13282 heartbeater.cc:344] Connected to a master server at 127.12.208.190:46177
I20260709 13:16:45.878997 13282 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:45.879249 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:45.879532 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:45.879733 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603005879716 us; error 0 us; skew 500 ppm
I20260709 13:16:45.880276 13282 heartbeater.cc:507] Master 127.12.208.190:46177 requested a full tablet report, sending...
I20260709 13:16:45.880524 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:45.884011 13122 webserver.cc:533] Webserver started at http://127.12.208.130:43847/ using document root <none> and password file <none>
I20260709 13:16:45.884033 13154 ts_manager.cc:194] Registered new tserver with Master: e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519)
I20260709 13:16:45.884742 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:45.885017 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:45.885357 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:45.886886 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-1-root/instance:
uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
format_stamp: "Formatted at 2026-07-09 13:16:45 on dist-test-slave-ll1f"
I20260709 13:16:45.886924 13154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50246
I20260709 13:16:45.893926 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:16:45.899567 13294 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:45.900592 13122 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:45.900928 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-1-root
uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
format_stamp: "Formatted at 2026-07-09 13:16:45 on dist-test-slave-ll1f"
I20260709 13:16:45.901278 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:45.924928 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:45.926687 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:45.928311 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:45.932076 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:45.932337 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:45.932622 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:45.932823 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.018599 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.130:41751
I20260709 13:16:46.018734 13356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.130:41751 every 8 connection(s)
I20260709 13:16:46.028543 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:46.037225 13360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:46.039232 13361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:46.039779 13357 heartbeater.cc:344] Connected to a master server at 127.12.208.190:46177
I20260709 13:16:46.040216 13357 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:46.041363 13357 heartbeater.cc:507] Master 127.12.208.190:46177 requested a full tablet report, sending...
I20260709 13:16:46.044814 13154 ts_manager.cc:194] Registered new tserver with Master: f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751)
I20260709 13:16:46.047451 13154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50256
W20260709 13:16:46.052254 13363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:46.054188 13122 server_base.cc:1061] running on GCE node
I20260709 13:16:46.055228 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:46.055488 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:46.055693 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603006055676 us; error 0 us; skew 500 ppm
I20260709 13:16:46.056438 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:46.059396 13122 webserver.cc:533] Webserver started at http://127.12.208.131:32787/ using document root <none> and password file <none>
I20260709 13:16:46.059986 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:46.060218 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:46.060532 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:46.061889 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-2-root/instance:
uuid: "e0da4e02b7d4435e99534f17dcb550ea"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-ll1f"
I20260709 13:16:46.067687 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:46.071841 13368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.072715 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:16:46.073048 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-2-root
uuid: "e0da4e02b7d4435e99534f17dcb550ea"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-ll1f"
I20260709 13:16:46.073408 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603003722080-13122-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:46.092800 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:46.094480 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:46.096464 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:46.099658 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:46.099917 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.100196 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:46.100405 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.187462 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.131:36639
I20260709 13:16:46.187944 13430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.131:36639 every 8 connection(s)
I20260709 13:16:46.205482 13431 heartbeater.cc:344] Connected to a master server at 127.12.208.190:46177
I20260709 13:16:46.205927 13431 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:46.206740 13431 heartbeater.cc:507] Master 127.12.208.190:46177 requested a full tablet report, sending...
I20260709 13:16:46.208653 13154 ts_manager.cc:194] Registered new tserver with Master: e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:46.209326 13122 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016252786s
I20260709 13:16:46.210139 13154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50272
I20260709 13:16:46.263906 13154 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50282:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:46.267891 13154 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:46.359436 13247 tablet_service.cc:1511] Processing CreateTablet for tablet 00f18c1dd0744729bbc46758c450cccc (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:46.361941 13247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f18c1dd0744729bbc46758c450cccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.371995 13246 tablet_service.cc:1511] Processing CreateTablet for tablet 875c370d8a9f49fe9d3bb5cbf776e2fb (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:46.372588 13245 tablet_service.cc:1511] Processing CreateTablet for tablet 89b0058a909b400985f7239ade36f6e5 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:46.374228 13246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875c370d8a9f49fe9d3bb5cbf776e2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.377466 13245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b0058a909b400985f7239ade36f6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.379081 13244 tablet_service.cc:1511] Processing CreateTablet for tablet ff1b9249e3cb4a66bcdfaf3ea4c6ac15 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:46.381121 13244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1b9249e3cb4a66bcdfaf3ea4c6ac15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.378337 13243 tablet_service.cc:1511] Processing CreateTablet for tablet 769250822d1d4385a381cd0dd59ef3a5 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:46.384011 13243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769250822d1d4385a381cd0dd59ef3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.390725 13242 tablet_service.cc:1511] Processing CreateTablet for tablet 171e108453e646898d93d53e996a098d (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:46.392328 13242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e108453e646898d93d53e996a098d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.402279 13241 tablet_service.cc:1511] Processing CreateTablet for tablet 1272bddccd314e818dd9fc54caff59a1 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:46.404511 13241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1272bddccd314e818dd9fc54caff59a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.422796 13322 tablet_service.cc:1511] Processing CreateTablet for tablet 00f18c1dd0744729bbc46758c450cccc (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:46.436259 13322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f18c1dd0744729bbc46758c450cccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.450855 13316 tablet_service.cc:1511] Processing CreateTablet for tablet 1272bddccd314e818dd9fc54caff59a1 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:46.451670 13320 tablet_service.cc:1511] Processing CreateTablet for tablet 89b0058a909b400985f7239ade36f6e5 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:46.436949 13321 tablet_service.cc:1511] Processing CreateTablet for tablet 875c370d8a9f49fe9d3bb5cbf776e2fb (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:46.453927 13318 tablet_service.cc:1511] Processing CreateTablet for tablet 769250822d1d4385a381cd0dd59ef3a5 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:46.448035 13319 tablet_service.cc:1511] Processing CreateTablet for tablet ff1b9249e3cb4a66bcdfaf3ea4c6ac15 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:46.456176 13316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1272bddccd314e818dd9fc54caff59a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.453040 13317 tablet_service.cc:1511] Processing CreateTablet for tablet 171e108453e646898d93d53e996a098d (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:46.468626 13449 tablet_bootstrap.cc:492] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377: Bootstrap starting.
I20260709 13:16:46.469609 13243 tablet_service.cc:1511] Processing CreateTablet for tablet ddcd97ab66144d7daf8c22eeed64dcc7 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:46.479036 13243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcd97ab66144d7daf8c22eeed64dcc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.480140 13392 tablet_service.cc:1511] Processing CreateTablet for tablet 769250822d1d4385a381cd0dd59ef3a5 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:46.481575 13392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769250822d1d4385a381cd0dd59ef3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.478219 13321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875c370d8a9f49fe9d3bb5cbf776e2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.489316 13394 tablet_service.cc:1511] Processing CreateTablet for tablet 89b0058a909b400985f7239ade36f6e5 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:46.494134 13394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b0058a909b400985f7239ade36f6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.499563 13318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769250822d1d4385a381cd0dd59ef3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.499756 13395 tablet_service.cc:1511] Processing CreateTablet for tablet 875c370d8a9f49fe9d3bb5cbf776e2fb (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:46.491566 13393 tablet_service.cc:1511] Processing CreateTablet for tablet ff1b9249e3cb4a66bcdfaf3ea4c6ac15 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:46.502965 13317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e108453e646898d93d53e996a098d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.511569 13396 tablet_service.cc:1511] Processing CreateTablet for tablet 00f18c1dd0744729bbc46758c450cccc (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:46.518018 13395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875c370d8a9f49fe9d3bb5cbf776e2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.520187 13393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1b9249e3cb4a66bcdfaf3ea4c6ac15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.521123 13315 tablet_service.cc:1511] Processing CreateTablet for tablet ddcd97ab66144d7daf8c22eeed64dcc7 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:46.522290 13391 tablet_service.cc:1511] Processing CreateTablet for tablet 171e108453e646898d93d53e996a098d (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:46.530989 13319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1b9249e3cb4a66bcdfaf3ea4c6ac15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.533226 13396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f18c1dd0744729bbc46758c450cccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.529263 13390 tablet_service.cc:1511] Processing CreateTablet for tablet 1272bddccd314e818dd9fc54caff59a1 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
W20260709 13:16:46.531279 13202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:46.537962 13320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b0058a909b400985f7239ade36f6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.538800 13389 tablet_service.cc:1511] Processing CreateTablet for tablet ddcd97ab66144d7daf8c22eeed64dcc7 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:46.545861 13391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e108453e646898d93d53e996a098d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.549260 13244 tablet_service.cc:1511] Processing CreateTablet for tablet 17212d33030a430784434e217ddb7e52 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:46.552542 13244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17212d33030a430784434e217ddb7e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.548691 13315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcd97ab66144d7daf8c22eeed64dcc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.557305 13390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1272bddccd314e818dd9fc54caff59a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.559805 13449 tablet_bootstrap.cc:654] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.566061 13389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcd97ab66144d7daf8c22eeed64dcc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.571072 13314 tablet_service.cc:1511] Processing CreateTablet for tablet 17212d33030a430784434e217ddb7e52 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:46.576625 13314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17212d33030a430784434e217ddb7e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.636513 13388 tablet_service.cc:1511] Processing CreateTablet for tablet 17212d33030a430784434e217ddb7e52 (DEFAULT_TABLE table=test-workload [id=ff5b2accf9aa4650a4900263ba107eb7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:46.653430 13388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17212d33030a430784434e217ddb7e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.656229 13450 tablet_bootstrap.cc:492] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680: Bootstrap starting.
I20260709 13:16:46.694172 13449 tablet_bootstrap.cc:492] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377: No bootstrap required, opened a new log
I20260709 13:16:46.694685 13449 ts_tablet_manager.cc:1403] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377: Time spent bootstrapping tablet: real 0.245s	user 0.019s	sys 0.012s
I20260709 13:16:46.697199 13452 tablet_bootstrap.cc:492] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea: Bootstrap starting.
I20260709 13:16:46.718431 13449 raft_consensus.cc:359] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.719241 13449 raft_consensus.cc:385] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.719509 13449 raft_consensus.cc:740] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.722548 13450 tablet_bootstrap.cc:654] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.723721 13449 consensus_queue.cc:260] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.732540 13452 tablet_bootstrap.cc:654] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.742549 13449 ts_tablet_manager.cc:1434] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.012s
I20260709 13:16:46.743710 13282 heartbeater.cc:499] Master 127.12.208.190:46177 was elected leader, sending a full tablet report...
I20260709 13:16:46.746572 13452 tablet_bootstrap.cc:492] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea: No bootstrap required, opened a new log
I20260709 13:16:46.747025 13452 ts_tablet_manager.cc:1403] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.008s
I20260709 13:16:46.748864 13450 tablet_bootstrap.cc:492] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680: No bootstrap required, opened a new log
I20260709 13:16:46.749346 13450 ts_tablet_manager.cc:1403] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent bootstrapping tablet: real 0.113s	user 0.009s	sys 0.014s
I20260709 13:16:46.750352 13452 raft_consensus.cc:359] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.751096 13452 raft_consensus.cc:385] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.751380 13452 raft_consensus.cc:740] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.752194 13450 raft_consensus.cc:359] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.752144 13452 consensus_queue.cc:260] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.752904 13450 raft_consensus.cc:385] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.753225 13450 raft_consensus.cc:740] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.754128 13449 tablet_bootstrap.cc:492] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377: Bootstrap starting.
I20260709 13:16:46.753973 13450 consensus_queue.cc:260] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.762733 13449 tablet_bootstrap.cc:654] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.763507 13450 ts_tablet_manager.cc:1434] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.001s
I20260709 13:16:46.764286 13357 heartbeater.cc:499] Master 127.12.208.190:46177 was elected leader, sending a full tablet report...
I20260709 13:16:46.770095 13450 tablet_bootstrap.cc:492] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680: Bootstrap starting.
I20260709 13:16:46.770576 13431 heartbeater.cc:499] Master 127.12.208.190:46177 was elected leader, sending a full tablet report...
I20260709 13:16:46.774511 13452 ts_tablet_manager.cc:1434] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.003s
I20260709 13:16:46.775560 13452 tablet_bootstrap.cc:492] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea: Bootstrap starting.
I20260709 13:16:46.777446 13450 tablet_bootstrap.cc:654] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:46.778687 13358 tablet.cc:2406] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:46.782581 13452 tablet_bootstrap.cc:654] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.788024 13449 tablet_bootstrap.cc:492] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377: No bootstrap required, opened a new log
I20260709 13:16:46.788519 13449 ts_tablet_manager.cc:1403] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.002s
I20260709 13:16:46.791872 13449 raft_consensus.cc:359] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.792857 13449 raft_consensus.cc:385] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.793169 13449 raft_consensus.cc:740] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.793987 13449 consensus_queue.cc:260] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.795738 13450 tablet_bootstrap.cc:492] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680: No bootstrap required, opened a new log
I20260709 13:16:46.796200 13450 ts_tablet_manager.cc:1403] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 13:16:46.796413 13449 ts_tablet_manager.cc:1434] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:46.797336 13449 tablet_bootstrap.cc:492] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377: Bootstrap starting.
I20260709 13:16:46.799013 13450 raft_consensus.cc:359] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.799723 13450 raft_consensus.cc:385] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.800035 13450 raft_consensus.cc:740] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.801118 13450 consensus_queue.cc:260] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.803659 13450 ts_tablet_manager.cc:1434] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 13:16:46.804648 13450 tablet_bootstrap.cc:492] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680: Bootstrap starting.
I20260709 13:16:46.809046 13449 tablet_bootstrap.cc:654] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.811607 13450 tablet_bootstrap.cc:654] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.818259 13452 tablet_bootstrap.cc:492] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea: No bootstrap required, opened a new log
I20260709 13:16:46.818607 13449 tablet_bootstrap.cc:492] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377: No bootstrap required, opened a new log
I20260709 13:16:46.818778 13452 ts_tablet_manager.cc:1403] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.009s
I20260709 13:16:46.819128 13449 ts_tablet_manager.cc:1403] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.008s
I20260709 13:16:46.821554 13452 raft_consensus.cc:359] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.822247 13452 raft_consensus.cc:385] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.822562 13452 raft_consensus.cc:740] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.823176 13452 consensus_queue.cc:260] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.826582 13452 ts_tablet_manager.cc:1434] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:46.827581 13452 tablet_bootstrap.cc:492] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea: Bootstrap starting.
I20260709 13:16:46.827998 13450 tablet_bootstrap.cc:492] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680: No bootstrap required, opened a new log
I20260709 13:16:46.828439 13450 ts_tablet_manager.cc:1403] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.005s
I20260709 13:16:46.831192 13449 raft_consensus.cc:359] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.831841 13450 raft_consensus.cc:359] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.837699 13449 raft_consensus.cc:385] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.837751 13450 raft_consensus.cc:385] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.834213 13452 tablet_bootstrap.cc:654] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.838147 13449 raft_consensus.cc:740] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.839051 13449 consensus_queue.cc:260] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.838188 13450 raft_consensus.cc:740] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.841286 13449 ts_tablet_manager.cc:1434] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:16:46.841643 13450 consensus_queue.cc:260] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.842509 13449 tablet_bootstrap.cc:492] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377: Bootstrap starting.
I20260709 13:16:46.844141 13450 ts_tablet_manager.cc:1434] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:16:46.845063 13450 tablet_bootstrap.cc:492] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680: Bootstrap starting.
I20260709 13:16:46.855401 13450 tablet_bootstrap.cc:654] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.855401 13449 tablet_bootstrap.cc:654] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.868173 13450 tablet_bootstrap.cc:492] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680: No bootstrap required, opened a new log
I20260709 13:16:46.868726 13450 ts_tablet_manager.cc:1403] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.004s
I20260709 13:16:46.868721 13452 tablet_bootstrap.cc:492] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea: No bootstrap required, opened a new log
I20260709 13:16:46.869519 13453 raft_consensus.cc:493] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.869740 13452 ts_tablet_manager.cc:1403] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.000s
I20260709 13:16:46.870057 13453 raft_consensus.cc:515] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.871397 13449 tablet_bootstrap.cc:492] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377: No bootstrap required, opened a new log
I20260709 13:16:46.871806 13449 ts_tablet_manager.cc:1403] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.000s
I20260709 13:16:46.873816 13453 leader_election.cc:290] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:46.874239 13452 raft_consensus.cc:359] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.875022 13452 raft_consensus.cc:385] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.876307 13452 raft_consensus.cc:740] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.877316 13452 consensus_queue.cc:260] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.880662 13452 ts_tablet_manager.cc:1434] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:46.881642 13452 tablet_bootstrap.cc:492] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea: Bootstrap starting.
I20260709 13:16:46.881664 13449 raft_consensus.cc:359] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.893854 13452 tablet_bootstrap.cc:654] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.894335 13450 raft_consensus.cc:359] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.895108 13450 raft_consensus.cc:385] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.895462 13450 raft_consensus.cc:740] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.896225 13450 consensus_queue.cc:260] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.902117 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f18c1dd0744729bbc46758c450cccc" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" is_pre_election: true
I20260709 13:16:46.903057 13332 raft_consensus.cc:2468] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 0.
I20260709 13:16:46.904958 13450 ts_tablet_manager.cc:1434] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:16:46.905038 13220 leader_election.cc:304] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:46.907135 13453 raft_consensus.cc:2804] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.907478 13453 raft_consensus.cc:493] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.907778 13453 raft_consensus.cc:3060] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.908999 13457 raft_consensus.cc:493] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.909503 13457 raft_consensus.cc:515] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.915552 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f18c1dd0744729bbc46758c450cccc" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:46.916564 13406 raft_consensus.cc:2468] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 0.
I20260709 13:16:46.920733 13453 raft_consensus.cc:515] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.921897 13457 leader_election.cc:290] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:46.927569 13453 leader_election.cc:290] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 election: Requested vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:46.928951 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f18c1dd0744729bbc46758c450cccc" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:46.930878 13406 raft_consensus.cc:3060] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.929261 13450 tablet_bootstrap.cc:492] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680: Bootstrap starting.
I20260709 13:16:46.937052 13456 raft_consensus.cc:493] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.937722 13456 raft_consensus.cc:515] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.887781 13449 raft_consensus.cc:385] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.939450 13449 raft_consensus.cc:740] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.940183 13449 consensus_queue.cc:260] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.942631 13449 ts_tablet_manager.cc:1434] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.002s
I20260709 13:16:46.949297 13456 leader_election.cc:290] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751)
I20260709 13:16:46.958060 13449 tablet_bootstrap.cc:492] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377: Bootstrap starting.
I20260709 13:16:46.964897 13449 tablet_bootstrap.cc:654] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.966840 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f18c1dd0744729bbc46758c450cccc" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:46.967653 13332 raft_consensus.cc:3060] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.971766 13453 raft_consensus.cc:493] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.972342 13453 raft_consensus.cc:515] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:46.974436 13453 leader_election.cc:290] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:46.975309 13331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" is_pre_election: true
I20260709 13:16:46.976202 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:46.977039 13405 raft_consensus.cc:2468] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 0.
I20260709 13:16:46.978749 13222 leader_election.cc:304] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: 
I20260709 13:16:46.979566 13453 raft_consensus.cc:2804] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.979914 13453 raft_consensus.cc:493] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.980221 13453 raft_consensus.cc:3060] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.981756 13406 raft_consensus.cc:2468] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 1.
W20260709 13:16:46.981930 13220 leader_election.cc:343] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.956928 13450 tablet_bootstrap.cc:654] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.983042 13222 leader_election.cc:304] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: 
I20260709 13:16:46.998688 13332 raft_consensus.cc:2468] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 1.
I20260709 13:16:47.001358 13453 raft_consensus.cc:515] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.003455 13453 leader_election.cc:290] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 election: Requested vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.005162 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:47.005599 13453 raft_consensus.cc:2804] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.005744 13406 raft_consensus.cc:3060] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.006297 13453 raft_consensus.cc:697] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Becoming Leader. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:47.007128 13453 consensus_queue.cc:237] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.015637 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:47.016177 13452 tablet_bootstrap.cc:492] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea: No bootstrap required, opened a new log
I20260709 13:16:47.016865 13452 ts_tablet_manager.cc:1403] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea: Time spent bootstrapping tablet: real 0.135s	user 0.029s	sys 0.054s
W20260709 13:16:47.018653 13220 leader_election.cc:343] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.021481 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377" is_pre_election: true
I20260709 13:16:47.023917 13257 raft_consensus.cc:2468] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 0.
I20260709 13:16:47.026670 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:47.027444 13295 leader_election.cc:304] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:47.028132 13405 raft_consensus.cc:2468] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 0.
I20260709 13:16:47.028640 13457 raft_consensus.cc:2804] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.029162 13457 raft_consensus.cc:493] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.029507 13457 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.036456 13449 tablet_bootstrap.cc:492] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377: No bootstrap required, opened a new log
I20260709 13:16:47.026387 13452 raft_consensus.cc:359] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.038848 13452 raft_consensus.cc:385] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.039171 13452 raft_consensus.cc:740] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.040050 13452 consensus_queue.cc:260] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.042873 13452 ts_tablet_manager.cc:1434] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:16:47.043367 13457 raft_consensus.cc:515] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.044291 13452 tablet_bootstrap.cc:492] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea: Bootstrap starting.
I20260709 13:16:47.045818 13449 ts_tablet_manager.cc:1403] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377: Time spent bootstrapping tablet: real 0.088s	user 0.028s	sys 0.016s
I20260709 13:16:47.046321 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:47.047055 13257 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.034911 13406 raft_consensus.cc:2468] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 1.
I20260709 13:16:47.046769 13457 leader_election.cc:290] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.049934 13222 leader_election.cc:304] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:47.057103 13475 raft_consensus.cc:2804] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.067720 13475 raft_consensus.cc:697] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Becoming Leader. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:47.068934 13475 consensus_queue.cc:237] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.075786 13257 raft_consensus.cc:2468] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 1.
I20260709 13:16:47.078378 13456 raft_consensus.cc:493] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.078989 13456 raft_consensus.cc:515] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.088435 13295 leader_election.cc:304] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:47.089395 13457 raft_consensus.cc:2804] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.089833 13481 raft_consensus.cc:493] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.090371 13481 raft_consensus.cc:515] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.094446 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" is_pre_election: true
W20260709 13:16:47.095659 13220 leader_election.cc:343] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.096202 13450 tablet_bootstrap.cc:492] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680: No bootstrap required, opened a new log
I20260709 13:16:47.096745 13450 ts_tablet_manager.cc:1403] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent bootstrapping tablet: real 0.168s	user 0.009s	sys 0.007s
I20260709 13:16:47.097805 13457 raft_consensus.cc:697] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Becoming Leader. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:47.099426 13481 leader_election.cc:290] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.099014 13457 consensus_queue.cc:237] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.100590 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:47.101186 13405 raft_consensus.cc:2468] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 0.
I20260709 13:16:47.102414 13222 leader_election.cc:304] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:47.103166 13481 raft_consensus.cc:2804] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.103689 13481 raft_consensus.cc:493] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.104697 13481 raft_consensus.cc:3060] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.104843 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:47.086776 13456 leader_election.cc:290] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751)
I20260709 13:16:47.106338 13406 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.112041 13450 raft_consensus.cc:359] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.112738 13450 raft_consensus.cc:385] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.113013 13450 raft_consensus.cc:740] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.113722 13450 consensus_queue.cc:260] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.105263 13449 raft_consensus.cc:359] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.118022 13449 raft_consensus.cc:385] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.122195 13449 raft_consensus.cc:740] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.123817 13449 consensus_queue.cc:260] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.131524 13450 ts_tablet_manager.cc:1434] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.002s
I20260709 13:16:47.132584 13450 tablet_bootstrap.cc:492] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680: Bootstrap starting.
I20260709 13:16:47.127754 13449 ts_tablet_manager.cc:1434] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.016s
I20260709 13:16:47.137720 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377" is_pre_election: true
I20260709 13:16:47.142063 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" is_pre_election: true
I20260709 13:16:47.142702 13406 raft_consensus.cc:2468] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 1.
I20260709 13:16:47.141459 13331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" is_pre_election: true
I20260709 13:16:47.146498 13331 raft_consensus.cc:2468] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0da4e02b7d4435e99534f17dcb550ea in term 0.
I20260709 13:16:47.140051 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377" is_pre_election: true
I20260709 13:16:47.143693 13449 tablet_bootstrap.cc:492] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377: Bootstrap starting.
W20260709 13:16:47.145231 13369 leader_election.cc:343] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.150939 13369 leader_election.cc:304] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea; no voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:47.150159 13154 catalog_manager.cc:5697] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "e3ebc7f240de4b83a92a971740d2a377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.152956 13456 raft_consensus.cc:2749] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.153313 13450 tablet_bootstrap.cc:654] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.154196 13452 tablet_bootstrap.cc:654] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.153620 13369 leader_election.cc:304] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:47.156970 13456 raft_consensus.cc:2804] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.157523 13456 raft_consensus.cc:493] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.154287 13151 catalog_manager.cc:5697] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.158103 13456 raft_consensus.cc:3060] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.157616 13481 raft_consensus.cc:515] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.162600 13256 raft_consensus.cc:2393] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0da4e02b7d4435e99534f17dcb550ea in current term 1: Already voted for candidate e3ebc7f240de4b83a92a971740d2a377 in this term.
I20260709 13:16:47.166337 13331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:47.167534 13331 raft_consensus.cc:3060] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.166852 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:47.167275 13481 leader_election.cc:290] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 election: Requested vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.174624 13456 raft_consensus.cc:515] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.176680 13406 raft_consensus.cc:2393] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ebc7f240de4b83a92a971740d2a377 in current term 1: Already voted for candidate e0da4e02b7d4435e99534f17dcb550ea in this term.
I20260709 13:16:47.179142 13456 leader_election.cc:290] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751)
I20260709 13:16:47.179764 13450 tablet_bootstrap.cc:492] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680: No bootstrap required, opened a new log
I20260709 13:16:47.179939 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:47.180233 13450 ts_tablet_manager.cc:1403] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.006s
I20260709 13:16:47.184846 13449 tablet_bootstrap.cc:654] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.184901 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:47.185248 13450 raft_consensus.cc:359] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.188427 13450 raft_consensus.cc:385] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.188848 13450 raft_consensus.cc:740] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.189255 13369 leader_election.cc:304] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea; no voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:47.189666 13450 consensus_queue.cc:260] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.192175 13456 raft_consensus.cc:2749] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.197953 13331 raft_consensus.cc:2468] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 1.
I20260709 13:16:47.203692 13220 leader_election.cc:304] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:47.205919 13450 ts_tablet_manager.cc:1434] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.008s
I20260709 13:16:47.206130 13481 raft_consensus.cc:2804] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.207729 13481 raft_consensus.cc:697] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Becoming Leader. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:47.208608 13450 tablet_bootstrap.cc:492] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680: Bootstrap starting.
I20260709 13:16:47.208935 13481 consensus_queue.cc:237] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.210733 13452 tablet_bootstrap.cc:492] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea: No bootstrap required, opened a new log
I20260709 13:16:47.212378 13452 ts_tablet_manager.cc:1403] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea: Time spent bootstrapping tablet: real 0.168s	user 0.012s	sys 0.011s
I20260709 13:16:47.227032 13457 raft_consensus.cc:493] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.227711 13457 raft_consensus.cc:515] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.232947 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377" is_pre_election: true
I20260709 13:16:47.230412 13457 leader_election.cc:290] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.235761 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:47.233655 13256 raft_consensus.cc:2468] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 0.
I20260709 13:16:47.239503 13295 leader_election.cc:304] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
W20260709 13:16:47.241077 13297 leader_election.cc:343] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.236557 13452 raft_consensus.cc:359] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.242417 13450 tablet_bootstrap.cc:654] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.241734 13452 raft_consensus.cc:385] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.243022 13452 raft_consensus.cc:740] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.241209 13457 raft_consensus.cc:2804] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.245519 13457 raft_consensus.cc:493] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.245994 13457 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.243788 13452 consensus_queue.cc:260] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.253866 13457 raft_consensus.cc:515] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.256171 13449 tablet_bootstrap.cc:492] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377: No bootstrap required, opened a new log
I20260709 13:16:47.257980 13449 ts_tablet_manager.cc:1403] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.019s
I20260709 13:16:47.258100 13452 ts_tablet_manager.cc:1434] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea: Time spent starting tablet: real 0.045s	user 0.003s	sys 0.006s
I20260709 13:16:47.259142 13452 tablet_bootstrap.cc:492] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea: Bootstrap starting.
I20260709 13:16:47.260878 13449 raft_consensus.cc:359] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.261304 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:47.262007 13256 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.261847 13449 raft_consensus.cc:385] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.263634 13449 raft_consensus.cc:740] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.262934 13457 leader_election.cc:290] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.263978 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:47.267119 13449 consensus_queue.cc:260] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.268855 13457 raft_consensus.cc:493] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.269275 13457 raft_consensus.cc:515] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
W20260709 13:16:47.265745 13297 leader_election.cc:343] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.274791 13449 ts_tablet_manager.cc:1434] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:16:47.276047 13452 tablet_bootstrap.cc:654] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.276470 13457 leader_election.cc:290] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.275772 13449 tablet_bootstrap.cc:492] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377: Bootstrap starting.
I20260709 13:16:47.278918 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:47.278918 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377" is_pre_election: true
I20260709 13:16:47.275779 13154 catalog_manager.cc:5697] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "e3ebc7f240de4b83a92a971740d2a377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:47.283036 13295 leader_election.cc:343] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:47.283635 13297 leader_election.cc:343] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.285382 13297 leader_election.cc:304] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3c3fd045a6f41d797d2d0ed3155a680; no voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377
I20260709 13:16:47.285823 13450 tablet_bootstrap.cc:492] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680: No bootstrap required, opened a new log
I20260709 13:16:47.286481 13450 ts_tablet_manager.cc:1403] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.010s
I20260709 13:16:47.286536 13457 raft_consensus.cc:2749] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.289867 13449 tablet_bootstrap.cc:654] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.291008 13450 raft_consensus.cc:359] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.291723 13450 raft_consensus.cc:385] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.292040 13450 raft_consensus.cc:740] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.292781 13450 consensus_queue.cc:260] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.295095 13450 ts_tablet_manager.cc:1434] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:16:47.297041 13450 tablet_bootstrap.cc:492] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680: Bootstrap starting.
I20260709 13:16:47.283226 13154 catalog_manager.cc:5697] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "e3ebc7f240de4b83a92a971740d2a377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.306238 13457 raft_consensus.cc:493] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.310520 13457 raft_consensus.cc:515] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.312704 13457 leader_election.cc:290] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.309675 13256 raft_consensus.cc:2468] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 1.
I20260709 13:16:47.314204 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17212d33030a430784434e217ddb7e52" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:47.314534 13295 leader_election.cc:304] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: e0da4e02b7d4435e99534f17dcb550ea
I20260709 13:16:47.313643 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17212d33030a430784434e217ddb7e52" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377" is_pre_election: true
I20260709 13:16:47.315358 13457 raft_consensus.cc:2804] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.315893 13457 raft_consensus.cc:697] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Becoming Leader. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:47.316387 13450 tablet_bootstrap.cc:654] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.316767 13457 consensus_queue.cc:237] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
W20260709 13:16:47.318441 13295 leader_election.cc:343] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:47.319973 13297 leader_election.cc:343] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.320436 13297 leader_election.cc:304] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3c3fd045a6f41d797d2d0ed3155a680; no voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377
I20260709 13:16:47.322667 13482 raft_consensus.cc:2749] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.328493 13452 tablet_bootstrap.cc:492] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea: No bootstrap required, opened a new log
I20260709 13:16:47.329025 13452 ts_tablet_manager.cc:1403] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.028s
I20260709 13:16:47.332717 13452 raft_consensus.cc:359] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.333659 13452 raft_consensus.cc:385] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.334066 13452 raft_consensus.cc:740] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.334851 13452 consensus_queue.cc:260] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.337212 13449 tablet_bootstrap.cc:492] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377: No bootstrap required, opened a new log
I20260709 13:16:47.337672 13449 ts_tablet_manager.cc:1403] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.013s
I20260709 13:16:47.338971 13452 ts_tablet_manager.cc:1434] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:16:47.339958 13452 tablet_bootstrap.cc:492] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea: Bootstrap starting.
I20260709 13:16:47.340415 13449 raft_consensus.cc:359] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.341313 13449 raft_consensus.cc:385] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.341635 13449 raft_consensus.cc:740] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.343775 13449 consensus_queue.cc:260] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.345970 13449 ts_tablet_manager.cc:1434] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:16:47.346875 13449 tablet_bootstrap.cc:492] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377: Bootstrap starting.
I20260709 13:16:47.347597 13452 tablet_bootstrap.cc:654] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.353092 13449 tablet_bootstrap.cc:654] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.342974 13450 tablet_bootstrap.cc:492] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680: No bootstrap required, opened a new log
I20260709 13:16:47.354233 13450 ts_tablet_manager.cc:1403] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.002s
I20260709 13:16:47.356688 13450 raft_consensus.cc:359] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.357321 13450 raft_consensus.cc:385] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.357564 13450 raft_consensus.cc:740] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.358407 13450 consensus_queue.cc:260] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.359129 13482 raft_consensus.cc:493] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.359587 13482 raft_consensus.cc:515] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.364133 13482 leader_election.cc:290] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.365159 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e108453e646898d93d53e996a098d" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:47.365849 13450 ts_tablet_manager.cc:1434] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:47.365765 13406 raft_consensus.cc:2468] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 0.
I20260709 13:16:47.366204 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e108453e646898d93d53e996a098d" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377" is_pre_election: true
I20260709 13:16:47.366791 13450 tablet_bootstrap.cc:492] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680: Bootstrap starting.
I20260709 13:16:47.366852 13257 raft_consensus.cc:2468] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 0.
I20260709 13:16:47.367928 13297 leader_election.cc:304] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:47.368659 13482 raft_consensus.cc:2804] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.368918 13452 tablet_bootstrap.cc:492] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea: No bootstrap required, opened a new log
I20260709 13:16:47.369035 13482 raft_consensus.cc:493] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.369391 13452 ts_tablet_manager.cc:1403] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 13:16:47.369398 13482 raft_consensus.cc:3060] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.372697 13452 raft_consensus.cc:359] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.373454 13452 raft_consensus.cc:385] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.373766 13452 raft_consensus.cc:740] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.374509 13452 consensus_queue.cc:260] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.376942 13452 ts_tablet_manager.cc:1434] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:16:47.378019 13452 tablet_bootstrap.cc:492] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea: Bootstrap starting.
I20260709 13:16:47.379321 13482 raft_consensus.cc:515] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.381623 13482 leader_election.cc:290] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.382614 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e108453e646898d93d53e996a098d" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:47.383325 13406 raft_consensus.cc:3060] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.384719 13450 tablet_bootstrap.cc:654] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.385319 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e108453e646898d93d53e996a098d" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:47.386118 13257 raft_consensus.cc:3060] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.395354 13452 tablet_bootstrap.cc:654] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.396802 13406 raft_consensus.cc:2468] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 1.
I20260709 13:16:47.397862 13257 raft_consensus.cc:2468] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 1.
I20260709 13:16:47.399374 13297 leader_election.cc:304] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:47.400547 13450 tablet_bootstrap.cc:492] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680: No bootstrap required, opened a new log
I20260709 13:16:47.401017 13450 ts_tablet_manager.cc:1403] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.008s
I20260709 13:16:47.401072 13457 raft_consensus.cc:2804] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.401603 13457 raft_consensus.cc:697] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Becoming Leader. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:47.401278 13151 catalog_manager.cc:5697] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.402621 13457 consensus_queue.cc:237] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.407754 13450 raft_consensus.cc:359] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.410943 13450 raft_consensus.cc:385] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.411310 13450 raft_consensus.cc:740] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.412416 13450 consensus_queue.cc:260] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.414176 13452 tablet_bootstrap.cc:492] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea: No bootstrap required, opened a new log
I20260709 13:16:47.414690 13452 ts_tablet_manager.cc:1403] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.001s
I20260709 13:16:47.416617 13482 raft_consensus.cc:493] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.417104 13482 raft_consensus.cc:515] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.417982 13452 raft_consensus.cc:359] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.418639 13452 raft_consensus.cc:385] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.418906 13452 raft_consensus.cc:740] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.419349 13482 leader_election.cc:290] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.419554 13452 consensus_queue.cc:260] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.420531 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377" is_pre_election: true
I20260709 13:16:47.421334 13449 tablet_bootstrap.cc:492] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377: No bootstrap required, opened a new log
I20260709 13:16:47.421849 13449 ts_tablet_manager.cc:1403] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.002s
I20260709 13:16:47.422212 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:47.422981 13406 raft_consensus.cc:2393] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3c3fd045a6f41d797d2d0ed3155a680 in current term 1: Already voted for candidate e3ebc7f240de4b83a92a971740d2a377 in this term.
I20260709 13:16:47.424675 13452 ts_tablet_manager.cc:1434] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:16:47.422996 13450 ts_tablet_manager.cc:1434] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.005s
I20260709 13:16:47.424772 13297 leader_election.cc:304] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3c3fd045a6f41d797d2d0ed3155a680; no voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377
I20260709 13:16:47.425187 13449 raft_consensus.cc:359] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.428714 13482 raft_consensus.cc:3060] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.425583 13452 tablet_bootstrap.cc:492] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea: Bootstrap starting.
I20260709 13:16:47.435102 13482 raft_consensus.cc:2749] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.434018 13449 raft_consensus.cc:385] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.435825 13449 raft_consensus.cc:740] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.436537 13449 consensus_queue.cc:260] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.438004 13154 catalog_manager.cc:5697] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.439850 13452 tablet_bootstrap.cc:654] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.455691 13481 consensus_queue.cc:1048] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.463737 13449 ts_tablet_manager.cc:1434] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.001s
I20260709 13:16:47.464632 13449 tablet_bootstrap.cc:492] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377: Bootstrap starting.
I20260709 13:16:47.471339 13449 tablet_bootstrap.cc:654] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.475062 13452 tablet_bootstrap.cc:492] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea: No bootstrap required, opened a new log
I20260709 13:16:47.473937 13481 consensus_queue.cc:1048] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.475485 13452 ts_tablet_manager.cc:1403] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.020s
I20260709 13:16:47.478119 13452 raft_consensus.cc:359] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.478791 13452 raft_consensus.cc:385] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.479071 13452 raft_consensus.cc:740] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.479739 13452 consensus_queue.cc:260] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.481819 13452 ts_tablet_manager.cc:1434] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:47.491273 13449 tablet_bootstrap.cc:492] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377: No bootstrap required, opened a new log
I20260709 13:16:47.491863 13449 ts_tablet_manager.cc:1403] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.002s
I20260709 13:16:47.494607 13449 raft_consensus.cc:359] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.495381 13449 raft_consensus.cc:385] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.495738 13449 raft_consensus.cc:740] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.496536 13449 consensus_queue.cc:260] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.499541 13449 ts_tablet_manager.cc:1434] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:16:47.514381 13481 consensus_queue.cc:1048] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.524199 13453 consensus_queue.cc:1048] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.534372 13482 raft_consensus.cc:493] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.535039 13482 raft_consensus.cc:515] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.538422 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcd97ab66144d7daf8c22eeed64dcc7" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377" is_pre_election: true
I20260709 13:16:47.539047 13257 raft_consensus.cc:2468] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 0.
I20260709 13:16:47.543264 13404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcd97ab66144d7daf8c22eeed64dcc7" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:47.544272 13404 raft_consensus.cc:2468] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 0.
I20260709 13:16:47.545589 13295 leader_election.cc:304] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:47.546767 13457 raft_consensus.cc:2804] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.547230 13457 raft_consensus.cc:493] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.547664 13457 raft_consensus.cc:3060] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:47.552259 13202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:47.541014 13482 leader_election.cc:290] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.560717 13457 raft_consensus.cc:515] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.573760 13481 raft_consensus.cc:493] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.574287 13481 raft_consensus.cc:515] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.576308 13481 leader_election.cc:290] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.578439 13457 leader_election.cc:290] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.579412 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcd97ab66144d7daf8c22eeed64dcc7" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:47.579582 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcd97ab66144d7daf8c22eeed64dcc7" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:47.579980 13257 raft_consensus.cc:3060] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.580292 13405 raft_consensus.cc:3060] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.583595 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:47.584491 13406 raft_consensus.cc:2468] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 0.
I20260709 13:16:47.586115 13222 leader_election.cc:304] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: 
I20260709 13:16:47.586901 13453 raft_consensus.cc:2804] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.587275 13453 raft_consensus.cc:493] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.587608 13453 raft_consensus.cc:3060] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.587690 13405 raft_consensus.cc:2468] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 1.
I20260709 13:16:47.592793 13453 raft_consensus.cc:515] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.593339 13257 raft_consensus.cc:2468] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 1.
I20260709 13:16:47.594221 13297 leader_election.cc:304] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:47.594470 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" is_pre_election: true
I20260709 13:16:47.595080 13332 raft_consensus.cc:2468] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 0.
I20260709 13:16:47.595209 13457 raft_consensus.cc:2804] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.596877 13457 raft_consensus.cc:697] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Becoming Leader. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:47.598487 13453 leader_election.cc:290] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 election: Requested vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.598367 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:47.599119 13457 consensus_queue.cc:237] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.599757 13332 raft_consensus.cc:3060] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.601945 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:47.602519 13405 raft_consensus.cc:3060] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.608942 13405 raft_consensus.cc:2468] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 1.
I20260709 13:16:47.610190 13222 leader_election.cc:304] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: 
I20260709 13:16:47.611194 13453 raft_consensus.cc:2804] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.611869 13453 raft_consensus.cc:697] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Becoming Leader. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:47.613008 13453 consensus_queue.cc:237] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.616787 13479 consensus_queue.cc:1048] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.617856 13332 raft_consensus.cc:2468] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 1.
I20260709 13:16:47.626536 13151 catalog_manager.cc:5697] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.631980 13152 catalog_manager.cc:5697] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "e3ebc7f240de4b83a92a971740d2a377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.633244 13457 consensus_queue.cc:1048] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.635161 13456 raft_consensus.cc:493] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.635638 13456 raft_consensus.cc:515] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.639356 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ebc7f240de4b83a92a971740d2a377" is_pre_election: true
I20260709 13:16:47.640369 13257 raft_consensus.cc:2393] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0da4e02b7d4435e99534f17dcb550ea in current term 1: Already voted for candidate f3c3fd045a6f41d797d2d0ed3155a680 in this term.
I20260709 13:16:47.642943 13456 leader_election.cc:290] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751)
I20260709 13:16:47.645001 13331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" is_pre_election: true
I20260709 13:16:47.646660 13369 leader_election.cc:304] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea; no voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:47.647780 13456 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.655609 13456 raft_consensus.cc:2749] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.684222 13481 consensus_queue.cc:1048] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.688658 13457 consensus_queue.cc:1048] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.751519 13479 raft_consensus.cc:493] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.752100 13479 raft_consensus.cc:515] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.754281 13479 leader_election.cc:290] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.755057 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17212d33030a430784434e217ddb7e52" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" is_pre_election: true
I20260709 13:16:47.755481 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17212d33030a430784434e217ddb7e52" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea" is_pre_election: true
I20260709 13:16:47.755802 13332 raft_consensus.cc:2468] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 0.
I20260709 13:16:47.756072 13405 raft_consensus.cc:2468] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 0.
I20260709 13:16:47.756937 13220 leader_election.cc:304] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:47.757828 13479 raft_consensus.cc:2804] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.758209 13479 raft_consensus.cc:493] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.758499 13479 raft_consensus.cc:3060] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.763096 13479 raft_consensus.cc:515] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.764801 13479 leader_election.cc:290] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 election: Requested vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:47.765646 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17212d33030a430784434e217ddb7e52" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:47.765960 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17212d33030a430784434e217ddb7e52" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:47.766264 13332 raft_consensus.cc:3060] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.766461 13405 raft_consensus.cc:3060] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.772902 13332 raft_consensus.cc:2468] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 1.
I20260709 13:16:47.772902 13405 raft_consensus.cc:2468] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 1.
I20260709 13:16:47.774348 13220 leader_election.cc:304] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:47.775092 13479 raft_consensus.cc:2804] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.775633 13479 raft_consensus.cc:697] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Becoming Leader. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:47.776365 13479 consensus_queue.cc:237] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:47.783700 13151 catalog_manager.cc:5697] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "e3ebc7f240de4b83a92a971740d2a377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.842690 13457 consensus_queue.cc:1048] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.865185 13515 consensus_queue.cc:1048] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.883394 13332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
mode: GRACEFUL
new_leader_uuid: "e3ebc7f240de4b83a92a971740d2a377"
 from {username='slave'} at 127.0.0.1:56838
I20260709 13:16:47.884110 13332 raft_consensus.cc:606] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Received request to transfer leadership to TS e3ebc7f240de4b83a92a971740d2a377
I20260709 13:16:47.905129 13257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5"
dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
mode: GRACEFUL
new_leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:38168
I20260709 13:16:47.905735 13257 raft_consensus.cc:606] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Received request to transfer leadership to TS f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:47.913973 13515 consensus_queue.cc:1048] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.922029 13257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17212d33030a430784434e217ddb7e52"
dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
mode: GRACEFUL
new_leader_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
 from {username='slave'} at 127.0.0.1:38168
I20260709 13:16:47.922747 13257 raft_consensus.cc:606] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Received request to transfer leadership to TS e0da4e02b7d4435e99534f17dcb550ea
I20260709 13:16:47.929325 13457 consensus_queue.cc:1048] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.087502 13457 consensus_queue.cc:1048] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.098971 13482 consensus_queue.cc:1048] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.105253 13479 consensus_queue.cc:1048] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.122511 13479 consensus_queue.cc:1048] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.156905 13453 raft_consensus.cc:993] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377: : Instructing follower f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:48.157379 13479 raft_consensus.cc:1081] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Signalling peer f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:48.159255 13332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:56824
I20260709 13:16:48.159884 13332 raft_consensus.cc:493] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.160231 13332 raft_consensus.cc:3060] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.165202 13332 raft_consensus.cc:515] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:48.167523 13332 leader_election.cc:290] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 2 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:48.167889 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:48.168188 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:48.168833 13257 raft_consensus.cc:3055] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:48.169027 13405 raft_consensus.cc:3060] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.169225 13257 raft_consensus.cc:740] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:48.170348 13257 consensus_queue.cc:260] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:48.171458 13257 raft_consensus.cc:3060] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.175926 13405 raft_consensus.cc:2468] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 2.
I20260709 13:16:48.176505 13257 raft_consensus.cc:2468] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 2.
I20260709 13:16:48.177269 13297 leader_election.cc:304] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:48.178131 13457 raft_consensus.cc:2804] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:48.178665 13457 raft_consensus.cc:697] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Becoming Leader. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:48.179543 13457 consensus_queue.cc:237] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:48.186007 13151 catalog_manager.cc:5697] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 reported cstate change: term changed from 1 to 2, leader changed from e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129) to f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.324741 13479 consensus_queue.cc:1048] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.332719 13453 raft_consensus.cc:993] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377: : Instructing follower e0da4e02b7d4435e99534f17dcb550ea to start an election
I20260709 13:16:48.333384 13481 raft_consensus.cc:1081] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Signalling peer e0da4e02b7d4435e99534f17dcb550ea to start an election
I20260709 13:16:48.336172 13405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17212d33030a430784434e217ddb7e52"
dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
 from {username='slave'} at 127.0.0.1:55310
I20260709 13:16:48.337105 13405 raft_consensus.cc:493] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.337570 13405 raft_consensus.cc:3060] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.345643 13537 consensus_queue.cc:1048] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.346884 13405 raft_consensus.cc:515] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:48.349135 13405 leader_election.cc:290] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751)
I20260709 13:16:48.350553 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17212d33030a430784434e217ddb7e52" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:48.351234 13257 raft_consensus.cc:3055] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:48.351600 13257 raft_consensus.cc:740] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:48.352406 13257 consensus_queue.cc:260] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:48.353542 13257 raft_consensus.cc:3060] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.354650 13331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17212d33030a430784434e217ddb7e52" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:48.360618 13257 raft_consensus.cc:2468] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0da4e02b7d4435e99534f17dcb550ea in term 2.
I20260709 13:16:48.362007 13369 leader_election.cc:304] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:48.362793 13519 raft_consensus.cc:2804] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:48.366362 13457 raft_consensus.cc:993] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680: : Instructing follower e3ebc7f240de4b83a92a971740d2a377 to start an election
I20260709 13:16:48.366847 13457 raft_consensus.cc:1081] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Signalling peer e3ebc7f240de4b83a92a971740d2a377 to start an election
I20260709 13:16:48.368381 13519 raft_consensus.cc:697] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 2 LEADER]: Becoming Leader. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Running, Role: LEADER
I20260709 13:16:48.369321 13519 consensus_queue.cc:237] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:48.369899 13257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15"
dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
 from {username='slave'} at 127.0.0.1:38136
I20260709 13:16:48.370618 13257 raft_consensus.cc:493] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.371099 13257 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.378286 13257 raft_consensus.cc:515] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:48.378727 13151 catalog_manager.cc:5697] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea reported cstate change: term changed from 1 to 2, leader changed from e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129) to e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131). New cstate: current_term: 2 leader_uuid: "e0da4e02b7d4435e99534f17dcb550ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.380353 13257 leader_election.cc:290] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 2 election: Requested vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:48.380916 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:48.381480 13405 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.380807 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:48.382102 13332 raft_consensus.cc:3055] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:48.382470 13332 raft_consensus.cc:740] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:48.383407 13332 consensus_queue.cc:260] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:48.384300 13332 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.388000 13405 raft_consensus.cc:2468] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 2.
I20260709 13:16:48.389169 13222 leader_election.cc:304] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: 
I20260709 13:16:48.389995 13481 raft_consensus.cc:2804] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:48.390408 13481 raft_consensus.cc:697] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 2 LEADER]: Becoming Leader. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:48.391139 13481 consensus_queue.cc:237] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:48.391772 13332 raft_consensus.cc:2468] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 2.
I20260709 13:16:48.397727 13151 catalog_manager.cc:5697] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 reported cstate change: term changed from 1 to 2, leader changed from f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130) to e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "e3ebc7f240de4b83a92a971740d2a377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.704535 13257 raft_consensus.cc:1275] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.706053 13457 consensus_queue.cc:1048] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.715735 13405 raft_consensus.cc:1275] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.719164 13482 consensus_queue.cc:1048] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:48.844043 13405 raft_consensus.cc:1275] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Refusing update from remote peer e3ebc7f240de4b83a92a971740d2a377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.845379 13481 consensus_queue.cc:1048] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.855630 13332 raft_consensus.cc:1275] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Refusing update from remote peer e3ebc7f240de4b83a92a971740d2a377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.857054 13481 consensus_queue.cc:1048] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.889678 13332 raft_consensus.cc:3060] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.894659 13332 raft_consensus.cc:1275] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Refusing update from remote peer e0da4e02b7d4435e99534f17dcb550ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.896057 13519 consensus_queue.cc:1048] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.908844 13257 raft_consensus.cc:1275] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Refusing update from remote peer e0da4e02b7d4435e99534f17dcb550ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.910181 13543 consensus_queue.cc:1048] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:50.953853 13122 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:16:50.954747 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:50.971416 13331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
mode: GRACEFUL
new_leader_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
 from {username='slave'} at 127.0.0.1:56844
I20260709 13:16:50.972016 13331 raft_consensus.cc:606] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Received request to transfer leadership to TS e0da4e02b7d4435e99534f17dcb550ea
I20260709 13:16:50.983484 13257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15"
dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
mode: GRACEFUL
new_leader_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
 from {username='slave'} at 127.0.0.1:38184
I20260709 13:16:50.984057 13257 raft_consensus.cc:606] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 2 LEADER]: Received request to transfer leadership to TS e0da4e02b7d4435e99534f17dcb550ea
I20260709 13:16:50.985170 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:50.985658 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:51.239670 13546 raft_consensus.cc:993] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377: : Instructing follower e0da4e02b7d4435e99534f17dcb550ea to start an election
I20260709 13:16:51.240096 13552 raft_consensus.cc:1081] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 2 LEADER]: Signalling peer e0da4e02b7d4435e99534f17dcb550ea to start an election
I20260709 13:16:51.241508 13405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15"
dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
 from {username='slave'} at 127.0.0.1:55310
I20260709 13:16:51.242040 13405 raft_consensus.cc:493] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:51.242401 13405 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:51.247586 13405 raft_consensus.cc:515] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:51.249023 13405 leader_election.cc:290] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751)
I20260709 13:16:51.249925 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:51.250451 13257 raft_consensus.cc:3055] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:51.250465 13331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:51.250759 13257 raft_consensus.cc:740] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:51.251109 13331 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:51.251538 13257 consensus_queue.cc:260] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:51.252475 13257 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:51.255927 13331 raft_consensus.cc:2468] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0da4e02b7d4435e99534f17dcb550ea in term 3.
I20260709 13:16:51.257084 13257 raft_consensus.cc:2468] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0da4e02b7d4435e99534f17dcb550ea in term 3.
I20260709 13:16:51.257134 13369 leader_election.cc:304] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:51.258045 13549 raft_consensus.cc:2804] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:51.259212 13549 raft_consensus.cc:697] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 3 LEADER]: Becoming Leader. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Running, Role: LEADER
I20260709 13:16:51.260020 13549 consensus_queue.cc:237] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:51.269207 13551 raft_consensus.cc:993] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680: : Instructing follower e0da4e02b7d4435e99534f17dcb550ea to start an election
I20260709 13:16:51.269634 13558 raft_consensus.cc:1081] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Signalling peer e0da4e02b7d4435e99534f17dcb550ea to start an election
I20260709 13:16:51.271245 13405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1"
dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
 from {username='slave'} at 127.0.0.1:55320
I20260709 13:16:51.271130 13152 catalog_manager.cc:5697] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea reported cstate change: term changed from 2 to 3, leader changed from e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129) to e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131). New cstate: current_term: 3 leader_uuid: "e0da4e02b7d4435e99534f17dcb550ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.271687 13405 raft_consensus.cc:493] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:51.272018 13405 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:51.276106 13405 raft_consensus.cc:515] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:51.278151 13405 leader_election.cc:290] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751)
I20260709 13:16:51.279136 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:51.279284 13331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:51.279716 13257 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:51.279778 13331 raft_consensus.cc:3055] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:51.280704 13331 raft_consensus.cc:740] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:51.281450 13331 consensus_queue.cc:260] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:51.282701 13331 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:51.285908 13257 raft_consensus.cc:2468] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0da4e02b7d4435e99534f17dcb550ea in term 2.
I20260709 13:16:51.287025 13369 leader_election.cc:304] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: 
I20260709 13:16:51.287815 13549 raft_consensus.cc:2804] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:51.288319 13549 raft_consensus.cc:697] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 2 LEADER]: Becoming Leader. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Running, Role: LEADER
I20260709 13:16:51.289141 13549 consensus_queue.cc:237] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:51.291411 13331 raft_consensus.cc:2468] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0da4e02b7d4435e99534f17dcb550ea in term 2.
I20260709 13:16:51.296476 13152 catalog_manager.cc:5697] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea reported cstate change: term changed from 1 to 2, leader changed from f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130) to e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131). New cstate: current_term: 2 leader_uuid: "e0da4e02b7d4435e99534f17dcb550ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.752727 13257 raft_consensus.cc:1275] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Refusing update from remote peer e0da4e02b7d4435e99534f17dcb550ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:51.754171 13549 consensus_queue.cc:1048] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:51.767344 13331 raft_consensus.cc:1275] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Refusing update from remote peer e0da4e02b7d4435e99534f17dcb550ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:51.769490 13566 consensus_queue.cc:1048] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:51.857007 13331 raft_consensus.cc:1275] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Refusing update from remote peer e0da4e02b7d4435e99534f17dcb550ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:51.858247 13566 consensus_queue.cc:1048] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:51.866799 13257 raft_consensus.cc:1275] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Refusing update from remote peer e0da4e02b7d4435e99534f17dcb550ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:51.869736 13549 consensus_queue.cc:1048] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:51.986526 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:51.996280 13257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00f18c1dd0744729bbc46758c450cccc"
dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
mode: GRACEFUL
new_leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:38168
I20260709 13:16:51.996806 13257 raft_consensus.cc:606] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Received request to transfer leadership to TS f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:52.001745 13257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb"
dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
mode: GRACEFUL
new_leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:38168
I20260709 13:16:52.002236 13257 raft_consensus.cc:606] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Received request to transfer leadership to TS f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:52.006852 13257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5"
dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
mode: GRACEFUL
new_leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:38168
I20260709 13:16:52.007314 13257 raft_consensus.cc:606] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Received request to transfer leadership to TS f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:52.021045 13405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15"
dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
mode: GRACEFUL
new_leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:55326
I20260709 13:16:52.021538 13405 raft_consensus.cc:606] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 3 LEADER]: Received request to transfer leadership to TS f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:52.031841 13405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1"
dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
mode: GRACEFUL
new_leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:55326
I20260709 13:16:52.032321 13405 raft_consensus.cc:606] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 2 LEADER]: Received request to transfer leadership to TS f3c3fd045a6f41d797d2d0ed3155a680
I20260709 13:16:52.070210 13552 raft_consensus.cc:993] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377: : Instructing follower f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:52.071075 13574 raft_consensus.cc:1081] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Signalling peer f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:52.072657 13331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:56824
I20260709 13:16:52.073212 13331 raft_consensus.cc:493] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:52.073637 13331 raft_consensus.cc:3060] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.078881 13331 raft_consensus.cc:515] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.081254 13331 leader_election.cc:290] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 2 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:52.081837 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:52.081553 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:52.082350 13405 raft_consensus.cc:3060] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.082638 13257 raft_consensus.cc:3055] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:52.082926 13257 raft_consensus.cc:740] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:52.083640 13257 consensus_queue.cc:260] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.084676 13257 raft_consensus.cc:3060] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.088234 13405 raft_consensus.cc:2468] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 2.
I20260709 13:16:52.089448 13297 leader_election.cc:304] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:52.090360 13558 raft_consensus.cc:2804] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:52.090426 13257 raft_consensus.cc:2468] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 2.
I20260709 13:16:52.091816 13558 raft_consensus.cc:697] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Becoming Leader. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:52.092741 13558 consensus_queue.cc:237] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.100344 13151 catalog_manager.cc:5697] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 reported cstate change: term changed from 1 to 2, leader changed from e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129) to f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.234745 13556 raft_consensus.cc:993] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea: : Instructing follower f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:52.235196 13549 raft_consensus.cc:1081] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 3 LEADER]: Signalling peer f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:52.236552 13331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:56826
I20260709 13:16:52.237115 13331 raft_consensus.cc:493] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:52.237564 13331 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:52.242048 13331 raft_consensus.cc:515] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.243821 13331 leader_election.cc:290] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 4 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:52.244591 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:52.244927 13405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b9249e3cb4a66bcdfaf3ea4c6ac15" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:52.245149 13257 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:52.245419 13405 raft_consensus.cc:3055] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:52.245711 13405 raft_consensus.cc:740] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Running, Role: LEADER
I20260709 13:16:52.246419 13405 consensus_queue.cc:260] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.247469 13405 raft_consensus.cc:3060] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:52.251228 13257 raft_consensus.cc:2468] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 4.
I20260709 13:16:52.252485 13295 leader_election.cc:304] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:52.253225 13558 raft_consensus.cc:2804] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:52.253417 13405 raft_consensus.cc:2468] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 4.
I20260709 13:16:52.253722 13558 raft_consensus.cc:697] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 4 LEADER]: Becoming Leader. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:52.254696 13558 consensus_queue.cc:237] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.260576 13151 catalog_manager.cc:5697] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 reported cstate change: term changed from 3 to 4, leader changed from e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131) to f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130). New cstate: current_term: 4 leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.362227 13556 raft_consensus.cc:993] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea: : Instructing follower f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:52.362661 13549 raft_consensus.cc:1081] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 2 LEADER]: Signalling peer f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:52.364077 13331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:56826
I20260709 13:16:52.364667 13331 raft_consensus.cc:493] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:52.365100 13331 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.370425 13331 raft_consensus.cc:515] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.372380 13331 leader_election.cc:290] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 3 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:52.373461 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:52.373677 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:52.374166 13406 raft_consensus.cc:3055] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:52.374163 13257 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.374836 13406 raft_consensus.cc:740] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Running, Role: LEADER
I20260709 13:16:52.375849 13406 consensus_queue.cc:260] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.376719 13406 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.379643 13257 raft_consensus.cc:2468] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 3.
I20260709 13:16:52.380272 13256 raft_consensus.cc:1240] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Rejecting Update request from peer e0da4e02b7d4435e99534f17dcb550ea for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:52.380734 13295 leader_election.cc:304] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:52.381536 13558 raft_consensus.cc:2804] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:52.381858 13406 raft_consensus.cc:2468] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 3.
I20260709 13:16:52.382112 13558 raft_consensus.cc:697] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 LEADER]: Becoming Leader. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:52.383141 13558 consensus_queue.cc:237] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.389428 13151 catalog_manager.cc:5697] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 reported cstate change: term changed from 2 to 3, leader changed from e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131) to f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130). New cstate: current_term: 3 leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.441256 13552 raft_consensus.cc:993] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377: : Instructing follower f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:52.441776 13574 raft_consensus.cc:1081] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Signalling peer f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:52.443290 13331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:56824
I20260709 13:16:52.443836 13331 raft_consensus.cc:493] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:52.444159 13331 raft_consensus.cc:3060] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.448776 13331 raft_consensus.cc:515] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.450601 13331 leader_election.cc:290] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 2 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:52.451366 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:52.451663 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:52.452193 13256 raft_consensus.cc:3055] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:52.452304 13406 raft_consensus.cc:3060] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.452486 13552 raft_consensus.cc:993] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377: : Instructing follower f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:52.452651 13256 raft_consensus.cc:740] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:52.453018 13574 raft_consensus.cc:1081] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Signalling peer f3c3fd045a6f41d797d2d0ed3155a680 to start an election
I20260709 13:16:52.453527 13256 consensus_queue.cc:260] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.454855 13256 raft_consensus.cc:3060] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.454882 13331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00f18c1dd0744729bbc46758c450cccc"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
 from {username='slave'} at 127.0.0.1:56824
I20260709 13:16:52.455533 13331 raft_consensus.cc:493] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:52.455943 13331 raft_consensus.cc:3060] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.459668 13256 raft_consensus.cc:2468] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 2.
I20260709 13:16:52.459657 13406 raft_consensus.cc:2468] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 2.
I20260709 13:16:52.461005 13295 leader_election.cc:304] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3ebc7f240de4b83a92a971740d2a377, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:52.461905 13558 raft_consensus.cc:2804] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:52.462466 13558 raft_consensus.cc:697] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Becoming Leader. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:52.462760 13331 raft_consensus.cc:515] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.463263 13558 consensus_queue.cc:237] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.464632 13331 leader_election.cc:290] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 2 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:52.465706 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f18c1dd0744729bbc46758c450cccc" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:52.466310 13406 raft_consensus.cc:3060] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.466977 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f18c1dd0744729bbc46758c450cccc" candidate_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:52.467695 13256 raft_consensus.cc:3055] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:52.468026 13256 raft_consensus.cc:740] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:52.468794 13256 consensus_queue.cc:260] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.470082 13256 raft_consensus.cc:3060] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.471760 13406 raft_consensus.cc:2468] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 2.
I20260709 13:16:52.472779 13297 leader_election.cc:304] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, f3c3fd045a6f41d797d2d0ed3155a680; no voters: 
I20260709 13:16:52.473565 13558 raft_consensus.cc:2804] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:52.474058 13558 raft_consensus.cc:697] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Becoming Leader. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:52.474772 13558 consensus_queue.cc:237] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:52.474969 13151 catalog_manager.cc:5697] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 reported cstate change: term changed from 1 to 2, leader changed from e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129) to f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.475667 13256 raft_consensus.cc:2468] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c3fd045a6f41d797d2d0ed3155a680 in term 2.
I20260709 13:16:52.487075 13151 catalog_manager.cc:5697] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 reported cstate change: term changed from 1 to 2, leader changed from e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129) to f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.488916 13256 raft_consensus.cc:1275] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:52.490335 13558 consensus_queue.cc:1048] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:52.501232 13406 raft_consensus.cc:1275] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:52.503717 13575 consensus_queue.cc:1048] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:52.792717 13406 raft_consensus.cc:1275] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 4 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:52.794092 13584 consensus_queue.cc:1048] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:52.799606 13405 raft_consensus.cc:1275] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:52.801466 13575 consensus_queue.cc:1048] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:52.803280 13256 raft_consensus.cc:1275] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 4 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:52.804756 13575 consensus_queue.cc:1048] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:52.817957 13257 raft_consensus.cc:1275] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:52.819974 13558 consensus_queue.cc:1048] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:52.923964 13256 raft_consensus.cc:1275] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:52.925575 13589 consensus_queue.cc:1048] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:52.930729 13405 raft_consensus.cc:1275] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:52.932622 13591 consensus_queue.cc:1048] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:52.936513 13406 raft_consensus.cc:1275] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:52.938603 13558 consensus_queue.cc:1048] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:52.950166 13256 raft_consensus.cc:1275] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Refusing update from remote peer f3c3fd045a6f41d797d2d0ed3155a680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:52.952040 13589 consensus_queue.cc:1048] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:55.039659 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:55.046882 13331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
mode: GRACEFUL
new_leader_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
 from {username='slave'} at 127.0.0.1:56844
I20260709 13:16:55.047605 13331 raft_consensus.cc:606] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 LEADER]: Received request to transfer leadership to TS e0da4e02b7d4435e99534f17dcb550ea
I20260709 13:16:55.050335 13331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
mode: GRACEFUL
new_leader_uuid: "e3ebc7f240de4b83a92a971740d2a377"
 from {username='slave'} at 127.0.0.1:56844
I20260709 13:16:55.050818 13331 raft_consensus.cc:606] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Received request to transfer leadership to TS e3ebc7f240de4b83a92a971740d2a377
I20260709 13:16:55.053094 13331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
mode: GRACEFUL
new_leader_uuid: "e3ebc7f240de4b83a92a971740d2a377"
 from {username='slave'} at 127.0.0.1:56844
I20260709 13:16:55.053622 13331 raft_consensus.cc:606] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Received request to transfer leadership to TS e3ebc7f240de4b83a92a971740d2a377
I20260709 13:16:55.056604 13331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
mode: GRACEFUL
new_leader_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
 from {username='slave'} at 127.0.0.1:56844
I20260709 13:16:55.057101 13331 raft_consensus.cc:606] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Received request to transfer leadership to TS e0da4e02b7d4435e99534f17dcb550ea
I20260709 13:16:55.059506 13331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddcd97ab66144d7daf8c22eeed64dcc7"
dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
mode: GRACEFUL
new_leader_uuid: "e3ebc7f240de4b83a92a971740d2a377"
 from {username='slave'} at 127.0.0.1:56844
I20260709 13:16:55.059962 13331 raft_consensus.cc:606] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Received request to transfer leadership to TS e3ebc7f240de4b83a92a971740d2a377
I20260709 13:16:55.060992 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:55.061431 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:55.137837 13597 raft_consensus.cc:993] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680: : Instructing follower e3ebc7f240de4b83a92a971740d2a377 to start an election
I20260709 13:16:55.138432 13584 raft_consensus.cc:1081] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Signalling peer e3ebc7f240de4b83a92a971740d2a377 to start an election
I20260709 13:16:55.140100 13256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddcd97ab66144d7daf8c22eeed64dcc7"
dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
 from {username='slave'} at 127.0.0.1:38136
I20260709 13:16:55.140607 13256 raft_consensus.cc:493] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:55.140954 13256 raft_consensus.cc:3060] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:55.146332 13256 raft_consensus.cc:515] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.148103 13256 leader_election.cc:290] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 2 election: Requested vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:55.149066 13331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcd97ab66144d7daf8c22eeed64dcc7" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:55.149708 13331 raft_consensus.cc:3055] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:55.149624 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcd97ab66144d7daf8c22eeed64dcc7" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:55.150170 13331 raft_consensus.cc:740] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:55.150365 13406 raft_consensus.cc:3060] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:55.151032 13331 consensus_queue.cc:260] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.152030 13331 raft_consensus.cc:3060] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:55.155328 13406 raft_consensus.cc:2468] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 2.
I20260709 13:16:55.156595 13222 leader_election.cc:304] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: 
I20260709 13:16:55.156771 13331 raft_consensus.cc:2468] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 2.
I20260709 13:16:55.158361 13598 raft_consensus.cc:2804] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:55.159183 13598 raft_consensus.cc:697] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 2 LEADER]: Becoming Leader. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:55.160094 13598 consensus_queue.cc:237] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.162938 13597 raft_consensus.cc:993] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680: : Instructing follower e0da4e02b7d4435e99534f17dcb550ea to start an election
I20260709 13:16:55.163479 13584 raft_consensus.cc:1081] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 LEADER]: Signalling peer e0da4e02b7d4435e99534f17dcb550ea to start an election
I20260709 13:16:55.165102 13406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1"
dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
 from {username='slave'} at 127.0.0.1:55320
I20260709 13:16:55.165546 13406 raft_consensus.cc:493] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:55.165854 13406 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.168676 13151 catalog_manager.cc:5697] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 reported cstate change: term changed from 1 to 2, leader changed from f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130) to e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "e3ebc7f240de4b83a92a971740d2a377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.170471 13597 raft_consensus.cc:993] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680: : Instructing follower e0da4e02b7d4435e99534f17dcb550ea to start an election
I20260709 13:16:55.171201 13584 raft_consensus.cc:1081] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Signalling peer e0da4e02b7d4435e99534f17dcb550ea to start an election
I20260709 13:16:55.172180 13406 raft_consensus.cc:515] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.173151 13405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5"
dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
 from {username='slave'} at 127.0.0.1:55320
I20260709 13:16:55.173684 13405 raft_consensus.cc:493] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:55.174074 13405 raft_consensus.cc:3060] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:55.174376 13406 leader_election.cc:290] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751)
I20260709 13:16:55.175115 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:55.175534 13331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1272bddccd314e818dd9fc54caff59a1" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:55.175794 13256 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.176143 13331 raft_consensus.cc:3055] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:55.176537 13331 raft_consensus.cc:740] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:55.177690 13331 consensus_queue.cc:260] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.179522 13331 raft_consensus.cc:3060] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.181456 13405 raft_consensus.cc:515] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.182842 13256 raft_consensus.cc:2468] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0da4e02b7d4435e99534f17dcb550ea in term 4.
I20260709 13:16:55.183935 13405 leader_election.cc:290] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519), f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751)
I20260709 13:16:55.184857 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
I20260709 13:16:55.184944 13369 leader_election.cc:304] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: 
I20260709 13:16:55.185515 13257 raft_consensus.cc:3060] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:55.186496 13566 raft_consensus.cc:2804] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:55.186690 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b0058a909b400985f7239ade36f6e5" candidate_uuid: "e0da4e02b7d4435e99534f17dcb550ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:55.187528 13332 raft_consensus.cc:3055] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:55.187879 13332 raft_consensus.cc:740] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:55.190455 13566 raft_consensus.cc:697] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 4 LEADER]: Becoming Leader. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Running, Role: LEADER
I20260709 13:16:55.188735 13332 consensus_queue.cc:260] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.191608 13332 raft_consensus.cc:3060] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:55.191462 13566 consensus_queue.cc:237] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.192816 13257 raft_consensus.cc:2468] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0da4e02b7d4435e99534f17dcb550ea in term 3.
I20260709 13:16:55.193953 13369 leader_election.cc:304] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: 
I20260709 13:16:55.195629 13331 raft_consensus.cc:2468] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0da4e02b7d4435e99534f17dcb550ea in term 4.
I20260709 13:16:55.197134 13603 raft_consensus.cc:2804] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:55.197747 13603 raft_consensus.cc:697] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 3 LEADER]: Becoming Leader. State: Replica: e0da4e02b7d4435e99534f17dcb550ea, State: Running, Role: LEADER
I20260709 13:16:55.201550 13332 raft_consensus.cc:2468] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0da4e02b7d4435e99534f17dcb550ea in term 3.
I20260709 13:16:55.201884 13603 consensus_queue.cc:237] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.204521 13152 catalog_manager.cc:5697] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea reported cstate change: term changed from 3 to 4, leader changed from f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130) to e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131). New cstate: current_term: 4 leader_uuid: "e0da4e02b7d4435e99534f17dcb550ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.216547 13152 catalog_manager.cc:5697] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea reported cstate change: term changed from 2 to 3, leader changed from f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130) to e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131). New cstate: current_term: 3 leader_uuid: "e0da4e02b7d4435e99534f17dcb550ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.248922 13597 raft_consensus.cc:993] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680: : Instructing follower e3ebc7f240de4b83a92a971740d2a377 to start an election
I20260709 13:16:55.249452 13597 raft_consensus.cc:1081] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Signalling peer e3ebc7f240de4b83a92a971740d2a377 to start an election
I20260709 13:16:55.250864 13257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb"
dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
 from {username='slave'} at 127.0.0.1:38136
I20260709 13:16:55.251296 13257 raft_consensus.cc:493] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:55.251607 13257 raft_consensus.cc:3060] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:55.255589 13257 raft_consensus.cc:515] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.257094 13257 leader_election.cc:290] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 3 election: Requested vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:55.258198 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:55.258075 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875c370d8a9f49fe9d3bb5cbf776e2fb" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:55.258736 13406 raft_consensus.cc:3060] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:55.258770 13332 raft_consensus.cc:3055] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:55.259286 13332 raft_consensus.cc:740] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:55.260110 13332 consensus_queue.cc:260] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.261335 13332 raft_consensus.cc:3060] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:55.265694 13406 raft_consensus.cc:2468] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 3.
I20260709 13:16:55.266804 13222 leader_election.cc:304] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: 
I20260709 13:16:55.267594 13598 raft_consensus.cc:2804] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:55.268009 13598 raft_consensus.cc:697] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 3 LEADER]: Becoming Leader. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:55.268061 13332 raft_consensus.cc:2468] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 3.
I20260709 13:16:55.268949 13598 consensus_queue.cc:237] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.275863 13152 catalog_manager.cc:5697] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 reported cstate change: term changed from 2 to 3, leader changed from f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130) to e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "e3ebc7f240de4b83a92a971740d2a377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.352985 13584 raft_consensus.cc:993] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680: : Instructing follower e3ebc7f240de4b83a92a971740d2a377 to start an election
I20260709 13:16:55.353461 13597 raft_consensus.cc:1081] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Signalling peer e3ebc7f240de4b83a92a971740d2a377 to start an election
I20260709 13:16:55.354722 13257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5"
dest_uuid: "e3ebc7f240de4b83a92a971740d2a377"
 from {username='slave'} at 127.0.0.1:38136
I20260709 13:16:55.355167 13257 raft_consensus.cc:493] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:55.355496 13257 raft_consensus.cc:3060] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:55.359330 13257 raft_consensus.cc:515] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.360718 13257 leader_election.cc:290] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 3 election: Requested vote from peers f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130:41751), e0da4e02b7d4435e99534f17dcb550ea (127.12.208.131:36639)
I20260709 13:16:55.361579 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3c3fd045a6f41d797d2d0ed3155a680"
I20260709 13:16:55.361728 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769250822d1d4385a381cd0dd59ef3a5" candidate_uuid: "e3ebc7f240de4b83a92a971740d2a377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0da4e02b7d4435e99534f17dcb550ea"
I20260709 13:16:55.362062 13332 raft_consensus.cc:3055] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:55.362277 13406 raft_consensus.cc:3060] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:55.362429 13332 raft_consensus.cc:740] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3c3fd045a6f41d797d2d0ed3155a680, State: Running, Role: LEADER
I20260709 13:16:55.363230 13332 consensus_queue.cc:260] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.364086 13332 raft_consensus.cc:3060] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:55.366421 13406 raft_consensus.cc:2468] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 3.
I20260709 13:16:55.367354 13222 leader_election.cc:304] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0da4e02b7d4435e99534f17dcb550ea, e3ebc7f240de4b83a92a971740d2a377; no voters: 
I20260709 13:16:55.368026 13598 raft_consensus.cc:2804] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:55.368696 13598 raft_consensus.cc:697] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 3 LEADER]: Becoming Leader. State: Replica: e3ebc7f240de4b83a92a971740d2a377, State: Running, Role: LEADER
I20260709 13:16:55.369179 13332 raft_consensus.cc:2468] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ebc7f240de4b83a92a971740d2a377 in term 3.
I20260709 13:16:55.369557 13598 consensus_queue.cc:237] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } }
I20260709 13:16:55.376405 13152 catalog_manager.cc:5697] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 reported cstate change: term changed from 2 to 3, leader changed from f3c3fd045a6f41d797d2d0ed3155a680 (127.12.208.130) to e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "e3ebc7f240de4b83a92a971740d2a377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.584147 13406 raft_consensus.cc:1275] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Refusing update from remote peer e3ebc7f240de4b83a92a971740d2a377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:55.585332 13598 consensus_queue.cc:1048] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:55.598424 13332 raft_consensus.cc:1275] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Refusing update from remote peer e3ebc7f240de4b83a92a971740d2a377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:55.599951 13598 consensus_queue.cc:1048] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:55.611719 13257 raft_consensus.cc:1275] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 4 FOLLOWER]: Refusing update from remote peer e0da4e02b7d4435e99534f17dcb550ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:55.612905 13603 consensus_queue.cc:1048] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:55.623009 13332 raft_consensus.cc:1275] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 4 FOLLOWER]: Refusing update from remote peer e0da4e02b7d4435e99534f17dcb550ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:55.624423 13566 consensus_queue.cc:1048] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:55.674137 13332 raft_consensus.cc:1275] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Refusing update from remote peer e3ebc7f240de4b83a92a971740d2a377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:55.675405 13598 consensus_queue.cc:1048] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:55.687250 13406 raft_consensus.cc:1275] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Refusing update from remote peer e3ebc7f240de4b83a92a971740d2a377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:55.688705 13619 consensus_queue.cc:1048] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:55.718220 13257 raft_consensus.cc:1275] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Refusing update from remote peer e0da4e02b7d4435e99534f17dcb550ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:55.719523 13566 consensus_queue.cc:1048] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ebc7f240de4b83a92a971740d2a377" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 39519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:55.725062 13332 raft_consensus.cc:1275] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Refusing update from remote peer e0da4e02b7d4435e99534f17dcb550ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:55.726464 13603 consensus_queue.cc:1048] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:55.770404 13332 raft_consensus.cc:1275] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Refusing update from remote peer e3ebc7f240de4b83a92a971740d2a377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:55.771495 13619 consensus_queue.cc:1048] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c3fd045a6f41d797d2d0ed3155a680" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 41751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:55.780601 13406 raft_consensus.cc:1275] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Refusing update from remote peer e3ebc7f240de4b83a92a971740d2a377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:55.782359 13619 consensus_queue.cc:1048] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0da4e02b7d4435e99534f17dcb550ea" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 36639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:56.062453 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:56.068425 13122 tablet_server.cc:179] TabletServer@127.12.208.129:0 shutting down...
I20260709 13:16:56.098302 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:56.099071 13122 tablet_replica.cc:333] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377: stopping tablet replica
I20260709 13:16:56.099772 13122 raft_consensus.cc:2243] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:56.100567 13122 raft_consensus.cc:2272] T 769250822d1d4385a381cd0dd59ef3a5 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.103994 13122 tablet_replica.cc:333] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377: stopping tablet replica
I20260709 13:16:56.104522 13122 raft_consensus.cc:2243] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.104965 13122 raft_consensus.cc:2272] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e3ebc7f240de4b83a92a971740d2a377 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.106745 13122 tablet_replica.cc:333] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377: stopping tablet replica
I20260709 13:16:56.107234 13122 raft_consensus.cc:2243] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:56.107980 13122 raft_consensus.cc:2272] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.109942 13122 tablet_replica.cc:333] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377: stopping tablet replica
I20260709 13:16:56.110451 13122 raft_consensus.cc:2243] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.110913 13122 raft_consensus.cc:2272] T 1272bddccd314e818dd9fc54caff59a1 P e3ebc7f240de4b83a92a971740d2a377 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.113055 13122 tablet_replica.cc:333] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377: stopping tablet replica
I20260709 13:16:56.113528 13122 raft_consensus.cc:2243] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:56.114284 13122 raft_consensus.cc:2272] T ddcd97ab66144d7daf8c22eeed64dcc7 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.116122 13122 tablet_replica.cc:333] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377: stopping tablet replica
I20260709 13:16:56.116592 13122 raft_consensus.cc:2243] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.116973 13122 raft_consensus.cc:2272] T 171e108453e646898d93d53e996a098d P e3ebc7f240de4b83a92a971740d2a377 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.118707 13122 tablet_replica.cc:333] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377: stopping tablet replica
I20260709 13:16:56.119163 13122 raft_consensus.cc:2243] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:56.119360 13369 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:56.119587 13122 raft_consensus.cc:2272] T 89b0058a909b400985f7239ade36f6e5 P e3ebc7f240de4b83a92a971740d2a377 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.122079 13122 tablet_replica.cc:333] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377: stopping tablet replica
W20260709 13:16:56.122547 13369 consensus_peers.cc:597] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea -> Peer e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519): Couldn't send request to peer e3ebc7f240de4b83a92a971740d2a377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:56.122663 13122 raft_consensus.cc:2243] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.123184 13122 raft_consensus.cc:2272] T 17212d33030a430784434e217ddb7e52 P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.124825 13122 tablet_replica.cc:333] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377: stopping tablet replica
I20260709 13:16:56.125212 13122 raft_consensus.cc:2243] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.125558 13122 raft_consensus.cc:2272] T 00f18c1dd0744729bbc46758c450cccc P e3ebc7f240de4b83a92a971740d2a377 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.229717 13122 tablet_server.cc:196] TabletServer@127.12.208.129:0 shutdown complete.
W20260709 13:16:56.230814 13295 consensus_peers.cc:597] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 -> Peer e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519): Couldn't send request to peer e3ebc7f240de4b83a92a971740d2a377. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:39519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:56.231348 13295 consensus_peers.cc:597] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 -> Peer e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519): Couldn't send request to peer e3ebc7f240de4b83a92a971740d2a377. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:39519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:56.249086 13122 tablet_server.cc:179] TabletServer@127.12.208.130:0 shutting down...
W20260709 13:16:56.269680 13369 consensus_peers.cc:597] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea -> Peer e3ebc7f240de4b83a92a971740d2a377 (127.12.208.129:39519): Couldn't send request to peer e3ebc7f240de4b83a92a971740d2a377. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:39519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:56.277623 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:56.278460 13122 tablet_replica.cc:333] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680: stopping tablet replica
I20260709 13:16:56.279080 13122 raft_consensus.cc:2243] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.279487 13122 raft_consensus.cc:2272] T ddcd97ab66144d7daf8c22eeed64dcc7 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.281540 13122 tablet_replica.cc:333] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680: stopping tablet replica
I20260709 13:16:56.282318 13122 raft_consensus.cc:2243] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:56.283354 13122 raft_consensus.cc:2272] T 171e108453e646898d93d53e996a098d P f3c3fd045a6f41d797d2d0ed3155a680 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.285064 13122 tablet_replica.cc:333] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680: stopping tablet replica
I20260709 13:16:56.285513 13122 raft_consensus.cc:2243] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.285925 13122 raft_consensus.cc:2272] T 89b0058a909b400985f7239ade36f6e5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.288029 13122 tablet_replica.cc:333] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680: stopping tablet replica
I20260709 13:16:56.288476 13122 raft_consensus.cc:2243] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:56.289199 13122 raft_consensus.cc:2272] T 00f18c1dd0744729bbc46758c450cccc P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.290885 13122 tablet_replica.cc:333] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680: stopping tablet replica
I20260709 13:16:56.291297 13122 raft_consensus.cc:2243] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.291682 13122 raft_consensus.cc:2272] T 17212d33030a430784434e217ddb7e52 P f3c3fd045a6f41d797d2d0ed3155a680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.293228 13122 tablet_replica.cc:333] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680: stopping tablet replica
I20260709 13:16:56.293640 13122 raft_consensus.cc:2243] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.294092 13122 raft_consensus.cc:2272] T 1272bddccd314e818dd9fc54caff59a1 P f3c3fd045a6f41d797d2d0ed3155a680 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.296375 13122 tablet_replica.cc:333] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680: stopping tablet replica
I20260709 13:16:56.296810 13122 raft_consensus.cc:2243] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.297207 13122 raft_consensus.cc:2272] T 875c370d8a9f49fe9d3bb5cbf776e2fb P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.299340 13122 tablet_replica.cc:333] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680: stopping tablet replica
I20260709 13:16:56.299777 13122 raft_consensus.cc:2243] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:56.300465 13122 raft_consensus.cc:2272] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P f3c3fd045a6f41d797d2d0ed3155a680 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.302125 13122 tablet_replica.cc:333] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680: stopping tablet replica
I20260709 13:16:56.302505 13122 raft_consensus.cc:2243] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.302821 13122 raft_consensus.cc:2272] T 769250822d1d4385a381cd0dd59ef3a5 P f3c3fd045a6f41d797d2d0ed3155a680 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.322230 13122 tablet_server.cc:196] TabletServer@127.12.208.130:0 shutdown complete.
I20260709 13:16:56.339339 13122 tablet_server.cc:179] TabletServer@127.12.208.131:0 shutting down...
I20260709 13:16:56.362272 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:56.362977 13122 tablet_replica.cc:333] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea: stopping tablet replica
I20260709 13:16:56.363574 13122 raft_consensus.cc:2243] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.364028 13122 raft_consensus.cc:2272] T ddcd97ab66144d7daf8c22eeed64dcc7 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.366204 13122 tablet_replica.cc:333] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea: stopping tablet replica
I20260709 13:16:56.366731 13122 raft_consensus.cc:2243] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:56.367452 13122 raft_consensus.cc:2272] T 89b0058a909b400985f7239ade36f6e5 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.369596 13122 tablet_replica.cc:333] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea: stopping tablet replica
I20260709 13:16:56.370160 13122 raft_consensus.cc:2243] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.370563 13122 raft_consensus.cc:2272] T 171e108453e646898d93d53e996a098d P e0da4e02b7d4435e99534f17dcb550ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.372098 13122 tablet_replica.cc:333] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea: stopping tablet replica
I20260709 13:16:56.372577 13122 raft_consensus.cc:2243] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.372988 13122 raft_consensus.cc:2272] T 875c370d8a9f49fe9d3bb5cbf776e2fb P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.375001 13122 tablet_replica.cc:333] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea: stopping tablet replica
I20260709 13:16:56.375619 13122 raft_consensus.cc:2243] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:56.376323 13122 raft_consensus.cc:2272] T 1272bddccd314e818dd9fc54caff59a1 P e0da4e02b7d4435e99534f17dcb550ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.378414 13122 tablet_replica.cc:333] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea: stopping tablet replica
I20260709 13:16:56.378911 13122 raft_consensus.cc:2243] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.379302 13122 raft_consensus.cc:2272] T ff1b9249e3cb4a66bcdfaf3ea4c6ac15 P e0da4e02b7d4435e99534f17dcb550ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.380802 13122 tablet_replica.cc:333] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea: stopping tablet replica
I20260709 13:16:56.381278 13122 raft_consensus.cc:2243] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.381701 13122 raft_consensus.cc:2272] T 769250822d1d4385a381cd0dd59ef3a5 P e0da4e02b7d4435e99534f17dcb550ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.383872 13122 tablet_replica.cc:333] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea: stopping tablet replica
I20260709 13:16:56.384349 13122 raft_consensus.cc:2243] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:56.385037 13122 raft_consensus.cc:2272] T 17212d33030a430784434e217ddb7e52 P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.386874 13122 tablet_replica.cc:333] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea: stopping tablet replica
I20260709 13:16:56.387305 13122 raft_consensus.cc:2243] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.387729 13122 raft_consensus.cc:2272] T 00f18c1dd0744729bbc46758c450cccc P e0da4e02b7d4435e99534f17dcb550ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.414564 13122 tablet_server.cc:196] TabletServer@127.12.208.131:0 shutdown complete.
I20260709 13:16:56.432106 13122 master.cc:562] Master@127.12.208.190:46177 shutting down...
I20260709 13:16:56.565577 13122 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:56.566191 13122 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.566565 13122 tablet_replica.cc:333] T 00000000000000000000000000000000 P 48fc02e1b2cc40299dc52f3cd6b06949: stopping tablet replica
I20260709 13:16:56.586187 13122 master.cc:584] Master@127.12.208.190:46177 shutdown complete.
e0da4e02b7d4435e99534f17dcb550ea  1
e3ebc7f240de4b83a92a971740d2a377  4
f3c3fd045a6f41d797d2d0ed3155a680  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12741 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:16:56.630600 13122 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.208.190:36509
I20260709 13:16:56.631836 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:56.638876 13630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:56.638823 13633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:56.638767 13631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:56.640633 13122 server_base.cc:1061] running on GCE node
I20260709 13:16:56.641621 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:56.641922 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:56.642102 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603016642085 us; error 0 us; skew 500 ppm
I20260709 13:16:56.642767 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:56.645280 13122 webserver.cc:533] Webserver started at http://127.12.208.190:36945/ using document root <none> and password file <none>
I20260709 13:16:56.646306 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:56.646539 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:56.646813 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:56.647962 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/master-0-root/instance:
uuid: "6706317fcb8c4e74b11856c440aa8086"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-ll1f"
I20260709 13:16:56.652277 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:56.655761 13638 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.656730 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:16:56.657140 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/master-0-root
uuid: "6706317fcb8c4e74b11856c440aa8086"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-ll1f"
I20260709 13:16:56.657546 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:56.679505 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:56.680753 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:56.721076 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.190:36509
I20260709 13:16:56.721189 13689 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.190:36509 every 8 connection(s)
I20260709 13:16:56.724934 13690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:56.735039 13690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086: Bootstrap starting.
I20260709 13:16:56.739939 13690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.744473 13690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086: No bootstrap required, opened a new log
I20260709 13:16:56.746733 13690 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6706317fcb8c4e74b11856c440aa8086" member_type: VOTER }
I20260709 13:16:56.747128 13690 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.747316 13690 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6706317fcb8c4e74b11856c440aa8086, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.747816 13690 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6706317fcb8c4e74b11856c440aa8086" member_type: VOTER }
I20260709 13:16:56.748226 13690 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:56.748433 13690 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:56.748646 13690 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.752610 13690 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6706317fcb8c4e74b11856c440aa8086" member_type: VOTER }
I20260709 13:16:56.753072 13690 leader_election.cc:304] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6706317fcb8c4e74b11856c440aa8086; no voters: 
I20260709 13:16:56.754146 13690 leader_election.cc:290] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:56.754463 13693 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.755812 13693 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [term 1 LEADER]: Becoming Leader. State: Replica: 6706317fcb8c4e74b11856c440aa8086, State: Running, Role: LEADER
I20260709 13:16:56.756585 13693 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6706317fcb8c4e74b11856c440aa8086" member_type: VOTER }
I20260709 13:16:56.757278 13690 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:56.761190 13695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6706317fcb8c4e74b11856c440aa8086. Latest consensus state: current_term: 1 leader_uuid: "6706317fcb8c4e74b11856c440aa8086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6706317fcb8c4e74b11856c440aa8086" member_type: VOTER } }
I20260709 13:16:56.761778 13695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:56.763084 13694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6706317fcb8c4e74b11856c440aa8086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6706317fcb8c4e74b11856c440aa8086" member_type: VOTER } }
I20260709 13:16:56.763615 13694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:56.764942 13700 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:56.773368 13700 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:56.774490 13122 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:56.782583 13700 catalog_manager.cc:1383] Generated new cluster ID: 2fc6d12c92984e5688cdc3fbf537e9ce
I20260709 13:16:56.782912 13700 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:56.797998 13700 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:56.799203 13700 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:56.818326 13700 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086: Generated new TSK 0
I20260709 13:16:56.818969 13700 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:56.841707 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:56.847980 13711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:56.849251 13712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:56.850594 13122 server_base.cc:1061] running on GCE node
W20260709 13:16:56.851181 13714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:56.852084 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:56.852308 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:56.852521 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603016852463 us; error 0 us; skew 500 ppm
I20260709 13:16:56.853032 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:56.855419 13122 webserver.cc:533] Webserver started at http://127.12.208.129:41509/ using document root <none> and password file <none>
I20260709 13:16:56.856026 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:56.856280 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:56.856575 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:56.857687 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-0-root/instance:
uuid: "c7128c1761044ba58dfe7531f93da235"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-ll1f"
I20260709 13:16:56.862622 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:56.865911 13719 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.866778 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:16:56.867149 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-0-root
uuid: "c7128c1761044ba58dfe7531f93da235"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-ll1f"
I20260709 13:16:56.867458 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:56.884065 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:56.885278 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:56.886744 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:56.889008 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:56.889179 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.889459 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:56.889617 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.932453 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.129:38835
I20260709 13:16:56.932551 13781 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.129:38835 every 8 connection(s)
I20260709 13:16:56.937292 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:56.945116 13786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:56.946921 13787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:56.948275 13789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:56.949393 13122 server_base.cc:1061] running on GCE node
I20260709 13:16:56.950330 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:56.950544 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:56.950719 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603016950700 us; error 0 us; skew 500 ppm
I20260709 13:16:56.951226 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:56.953514 13122 webserver.cc:533] Webserver started at http://127.12.208.130:46199/ using document root <none> and password file <none>
I20260709 13:16:56.954099 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:56.954336 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:56.954636 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:56.956182 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-1-root/instance:
uuid: "24afb6f58d504d819c22d3239ab94c06"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-ll1f"
I20260709 13:16:56.957703 13782 heartbeater.cc:344] Connected to a master server at 127.12.208.190:36509
I20260709 13:16:56.958091 13782 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:56.958822 13782 heartbeater.cc:507] Master 127.12.208.190:36509 requested a full tablet report, sending...
I20260709 13:16:56.961004 13655 ts_manager.cc:194] Registered new tserver with Master: c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835)
I20260709 13:16:56.962055 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:16:56.963094 13655 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44634
I20260709 13:16:56.965991 13794 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.966722 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.004s
I20260709 13:16:56.967037 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-1-root
uuid: "24afb6f58d504d819c22d3239ab94c06"
format_stamp: "Formatted at 2026-07-09 13:16:56 on dist-test-slave-ll1f"
I20260709 13:16:56.967317 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:56.993608 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:56.994905 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:56.996359 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:56.998549 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:56.998770 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:56.999008 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:56.999172 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:57.038709 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.130:39785
I20260709 13:16:57.038807 13856 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.130:39785 every 8 connection(s)
I20260709 13:16:57.043296 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:57.050462 13860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:57.051386 13861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:57.053310 13863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:57.054481 13122 server_base.cc:1061] running on GCE node
I20260709 13:16:57.055467 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:57.055804 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:57.055893 13857 heartbeater.cc:344] Connected to a master server at 127.12.208.190:36509
I20260709 13:16:57.056038 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603017056015 us; error 0 us; skew 500 ppm
I20260709 13:16:57.056391 13857 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:57.056813 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:57.057195 13857 heartbeater.cc:507] Master 127.12.208.190:36509 requested a full tablet report, sending...
I20260709 13:16:57.059461 13655 ts_manager.cc:194] Registered new tserver with Master: 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:57.059660 13122 webserver.cc:533] Webserver started at http://127.12.208.131:41105/ using document root <none> and password file <none>
I20260709 13:16:57.060245 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:57.060456 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:57.060716 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:57.061092 13655 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44638
I20260709 13:16:57.061947 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-2-root/instance:
uuid: "49ad832dd3d64a25ac65354295648e05"
format_stamp: "Formatted at 2026-07-09 13:16:57 on dist-test-slave-ll1f"
I20260709 13:16:57.066466 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:16:57.069911 13868 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:57.070784 13122 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:16:57.071035 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-2-root
uuid: "49ad832dd3d64a25ac65354295648e05"
format_stamp: "Formatted at 2026-07-09 13:16:57 on dist-test-slave-ll1f"
I20260709 13:16:57.071272 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603003722080-13122-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:57.085882 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:57.087015 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:57.088469 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:57.090670 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:57.090852 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:57.091130 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:57.091288 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:57.131510 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.131:35797
I20260709 13:16:57.131599 13930 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.131:35797 every 8 connection(s)
I20260709 13:16:57.145164 13931 heartbeater.cc:344] Connected to a master server at 127.12.208.190:36509
I20260709 13:16:57.145553 13931 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:57.146390 13931 heartbeater.cc:507] Master 127.12.208.190:36509 requested a full tablet report, sending...
I20260709 13:16:57.148262 13655 ts_manager.cc:194] Registered new tserver with Master: 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:57.149116 13122 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014474545s
I20260709 13:16:57.149605 13655 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44652
I20260709 13:16:57.174289 13655 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44668:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:57.177147 13655 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:57.245913 13747 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca7733dfd634180bf3f2e16db53d421 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:57.246411 13745 tablet_service.cc:1511] Processing CreateTablet for tablet ff7624c5814a472d9dc090a75287175a (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:57.246399 13746 tablet_service.cc:1511] Processing CreateTablet for tablet cdb5f612c0c644b1b3c249f6a0358a1e (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:57.247574 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca7733dfd634180bf3f2e16db53d421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.248442 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7624c5814a472d9dc090a75287175a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.252009 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb5f612c0c644b1b3c249f6a0358a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.261436 13822 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca7733dfd634180bf3f2e16db53d421 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:57.262933 13822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca7733dfd634180bf3f2e16db53d421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.265107 13820 tablet_service.cc:1511] Processing CreateTablet for tablet ff7624c5814a472d9dc090a75287175a (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:57.265705 13821 tablet_service.cc:1511] Processing CreateTablet for tablet cdb5f612c0c644b1b3c249f6a0358a1e (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:57.266463 13820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7624c5814a472d9dc090a75287175a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.269666 13821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb5f612c0c644b1b3c249f6a0358a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.278805 13744 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1345ebd6694bce8f588e01d2458592 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:57.280148 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1345ebd6694bce8f588e01d2458592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.286507 13896 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca7733dfd634180bf3f2e16db53d421 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:57.287842 13896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca7733dfd634180bf3f2e16db53d421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.291330 13895 tablet_service.cc:1511] Processing CreateTablet for tablet cdb5f612c0c644b1b3c249f6a0358a1e (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:57.292680 13895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb5f612c0c644b1b3c249f6a0358a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.294965 13894 tablet_service.cc:1511] Processing CreateTablet for tablet ff7624c5814a472d9dc090a75287175a (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:57.296629 13894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7624c5814a472d9dc090a75287175a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.298214 13946 tablet_bootstrap.cc:492] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235: Bootstrap starting.
I20260709 13:16:57.299873 13892 tablet_service.cc:1511] Processing CreateTablet for tablet 9d401f338ca64ac8b0830262c8460cc5 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:57.300062 13893 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1345ebd6694bce8f588e01d2458592 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:57.301666 13893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1345ebd6694bce8f588e01d2458592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.310161 13892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d401f338ca64ac8b0830262c8460cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.316679 13747 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0bc847b22441a3a256d44723664001 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:57.318709 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0bc847b22441a3a256d44723664001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.319479 13744 tablet_service.cc:1511] Processing CreateTablet for tablet 9d401f338ca64ac8b0830262c8460cc5 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:57.321158 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d401f338ca64ac8b0830262c8460cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.326985 13819 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0bc847b22441a3a256d44723664001 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:57.327415 13745 tablet_service.cc:1511] Processing CreateTablet for tablet bcc4a9f307b540eb803978e9f254f871 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:57.328457 13819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0bc847b22441a3a256d44723664001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.328650 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcc4a9f307b540eb803978e9f254f871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.334913 13890 tablet_service.cc:1511] Processing CreateTablet for tablet b4537142385245879562f9b303458356 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:57.335638 13888 tablet_service.cc:1511] Processing CreateTablet for tablet 877659d20e9b42b8a363489846fa8f35 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:57.335801 13818 tablet_service.cc:1511] Processing CreateTablet for tablet bcc4a9f307b540eb803978e9f254f871 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:57.336395 13890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4537142385245879562f9b303458356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.336056 13743 tablet_service.cc:1511] Processing CreateTablet for tablet b4537142385245879562f9b303458356 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:57.337023 13888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877659d20e9b42b8a363489846fa8f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.337296 13818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcc4a9f307b540eb803978e9f254f871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.338922 13889 tablet_service.cc:1511] Processing CreateTablet for tablet 3b8146a2778341f3a8cfd96b3282b848 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:57.340291 13889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b8146a2778341f3a8cfd96b3282b848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.341176 13742 tablet_service.cc:1511] Processing CreateTablet for tablet 3b8146a2778341f3a8cfd96b3282b848 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:57.333549 13891 tablet_service.cc:1511] Processing CreateTablet for tablet bcc4a9f307b540eb803978e9f254f871 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:57.337339 13743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4537142385245879562f9b303458356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.342908 13891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcc4a9f307b540eb803978e9f254f871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.343106 13742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b8146a2778341f3a8cfd96b3282b848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.344722 13817 tablet_service.cc:1511] Processing CreateTablet for tablet b4537142385245879562f9b303458356 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:57.346140 13817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4537142385245879562f9b303458356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.354542 13947 tablet_bootstrap.cc:492] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06: Bootstrap starting.
I20260709 13:16:57.349591 13946 tablet_bootstrap.cc:654] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.358811 13893 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0bc847b22441a3a256d44723664001 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:57.360121 13893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0bc847b22441a3a256d44723664001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.362628 13821 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1345ebd6694bce8f588e01d2458592 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:57.363938 13821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1345ebd6694bce8f588e01d2458592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.373099 13947 tablet_bootstrap.cc:654] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.373929 13820 tablet_service.cc:1511] Processing CreateTablet for tablet 9d401f338ca64ac8b0830262c8460cc5 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:57.375924 13820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d401f338ca64ac8b0830262c8460cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.404583 13816 tablet_service.cc:1511] Processing CreateTablet for tablet 3b8146a2778341f3a8cfd96b3282b848 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:57.411583 13816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b8146a2778341f3a8cfd96b3282b848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.412257 13948 tablet_bootstrap.cc:492] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05: Bootstrap starting.
I20260709 13:16:57.415565 13746 tablet_service.cc:1511] Processing CreateTablet for tablet 877659d20e9b42b8a363489846fa8f35 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:57.417016 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877659d20e9b42b8a363489846fa8f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.420059 13815 tablet_service.cc:1511] Processing CreateTablet for tablet 877659d20e9b42b8a363489846fa8f35 (DEFAULT_TABLE table=test-workload [id=6eb02045d5bd42cab1acd55756efb038]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:57.421522 13815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877659d20e9b42b8a363489846fa8f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:57.436121 13946 tablet_bootstrap.cc:492] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235: No bootstrap required, opened a new log
I20260709 13:16:57.436674 13946 ts_tablet_manager.cc:1403] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235: Time spent bootstrapping tablet: real 0.139s	user 0.015s	sys 0.037s
I20260709 13:16:57.439544 13946 raft_consensus.cc:359] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.440302 13946 raft_consensus.cc:385] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.440665 13946 raft_consensus.cc:740] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.441576 13946 consensus_queue.cc:260] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.451495 13947 tablet_bootstrap.cc:492] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06: No bootstrap required, opened a new log
I20260709 13:16:57.452108 13947 ts_tablet_manager.cc:1403] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.013s
I20260709 13:16:57.463089 13947 raft_consensus.cc:359] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.463888 13947 raft_consensus.cc:385] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.464212 13947 raft_consensus.cc:740] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.468494 13948 tablet_bootstrap.cc:654] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.465164 13947 consensus_queue.cc:260] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.489656 13946 ts_tablet_manager.cc:1434] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235: Time spent starting tablet: real 0.053s	user 0.022s	sys 0.024s
I20260709 13:16:57.491034 13782 heartbeater.cc:499] Master 127.12.208.190:36509 was elected leader, sending a full tablet report...
I20260709 13:16:57.491423 13946 tablet_bootstrap.cc:492] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235: Bootstrap starting.
I20260709 13:16:57.496791 13948 tablet_bootstrap.cc:492] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05: No bootstrap required, opened a new log
I20260709 13:16:57.497287 13948 ts_tablet_manager.cc:1403] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.005s
I20260709 13:16:57.498184 13947 ts_tablet_manager.cc:1434] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.012s
I20260709 13:16:57.498919 13857 heartbeater.cc:499] Master 127.12.208.190:36509 was elected leader, sending a full tablet report...
I20260709 13:16:57.499208 13947 tablet_bootstrap.cc:492] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06: Bootstrap starting.
I20260709 13:16:57.500711 13946 tablet_bootstrap.cc:654] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.505416 13948 raft_consensus.cc:359] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.506316 13948 raft_consensus.cc:385] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.506631 13947 tablet_bootstrap.cc:654] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.506704 13948 raft_consensus.cc:740] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.507927 13948 consensus_queue.cc:260] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.513893 13931 heartbeater.cc:499] Master 127.12.208.190:36509 was elected leader, sending a full tablet report...
I20260709 13:16:57.514878 13948 ts_tablet_manager.cc:1434] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.007s
I20260709 13:16:57.515926 13948 tablet_bootstrap.cc:492] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05: Bootstrap starting.
I20260709 13:16:57.522485 13948 tablet_bootstrap.cc:654] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.534076 13948 tablet_bootstrap.cc:492] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05: No bootstrap required, opened a new log
I20260709 13:16:57.534662 13948 ts_tablet_manager.cc:1403] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:16:57.537715 13948 raft_consensus.cc:359] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.538677 13948 raft_consensus.cc:385] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.539031 13948 raft_consensus.cc:740] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.539973 13948 consensus_queue.cc:260] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.542429 13948 ts_tablet_manager.cc:1434] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:57.543427 13948 tablet_bootstrap.cc:492] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05: Bootstrap starting.
I20260709 13:16:57.548961 13951 raft_consensus.cc:493] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.549957 13948 tablet_bootstrap.cc:654] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.549490 13951 raft_consensus.cc:515] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.554443 13951 leader_election.cc:290] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:57.578541 13948 tablet_bootstrap.cc:492] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05: No bootstrap required, opened a new log
I20260709 13:16:57.579149 13948 ts_tablet_manager.cc:1403] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:16:57.582851 13948 raft_consensus.cc:359] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.588286 13948 raft_consensus.cc:385] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.588397 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca7733dfd634180bf3f2e16db53d421" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06" is_pre_election: true
I20260709 13:16:57.588719 13948 raft_consensus.cc:740] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.586824 13946 tablet_bootstrap.cc:492] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235: No bootstrap required, opened a new log
W20260709 13:16:57.589963 13721 leader_election.cc:343] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.590109 13946 ts_tablet_manager.cc:1403] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235: Time spent bootstrapping tablet: real 0.099s	user 0.039s	sys 0.052s
I20260709 13:16:57.589615 13948 consensus_queue.cc:260] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.591919 13948 ts_tablet_manager.cc:1434] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:16:57.592759 13947 tablet_bootstrap.cc:492] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06: No bootstrap required, opened a new log
I20260709 13:16:57.592850 13948 tablet_bootstrap.cc:492] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05: Bootstrap starting.
I20260709 13:16:57.593259 13947 ts_tablet_manager.cc:1403] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.039s
I20260709 13:16:57.592985 13946 raft_consensus.cc:359] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.593734 13946 raft_consensus.cc:385] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.594094 13946 raft_consensus.cc:740] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.594959 13946 consensus_queue.cc:260] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.596122 13947 raft_consensus.cc:359] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.596915 13947 raft_consensus.cc:385] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.597205 13947 raft_consensus.cc:740] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.599676 13948 tablet_bootstrap.cc:654] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.602201 13947 consensus_queue.cc:260] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.604192 13946 ts_tablet_manager.cc:1434] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:16:57.604979 13947 ts_tablet_manager.cc:1434] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.007s
I20260709 13:16:57.606156 13947 tablet_bootstrap.cc:492] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06: Bootstrap starting.
I20260709 13:16:57.609552 13946 tablet_bootstrap.cc:492] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235: Bootstrap starting.
I20260709 13:16:57.611362 13948 tablet_bootstrap.cc:492] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05: No bootstrap required, opened a new log
I20260709 13:16:57.611792 13948 ts_tablet_manager.cc:1403] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:16:57.614133 13948 raft_consensus.cc:359] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.614890 13948 raft_consensus.cc:385] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.615056 13946 tablet_bootstrap.cc:654] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.615221 13948 raft_consensus.cc:740] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.616073 13948 consensus_queue.cc:260] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.618538 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca7733dfd634180bf3f2e16db53d421" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05" is_pre_election: true
I20260709 13:16:57.619439 13906 raft_consensus.cc:2468] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 0.
I20260709 13:16:57.620337 13948 ts_tablet_manager.cc:1434] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:16:57.621227 13947 tablet_bootstrap.cc:654] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.621373 13948 tablet_bootstrap.cc:492] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05: Bootstrap starting.
I20260709 13:16:57.621621 13722 leader_election.cc:304] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 24afb6f58d504d819c22d3239ab94c06
I20260709 13:16:57.623270 13951 raft_consensus.cc:2804] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.623740 13951 raft_consensus.cc:493] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.624148 13951 raft_consensus.cc:3060] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.626188 13953 raft_consensus.cc:493] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.626821 13953 raft_consensus.cc:515] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.629923 13948 tablet_bootstrap.cc:654] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.650323 13953 leader_election.cc:290] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:57.650642 13955 raft_consensus.cc:493] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.651515 13955 raft_consensus.cc:515] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.653626 13955 leader_election.cc:290] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:57.665584 13946 tablet_bootstrap.cc:492] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235: No bootstrap required, opened a new log
I20260709 13:16:57.666435 13946 ts_tablet_manager.cc:1403] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235: Time spent bootstrapping tablet: real 0.057s	user 0.027s	sys 0.011s
I20260709 13:16:57.672433 13968 raft_consensus.cc:493] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.674350 13948 tablet_bootstrap.cc:492] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05: No bootstrap required, opened a new log
I20260709 13:16:57.674841 13948 ts_tablet_manager.cc:1403] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.001s
I20260709 13:16:57.674628 13968 raft_consensus.cc:515] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.676072 13947 tablet_bootstrap.cc:492] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06: No bootstrap required, opened a new log
I20260709 13:16:57.676558 13947 ts_tablet_manager.cc:1403] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.013s
I20260709 13:16:57.678193 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06" is_pre_election: true
I20260709 13:16:57.678869 13832 raft_consensus.cc:2468] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 0.
I20260709 13:16:57.679356 13947 raft_consensus.cc:359] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.680085 13721 leader_election.cc:304] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:57.680303 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05" is_pre_election: true
I20260709 13:16:57.681550 13968 leader_election.cc:290] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:57.686899 13968 raft_consensus.cc:2804] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.687336 13968 raft_consensus.cc:493] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.687650 13968 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.680068 13947 raft_consensus.cc:385] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.678261 13951 raft_consensus.cc:515] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.691104 13947 raft_consensus.cc:740] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.692788 13947 consensus_queue.cc:260] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
W20260709 13:16:57.693809 13722 leader_election.cc:343] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.697091 13947 ts_tablet_manager.cc:1434] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:16:57.698340 13947 tablet_bootstrap.cc:492] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06: Bootstrap starting.
I20260709 13:16:57.698205 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca7733dfd634180bf3f2e16db53d421" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
W20260709 13:16:57.699788 13721 leader_election.cc:343] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.697927 13948 raft_consensus.cc:359] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.697062 13951 leader_election.cc:290] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:57.704589 13968 raft_consensus.cc:515] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.705276 13947 tablet_bootstrap.cc:654] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.705892 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235" is_pre_election: true
I20260709 13:16:57.706816 13757 raft_consensus.cc:2393] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24afb6f58d504d819c22d3239ab94c06 in current term 1: Already voted for candidate c7128c1761044ba58dfe7531f93da235 in this term.
I20260709 13:16:57.707429 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:16:57.708041 13832 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.704051 13946 raft_consensus.cc:359] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.708334 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca7733dfd634180bf3f2e16db53d421" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:57.708961 13906 raft_consensus.cc:3060] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.716276 13832 raft_consensus.cc:2468] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 1.
I20260709 13:16:57.717447 13721 leader_election.cc:304] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:57.718355 13951 raft_consensus.cc:2804] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.718890 13951 raft_consensus.cc:697] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:16:57.704921 13948 raft_consensus.cc:385] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.719753 13951 consensus_queue.cc:237] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.720345 13968 leader_election.cc:290] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:57.726886 13905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:57.719760 13948 raft_consensus.cc:740] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Initialized, Role: FOLLOWER
W20260709 13:16:57.728705 13722 leader_election.cc:343] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.708491 13946 raft_consensus.cc:385] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.730016 13946 raft_consensus.cc:740] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.732756 13905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05" is_pre_election: true
I20260709 13:16:57.733151 13946 consensus_queue.cc:260] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.734225 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06" is_pre_election: true
I20260709 13:16:57.732221 13906 raft_consensus.cc:2468] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 1.
I20260709 13:16:57.736230 13946 ts_tablet_manager.cc:1434] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
I20260709 13:16:57.736465 13948 consensus_queue.cc:260] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
W20260709 13:16:57.736819 13797 leader_election.cc:343] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.737514 13797 leader_election.cc:304] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06; no voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235
W20260709 13:16:57.736055 13870 leader_election.cc:343] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.734409 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235" is_pre_election: true
I20260709 13:16:57.738480 13953 raft_consensus.cc:2749] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.739187 13757 raft_consensus.cc:2468] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 0.
I20260709 13:16:57.740499 13948 ts_tablet_manager.cc:1434] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 13:16:57.740415 13870 leader_election.cc:304] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 24afb6f58d504d819c22d3239ab94c06
I20260709 13:16:57.741039 13947 tablet_bootstrap.cc:492] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06: No bootstrap required, opened a new log
I20260709 13:16:57.741456 13948 tablet_bootstrap.cc:492] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05: Bootstrap starting.
I20260709 13:16:57.741528 13947 ts_tablet_manager.cc:1403] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.022s
I20260709 13:16:57.737516 13946 tablet_bootstrap.cc:492] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235: Bootstrap starting.
I20260709 13:16:57.741421 13955 raft_consensus.cc:2804] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.745604 13955 raft_consensus.cc:493] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.745093 13947 raft_consensus.cc:359] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.745996 13955 raft_consensus.cc:3060] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.746239 13947 raft_consensus.cc:385] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.746677 13947 raft_consensus.cc:740] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.747596 13947 consensus_queue.cc:260] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.748344 13948 tablet_bootstrap.cc:654] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.748786 13946 tablet_bootstrap.cc:654] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.741743 13722 leader_election.cc:304] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 24afb6f58d504d819c22d3239ab94c06
I20260709 13:16:57.751147 13971 raft_consensus.cc:2804] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.752596 13971 raft_consensus.cc:697] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:16:57.752856 13947 ts_tablet_manager.cc:1434] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:16:57.753413 13971 consensus_queue.cc:237] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.753953 13947 tablet_bootstrap.cc:492] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06: Bootstrap starting.
I20260709 13:16:57.761615 13955 raft_consensus.cc:515] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.764526 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:16:57.765290 13757 raft_consensus.cc:3060] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:57.771570 13703 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:57.773415 13947 tablet_bootstrap.cc:654] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.776469 13948 tablet_bootstrap.cc:492] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05: No bootstrap required, opened a new log
I20260709 13:16:57.775638 13652 catalog_manager.cc:5697] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.777040 13948 ts_tablet_manager.cc:1403] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.007s
I20260709 13:16:57.779942 13757 raft_consensus.cc:2468] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 1.
I20260709 13:16:57.781296 13955 leader_election.cc:290] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:57.781366 13870 leader_election.cc:304] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:57.783442 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
W20260709 13:16:57.785086 13870 leader_election.cc:343] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.780198 13948 raft_consensus.cc:359] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.786366 13946 tablet_bootstrap.cc:492] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235: No bootstrap required, opened a new log
I20260709 13:16:57.786515 13947 tablet_bootstrap.cc:492] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06: No bootstrap required, opened a new log
I20260709 13:16:57.786912 13946 ts_tablet_manager.cc:1403] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.015s
I20260709 13:16:57.786454 13948 raft_consensus.cc:385] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.787303 13947 ts_tablet_manager.cc:1403] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.003s
I20260709 13:16:57.787312 13948 raft_consensus.cc:740] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.788517 13955 raft_consensus.cc:2804] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.789860 13948 consensus_queue.cc:260] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.791435 13946 raft_consensus.cc:359] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.791867 13947 raft_consensus.cc:359] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.792388 13946 raft_consensus.cc:385] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.792601 13947 raft_consensus.cc:385] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.792802 13946 raft_consensus.cc:740] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.792984 13947 raft_consensus.cc:740] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.793967 13947 consensus_queue.cc:260] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.794065 13946 consensus_queue.cc:260] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.796479 13947 ts_tablet_manager.cc:1434] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:16:57.797065 13946 ts_tablet_manager.cc:1434] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260709 13:16:57.797423 13947 tablet_bootstrap.cc:492] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06: Bootstrap starting.
I20260709 13:16:57.798296 13946 tablet_bootstrap.cc:492] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235: Bootstrap starting.
I20260709 13:16:57.801030 13953 raft_consensus.cc:493] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.801546 13953 raft_consensus.cc:515] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.802091 13955 raft_consensus.cc:697] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Becoming Leader. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:16:57.803182 13955 consensus_queue.cc:237] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.805631 13946 tablet_bootstrap.cc:654] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.806308 13947 tablet_bootstrap.cc:654] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.806721 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca7733dfd634180bf3f2e16db53d421" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235" is_pre_election: true
I20260709 13:16:57.807749 13953 leader_election.cc:290] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:57.808722 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca7733dfd634180bf3f2e16db53d421" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05" is_pre_election: true
I20260709 13:16:57.809477 13906 raft_consensus.cc:2393] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24afb6f58d504d819c22d3239ab94c06 in current term 1: Already voted for candidate c7128c1761044ba58dfe7531f93da235 in this term.
I20260709 13:16:57.811057 13797 leader_election.cc:304] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06; no voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235
I20260709 13:16:57.823760 13946 tablet_bootstrap.cc:492] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235: No bootstrap required, opened a new log
I20260709 13:16:57.824232 13946 ts_tablet_manager.cc:1403] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.011s
I20260709 13:16:57.825536 13953 raft_consensus.cc:3060] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.826735 13946 raft_consensus.cc:359] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.827524 13946 raft_consensus.cc:385] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.827821 13946 raft_consensus.cc:740] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.828624 13946 consensus_queue.cc:260] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.828372 13653 catalog_manager.cc:5697] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49ad832dd3d64a25ac65354295648e05 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "49ad832dd3d64a25ac65354295648e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:57.830955 13946 ts_tablet_manager.cc:1434] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:57.831954 13946 tablet_bootstrap.cc:492] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235: Bootstrap starting.
I20260709 13:16:57.836357 13946 tablet_bootstrap.cc:654] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.841699 13946 tablet_bootstrap.cc:492] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235: No bootstrap required, opened a new log
I20260709 13:16:57.842391 13946 ts_tablet_manager.cc:1403] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:16:57.846385 13946 raft_consensus.cc:359] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.847366 13946 raft_consensus.cc:385] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.847756 13946 raft_consensus.cc:740] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.847893 13953 raft_consensus.cc:2749] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.848969 13946 consensus_queue.cc:260] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.852569 13948 ts_tablet_manager.cc:1434] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05: Time spent starting tablet: real 0.075s	user 0.020s	sys 0.019s
I20260709 13:16:57.852574 13946 ts_tablet_manager.cc:1434] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:57.854041 13948 tablet_bootstrap.cc:492] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05: Bootstrap starting.
I20260709 13:16:57.854235 13946 tablet_bootstrap.cc:492] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235: Bootstrap starting.
I20260709 13:16:57.859742 13947 tablet_bootstrap.cc:492] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06: No bootstrap required, opened a new log
I20260709 13:16:57.860577 13947 ts_tablet_manager.cc:1403] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06: Time spent bootstrapping tablet: real 0.063s	user 0.024s	sys 0.016s
I20260709 13:16:57.862026 13948 tablet_bootstrap.cc:654] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.864042 13946 tablet_bootstrap.cc:654] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.863662 13947 raft_consensus.cc:359] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.864532 13947 raft_consensus.cc:385] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.864914 13947 raft_consensus.cc:740] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.865883 13947 consensus_queue.cc:260] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.869413 13981 raft_consensus.cc:493] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.869902 13981 raft_consensus.cc:515] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.871560 13947 ts_tablet_manager.cc:1434] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:57.872037 13981 leader_election.cc:290] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:57.872668 13947 tablet_bootstrap.cc:492] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06: Bootstrap starting.
I20260709 13:16:57.873759 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0bc847b22441a3a256d44723664001" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235" is_pre_election: true
I20260709 13:16:57.874420 13757 raft_consensus.cc:2468] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 0.
I20260709 13:16:57.875386 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0bc847b22441a3a256d44723664001" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06" is_pre_election: true
I20260709 13:16:57.880241 13946 tablet_bootstrap.cc:492] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235: No bootstrap required, opened a new log
I20260709 13:16:57.880733 13946 ts_tablet_manager.cc:1403] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.006s
I20260709 13:16:57.880790 13947 tablet_bootstrap.cc:654] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.883854 13946 raft_consensus.cc:359] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.884792 13946 raft_consensus.cc:385] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.885162 13946 raft_consensus.cc:740] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.886372 13946 consensus_queue.cc:260] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.889631 13946 ts_tablet_manager.cc:1434] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
W20260709 13:16:57.890632 13870 leader_election.cc:343] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.891460 13946 tablet_bootstrap.cc:492] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235: Bootstrap starting.
I20260709 13:16:57.891595 13870 leader_election.cc:304] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 24afb6f58d504d819c22d3239ab94c06
I20260709 13:16:57.892249 13947 tablet_bootstrap.cc:492] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06: No bootstrap required, opened a new log
I20260709 13:16:57.892349 13981 raft_consensus.cc:2804] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.892756 13947 ts_tablet_manager.cc:1403] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 13:16:57.892794 13981 raft_consensus.cc:493] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.893311 13981 raft_consensus.cc:3060] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.893280 13655 catalog_manager.cc:5697] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.895797 13947 raft_consensus.cc:359] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.896373 13947 raft_consensus.cc:385] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.896622 13947 raft_consensus.cc:740] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.899384 13948 tablet_bootstrap.cc:492] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05: No bootstrap required, opened a new log
I20260709 13:16:57.899889 13948 ts_tablet_manager.cc:1403] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.012s
I20260709 13:16:57.900871 13981 raft_consensus.cc:515] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.902901 13948 raft_consensus.cc:359] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.903630 13948 raft_consensus.cc:385] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.903788 13946 tablet_bootstrap.cc:654] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.903955 13948 raft_consensus.cc:740] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.904805 13948 consensus_queue.cc:260] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.907138 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0bc847b22441a3a256d44723664001" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:16:57.907028 13947 consensus_queue.cc:260] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.907584 13948 ts_tablet_manager.cc:1434] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:57.907733 13757 raft_consensus.cc:3060] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.908517 13948 tablet_bootstrap.cc:492] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05: Bootstrap starting.
I20260709 13:16:57.909248 13947 ts_tablet_manager.cc:1434] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:16:57.912797 13955 raft_consensus.cc:493] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.913249 13955 raft_consensus.cc:515] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.915328 13948 tablet_bootstrap.cc:654] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.915303 13955 leader_election.cc:290] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:57.915546 13947 tablet_bootstrap.cc:492] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06: Bootstrap starting.
I20260709 13:16:57.918900 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877659d20e9b42b8a363489846fa8f35" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235" is_pre_election: true
I20260709 13:16:57.920142 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877659d20e9b42b8a363489846fa8f35" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06" is_pre_election: true
I20260709 13:16:57.922073 13947 tablet_bootstrap.cc:654] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:57.921574 13870 leader_election.cc:343] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.922567 13981 leader_election.cc:290] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:57.923834 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0bc847b22441a3a256d44723664001" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:16:57.922035 13757 raft_consensus.cc:2468] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 1.
W20260709 13:16:57.926507 13870 leader_election.cc:343] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.927069 13870 leader_election.cc:304] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05; no voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235
I20260709 13:16:57.928498 13870 leader_election.cc:304] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:57.929468 13955 raft_consensus.cc:2749] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.930418 13955 raft_consensus.cc:2804] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.930971 13955 raft_consensus.cc:697] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Becoming Leader. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:16:57.932021 13955 consensus_queue.cc:237] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
W20260709 13:16:57.929610 13870 leader_election.cc:343] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.939141 13946 tablet_bootstrap.cc:492] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235: No bootstrap required, opened a new log
I20260709 13:16:57.939651 13946 ts_tablet_manager.cc:1403] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.016s
I20260709 13:16:57.942267 13946 raft_consensus.cc:359] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.942978 13946 raft_consensus.cc:385] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.943267 13946 raft_consensus.cc:740] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.944032 13946 consensus_queue.cc:260] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.945675 13947 tablet_bootstrap.cc:492] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06: No bootstrap required, opened a new log
I20260709 13:16:57.946173 13947 ts_tablet_manager.cc:1403] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.025s
I20260709 13:16:57.948431 13948 tablet_bootstrap.cc:492] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05: No bootstrap required, opened a new log
I20260709 13:16:57.948863 13948 ts_tablet_manager.cc:1403] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.008s
I20260709 13:16:57.948760 13947 raft_consensus.cc:359] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.949470 13947 raft_consensus.cc:385] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.949752 13947 raft_consensus.cc:740] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.950158 13946 ts_tablet_manager.cc:1434] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:57.949679 13654 catalog_manager.cc:5697] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49ad832dd3d64a25ac65354295648e05 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "49ad832dd3d64a25ac65354295648e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:57.951000 13946 tablet_bootstrap.cc:492] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235: Bootstrap starting.
I20260709 13:16:57.950600 13947 consensus_queue.cc:260] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.952862 13947 ts_tablet_manager.cc:1434] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:57.953727 13947 tablet_bootstrap.cc:492] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06: Bootstrap starting.
I20260709 13:16:57.954231 13948 raft_consensus.cc:359] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.954950 13948 raft_consensus.cc:385] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.955240 13948 raft_consensus.cc:740] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.956030 13948 consensus_queue.cc:260] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.956722 13946 tablet_bootstrap.cc:654] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.957535 13955 raft_consensus.cc:493] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.958025 13955 raft_consensus.cc:515] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.960063 13955 leader_election.cc:290] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:57.960757 13947 tablet_bootstrap.cc:654] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.961833 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06" is_pre_election: true
I20260709 13:16:57.961974 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235" is_pre_election: true
I20260709 13:16:57.962450 13832 raft_consensus.cc:2468] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 0.
I20260709 13:16:57.962600 13757 raft_consensus.cc:2468] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 0.
I20260709 13:16:57.963683 13870 leader_election.cc:304] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:57.964970 13955 raft_consensus.cc:2804] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.965363 13955 raft_consensus.cc:493] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.965726 13955 raft_consensus.cc:3060] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.973975 13948 ts_tablet_manager.cc:1434] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:16:57.975034 13948 tablet_bootstrap.cc:492] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05: Bootstrap starting.
I20260709 13:16:57.982160 13948 tablet_bootstrap.cc:654] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.972486 13955 raft_consensus.cc:515] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.985057 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:16:57.985646 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:16:57.985834 13757 raft_consensus.cc:3060] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.986246 13832 raft_consensus.cc:3060] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.992945 13832 raft_consensus.cc:2468] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 1.
I20260709 13:16:57.994148 13870 leader_election.cc:304] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, 49ad832dd3d64a25ac65354295648e05; no voters: 
I20260709 13:16:57.995096 13979 raft_consensus.cc:2804] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.995198 13757 raft_consensus.cc:2468] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 1.
I20260709 13:16:57.995599 13979 raft_consensus.cc:697] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Becoming Leader. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:16:57.996488 13979 consensus_queue.cc:237] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:57.997644 13955 leader_election.cc:290] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:58.001286 13946 tablet_bootstrap.cc:492] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235: No bootstrap required, opened a new log
I20260709 13:16:58.001884 13946 ts_tablet_manager.cc:1403] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.008s
I20260709 13:16:58.004299 13947 tablet_bootstrap.cc:492] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06: No bootstrap required, opened a new log
I20260709 13:16:58.004951 13947 ts_tablet_manager.cc:1403] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.024s
I20260709 13:16:58.005299 13946 raft_consensus.cc:359] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.006249 13946 raft_consensus.cc:385] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.006604 13946 raft_consensus.cc:740] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.007597 13946 consensus_queue.cc:260] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.008316 13947 raft_consensus.cc:359] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.009256 13947 raft_consensus.cc:385] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.009572 13947 raft_consensus.cc:740] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.010502 13947 consensus_queue.cc:260] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.012518 13947 ts_tablet_manager.cc:1434] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:16:58.013427 13947 tablet_bootstrap.cc:492] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06: Bootstrap starting.
I20260709 13:16:58.015332 13971 raft_consensus.cc:493] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.015178 13655 catalog_manager.cc:5697] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49ad832dd3d64a25ac65354295648e05 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "49ad832dd3d64a25ac65354295648e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.015967 13971 raft_consensus.cc:515] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.019511 13947 tablet_bootstrap.cc:654] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.019768 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06" is_pre_election: true
I20260709 13:16:58.020406 13832 raft_consensus.cc:2468] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 0.
I20260709 13:16:58.022531 13721 leader_election.cc:304] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.023366 13951 raft_consensus.cc:2804] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.023717 13951 raft_consensus.cc:493] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.023854 13946 ts_tablet_manager.cc:1434] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:16:58.024111 13951 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.025390 13955 raft_consensus.cc:493] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.026007 13955 raft_consensus.cc:515] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.030360 13955 leader_election.cc:290] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:58.030531 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235" is_pre_election: true
I20260709 13:16:58.033811 13946 tablet_bootstrap.cc:492] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235: Bootstrap starting.
I20260709 13:16:58.035779 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06" is_pre_election: true
I20260709 13:16:58.036396 13832 raft_consensus.cc:2468] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 0.
I20260709 13:16:58.037631 13870 leader_election.cc:304] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, 49ad832dd3d64a25ac65354295648e05; no voters: 
I20260709 13:16:58.038530 13979 raft_consensus.cc:2804] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.039045 13979 raft_consensus.cc:493] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.039525 13979 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.039913 13946 tablet_bootstrap.cc:654] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.041033 13971 leader_election.cc:290] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.042135 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05" is_pre_election: true
I20260709 13:16:58.042574 13951 raft_consensus.cc:515] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.043747 13757 raft_consensus.cc:2393] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 49ad832dd3d64a25ac65354295648e05 in current term 1: Already voted for candidate c7128c1761044ba58dfe7531f93da235 in this term.
I20260709 13:16:58.048660 13948 tablet_bootstrap.cc:492] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05: No bootstrap required, opened a new log
I20260709 13:16:58.049214 13948 ts_tablet_manager.cc:1403] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.014s
I20260709 13:16:58.050109 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:16:58.050729 13832 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.051682 13905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:58.051859 13948 raft_consensus.cc:359] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.055627 13979 raft_consensus.cc:515] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.056842 13906 raft_consensus.cc:2393] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7128c1761044ba58dfe7531f93da235 in current term 1: Already voted for candidate 49ad832dd3d64a25ac65354295648e05 in this term.
I20260709 13:16:58.058399 13947 tablet_bootstrap.cc:492] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06: No bootstrap required, opened a new log
I20260709 13:16:58.058485 13951 leader_election.cc:290] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.052604 13948 raft_consensus.cc:385] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.060348 13948 raft_consensus.cc:740] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.059931 13947 ts_tablet_manager.cc:1403] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.015s
I20260709 13:16:58.060811 13832 raft_consensus.cc:2468] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 1.
I20260709 13:16:58.061170 13948 consensus_queue.cc:260] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.062194 13721 leader_election.cc:304] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 49ad832dd3d64a25ac65354295648e05
I20260709 13:16:58.063308 13951 raft_consensus.cc:2804] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.063504 13946 tablet_bootstrap.cc:492] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235: No bootstrap required, opened a new log
I20260709 13:16:58.063442 13947 raft_consensus.cc:359] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.064065 13946 ts_tablet_manager.cc:1403] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.018s
I20260709 13:16:58.064018 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:16:58.064210 13947 raft_consensus.cc:385] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.064693 13947 raft_consensus.cc:740] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.065925 13948 ts_tablet_manager.cc:1434] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:16:58.065482 13947 consensus_queue.cc:260] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.067747 13979 leader_election.cc:290] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:58.067698 13946 raft_consensus.cc:359] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.066793 13948 tablet_bootstrap.cc:492] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05: Bootstrap starting.
I20260709 13:16:58.068423 13946 raft_consensus.cc:385] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.068377 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:16:58.068872 13946 raft_consensus.cc:740] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.069360 13831 raft_consensus.cc:2393] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 49ad832dd3d64a25ac65354295648e05 in current term 1: Already voted for candidate c7128c1761044ba58dfe7531f93da235 in this term.
I20260709 13:16:58.069608 13946 consensus_queue.cc:260] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.071794 13946 ts_tablet_manager.cc:1434] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:58.064487 13951 raft_consensus.cc:697] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:16:58.073094 13951 consensus_queue.cc:237] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.073668 13947 ts_tablet_manager.cc:1434] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:58.074596 13948 tablet_bootstrap.cc:654] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.081005 13953 raft_consensus.cc:493] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.081473 13953 raft_consensus.cc:515] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.084013 13953 leader_election.cc:290] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.086920 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235" is_pre_election: true
I20260709 13:16:58.087749 13757 raft_consensus.cc:2393] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24afb6f58d504d819c22d3239ab94c06 in current term 1: Already voted for candidate 49ad832dd3d64a25ac65354295648e05 in this term.
I20260709 13:16:58.088768 13870 leader_election.cc:304] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05; no voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235
I20260709 13:16:58.089270 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05" is_pre_election: true
I20260709 13:16:58.089726 13979 raft_consensus.cc:2749] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:58.090549 13797 leader_election.cc:304] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06; no voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235
I20260709 13:16:58.091130 13953 raft_consensus.cc:3060] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.090953 13654 catalog_manager.cc:5697] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.092826 13951 raft_consensus.cc:493] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.093294 13951 raft_consensus.cc:515] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.095254 13948 tablet_bootstrap.cc:492] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05: No bootstrap required, opened a new log
I20260709 13:16:58.095752 13948 ts_tablet_manager.cc:1403] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.004s
I20260709 13:16:58.096314 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877659d20e9b42b8a363489846fa8f35" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06" is_pre_election: true
I20260709 13:16:58.096912 13832 raft_consensus.cc:2468] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 0.
I20260709 13:16:58.097043 13953 raft_consensus.cc:2749] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:58.098039 13721 leader_election.cc:304] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.098553 13971 raft_consensus.cc:493] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.098932 13968 raft_consensus.cc:2804] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.099040 13971 raft_consensus.cc:515] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.099334 13968 raft_consensus.cc:493] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.099875 13968 raft_consensus.cc:3060] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.099334 13948 raft_consensus.cc:359] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.100342 13948 raft_consensus.cc:385] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.100979 13948 raft_consensus.cc:740] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.101141 13971 leader_election.cc:290] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.101676 13953 raft_consensus.cc:493] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.101900 13948 consensus_queue.cc:260] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.102145 13953 raft_consensus.cc:515] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.102947 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4537142385245879562f9b303458356" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05" is_pre_election: true
I20260709 13:16:58.103550 13906 raft_consensus.cc:2468] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 0.
I20260709 13:16:58.104512 13948 ts_tablet_manager.cc:1434] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:58.104514 13953 leader_election.cc:290] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.104696 13722 leader_election.cc:304] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.105897 13971 raft_consensus.cc:2804] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.106230 13971 raft_consensus.cc:493] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.106560 13971 raft_consensus.cc:3060] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.107813 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4537142385245879562f9b303458356" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06" is_pre_election: true
I20260709 13:16:58.108422 13832 raft_consensus.cc:2468] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 0.
I20260709 13:16:58.110535 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235" is_pre_election: true
I20260709 13:16:58.111133 13757 raft_consensus.cc:2468] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 0.
I20260709 13:16:58.112350 13971 raft_consensus.cc:515] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.110538 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05" is_pre_election: true
I20260709 13:16:58.114391 13796 leader_election.cc:304] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.114584 13971 leader_election.cc:290] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.114687 13906 raft_consensus.cc:2468] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 0.
I20260709 13:16:58.115214 13953 raft_consensus.cc:2804] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.115567 13953 raft_consensus.cc:493] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.115885 13953 raft_consensus.cc:3060] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.115845 13905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4537142385245879562f9b303458356" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:58.116537 13905 raft_consensus.cc:3060] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.117271 13951 leader_election.cc:290] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.118351 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877659d20e9b42b8a363489846fa8f35" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05" is_pre_election: true
I20260709 13:16:58.118938 13906 raft_consensus.cc:2468] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 0.
I20260709 13:16:58.120366 13968 raft_consensus.cc:515] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.121253 13953 raft_consensus.cc:515] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.122423 13968 leader_election.cc:290] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.123303 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4537142385245879562f9b303458356" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:16:58.123328 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877659d20e9b42b8a363489846fa8f35" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:16:58.123960 13832 raft_consensus.cc:3060] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.124284 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877659d20e9b42b8a363489846fa8f35" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:58.124851 13906 raft_consensus.cc:3060] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.125069 13953 leader_election.cc:290] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.126173 13904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:58.126644 13904 raft_consensus.cc:3060] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.124393 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:16:58.123983 13831 raft_consensus.cc:3060] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.130097 13757 raft_consensus.cc:3060] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.131590 13904 raft_consensus.cc:2468] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 1.
I20260709 13:16:58.131670 13906 raft_consensus.cc:2468] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 1.
I20260709 13:16:58.132856 13797 leader_election.cc:304] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, 49ad832dd3d64a25ac65354295648e05; no voters: 
I20260709 13:16:58.133888 13953 raft_consensus.cc:2804] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.134572 13722 leader_election.cc:304] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.135483 13968 raft_consensus.cc:2804] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.136070 13831 raft_consensus.cc:2468] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 1.
I20260709 13:16:58.136837 13968 raft_consensus.cc:697] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:16:58.137735 13968 consensus_queue.cc:237] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.139118 13905 raft_consensus.cc:2468] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 1.
I20260709 13:16:58.140584 13722 leader_election.cc:304] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.141312 13953 raft_consensus.cc:697] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 1 LEADER]: Becoming Leader. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Running, Role: LEADER
I20260709 13:16:58.141445 13951 raft_consensus.cc:2804] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.142124 13951 raft_consensus.cc:697] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:16:58.142421 13953 consensus_queue.cc:237] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.143188 13951 consensus_queue.cc:237] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.145318 13757 raft_consensus.cc:2468] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 1.
I20260709 13:16:58.151892 13832 raft_consensus.cc:2468] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 1.
I20260709 13:16:58.151561 13654 catalog_manager.cc:5697] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "24afb6f58d504d819c22d3239ab94c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.156774 13652 catalog_manager.cc:5697] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.169194 13652 catalog_manager.cc:5697] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.193816 13979 raft_consensus.cc:493] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.194315 13979 raft_consensus.cc:515] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.196044 13979 leader_election.cc:290] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:58.196787 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b8146a2778341f3a8cfd96b3282b848" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235" is_pre_election: true
I20260709 13:16:58.197081 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b8146a2778341f3a8cfd96b3282b848" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06" is_pre_election: true
I20260709 13:16:58.197424 13757 raft_consensus.cc:2468] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 0.
I20260709 13:16:58.197639 13832 raft_consensus.cc:2468] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 0.
I20260709 13:16:58.198503 13870 leader_election.cc:304] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.199285 13979 raft_consensus.cc:2804] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.199656 13979 raft_consensus.cc:493] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.199930 13979 raft_consensus.cc:3060] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.204602 13979 raft_consensus.cc:515] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.206107 13979 leader_election.cc:290] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:58.206943 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b8146a2778341f3a8cfd96b3282b848" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:16:58.207427 13757 raft_consensus.cc:3060] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.207278 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b8146a2778341f3a8cfd96b3282b848" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:16:58.207846 13832 raft_consensus.cc:3060] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.211817 13757 raft_consensus.cc:2468] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 1.
I20260709 13:16:58.212428 13953 raft_consensus.cc:493] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.213178 13832 raft_consensus.cc:2468] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 1.
I20260709 13:16:58.212965 13953 raft_consensus.cc:515] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.213678 13905 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.213949 13870 leader_election.cc:304] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.214911 13979 raft_consensus.cc:2804] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.215469 13979 raft_consensus.cc:697] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Becoming Leader. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:16:58.216650 13904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0bc847b22441a3a256d44723664001" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ad832dd3d64a25ac65354295648e05" is_pre_election: true
I20260709 13:16:58.216413 13979 consensus_queue.cc:237] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.215294 13953 leader_election.cc:290] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.216881 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0bc847b22441a3a256d44723664001" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7128c1761044ba58dfe7531f93da235" is_pre_election: true
I20260709 13:16:58.218743 13757 raft_consensus.cc:2393] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24afb6f58d504d819c22d3239ab94c06 in current term 1: Already voted for candidate 49ad832dd3d64a25ac65354295648e05 in this term.
I20260709 13:16:58.219759 13796 leader_election.cc:304] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06; no voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235
I20260709 13:16:58.220932 13953 raft_consensus.cc:3060] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.223918 13968 consensus_queue.cc:1048] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.226733 13953 raft_consensus.cc:2749] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:58.226254 13652 catalog_manager.cc:5697] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49ad832dd3d64a25ac65354295648e05 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "49ad832dd3d64a25ac65354295648e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.236115 13971 consensus_queue.cc:1048] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.285056 13979 consensus_queue.cc:1048] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.296229 13981 consensus_queue.cc:1048] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.325348 13971 consensus_queue.cc:1048] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.338620 13971 consensus_queue.cc:1048] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.348848 13832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e"
dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
mode: GRACEFUL
new_leader_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:35924
I20260709 13:16:58.349511 13832 raft_consensus.cc:606] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 1 LEADER]: Received request to transfer leadership to TS c7128c1761044ba58dfe7531f93da235
I20260709 13:16:58.351100 13981 consensus_queue.cc:1048] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.369729 13905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592"
dest_uuid: "49ad832dd3d64a25ac65354295648e05"
mode: GRACEFUL
new_leader_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:57366
I20260709 13:16:58.370386 13905 raft_consensus.cc:606] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Received request to transfer leadership to TS c7128c1761044ba58dfe7531f93da235
I20260709 13:16:58.377135 13955 consensus_queue.cc:1048] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.383234 13905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f0bc847b22441a3a256d44723664001"
dest_uuid: "49ad832dd3d64a25ac65354295648e05"
mode: GRACEFUL
new_leader_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:57366
I20260709 13:16:58.383853 13905 raft_consensus.cc:606] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Received request to transfer leadership to TS 24afb6f58d504d819c22d3239ab94c06
I20260709 13:16:58.387516 13979 raft_consensus.cc:993] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05: : Instructing follower 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:16:58.387949 13979 raft_consensus.cc:1081] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Signalling peer 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:16:58.389392 13832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f0bc847b22441a3a256d44723664001"
dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:35910
I20260709 13:16:58.389305 13905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871"
dest_uuid: "49ad832dd3d64a25ac65354295648e05"
mode: GRACEFUL
new_leader_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:57366
I20260709 13:16:58.389959 13832 raft_consensus.cc:493] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:58.390220 13832 raft_consensus.cc:3060] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.390084 13905 raft_consensus.cc:606] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Received request to transfer leadership to TS 24afb6f58d504d819c22d3239ab94c06
I20260709 13:16:58.395015 13832 raft_consensus.cc:515] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.397696 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0bc847b22441a3a256d44723664001" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:16:58.398263 13757 raft_consensus.cc:3060] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.399297 13905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0bc847b22441a3a256d44723664001" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:58.399827 13905 raft_consensus.cc:3055] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.400139 13905 raft_consensus.cc:740] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:16:58.400884 13905 consensus_queue.cc:260] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.401993 13905 raft_consensus.cc:3060] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.404975 13757 raft_consensus.cc:2468] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 2.
I20260709 13:16:58.406111 13796 leader_election.cc:304] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.406877 13953 raft_consensus.cc:2804] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.407311 13953 raft_consensus.cc:697] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Becoming Leader. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Running, Role: LEADER
I20260709 13:16:58.407927 13832 leader_election.cc:290] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 2 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.408087 13953 consensus_queue.cc:237] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.409484 13905 raft_consensus.cc:2468] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 2.
I20260709 13:16:58.412204 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4537142385245879562f9b303458356"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
mode: GRACEFUL
new_leader_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:46068
I20260709 13:16:58.412809 13757 raft_consensus.cc:606] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Received request to transfer leadership to TS 24afb6f58d504d819c22d3239ab94c06
I20260709 13:16:58.416456 13655 catalog_manager.cc:5697] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 reported cstate change: term changed from 1 to 2, leader changed from 49ad832dd3d64a25ac65354295648e05 (127.12.208.131) to 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "24afb6f58d504d819c22d3239ab94c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.418538 13905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b8146a2778341f3a8cfd96b3282b848"
dest_uuid: "49ad832dd3d64a25ac65354295648e05"
mode: GRACEFUL
new_leader_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:57366
I20260709 13:16:58.419176 13905 raft_consensus.cc:606] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Received request to transfer leadership to TS 24afb6f58d504d819c22d3239ab94c06
I20260709 13:16:58.424652 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "877659d20e9b42b8a363489846fa8f35"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
mode: GRACEFUL
new_leader_uuid: "49ad832dd3d64a25ac65354295648e05"
 from {username='slave'} at 127.0.0.1:46068
I20260709 13:16:58.425117 13757 raft_consensus.cc:606] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Received request to transfer leadership to TS 49ad832dd3d64a25ac65354295648e05
I20260709 13:16:58.504060 13971 consensus_queue.cc:1048] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.514987 13971 consensus_queue.cc:1048] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.549211 13955 consensus_queue.cc:1048] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.560747 13981 consensus_queue.cc:1048] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.569131 13981 raft_consensus.cc:993] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05: : Instructing follower 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:16:58.569607 13955 raft_consensus.cc:1081] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Signalling peer 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:16:58.571229 13832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871"
dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:35910
I20260709 13:16:58.571681 13832 raft_consensus.cc:493] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:58.572002 13832 raft_consensus.cc:3060] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.577171 13832 raft_consensus.cc:515] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.579303 13832 leader_election.cc:290] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 2 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.580264 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:16:58.580876 13757 raft_consensus.cc:3060] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.586179 13905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:58.586877 13905 raft_consensus.cc:3055] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.587234 13905 raft_consensus.cc:740] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:16:58.587996 13757 raft_consensus.cc:2468] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 2.
I20260709 13:16:58.588125 13905 consensus_queue.cc:260] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.589195 13796 leader_election.cc:304] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.589555 13905 raft_consensus.cc:3060] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.590102 13953 raft_consensus.cc:2804] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.590497 13953 raft_consensus.cc:697] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Becoming Leader. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Running, Role: LEADER
I20260709 13:16:58.591248 13953 consensus_queue.cc:237] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.595845 13905 raft_consensus.cc:2468] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 2.
I20260709 13:16:58.597690 13652 catalog_manager.cc:5697] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 reported cstate change: term changed from 1 to 2, leader changed from 49ad832dd3d64a25ac65354295648e05 (127.12.208.131) to 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "24afb6f58d504d819c22d3239ab94c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.602646 13971 consensus_queue.cc:1048] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.605381 13955 consensus_queue.cc:1048] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:58.615471 13968 consensus_queue.cc:1048] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:58.625569 13979 consensus_queue.cc:1048] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.628756 13951 raft_consensus.cc:993] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235: : Instructing follower 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:16:58.629205 13951 raft_consensus.cc:1081] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Signalling peer 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:16:58.630774 13831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4537142385245879562f9b303458356"
dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:35904
I20260709 13:16:58.631588 13831 raft_consensus.cc:493] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:58.631412 13953 consensus_queue.cc:1048] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:58.632045 13831 raft_consensus.cc:3060] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.639086 13979 raft_consensus.cc:993] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05: : Instructing follower 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:16:58.639544 13955 raft_consensus.cc:1081] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Signalling peer 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:16:58.641414 13832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b8146a2778341f3a8cfd96b3282b848"
dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:35910
I20260709 13:16:58.642031 13832 raft_consensus.cc:493] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:58.642485 13832 raft_consensus.cc:3060] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.642030 13831 raft_consensus.cc:515] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.646579 13831 leader_election.cc:290] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 2 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.647902 13905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4537142385245879562f9b303458356" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:58.648434 13905 raft_consensus.cc:3060] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.650982 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4537142385245879562f9b303458356" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:16:58.651569 13757 raft_consensus.cc:3055] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.651901 13757 raft_consensus.cc:740] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:16:58.650669 13832 raft_consensus.cc:515] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.652724 13757 consensus_queue.cc:260] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.654896 13905 raft_consensus.cc:2468] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 2.
I20260709 13:16:58.656872 13757 raft_consensus.cc:3060] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.658272 13797 leader_election.cc:304] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, 49ad832dd3d64a25ac65354295648e05; no voters: 
I20260709 13:16:58.659137 13832 leader_election.cc:290] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 2 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.659746 13953 raft_consensus.cc:2804] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.661250 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b8146a2778341f3a8cfd96b3282b848" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:58.661863 13906 raft_consensus.cc:3055] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.662189 13906 raft_consensus.cc:740] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:16:58.663110 13906 consensus_queue.cc:260] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.664458 13906 raft_consensus.cc:3060] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.666178 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b8146a2778341f3a8cfd96b3282b848" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:16:58.666877 13755 raft_consensus.cc:3060] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.675107 13953 raft_consensus.cc:697] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Becoming Leader. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Running, Role: LEADER
I20260709 13:16:58.676081 13968 consensus_queue.cc:1048] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.680876 13757 raft_consensus.cc:2468] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 2.
I20260709 13:16:58.682972 13906 raft_consensus.cc:2468] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 2.
I20260709 13:16:58.684708 13755 raft_consensus.cc:2468] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 2.
I20260709 13:16:58.677152 13953 consensus_queue.cc:237] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.685845 13796 leader_election.cc:304] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.686721 14003 raft_consensus.cc:2804] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.687186 14003 raft_consensus.cc:697] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Becoming Leader. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Running, Role: LEADER
I20260709 13:16:58.687908 14003 consensus_queue.cc:237] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.682291 14033 consensus_queue.cc:1048] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:16:58.703058 13654 catalog_manager.cc:5697] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 reported cstate change: term changed from 1 to 2, leader changed from c7128c1761044ba58dfe7531f93da235 (127.12.208.129) to 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "24afb6f58d504d819c22d3239ab94c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.704530 13968 consensus_queue.cc:1048] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:58.704941 13654 catalog_manager.cc:5697] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 reported cstate change: term changed from 1 to 2, leader changed from 49ad832dd3d64a25ac65354295648e05 (127.12.208.131) to 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "24afb6f58d504d819c22d3239ab94c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.708238 13953 raft_consensus.cc:993] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06: : Instructing follower c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:16:58.708750 14003 raft_consensus.cc:1081] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 1 LEADER]: Signalling peer c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:16:58.710875 13755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:46048
I20260709 13:16:58.711397 13755 raft_consensus.cc:493] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:58.711759 13755 raft_consensus.cc:3060] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.713502 13968 raft_consensus.cc:993] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235: : Instructing follower 49ad832dd3d64a25ac65354295648e05 to start an election
I20260709 13:16:58.713963 13968 raft_consensus.cc:1081] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Signalling peer 49ad832dd3d64a25ac65354295648e05 to start an election
I20260709 13:16:58.715593 13904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "877659d20e9b42b8a363489846fa8f35"
dest_uuid: "49ad832dd3d64a25ac65354295648e05"
 from {username='slave'} at 127.0.0.1:57340
I20260709 13:16:58.716166 13904 raft_consensus.cc:493] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:58.716602 13904 raft_consensus.cc:3060] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.718820 13755 raft_consensus.cc:515] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.721946 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:16:58.722731 13832 raft_consensus.cc:3055] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.723232 13832 raft_consensus.cc:740] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Running, Role: LEADER
I20260709 13:16:58.723693 13904 raft_consensus.cc:515] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.724172 13832 consensus_queue.cc:260] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.727140 13904 leader_election.cc:290] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 2 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:16:58.726814 13832 raft_consensus.cc:3060] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.727803 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877659d20e9b42b8a363489846fa8f35" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:16:58.728204 13831 raft_consensus.cc:3060] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.730274 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877659d20e9b42b8a363489846fa8f35" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:16:58.730849 13757 raft_consensus.cc:3055] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.731169 13757 raft_consensus.cc:740] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:16:58.731936 13757 consensus_queue.cc:260] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.733150 13757 raft_consensus.cc:3060] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.733557 13832 raft_consensus.cc:2468] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 2.
I20260709 13:16:58.734197 13831 raft_consensus.cc:2468] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 2.
I20260709 13:16:58.734828 13721 leader_election.cc:304] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.735826 13951 raft_consensus.cc:2804] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.736343 13951 raft_consensus.cc:697] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 2 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:16:58.739337 13757 raft_consensus.cc:2468] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 2.
I20260709 13:16:58.739779 13870 leader_election.cc:304] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, 49ad832dd3d64a25ac65354295648e05; no voters: 
I20260709 13:16:58.737237 13951 consensus_queue.cc:237] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.741287 13979 raft_consensus.cc:2804] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.741863 13979 raft_consensus.cc:697] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Becoming Leader. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:16:58.742767 13979 consensus_queue.cc:237] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.745668 13755 leader_election.cc:290] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 2 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.748303 13655 catalog_manager.cc:5697] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 1 to 2, leader changed from 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130) to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.748908 13904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:58.749594 13904 raft_consensus.cc:3060] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.750223 13652 catalog_manager.cc:5697] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 reported cstate change: term changed from 1 to 2, leader changed from c7128c1761044ba58dfe7531f93da235 (127.12.208.129) to 49ad832dd3d64a25ac65354295648e05 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "49ad832dd3d64a25ac65354295648e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.756142 13979 raft_consensus.cc:993] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05: : Instructing follower c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:16:58.756616 13955 raft_consensus.cc:1081] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Signalling peer c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:16:58.758890 13904 raft_consensus.cc:2468] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 2.
I20260709 13:16:58.760551 13755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:46052
I20260709 13:16:58.761113 13755 raft_consensus.cc:493] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:58.761440 13755 raft_consensus.cc:3060] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.766189 13755 raft_consensus.cc:515] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.768190 13755 leader_election.cc:290] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 2 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:16:58.769032 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:16:58.769244 13904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:16:58.769589 13832 raft_consensus.cc:3060] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.769816 13904 raft_consensus.cc:3055] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:58.770146 13904 raft_consensus.cc:740] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:16:58.771117 13904 consensus_queue.cc:260] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.773205 13904 raft_consensus.cc:3060] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:58.776073 13832 raft_consensus.cc:2468] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 2.
I20260709 13:16:58.777207 13721 leader_election.cc:304] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:16:58.777930 13951 raft_consensus.cc:2804] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:58.778366 13951 raft_consensus.cc:697] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 2 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:16:58.779193 13951 consensus_queue.cc:237] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:16:58.780372 13904 raft_consensus.cc:2468] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 2.
I20260709 13:16:58.785565 13652 catalog_manager.cc:5697] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 1 to 2, leader changed from 49ad832dd3d64a25ac65354295648e05 (127.12.208.131) to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.816672 13904 raft_consensus.cc:1275] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.818210 13953 consensus_queue.cc:1048] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.825853 13755 raft_consensus.cc:1275] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.827756 14033 consensus_queue.cc:1048] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:58.994773 13904 raft_consensus.cc:1275] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:58.995945 14033 consensus_queue.cc:1048] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.003141 13755 raft_consensus.cc:1275] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.004794 14033 consensus_queue.cc:1048] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.075126 13904 raft_consensus.cc:1275] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.076439 14033 consensus_queue.cc:1048] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.084632 13755 raft_consensus.cc:1275] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.086300 14033 consensus_queue.cc:1048] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.114756 13904 raft_consensus.cc:1275] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.116117 14033 consensus_queue.cc:1048] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.123960 13755 raft_consensus.cc:1275] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.126159 14033 consensus_queue.cc:1048] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.150815 13755 raft_consensus.cc:1275] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Refusing update from remote peer 49ad832dd3d64a25ac65354295648e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.152146 13979 consensus_queue.cc:1048] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.159610 13832 raft_consensus.cc:1275] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Refusing update from remote peer 49ad832dd3d64a25ac65354295648e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.161274 13955 consensus_queue.cc:1048] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.219375 13904 raft_consensus.cc:1275] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.220719 13951 consensus_queue.cc:1048] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.221669 13832 raft_consensus.cc:1275] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.222949 13951 consensus_queue.cc:1048] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.306516 13904 raft_consensus.cc:1275] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.307775 13968 consensus_queue.cc:1048] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:59.315961 13831 raft_consensus.cc:1275] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:59.317258 13971 consensus_queue.cc:1048] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:01.454229 13122 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:17:01.454998 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:01.471617 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
mode: GRACEFUL
new_leader_uuid: "49ad832dd3d64a25ac65354295648e05"
 from {username='slave'} at 127.0.0.1:46076
I20260709 13:17:01.472092 13755 raft_consensus.cc:606] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Received request to transfer leadership to TS 49ad832dd3d64a25ac65354295648e05
I20260709 13:17:01.474416 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
mode: GRACEFUL
new_leader_uuid: "49ad832dd3d64a25ac65354295648e05"
 from {username='slave'} at 127.0.0.1:46076
I20260709 13:17:01.474802 13755 raft_consensus.cc:606] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Received request to transfer leadership to TS 49ad832dd3d64a25ac65354295648e05
I20260709 13:17:01.475701 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:01.476068 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:01.655169 13968 raft_consensus.cc:993] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235: : Instructing follower 49ad832dd3d64a25ac65354295648e05 to start an election
I20260709 13:17:01.655761 14038 raft_consensus.cc:1081] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Signalling peer 49ad832dd3d64a25ac65354295648e05 to start an election
I20260709 13:17:01.657451 13906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a"
dest_uuid: "49ad832dd3d64a25ac65354295648e05"
 from {username='slave'} at 127.0.0.1:57340
I20260709 13:17:01.658057 13906 raft_consensus.cc:493] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:01.658396 13906 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.663553 13906 raft_consensus.cc:515] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:01.665154 13906 leader_election.cc:290] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 2 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:17:01.666170 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:17:01.666438 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:17:01.666790 13755 raft_consensus.cc:3055] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:01.666985 13831 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.667284 13755 raft_consensus.cc:740] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:17:01.668200 13755 consensus_queue.cc:260] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:01.669415 13755 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.674006 13831 raft_consensus.cc:2468] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 2.
I20260709 13:17:01.675312 13870 leader_election.cc:304] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, 49ad832dd3d64a25ac65354295648e05; no voters: 
I20260709 13:17:01.676100 13955 raft_consensus.cc:2804] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:01.676476 13755 raft_consensus.cc:2468] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 2.
I20260709 13:17:01.677259 13955 raft_consensus.cc:697] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Becoming Leader. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:17:01.678431 13955 consensus_queue.cc:237] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:01.684914 13654 catalog_manager.cc:5697] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 reported cstate change: term changed from 1 to 2, leader changed from c7128c1761044ba58dfe7531f93da235 (127.12.208.129) to 49ad832dd3d64a25ac65354295648e05 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "49ad832dd3d64a25ac65354295648e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:01.869521 13968 raft_consensus.cc:993] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235: : Instructing follower 49ad832dd3d64a25ac65354295648e05 to start an election
I20260709 13:17:01.870038 14038 raft_consensus.cc:1081] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Signalling peer 49ad832dd3d64a25ac65354295648e05 to start an election
I20260709 13:17:01.871469 13906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5"
dest_uuid: "49ad832dd3d64a25ac65354295648e05"
 from {username='slave'} at 127.0.0.1:57340
I20260709 13:17:01.871924 13906 raft_consensus.cc:493] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:01.872215 13906 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.876706 13906 raft_consensus.cc:515] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:01.878588 13906 leader_election.cc:290] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 2 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:17:01.879413 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:17:01.879657 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:17:01.880020 13755 raft_consensus.cc:3055] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:01.880251 13831 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.880369 13755 raft_consensus.cc:740] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:17:01.881219 13755 consensus_queue.cc:260] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:01.882128 13755 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:01.885344 13831 raft_consensus.cc:2468] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 2.
I20260709 13:17:01.886482 13870 leader_election.cc:304] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, 49ad832dd3d64a25ac65354295648e05; no voters: 
I20260709 13:17:01.886684 13755 raft_consensus.cc:2468] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 2.
I20260709 13:17:01.887204 13955 raft_consensus.cc:2804] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:01.887707 13955 raft_consensus.cc:697] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Becoming Leader. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:17:01.888429 13955 consensus_queue.cc:237] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:01.895027 13654 catalog_manager.cc:5697] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 reported cstate change: term changed from 1 to 2, leader changed from c7128c1761044ba58dfe7531f93da235 (127.12.208.129) to 49ad832dd3d64a25ac65354295648e05 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "49ad832dd3d64a25ac65354295648e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:02.108806 13755 raft_consensus.cc:1275] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Refusing update from remote peer 49ad832dd3d64a25ac65354295648e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.110021 13955 consensus_queue.cc:1048] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.119598 13831 raft_consensus.cc:1275] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Refusing update from remote peer 49ad832dd3d64a25ac65354295648e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.123302 13955 consensus_queue.cc:1048] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.343250 13831 raft_consensus.cc:1275] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Refusing update from remote peer 49ad832dd3d64a25ac65354295648e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.344633 13955 consensus_queue.cc:1048] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.353915 13755 raft_consensus.cc:1275] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Refusing update from remote peer 49ad832dd3d64a25ac65354295648e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:02.355561 14050 consensus_queue.cc:1048] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.476897 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:02.492266 13904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a"
dest_uuid: "49ad832dd3d64a25ac65354295648e05"
mode: GRACEFUL
new_leader_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:57366
I20260709 13:17:02.492749 13904 raft_consensus.cc:606] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Received request to transfer leadership to TS c7128c1761044ba58dfe7531f93da235
I20260709 13:17:02.501013 13904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5"
dest_uuid: "49ad832dd3d64a25ac65354295648e05"
mode: GRACEFUL
new_leader_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:57366
I20260709 13:17:02.501508 13904 raft_consensus.cc:606] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Received request to transfer leadership to TS c7128c1761044ba58dfe7531f93da235
I20260709 13:17:02.506186 13831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f0bc847b22441a3a256d44723664001"
dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
mode: GRACEFUL
new_leader_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:35924
I20260709 13:17:02.506801 13831 raft_consensus.cc:606] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Received request to transfer leadership to TS c7128c1761044ba58dfe7531f93da235
I20260709 13:17:02.511292 13831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871"
dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
mode: GRACEFUL
new_leader_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:35924
I20260709 13:17:02.511761 13831 raft_consensus.cc:606] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Received request to transfer leadership to TS c7128c1761044ba58dfe7531f93da235
I20260709 13:17:02.516110 13831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4537142385245879562f9b303458356"
dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
mode: GRACEFUL
new_leader_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:35924
I20260709 13:17:02.516621 13831 raft_consensus.cc:606] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Received request to transfer leadership to TS c7128c1761044ba58dfe7531f93da235
I20260709 13:17:02.692619 13955 raft_consensus.cc:993] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05: : Instructing follower c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:17:02.693085 14041 raft_consensus.cc:1081] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Signalling peer c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:17:02.694594 13755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:46052
I20260709 13:17:02.695228 13755 raft_consensus.cc:493] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:02.695688 13755 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.701297 13755 raft_consensus.cc:515] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:02.703377 13755 leader_election.cc:290] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 3 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:17:02.704151 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:17:02.704560 13904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:17:02.704720 13831 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.705049 13904 raft_consensus.cc:3055] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:02.705312 13904 raft_consensus.cc:740] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:17:02.706003 13904 consensus_queue.cc:260] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:02.706847 13904 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.709736 13831 raft_consensus.cc:2468] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 3.
I20260709 13:17:02.710861 13721 leader_election.cc:304] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:17:02.711632 14038 raft_consensus.cc:2804] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:02.711836 13904 raft_consensus.cc:2468] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 3.
I20260709 13:17:02.712680 14038 raft_consensus.cc:697] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:17:02.713469 14038 consensus_queue.cc:237] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:02.719089 13655 catalog_manager.cc:5697] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 2 to 3, leader changed from 49ad832dd3d64a25ac65354295648e05 (127.12.208.131) to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.721788 14003 raft_consensus.cc:993] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06: : Instructing follower c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:17:02.722258 14057 raft_consensus.cc:1081] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Signalling peer c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:17:02.723768 13755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f0bc847b22441a3a256d44723664001"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:46048
I20260709 13:17:02.724272 13755 raft_consensus.cc:493] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:02.724572 13755 raft_consensus.cc:3060] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.730562 13755 raft_consensus.cc:515] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:02.732211 13755 leader_election.cc:290] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 3 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:17:02.732975 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0bc847b22441a3a256d44723664001" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:17:02.733470 13831 raft_consensus.cc:3055] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:02.733470 13904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0bc847b22441a3a256d44723664001" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:17:02.733857 13831 raft_consensus.cc:740] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Running, Role: LEADER
I20260709 13:17:02.734122 13904 raft_consensus.cc:3060] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.734608 13831 consensus_queue.cc:260] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:02.735688 13831 raft_consensus.cc:3060] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.740514 13904 raft_consensus.cc:2468] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 3.
I20260709 13:17:02.741639 13722 leader_election.cc:304] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:17:02.741958 13831 raft_consensus.cc:2468] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 3.
I20260709 13:17:02.742383 14038 raft_consensus.cc:2804] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:02.742841 14038 raft_consensus.cc:697] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:17:02.743645 14038 consensus_queue.cc:237] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:02.746978 14041 raft_consensus.cc:993] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05: : Instructing follower c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:17:02.747380 14041 raft_consensus.cc:1081] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Signalling peer c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:17:02.749253 13755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:46052
I20260709 13:17:02.749846 13755 raft_consensus.cc:493] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:02.750217 13755 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.752213 13655 catalog_manager.cc:5697] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 2 to 3, leader changed from 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130) to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.756433 13755 raft_consensus.cc:515] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:02.758896 13755 leader_election.cc:290] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 3 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:17:02.759840 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:17:02.760082 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:17:02.760391 13906 raft_consensus.cc:3055] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:02.760653 13831 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.760725 13906 raft_consensus.cc:740] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:17:02.761539 13906 consensus_queue.cc:260] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:02.762495 13906 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:02.766043 13831 raft_consensus.cc:2468] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 3.
I20260709 13:17:02.767067 13721 leader_election.cc:304] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:17:02.767877 14056 raft_consensus.cc:2804] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:02.767864 13906 raft_consensus.cc:2468] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 3.
I20260709 13:17:02.768491 14056 raft_consensus.cc:697] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:17:02.769348 14056 consensus_queue.cc:237] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:02.775094 13655 catalog_manager.cc:5697] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 2 to 3, leader changed from 49ad832dd3d64a25ac65354295648e05 (127.12.208.131) to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.010771 14003 raft_consensus.cc:993] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06: : Instructing follower c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:17:03.011217 14057 raft_consensus.cc:1081] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Signalling peer c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:17:03.012679 13755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4537142385245879562f9b303458356"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:46048
I20260709 13:17:03.013147 13755 raft_consensus.cc:493] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:03.013432 13755 raft_consensus.cc:3060] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.017537 13755 raft_consensus.cc:515] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:03.019047 13755 leader_election.cc:290] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 3 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:17:03.020052 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4537142385245879562f9b303458356" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:17:03.020099 13904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4537142385245879562f9b303458356" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:17:03.020650 13831 raft_consensus.cc:3055] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:03.020789 13904 raft_consensus.cc:3060] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.021049 13831 raft_consensus.cc:740] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Running, Role: LEADER
I20260709 13:17:03.021940 13831 consensus_queue.cc:260] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:03.022950 13831 raft_consensus.cc:3060] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.027063 13904 raft_consensus.cc:2468] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 3.
I20260709 13:17:03.027891 13831 raft_consensus.cc:2468] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 3.
I20260709 13:17:03.028124 13722 leader_election.cc:304] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:17:03.028980 14038 raft_consensus.cc:2804] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:03.029577 14038 raft_consensus.cc:697] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:17:03.030905 14038 consensus_queue.cc:237] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:03.037379 13655 catalog_manager.cc:5697] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 2 to 3, leader changed from 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130) to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.077422 14003 raft_consensus.cc:993] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06: : Instructing follower c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:17:03.077847 14057 raft_consensus.cc:1081] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Signalling peer c7128c1761044ba58dfe7531f93da235 to start an election
I20260709 13:17:03.079149 13755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
 from {username='slave'} at 127.0.0.1:46048
I20260709 13:17:03.079540 13755 raft_consensus.cc:493] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:03.079759 13755 raft_consensus.cc:3060] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.083683 13755 raft_consensus.cc:515] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:03.085003 13755 leader_election.cc:290] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 3 election: Requested vote from peers 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:17:03.085886 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:17:03.086025 13904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc4a9f307b540eb803978e9f254f871" candidate_uuid: "c7128c1761044ba58dfe7531f93da235" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:17:03.086355 13831 raft_consensus.cc:3055] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:03.086544 13904 raft_consensus.cc:3060] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.086707 13831 raft_consensus.cc:740] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Running, Role: LEADER
I20260709 13:17:03.087440 13831 consensus_queue.cc:260] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:03.088297 13831 raft_consensus.cc:3060] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:03.091496 13904 raft_consensus.cc:2468] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 3.
I20260709 13:17:03.092568 13831 raft_consensus.cc:2468] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7128c1761044ba58dfe7531f93da235 in term 3.
I20260709 13:17:03.092476 13722 leader_election.cc:304] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ad832dd3d64a25ac65354295648e05, c7128c1761044ba58dfe7531f93da235; no voters: 
I20260709 13:17:03.093204 13904 raft_consensus.cc:1275] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.093358 14038 raft_consensus.cc:2804] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:03.093897 14038 raft_consensus.cc:697] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Becoming Leader. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:17:03.094552 14056 consensus_queue.cc:1048] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.094658 14038 consensus_queue.cc:237] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:03.103176 13831 raft_consensus.cc:1275] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.102873 13654 catalog_manager.cc:5697] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 reported cstate change: term changed from 2 to 3, leader changed from 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130) to c7128c1761044ba58dfe7531f93da235 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "c7128c1761044ba58dfe7531f93da235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.104641 14038 consensus_queue.cc:1048] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.204156 13904 raft_consensus.cc:1275] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.204569 13906 raft_consensus.cc:1275] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.205463 14038 consensus_queue.cc:1048] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.205735 14062 consensus_queue.cc:1048] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.219178 13831 raft_consensus.cc:1275] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.222725 13831 raft_consensus.cc:1275] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.222744 14038 consensus_queue.cc:1048] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:03.224606 14062 consensus_queue.cc:1048] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.485224 13906 raft_consensus.cc:1275] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.486478 14038 consensus_queue.cc:1048] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.495498 13832 raft_consensus.cc:1275] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.496058 13904 raft_consensus.cc:1275] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.496922 14056 consensus_queue.cc:1048] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.498806 14056 consensus_queue.cc:1048] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.511736 13832 raft_consensus.cc:1275] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Refusing update from remote peer c7128c1761044ba58dfe7531f93da235: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:03.513085 14038 consensus_queue.cc:1048] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:05.523408 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:05.533140 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
mode: GRACEFUL
new_leader_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:46076
I20260709 13:17:05.534082 13755 raft_consensus.cc:606] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 2 LEADER]: Received request to transfer leadership to TS 24afb6f58d504d819c22d3239ab94c06
I20260709 13:17:05.537134 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
mode: GRACEFUL
new_leader_uuid: "49ad832dd3d64a25ac65354295648e05"
 from {username='slave'} at 127.0.0.1:46076
I20260709 13:17:05.537627 13755 raft_consensus.cc:606] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Received request to transfer leadership to TS 49ad832dd3d64a25ac65354295648e05
I20260709 13:17:05.539775 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
mode: GRACEFUL
new_leader_uuid: "49ad832dd3d64a25ac65354295648e05"
 from {username='slave'} at 127.0.0.1:46076
I20260709 13:17:05.540192 13755 raft_consensus.cc:606] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 2 LEADER]: Received request to transfer leadership to TS 49ad832dd3d64a25ac65354295648e05
I20260709 13:17:05.542307 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a"
dest_uuid: "c7128c1761044ba58dfe7531f93da235"
mode: GRACEFUL
new_leader_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:46076
I20260709 13:17:05.542738 13755 raft_consensus.cc:606] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Received request to transfer leadership to TS 24afb6f58d504d819c22d3239ab94c06
I20260709 13:17:05.543666 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:05.544103 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:05.570461 14076 raft_consensus.cc:993] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235: : Instructing follower 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:17:05.571038 14075 raft_consensus.cc:1081] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Signalling peer 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:17:05.572575 13832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a"
dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:35904
I20260709 13:17:05.573074 13832 raft_consensus.cc:493] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:05.573421 13832 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:05.578313 13832 raft_consensus.cc:515] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:05.580021 13832 leader_election.cc:290] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 4 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:17:05.581189 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:17:05.581090 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7624c5814a472d9dc090a75287175a" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:17:05.581789 13906 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:05.581880 13755 raft_consensus.cc:3055] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:05.582239 13755 raft_consensus.cc:740] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:17:05.582939 13755 consensus_queue.cc:260] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:05.583884 13755 raft_consensus.cc:3060] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:05.587106 13906 raft_consensus.cc:2468] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 4.
I20260709 13:17:05.588361 13797 leader_election.cc:304] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, 49ad832dd3d64a25ac65354295648e05; no voters: 
I20260709 13:17:05.589437 14057 raft_consensus.cc:2804] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:05.589617 13755 raft_consensus.cc:2468] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 4.
I20260709 13:17:05.590615 14057 raft_consensus.cc:697] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 4 LEADER]: Becoming Leader. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Running, Role: LEADER
I20260709 13:17:05.591743 14057 consensus_queue.cc:237] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:05.595494 14062 raft_consensus.cc:993] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235: : Instructing follower 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:17:05.595929 14075 raft_consensus.cc:1081] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 2 LEADER]: Signalling peer 24afb6f58d504d819c22d3239ab94c06 to start an election
I20260709 13:17:05.597458 13832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592"
dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
 from {username='slave'} at 127.0.0.1:35904
I20260709 13:17:05.597900 13832 raft_consensus.cc:493] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:05.598243 13832 raft_consensus.cc:3060] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:05.600412 13652 catalog_manager.cc:5697] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 reported cstate change: term changed from 3 to 4, leader changed from c7128c1761044ba58dfe7531f93da235 (127.12.208.129) to 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130). New cstate: current_term: 4 leader_uuid: "24afb6f58d504d819c22d3239ab94c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:05.604506 13832 raft_consensus.cc:515] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:05.606557 13832 leader_election.cc:290] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 3 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 49ad832dd3d64a25ac65354295648e05 (127.12.208.131:35797)
I20260709 13:17:05.606948 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:17:05.607157 13906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1345ebd6694bce8f588e01d2458592" candidate_uuid: "24afb6f58d504d819c22d3239ab94c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49ad832dd3d64a25ac65354295648e05"
I20260709 13:17:05.607692 13906 raft_consensus.cc:3060] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:05.607652 13755 raft_consensus.cc:3055] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:05.608328 13755 raft_consensus.cc:740] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:17:05.609138 13755 consensus_queue.cc:260] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:05.610087 13755 raft_consensus.cc:3060] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:05.614089 13906 raft_consensus.cc:2468] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 3.
I20260709 13:17:05.615267 13797 leader_election.cc:304] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, 49ad832dd3d64a25ac65354295648e05; no voters: 
I20260709 13:17:05.616119 14057 raft_consensus.cc:2804] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:05.616062 13755 raft_consensus.cc:2468] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24afb6f58d504d819c22d3239ab94c06 in term 3.
I20260709 13:17:05.616688 14057 raft_consensus.cc:697] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 3 LEADER]: Becoming Leader. State: Replica: 24afb6f58d504d819c22d3239ab94c06, State: Running, Role: LEADER
I20260709 13:17:05.617882 14057 consensus_queue.cc:237] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:05.624897 13652 catalog_manager.cc:5697] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 reported cstate change: term changed from 2 to 3, leader changed from c7128c1761044ba58dfe7531f93da235 (127.12.208.129) to 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130). New cstate: current_term: 3 leader_uuid: "24afb6f58d504d819c22d3239ab94c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:05.794507 14075 raft_consensus.cc:993] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235: : Instructing follower 49ad832dd3d64a25ac65354295648e05 to start an election
I20260709 13:17:05.794991 14062 raft_consensus.cc:1081] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 2 LEADER]: Signalling peer 49ad832dd3d64a25ac65354295648e05 to start an election
I20260709 13:17:05.796375 13906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e"
dest_uuid: "49ad832dd3d64a25ac65354295648e05"
 from {username='slave'} at 127.0.0.1:57340
I20260709 13:17:05.796867 13906 raft_consensus.cc:493] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:05.797178 13906 raft_consensus.cc:3060] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:05.802256 13906 raft_consensus.cc:515] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:05.803799 13906 leader_election.cc:290] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 3 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:17:05.804638 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:17:05.805086 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb5f612c0c644b1b3c249f6a0358a1e" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:17:05.805226 13755 raft_consensus.cc:3055] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:05.805591 13755 raft_consensus.cc:740] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:17:05.805609 13832 raft_consensus.cc:3060] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:05.806444 13755 consensus_queue.cc:260] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:05.807332 13755 raft_consensus.cc:3060] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:05.809759 13832 raft_consensus.cc:2468] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 3.
I20260709 13:17:05.810885 13870 leader_election.cc:304] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, 49ad832dd3d64a25ac65354295648e05; no voters: 
I20260709 13:17:05.811673 13955 raft_consensus.cc:2804] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:05.811787 13755 raft_consensus.cc:2468] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 3.
I20260709 13:17:05.813179 13955 raft_consensus.cc:697] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 3 LEADER]: Becoming Leader. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:17:05.814109 13955 consensus_queue.cc:237] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:05.821584 13652 catalog_manager.cc:5697] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 reported cstate change: term changed from 2 to 3, leader changed from c7128c1761044ba58dfe7531f93da235 (127.12.208.129) to 49ad832dd3d64a25ac65354295648e05 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "49ad832dd3d64a25ac65354295648e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.046955 13755 raft_consensus.cc:1275] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 4 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:06.048235 14057 consensus_queue.cc:1048] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:06.058624 13906 raft_consensus.cc:1275] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 4 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:06.060549 14077 consensus_queue.cc:1048] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:06.126994 14062 raft_consensus.cc:993] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235: : Instructing follower 49ad832dd3d64a25ac65354295648e05 to start an election
I20260709 13:17:06.127665 14062 raft_consensus.cc:1081] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Signalling peer 49ad832dd3d64a25ac65354295648e05 to start an election
I20260709 13:17:06.129194 13906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5"
dest_uuid: "49ad832dd3d64a25ac65354295648e05"
 from {username='slave'} at 127.0.0.1:57340
I20260709 13:17:06.129706 13906 raft_consensus.cc:493] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:06.130044 13906 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:06.134723 13906 raft_consensus.cc:515] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:06.136219 13906 leader_election.cc:290] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 4 election: Requested vote from peers c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835), 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785)
I20260709 13:17:06.137019 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c7128c1761044ba58dfe7531f93da235"
I20260709 13:17:06.137259 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d401f338ca64ac8b0830262c8460cc5" candidate_uuid: "49ad832dd3d64a25ac65354295648e05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "24afb6f58d504d819c22d3239ab94c06"
I20260709 13:17:06.137517 13755 raft_consensus.cc:3055] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:06.137907 13832 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:06.137910 13755 raft_consensus.cc:740] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7128c1761044ba58dfe7531f93da235, State: Running, Role: LEADER
I20260709 13:17:06.138787 13755 consensus_queue.cc:260] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:06.139657 13755 raft_consensus.cc:3060] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:06.142551 13832 raft_consensus.cc:2468] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 4.
I20260709 13:17:06.143769 13870 leader_election.cc:304] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24afb6f58d504d819c22d3239ab94c06, 49ad832dd3d64a25ac65354295648e05; no voters: 
I20260709 13:17:06.144192 13755 raft_consensus.cc:2468] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ad832dd3d64a25ac65354295648e05 in term 4.
I20260709 13:17:06.144718 13955 raft_consensus.cc:2804] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:06.145241 13955 raft_consensus.cc:697] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 4 LEADER]: Becoming Leader. State: Replica: 49ad832dd3d64a25ac65354295648e05, State: Running, Role: LEADER
I20260709 13:17:06.146186 13955 consensus_queue.cc:237] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } }
I20260709 13:17:06.153831 13655 catalog_manager.cc:5697] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 reported cstate change: term changed from 3 to 4, leader changed from c7128c1761044ba58dfe7531f93da235 (127.12.208.129) to 49ad832dd3d64a25ac65354295648e05 (127.12.208.131). New cstate: current_term: 4 leader_uuid: "49ad832dd3d64a25ac65354295648e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.188408 13906 raft_consensus.cc:1275] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:06.190026 14077 consensus_queue.cc:1048] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ad832dd3d64a25ac65354295648e05" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:06.196481 13832 raft_consensus.cc:1275] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Refusing update from remote peer 49ad832dd3d64a25ac65354295648e05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:06.198081 13955 consensus_queue.cc:1048] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:06.200235 13755 raft_consensus.cc:1275] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Refusing update from remote peer 24afb6f58d504d819c22d3239ab94c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:06.202925 14077 consensus_queue.cc:1048] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:06.213165 13757 raft_consensus.cc:1275] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Refusing update from remote peer 49ad832dd3d64a25ac65354295648e05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:06.216056 14084 consensus_queue.cc:1048] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7128c1761044ba58dfe7531f93da235" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:06.544893 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:06.550747 13122 tablet_server.cc:179] TabletServer@127.12.208.129:0 shutting down...
I20260709 13:17:06.558223 13832 raft_consensus.cc:1275] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 4 FOLLOWER]: Refusing update from remote peer 49ad832dd3d64a25ac65354295648e05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:06.559962 14084 consensus_queue.cc:1048] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24afb6f58d504d819c22d3239ab94c06" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:06.584972 13870 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 13:17:06.603307 13870 consensus_peers.cc:597] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 -> Peer c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835): Couldn't send request to peer c7128c1761044ba58dfe7531f93da235. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:06.606530 13870 consensus_peers.cc:597] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 -> Peer c7128c1761044ba58dfe7531f93da235 (127.12.208.129:38835): Couldn't send request to peer c7128c1761044ba58dfe7531f93da235. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.611290 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:06.612116 13122 tablet_replica.cc:333] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235: stopping tablet replica
I20260709 13:17:06.612782 13122 raft_consensus.cc:2243] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.613273 13122 raft_consensus.cc:2272] T 3b8146a2778341f3a8cfd96b3282b848 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.615239 13122 tablet_replica.cc:333] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235: stopping tablet replica
I20260709 13:17:06.615804 13122 raft_consensus.cc:2243] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.616289 13122 raft_consensus.cc:2272] T 877659d20e9b42b8a363489846fa8f35 P c7128c1761044ba58dfe7531f93da235 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.618268 13122 tablet_replica.cc:333] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235: stopping tablet replica
I20260709 13:17:06.618901 13122 raft_consensus.cc:2243] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.619313 13122 raft_consensus.cc:2272] T 9d401f338ca64ac8b0830262c8460cc5 P c7128c1761044ba58dfe7531f93da235 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.620991 13122 tablet_replica.cc:333] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235: stopping tablet replica
I20260709 13:17:06.621580 13122 raft_consensus.cc:2243] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.622500 13122 raft_consensus.cc:2272] T bcc4a9f307b540eb803978e9f254f871 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.624401 13122 tablet_replica.cc:333] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235: stopping tablet replica
I20260709 13:17:06.624956 13122 raft_consensus.cc:2243] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.625715 13122 raft_consensus.cc:2272] T 9f0bc847b22441a3a256d44723664001 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.627475 13122 tablet_replica.cc:333] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235: stopping tablet replica
I20260709 13:17:06.627966 13122 raft_consensus.cc:2243] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.628685 13122 raft_consensus.cc:2272] T b4537142385245879562f9b303458356 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.630514 13122 tablet_replica.cc:333] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235: stopping tablet replica
I20260709 13:17:06.631094 13122 raft_consensus.cc:2243] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.631573 13122 raft_consensus.cc:2272] T ff7624c5814a472d9dc090a75287175a P c7128c1761044ba58dfe7531f93da235 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.634053 13122 tablet_replica.cc:333] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235: stopping tablet replica
I20260709 13:17:06.634579 13122 raft_consensus.cc:2243] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.635001 13122 raft_consensus.cc:2272] T 1f1345ebd6694bce8f588e01d2458592 P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.637123 13122 tablet_replica.cc:333] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235: stopping tablet replica
I20260709 13:17:06.637629 13122 raft_consensus.cc:2243] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.638051 13122 raft_consensus.cc:2272] T cdb5f612c0c644b1b3c249f6a0358a1e P c7128c1761044ba58dfe7531f93da235 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.640033 13122 tablet_replica.cc:333] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235: stopping tablet replica
I20260709 13:17:06.640465 13122 raft_consensus.cc:2243] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.641153 13122 raft_consensus.cc:2272] T 9ca7733dfd634180bf3f2e16db53d421 P c7128c1761044ba58dfe7531f93da235 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.670200 13122 tablet_server.cc:196] TabletServer@127.12.208.129:0 shutdown complete.
I20260709 13:17:06.688975 13122 tablet_server.cc:179] TabletServer@127.12.208.130:0 shutting down...
W20260709 13:17:06.693742 13870 consensus_peers.cc:597] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 -> Peer 24afb6f58d504d819c22d3239ab94c06 (127.12.208.130:39785): Couldn't send request to peer 24afb6f58d504d819c22d3239ab94c06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:06.716142 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:06.716979 13122 tablet_replica.cc:333] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06: stopping tablet replica
I20260709 13:17:06.717563 13122 raft_consensus.cc:2243] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.718058 13122 raft_consensus.cc:2272] T 877659d20e9b42b8a363489846fa8f35 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.719868 13122 tablet_replica.cc:333] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06: stopping tablet replica
I20260709 13:17:06.720397 13122 raft_consensus.cc:2243] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.721061 13122 raft_consensus.cc:2272] T 3b8146a2778341f3a8cfd96b3282b848 P 24afb6f58d504d819c22d3239ab94c06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.723086 13122 tablet_replica.cc:333] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06: stopping tablet replica
I20260709 13:17:06.723588 13122 raft_consensus.cc:2243] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.724028 13122 raft_consensus.cc:2272] T 9d401f338ca64ac8b0830262c8460cc5 P 24afb6f58d504d819c22d3239ab94c06 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.727617 13122 tablet_replica.cc:333] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06: stopping tablet replica
I20260709 13:17:06.728250 13122 raft_consensus.cc:2243] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.728798 13122 raft_consensus.cc:2272] T 9ca7733dfd634180bf3f2e16db53d421 P 24afb6f58d504d819c22d3239ab94c06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.730613 13122 tablet_replica.cc:333] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06: stopping tablet replica
I20260709 13:17:06.731176 13122 raft_consensus.cc:2243] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.731637 13122 raft_consensus.cc:2272] T b4537142385245879562f9b303458356 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.733621 13122 tablet_replica.cc:333] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06: stopping tablet replica
I20260709 13:17:06.734172 13122 raft_consensus.cc:2243] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.734611 13122 raft_consensus.cc:2272] T 9f0bc847b22441a3a256d44723664001 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.736424 13122 tablet_replica.cc:333] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06: stopping tablet replica
I20260709 13:17:06.737197 13122 raft_consensus.cc:2243] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.737720 13122 raft_consensus.cc:2272] T bcc4a9f307b540eb803978e9f254f871 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.739893 13122 tablet_replica.cc:333] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06: stopping tablet replica
I20260709 13:17:06.740422 13122 raft_consensus.cc:2243] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.740875 13122 raft_consensus.cc:2272] T cdb5f612c0c644b1b3c249f6a0358a1e P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.743556 13122 tablet_replica.cc:333] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06: stopping tablet replica
I20260709 13:17:06.744053 13122 raft_consensus.cc:2243] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.744817 13122 raft_consensus.cc:2272] T 1f1345ebd6694bce8f588e01d2458592 P 24afb6f58d504d819c22d3239ab94c06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.746789 13122 tablet_replica.cc:333] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06: stopping tablet replica
I20260709 13:17:06.747221 13122 raft_consensus.cc:2243] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.747861 13122 raft_consensus.cc:2272] T ff7624c5814a472d9dc090a75287175a P 24afb6f58d504d819c22d3239ab94c06 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.777987 13122 tablet_server.cc:196] TabletServer@127.12.208.130:0 shutdown complete.
I20260709 13:17:06.796077 13122 tablet_server.cc:179] TabletServer@127.12.208.131:0 shutting down...
I20260709 13:17:06.817610 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:06.818380 13122 tablet_replica.cc:333] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05: stopping tablet replica
I20260709 13:17:06.819159 13122 raft_consensus.cc:2243] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.819759 13122 raft_consensus.cc:2272] T b4537142385245879562f9b303458356 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.821491 13122 tablet_replica.cc:333] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05: stopping tablet replica
I20260709 13:17:06.822093 13122 raft_consensus.cc:2243] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.822564 13122 raft_consensus.cc:2272] T 3b8146a2778341f3a8cfd96b3282b848 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.824283 13122 tablet_replica.cc:333] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05: stopping tablet replica
I20260709 13:17:06.824770 13122 raft_consensus.cc:2243] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.825505 13122 raft_consensus.cc:2272] T cdb5f612c0c644b1b3c249f6a0358a1e P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.827469 13122 tablet_replica.cc:333] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05: stopping tablet replica
I20260709 13:17:06.827957 13122 raft_consensus.cc:2243] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.828687 13122 raft_consensus.cc:2272] T 877659d20e9b42b8a363489846fa8f35 P 49ad832dd3d64a25ac65354295648e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.830355 13122 tablet_replica.cc:333] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05: stopping tablet replica
I20260709 13:17:06.830838 13122 raft_consensus.cc:2243] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.831287 13122 raft_consensus.cc:2272] T 9f0bc847b22441a3a256d44723664001 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.832823 13122 tablet_replica.cc:333] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05: stopping tablet replica
I20260709 13:17:06.833289 13122 raft_consensus.cc:2243] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.833731 13122 raft_consensus.cc:2272] T bcc4a9f307b540eb803978e9f254f871 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.835322 13122 tablet_replica.cc:333] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05: stopping tablet replica
I20260709 13:17:06.835788 13122 raft_consensus.cc:2243] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.836490 13122 raft_consensus.cc:2272] T 9d401f338ca64ac8b0830262c8460cc5 P 49ad832dd3d64a25ac65354295648e05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.839066 13122 tablet_replica.cc:333] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05: stopping tablet replica
I20260709 13:17:06.839613 13122 raft_consensus.cc:2243] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.840034 13122 raft_consensus.cc:2272] T ff7624c5814a472d9dc090a75287175a P 49ad832dd3d64a25ac65354295648e05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.841955 13122 tablet_replica.cc:333] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05: stopping tablet replica
I20260709 13:17:06.842386 13122 raft_consensus.cc:2243] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.842819 13122 raft_consensus.cc:2272] T 1f1345ebd6694bce8f588e01d2458592 P 49ad832dd3d64a25ac65354295648e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.844792 13122 tablet_replica.cc:333] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05: stopping tablet replica
I20260709 13:17:06.845227 13122 raft_consensus.cc:2243] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.845650 13122 raft_consensus.cc:2272] T 9ca7733dfd634180bf3f2e16db53d421 P 49ad832dd3d64a25ac65354295648e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.874185 13122 tablet_server.cc:196] TabletServer@127.12.208.131:0 shutdown complete.
I20260709 13:17:06.894265 13122 master.cc:562] Master@127.12.208.190:36509 shutting down...
I20260709 13:17:06.918260 13122 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:06.918859 13122 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.919211 13122 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6706317fcb8c4e74b11856c440aa8086: stopping tablet replica
I20260709 13:17:06.939713 13122 master.cc:584] Master@127.12.208.190:36509 shutdown complete.
24afb6f58d504d819c22d3239ab94c06  4
49ad832dd3d64a25ac65354295648e05  1
c7128c1761044ba58dfe7531f93da235  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10349 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:17:06.979991 13122 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.208.190:37027
I20260709 13:17:06.981261 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:06.987845 14103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:06.987931 14102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:06.989151 13122 server_base.cc:1061] running on GCE node
W20260709 13:17:06.989100 14105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:06.990484 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:06.990681 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:06.990813 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603026990800 us; error 0 us; skew 500 ppm
I20260709 13:17:06.991291 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:06.993854 13122 webserver.cc:533] Webserver started at http://127.12.208.190:43369/ using document root <none> and password file <none>
I20260709 13:17:06.994341 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:06.994518 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:06.994752 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:06.995895 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/master-0-root/instance:
uuid: "2510e400b67647c7923cee16a251d2de"
format_stamp: "Formatted at 2026-07-09 13:17:06 on dist-test-slave-ll1f"
I20260709 13:17:07.000516 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:17:07.004091 14110 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:07.004944 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:07.005264 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/master-0-root
uuid: "2510e400b67647c7923cee16a251d2de"
format_stamp: "Formatted at 2026-07-09 13:17:06 on dist-test-slave-ll1f"
I20260709 13:17:07.005549 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:07.032199 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:07.033488 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:07.072464 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.190:37027
I20260709 13:17:07.072593 14161 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.190:37027 every 8 connection(s)
I20260709 13:17:07.076298 14162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.086143 14162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Bootstrap starting.
I20260709 13:17:07.090765 14162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:07.094924 14162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: No bootstrap required, opened a new log
I20260709 13:17:07.096935 14162 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510e400b67647c7923cee16a251d2de" member_type: VOTER }
I20260709 13:17:07.097297 14162 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:07.097585 14162 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2510e400b67647c7923cee16a251d2de, State: Initialized, Role: FOLLOWER
I20260709 13:17:07.098282 14162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510e400b67647c7923cee16a251d2de" member_type: VOTER }
I20260709 13:17:07.098762 14162 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:07.098986 14162 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:07.099283 14162 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:07.103703 14162 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510e400b67647c7923cee16a251d2de" member_type: VOTER }
I20260709 13:17:07.104244 14162 leader_election.cc:304] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2510e400b67647c7923cee16a251d2de; no voters: 
I20260709 13:17:07.105368 14162 leader_election.cc:290] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:07.105926 14165 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:07.107288 14165 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [term 1 LEADER]: Becoming Leader. State: Replica: 2510e400b67647c7923cee16a251d2de, State: Running, Role: LEADER
I20260709 13:17:07.107985 14165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510e400b67647c7923cee16a251d2de" member_type: VOTER }
I20260709 13:17:07.108415 14162 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:07.112524 14166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2510e400b67647c7923cee16a251d2de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510e400b67647c7923cee16a251d2de" member_type: VOTER } }
I20260709 13:17:07.113117 14166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:07.114413 14167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2510e400b67647c7923cee16a251d2de. Latest consensus state: current_term: 1 leader_uuid: "2510e400b67647c7923cee16a251d2de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510e400b67647c7923cee16a251d2de" member_type: VOTER } }
I20260709 13:17:07.114966 14167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:07.115165 14172 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:07.120028 14172 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:07.123857 13122 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:07.128562 14172 catalog_manager.cc:1383] Generated new cluster ID: e832f9a0ebb94fb1aad6578fa06008a6
I20260709 13:17:07.128841 14172 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:07.141705 14172 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:07.143015 14172 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:07.159437 14172 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Generated new TSK 0
I20260709 13:17:07.160017 14172 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:07.190796 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:07.196813 14183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:07.197963 14184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:07.199884 14186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:07.200114 13122 server_base.cc:1061] running on GCE node
I20260709 13:17:07.200991 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:07.201215 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:07.201378 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603027201360 us; error 0 us; skew 500 ppm
I20260709 13:17:07.202009 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:07.204144 13122 webserver.cc:533] Webserver started at http://127.12.208.129:39053/ using document root <none> and password file <none>
I20260709 13:17:07.204607 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:07.204806 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:07.205080 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:07.206184 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/instance:
uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
format_stamp: "Formatted at 2026-07-09 13:17:07 on dist-test-slave-ll1f"
I20260709 13:17:07.210561 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:17:07.213984 14191 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:07.214803 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:17:07.215121 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root
uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
format_stamp: "Formatted at 2026-07-09 13:17:07 on dist-test-slave-ll1f"
I20260709 13:17:07.215404 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:07.227557 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:07.228780 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:07.230310 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:07.232468 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:07.232679 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:07.232926 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:07.233124 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:07.274896 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.129:38445
I20260709 13:17:07.275002 14253 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.129:38445 every 8 connection(s)
I20260709 13:17:07.279372 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:07.287039 14258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:07.287518 14259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:07.290071 13122 server_base.cc:1061] running on GCE node
W20260709 13:17:07.290953 14262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:07.291889 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:07.292099 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:07.292295 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603027292282 us; error 0 us; skew 500 ppm
I20260709 13:17:07.292923 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:07.295951 13122 webserver.cc:533] Webserver started at http://127.12.208.130:36103/ using document root <none> and password file <none>
I20260709 13:17:07.296532 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:07.296772 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:07.297055 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:07.297899 14254 heartbeater.cc:344] Connected to a master server at 127.12.208.190:37027
I20260709 13:17:07.298302 14254 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:07.298372 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/instance:
uuid: "bee4f7fc1b4740dc875537c79309664f"
format_stamp: "Formatted at 2026-07-09 13:17:07 on dist-test-slave-ll1f"
I20260709 13:17:07.299197 14254 heartbeater.cc:507] Master 127.12.208.190:37027 requested a full tablet report, sending...
I20260709 13:17:07.301388 14127 ts_manager.cc:194] Registered new tserver with Master: a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:07.303637 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:17:07.303633 14127 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37072
I20260709 13:17:07.307579 14266 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:07.308566 13122 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:17:07.308889 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root
uuid: "bee4f7fc1b4740dc875537c79309664f"
format_stamp: "Formatted at 2026-07-09 13:17:07 on dist-test-slave-ll1f"
I20260709 13:17:07.309146 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:07.328208 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:07.329459 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:07.330987 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:07.333134 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:07.333307 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:07.333583 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:07.333736 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:07.373978 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.130:44127
I20260709 13:17:07.374082 14328 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.130:44127 every 8 connection(s)
I20260709 13:17:07.378700 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:07.386214 14332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:07.386618 14333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:07.389868 13122 server_base.cc:1061] running on GCE node
W20260709 13:17:07.390617 14335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:07.391698 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:07.391822 14329 heartbeater.cc:344] Connected to a master server at 127.12.208.190:37027
W20260709 13:17:07.391988 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:07.392218 14329 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:07.392202 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603027392184 us; error 0 us; skew 500 ppm
I20260709 13:17:07.393142 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:07.393241 14329 heartbeater.cc:507] Master 127.12.208.190:37027 requested a full tablet report, sending...
I20260709 13:17:07.395509 14127 ts_manager.cc:194] Registered new tserver with Master: bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:07.395792 13122 webserver.cc:533] Webserver started at http://127.12.208.131:33251/ using document root <none> and password file <none>
I20260709 13:17:07.396366 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:07.396559 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:07.396849 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:07.397037 14127 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37080
I20260709 13:17:07.398149 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/instance:
uuid: "181bbac22422408c87cd13b7fe3008f9"
format_stamp: "Formatted at 2026-07-09 13:17:07 on dist-test-slave-ll1f"
I20260709 13:17:07.402616 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:17:07.406069 14340 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:07.406937 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:17:07.407239 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root
uuid: "181bbac22422408c87cd13b7fe3008f9"
format_stamp: "Formatted at 2026-07-09 13:17:07 on dist-test-slave-ll1f"
I20260709 13:17:07.407593 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:07.434697 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:07.435880 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:07.437470 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:07.439693 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:07.439944 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:07.440181 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:07.440354 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:07.479815 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.131:41203
I20260709 13:17:07.479931 14402 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.131:41203 every 8 connection(s)
I20260709 13:17:07.493955 14403 heartbeater.cc:344] Connected to a master server at 127.12.208.190:37027
I20260709 13:17:07.494315 14403 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:07.495038 14403 heartbeater.cc:507] Master 127.12.208.190:37027 requested a full tablet report, sending...
I20260709 13:17:07.496923 14127 ts_manager.cc:194] Registered new tserver with Master: 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:07.497481 13122 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014524705s
I20260709 13:17:07.498656 14127 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37096
I20260709 13:17:07.524953 14127 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37110:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:07.531675 14127 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:07.729995 14367 tablet_service.cc:1511] Processing CreateTablet for tablet bddcf0184f1049499e0383b72e34ef74 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:07.731530 14367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddcf0184f1049499e0383b72e34ef74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.733404 14366 tablet_service.cc:1511] Processing CreateTablet for tablet f286c75a82eb4a2284617cd66deff360 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:07.734797 14366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f286c75a82eb4a2284617cd66deff360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.734962 14368 tablet_service.cc:1511] Processing CreateTablet for tablet 52ca7fe34f2a4185a741b8aebabd8bfc (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:07.736217 14368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ca7fe34f2a4185a741b8aebabd8bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.739073 14364 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:07.740540 14364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.742733 14363 tablet_service.cc:1511] Processing CreateTablet for tablet cde980445ec54bac8c99f8e77669bffa (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:07.744017 14365 tablet_service.cc:1511] Processing CreateTablet for tablet 0694154dd8ad41ad93089be880f2e363 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:07.745899 14294 tablet_service.cc:1511] Processing CreateTablet for tablet 52ca7fe34f2a4185a741b8aebabd8bfc (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:07.747246 14294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ca7fe34f2a4185a741b8aebabd8bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.747613 14362 tablet_service.cc:1511] Processing CreateTablet for tablet 98310add35f94d0685fee6cc0aba55a2 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:07.746304 14363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde980445ec54bac8c99f8e77669bffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.750113 14362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98310add35f94d0685fee6cc0aba55a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.751210 14365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0694154dd8ad41ad93089be880f2e363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.754106 14293 tablet_service.cc:1511] Processing CreateTablet for tablet bddcf0184f1049499e0383b72e34ef74 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:07.755439 14293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddcf0184f1049499e0383b72e34ef74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.759023 14291 tablet_service.cc:1511] Processing CreateTablet for tablet 0694154dd8ad41ad93089be880f2e363 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:07.760416 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0694154dd8ad41ad93089be880f2e363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.760579 14287 tablet_service.cc:1511] Processing CreateTablet for tablet a1479f9f47ee4f9984bc3dae70e66f3a (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:07.761890 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1479f9f47ee4f9984bc3dae70e66f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.762827 14290 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:07.764138 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.766870 14289 tablet_service.cc:1511] Processing CreateTablet for tablet cde980445ec54bac8c99f8e77669bffa (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:07.768229 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde980445ec54bac8c99f8e77669bffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.768016 14361 tablet_service.cc:1511] Processing CreateTablet for tablet a1479f9f47ee4f9984bc3dae70e66f3a (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:07.769311 14361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1479f9f47ee4f9984bc3dae70e66f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.771065 14360 tablet_service.cc:1511] Processing CreateTablet for tablet c38fd596811644f8b5ab0c134b279676 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:07.772364 14360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38fd596811644f8b5ab0c134b279676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.774948 14359 tablet_service.cc:1511] Processing CreateTablet for tablet a24d1f6f6adb4246b65902328e51dfdf (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:07.776247 14359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24d1f6f6adb4246b65902328e51dfdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.766870 14292 tablet_service.cc:1511] Processing CreateTablet for tablet f286c75a82eb4a2284617cd66deff360 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:07.779160 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f286c75a82eb4a2284617cd66deff360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.759023 14288 tablet_service.cc:1511] Processing CreateTablet for tablet 98310add35f94d0685fee6cc0aba55a2 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:07.781286 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98310add35f94d0685fee6cc0aba55a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.811440 14218 tablet_service.cc:1511] Processing CreateTablet for tablet bddcf0184f1049499e0383b72e34ef74 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:07.812878 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddcf0184f1049499e0383b72e34ef74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.814862 14210 tablet_service.cc:1511] Processing CreateTablet for tablet a24d1f6f6adb4246b65902328e51dfdf (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:07.816223 14210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24d1f6f6adb4246b65902328e51dfdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.815794 14219 tablet_service.cc:1511] Processing CreateTablet for tablet 52ca7fe34f2a4185a741b8aebabd8bfc (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:07.818964 14219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ca7fe34f2a4185a741b8aebabd8bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.820549 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 0694154dd8ad41ad93089be880f2e363 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:07.823011 14215 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:07.818645 14217 tablet_service.cc:1511] Processing CreateTablet for tablet f286c75a82eb4a2284617cd66deff360 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:07.824687 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0694154dd8ad41ad93089be880f2e363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.826035 14212 tablet_service.cc:1511] Processing CreateTablet for tablet a1479f9f47ee4f9984bc3dae70e66f3a (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:07.827420 14212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1479f9f47ee4f9984bc3dae70e66f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.830977 14211 tablet_service.cc:1511] Processing CreateTablet for tablet c38fd596811644f8b5ab0c134b279676 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:07.832360 14211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38fd596811644f8b5ab0c134b279676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.832508 14213 tablet_service.cc:1511] Processing CreateTablet for tablet 98310add35f94d0685fee6cc0aba55a2 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:07.835482 14214 tablet_service.cc:1511] Processing CreateTablet for tablet cde980445ec54bac8c99f8e77669bffa (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:07.838124 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.842103 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde980445ec54bac8c99f8e77669bffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.846357 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f286c75a82eb4a2284617cd66deff360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.850139 14213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98310add35f94d0685fee6cc0aba55a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.850797 14361 tablet_service.cc:1511] Processing CreateTablet for tablet 8c137013238f4b1dbae260e32cb316dc (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:07.864763 14418 tablet_bootstrap.cc:492] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:07.865136 14286 tablet_service.cc:1511] Processing CreateTablet for tablet c38fd596811644f8b5ab0c134b279676 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:07.867178 14286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38fd596811644f8b5ab0c134b279676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.871592 14418 tablet_bootstrap.cc:654] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:07.875833 14367 tablet_service.cc:1511] Processing CreateTablet for tablet 99c124265b9c42a5a1adf047554812b4 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:07.877115 14367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c124265b9c42a5a1adf047554812b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.879174 14364 tablet_service.cc:1511] Processing CreateTablet for tablet 76a21260793b426d8f662c772b5b2a03 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:07.895159 14364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a21260793b426d8f662c772b5b2a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.899678 14285 tablet_service.cc:1511] Processing CreateTablet for tablet a24d1f6f6adb4246b65902328e51dfdf (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:07.901453 14285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24d1f6f6adb4246b65902328e51dfdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.924836 14214 tablet_service.cc:1511] Processing CreateTablet for tablet fde6831a789b45549658b2c2146dd650 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:07.926406 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde6831a789b45549658b2c2146dd650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.911528 14359 tablet_service.cc:1511] Processing CreateTablet for tablet b03bb64d471f488094a4e3dd7d934b67 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:07.947216 14359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03bb64d471f488094a4e3dd7d934b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.965711 14366 tablet_service.cc:1511] Processing CreateTablet for tablet 439318510aaf4073b4ca2996d73b9d8e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:07.966842 14294 tablet_service.cc:1511] Processing CreateTablet for tablet 99c124265b9c42a5a1adf047554812b4 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:07.968153 14419 tablet_bootstrap.cc:492] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:07.968369 14294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c124265b9c42a5a1adf047554812b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.975682 14287 tablet_service.cc:1511] Processing CreateTablet for tablet 8c137013238f4b1dbae260e32cb316dc (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:07.991217 14363 tablet_service.cc:1511] Processing CreateTablet for tablet 42c37f8aa458494687312360eddb12a9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:07.957569 14361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c137013238f4b1dbae260e32cb316dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.008167 14289 tablet_service.cc:1511] Processing CreateTablet for tablet 439318510aaf4073b4ca2996d73b9d8e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:08.016541 14363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42c37f8aa458494687312360eddb12a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.020364 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c137013238f4b1dbae260e32cb316dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.028971 14292 tablet_service.cc:1511] Processing CreateTablet for tablet 76a21260793b426d8f662c772b5b2a03 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:08.030084 14418 tablet_bootstrap.cc:492] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:08.030650 14418 ts_tablet_manager.cc:1403] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.166s	user 0.026s	sys 0.021s
I20260709 13:17:08.034031 14418 raft_consensus.cc:359] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.034895 14418 raft_consensus.cc:385] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:08.035285 14418 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:08.036309 14418 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.036844 14211 tablet_service.cc:1511] Processing CreateTablet for tablet 42c37f8aa458494687312360eddb12a9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:08.043524 14364 tablet_service.cc:1511] Processing CreateTablet for tablet fde6831a789b45549658b2c2146dd650 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:08.056880 14419 tablet_bootstrap.cc:654] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:08.057999 14214 tablet_service.cc:1511] Processing CreateTablet for tablet 8c137013238f4b1dbae260e32cb316dc (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:08.058576 14364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde6831a789b45549658b2c2146dd650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.060016 14366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439318510aaf4073b4ca2996d73b9d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.062165 14420 tablet_bootstrap.cc:492] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:08.073418 14291 tablet_service.cc:1511] Processing CreateTablet for tablet 42c37f8aa458494687312360eddb12a9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:08.041586 14288 tablet_service.cc:1511] Processing CreateTablet for tablet b03bb64d471f488094a4e3dd7d934b67 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:08.090752 14211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42c37f8aa458494687312360eddb12a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.091678 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c137013238f4b1dbae260e32cb316dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.090677 14290 tablet_service.cc:1511] Processing CreateTablet for tablet fde6831a789b45549658b2c2146dd650 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:08.107090 14403 heartbeater.cc:499] Master 127.12.208.190:37027 was elected leader, sending a full tablet report...
I20260709 13:17:08.108106 14418 ts_tablet_manager.cc:1434] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.077s	user 0.026s	sys 0.046s
I20260709 13:17:08.109254 14418 tablet_bootstrap.cc:492] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:08.114033 14212 tablet_service.cc:1511] Processing CreateTablet for tablet 99c124265b9c42a5a1adf047554812b4 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:08.115331 14212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c124265b9c42a5a1adf047554812b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:08.119319 14175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:08.121439 14210 tablet_service.cc:1511] Processing CreateTablet for tablet 76a21260793b426d8f662c772b5b2a03 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:08.126471 14210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a21260793b426d8f662c772b5b2a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.126485 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde6831a789b45549658b2c2146dd650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.128397 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42c37f8aa458494687312360eddb12a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.129536 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439318510aaf4073b4ca2996d73b9d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.130132 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a21260793b426d8f662c772b5b2a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.130501 14218 tablet_service.cc:1511] Processing CreateTablet for tablet cab4884dfe6c4e24a9430e2449523d61 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:08.131695 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03bb64d471f488094a4e3dd7d934b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.134156 14219 tablet_service.cc:1511] Processing CreateTablet for tablet 475079f88bce40fea814453c8c4bfaac (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:08.138602 14418 tablet_bootstrap.cc:654] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:08.138265 14359 tablet_service.cc:1511] Processing CreateTablet for tablet cab4884dfe6c4e24a9430e2449523d61 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:08.139194 14366 tablet_service.cc:1511] Processing CreateTablet for tablet 08fd6b58648f4a6ca27b84f4fd829df9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:08.139807 14361 tablet_service.cc:1511] Processing CreateTablet for tablet a4e025a69a5c42f3be03aeed0ac9a998 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:08.150667 14359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab4884dfe6c4e24a9430e2449523d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.150942 14213 tablet_service.cc:1511] Processing CreateTablet for tablet 08fd6b58648f4a6ca27b84f4fd829df9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:08.153117 14368 tablet_service.cc:1511] Processing CreateTablet for tablet c93ab0fd97734540911af5bd148751d5 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:08.154452 14361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e025a69a5c42f3be03aeed0ac9a998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.162315 14366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fd6b58648f4a6ca27b84f4fd829df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.166738 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 439318510aaf4073b4ca2996d73b9d8e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:08.170519 14286 tablet_service.cc:1511] Processing CreateTablet for tablet 475079f88bce40fea814453c8c4bfaac (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:08.171759 14286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475079f88bce40fea814453c8c4bfaac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.140481 14365 tablet_service.cc:1511] Processing CreateTablet for tablet cf286f2db09c4718a255c14e95c7e781 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:08.131717 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab4884dfe6c4e24a9430e2449523d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.175434 14364 tablet_service.cc:1511] Processing CreateTablet for tablet ebe53e62fb464cccbd45d08ede5b5c4e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:08.146323 14217 tablet_service.cc:1511] Processing CreateTablet for tablet b03bb64d471f488094a4e3dd7d934b67 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:08.143067 14294 tablet_service.cc:1511] Processing CreateTablet for tablet cab4884dfe6c4e24a9430e2449523d61 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:08.190623 14294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab4884dfe6c4e24a9430e2449523d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.193408 14292 tablet_service.cc:1511] Processing CreateTablet for tablet cf286f2db09c4718a255c14e95c7e781 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:08.194646 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf286f2db09c4718a255c14e95c7e781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.178306 14368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93ab0fd97734540911af5bd148751d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.184614 14362 tablet_service.cc:1511] Processing CreateTablet for tablet 475079f88bce40fea814453c8c4bfaac (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:08.185580 14418 tablet_bootstrap.cc:492] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:08.186877 14291 tablet_service.cc:1511] Processing CreateTablet for tablet 08fd6b58648f4a6ca27b84f4fd829df9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:08.207495 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fd6b58648f4a6ca27b84f4fd829df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.208528 14288 tablet_service.cc:1511] Processing CreateTablet for tablet a4e025a69a5c42f3be03aeed0ac9a998 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:08.199368 14213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fd6b58648f4a6ca27b84f4fd829df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.210361 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03bb64d471f488094a4e3dd7d934b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.210592 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e025a69a5c42f3be03aeed0ac9a998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.204788 14360 tablet_service.cc:1511] Processing CreateTablet for tablet 78b3fe008c45425b8fd1c2bac8020950 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:08.206130 14289 tablet_service.cc:1511] Processing CreateTablet for tablet ebe53e62fb464cccbd45d08ede5b5c4e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:08.206480 14420 tablet_bootstrap.cc:654] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:08.200198 14215 tablet_service.cc:1511] Processing CreateTablet for tablet a4e025a69a5c42f3be03aeed0ac9a998 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:08.214071 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439318510aaf4073b4ca2996d73b9d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.206619 14210 tablet_service.cc:1511] Processing CreateTablet for tablet cf286f2db09c4718a255c14e95c7e781 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:08.223528 14422 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.226606 14365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf286f2db09c4718a255c14e95c7e781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.227649 14287 tablet_service.cc:1511] Processing CreateTablet for tablet c93ab0fd97734540911af5bd148751d5 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:08.228384 14361 tablet_service.cc:1511] Processing CreateTablet for tablet ca72c82f0b3e4842b7c74a63118d3360 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:08.231660 14293 tablet_service.cc:1511] Processing CreateTablet for tablet 78b3fe008c45425b8fd1c2bac8020950 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:08.233186 14366 tablet_service.cc:1511] Processing CreateTablet for tablet ede0d59e482a4cff952455ca90001863 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:08.235181 14367 tablet_service.cc:1511] Processing CreateTablet for tablet 46b663177bbd4fbdbe452c58cdba8307 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:08.258304 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe53e62fb464cccbd45d08ede5b5c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.258451 14219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475079f88bce40fea814453c8c4bfaac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.241528 14418 ts_tablet_manager.cc:1403] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.002s
I20260709 13:17:08.265288 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93ab0fd97734540911af5bd148751d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.265588 14419 tablet_bootstrap.cc:492] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:08.266086 14419 ts_tablet_manager.cc:1403] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.298s	user 0.013s	sys 0.003s
I20260709 13:17:08.269040 14419 raft_consensus.cc:359] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.274215 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e025a69a5c42f3be03aeed0ac9a998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.254602 14422 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.275604 14212 tablet_service.cc:1511] Processing CreateTablet for tablet c93ab0fd97734540911af5bd148751d5 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:08.276868 14212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93ab0fd97734540911af5bd148751d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.277760 14422 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:08.278998 14210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf286f2db09c4718a255c14e95c7e781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.281713 14285 tablet_service.cc:1511] Processing CreateTablet for tablet ca72c82f0b3e4842b7c74a63118d3360 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:08.269726 14419 raft_consensus.cc:385] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:08.302296 14290 tablet_service.cc:1511] Processing CreateTablet for tablet 46b663177bbd4fbdbe452c58cdba8307 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:08.300913 14419 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:08.306658 14254 heartbeater.cc:499] Master 127.12.208.190:37027 was elected leader, sending a full tablet report...
I20260709 13:17:08.312224 14218 tablet_service.cc:1511] Processing CreateTablet for tablet ca72c82f0b3e4842b7c74a63118d3360 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:08.313500 14362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475079f88bce40fea814453c8c4bfaac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.313750 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca72c82f0b3e4842b7c74a63118d3360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.322093 14367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b663177bbd4fbdbe452c58cdba8307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.325603 14364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe53e62fb464cccbd45d08ede5b5c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.281513 14293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3fe008c45425b8fd1c2bac8020950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.330087 14361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca72c82f0b3e4842b7c74a63118d3360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.329948 14419 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.338248 14285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca72c82f0b3e4842b7c74a63118d3360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.310621 14217 tablet_service.cc:1511] Processing CreateTablet for tablet 78b3fe008c45425b8fd1c2bac8020950 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:08.333150 14360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3fe008c45425b8fd1c2bac8020950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.348178 14359 tablet_service.cc:1511] Processing CreateTablet for tablet cf37326f616a4b18aaaa6c2c405074bf (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:08.342236 14286 tablet_service.cc:1511] Processing CreateTablet for tablet ede0d59e482a4cff952455ca90001863 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:08.355353 14420 tablet_bootstrap.cc:492] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:08.355877 14420 ts_tablet_manager.cc:1403] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.337s	user 0.015s	sys 0.006s
I20260709 13:17:08.356539 14418 raft_consensus.cc:359] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.357304 14418 raft_consensus.cc:385] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:08.357935 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b663177bbd4fbdbe452c58cdba8307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.358592 14420 raft_consensus.cc:359] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.359300 14420 raft_consensus.cc:385] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:08.359592 14420 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:08.360426 14214 tablet_service.cc:1511] Processing CreateTablet for tablet 46b663177bbd4fbdbe452c58cdba8307 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:08.362108 14366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ede0d59e482a4cff952455ca90001863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.367112 14359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf37326f616a4b18aaaa6c2c405074bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.367460 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3fe008c45425b8fd1c2bac8020950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.306658 14213 tablet_service.cc:1511] Processing CreateTablet for tablet ebe53e62fb464cccbd45d08ede5b5c4e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:08.372120 14368 tablet_service.cc:1511] Processing CreateTablet for tablet f80782a117e14a308698329b8639179e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:08.372893 14363 tablet_service.cc:1511] Processing CreateTablet for tablet 65fa0102e1144f94a57015823294e331 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:08.373435 14368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80782a117e14a308698329b8639179e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.374114 14363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fa0102e1144f94a57015823294e331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.374584 14213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe53e62fb464cccbd45d08ede5b5c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.375262 14291 tablet_service.cc:1511] Processing CreateTablet for tablet cf37326f616a4b18aaaa6c2c405074bf (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:08.375907 14294 tablet_service.cc:1511] Processing CreateTablet for tablet f80782a117e14a308698329b8639179e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:08.376483 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf37326f616a4b18aaaa6c2c405074bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.377111 14294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80782a117e14a308698329b8639179e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.357640 14418 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:08.379941 14286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ede0d59e482a4cff952455ca90001863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.381067 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b663177bbd4fbdbe452c58cdba8307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.380722 14418 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.383013 14418 ts_tablet_manager.cc:1434] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.121s	user 0.006s	sys 0.000s
I20260709 13:17:08.384016 14418 tablet_bootstrap.cc:492] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:08.387574 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:08.389199 14344 leader_election.cc:343] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:08.395443 14292 tablet_service.cc:1511] Processing CreateTablet for tablet fa1054f387364ae4b11260c5ab742790 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:08.399497 14329 heartbeater.cc:499] Master 127.12.208.190:37027 was elected leader, sending a full tablet report...
I20260709 13:17:08.416692 14287 tablet_service.cc:1511] Processing CreateTablet for tablet 65fa0102e1144f94a57015823294e331 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:08.420971 14210 tablet_service.cc:1511] Processing CreateTablet for tablet ede0d59e482a4cff952455ca90001863 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:08.422430 14210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ede0d59e482a4cff952455ca90001863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.425400 14289 tablet_service.cc:1511] Processing CreateTablet for tablet 2582e91d201c4063b3eff5158b611448 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:08.438695 14211 tablet_service.cc:1511] Processing CreateTablet for tablet f80782a117e14a308698329b8639179e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:08.417212 14216 tablet_service.cc:1511] Processing CreateTablet for tablet cf37326f616a4b18aaaa6c2c405074bf (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:08.440448 14211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80782a117e14a308698329b8639179e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.441264 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf37326f616a4b18aaaa6c2c405074bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.448283 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fa0102e1144f94a57015823294e331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.449132 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2582e91d201c4063b3eff5158b611448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.419360 14420 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.450978 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1054f387364ae4b11260c5ab742790. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:08.470131 14112 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 58737.4us
I20260709 13:17:08.482753 14419 ts_tablet_manager.cc:1434] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.216s	user 0.013s	sys 0.009s
I20260709 13:17:08.483763 14419 tablet_bootstrap.cc:492] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:08.500559 14429 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.501112 14429 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.495594 14418 tablet_bootstrap.cc:654] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:08.506798 14429 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:08.543450 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:08.545241 14342 leader_election.cc:343] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:08.545732 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:08.546905 14422 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:08.548831 14361 tablet_service.cc:1511] Processing CreateTablet for tablet fa1054f387364ae4b11260c5ab742790 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:08.550140 14361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1054f387364ae4b11260c5ab742790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.550262 14219 tablet_service.cc:1511] Processing CreateTablet for tablet fa1054f387364ae4b11260c5ab742790 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:08.551476 14219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1054f387364ae4b11260c5ab742790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.551760 14364 tablet_service.cc:1511] Processing CreateTablet for tablet 2582e91d201c4063b3eff5158b611448 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:08.552953 14364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2582e91d201c4063b3eff5158b611448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.554106 14288 tablet_service.cc:1511] Processing CreateTablet for tablet 37975f772fc648329a8acae36d33a345 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:08.555310 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37975f772fc648329a8acae36d33a345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.555562 14360 tablet_service.cc:1511] Processing CreateTablet for tablet 402f68d4d3464bffb55e8bd010ec0133 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:08.559190 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:08.560755 14270 leader_election.cc:343] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:08.560770 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 2582e91d201c4063b3eff5158b611448 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:08.562577 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2582e91d201c4063b3eff5158b611448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.497669 14293 tablet_service.cc:1511] Processing CreateTablet for tablet 402f68d4d3464bffb55e8bd010ec0133 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:08.570084 14293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402f68d4d3464bffb55e8bd010ec0133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.582203 14422 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.582845 14422 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.586059 14422 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:08.587070 14215 tablet_service.cc:1511] Processing CreateTablet for tablet 65fa0102e1144f94a57015823294e331 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:08.588050 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:08.588449 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fa0102e1144f94a57015823294e331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.588853 14304 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:08.590394 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:08.591377 14422 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:08.591775 14422 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.592175 14422 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:08.592338 14288 tablet_service.cc:1511] Processing CreateTablet for tablet 2359e4575c5b49208e2395d3f12a7da9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:08.593650 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2359e4575c5b49208e2395d3f12a7da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.599875 14422 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.605211 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 402f68d4d3464bffb55e8bd010ec0133 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:08.611081 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402f68d4d3464bffb55e8bd010ec0133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.624629 14290 tablet_service.cc:1511] Processing CreateTablet for tablet d8db981b8c9a4369a9fa90b9ecf4c80c (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:08.626062 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8db981b8c9a4369a9fa90b9ecf4c80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.626322 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:08.627580 14344 leader_election.cc:343] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:08.628093 14360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402f68d4d3464bffb55e8bd010ec0133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.636096 14420 ts_tablet_manager.cc:1434] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.280s	user 0.008s	sys 0.007s
I20260709 13:17:08.636755 14419 tablet_bootstrap.cc:654] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:08.637224 14420 tablet_bootstrap.cc:492] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:08.638612 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:17:08.639901 14344 leader_election.cc:343] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:08.641633 14212 tablet_service.cc:1511] Processing CreateTablet for tablet 2359e4575c5b49208e2395d3f12a7da9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:08.641996 14210 tablet_service.cc:1511] Processing CreateTablet for tablet d8db981b8c9a4369a9fa90b9ecf4c80c (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:08.650758 14217 tablet_service.cc:1511] Processing CreateTablet for tablet 37975f772fc648329a8acae36d33a345 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:08.651935 14431 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.666039 14431 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.670123 14212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2359e4575c5b49208e2395d3f12a7da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.683511 14418 tablet_bootstrap.cc:492] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:08.684118 14418 ts_tablet_manager.cc:1403] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.300s	user 0.007s	sys 0.010s
I20260709 13:17:08.683034 14365 tablet_service.cc:1511] Processing CreateTablet for tablet 37975f772fc648329a8acae36d33a345 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:08.670320 14431 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:08.691192 14287 tablet_service.cc:1511] Processing CreateTablet for tablet e531770baa044bc49820df7e47c608eb (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:08.692487 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e531770baa044bc49820df7e47c608eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.684530 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37975f772fc648329a8acae36d33a345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.694571 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:08.695101 14304 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:08.693442 14418 raft_consensus.cc:359] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.697830 14418 raft_consensus.cc:385] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:08.698143 14418 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:08.698930 14418 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.706118 14363 tablet_service.cc:1511] Processing CreateTablet for tablet 2359e4575c5b49208e2395d3f12a7da9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:08.708603 14363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2359e4575c5b49208e2395d3f12a7da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.688184 14422 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:08.705080 14420 tablet_bootstrap.cc:654] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:08.722435 14365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37975f772fc648329a8acae36d33a345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.719763 14210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8db981b8c9a4369a9fa90b9ecf4c80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.728786 14213 tablet_service.cc:1511] Processing CreateTablet for tablet e531770baa044bc49820df7e47c608eb (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:08.730718 14366 tablet_service.cc:1511] Processing CreateTablet for tablet d8db981b8c9a4369a9fa90b9ecf4c80c (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:08.731741 14366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8db981b8c9a4369a9fa90b9ecf4c80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.735239 14359 tablet_service.cc:1511] Processing CreateTablet for tablet e531770baa044bc49820df7e47c608eb (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:08.736508 14359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e531770baa044bc49820df7e47c608eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.742244 14213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e531770baa044bc49820df7e47c608eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.743234 14288 tablet_service.cc:1511] Processing CreateTablet for tablet e8fbf1e78cfb4a15820b9812967ec58c (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:08.744568 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8fbf1e78cfb4a15820b9812967ec58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.744995 14361 tablet_service.cc:1511] Processing CreateTablet for tablet 25d39c5ba6de4fbd8f025024428fbd57 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:08.746234 14361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d39c5ba6de4fbd8f025024428fbd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.746017 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 25d39c5ba6de4fbd8f025024428fbd57 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:08.746287 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:08.747206 14378 raft_consensus.cc:2393] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:08.778358 14267 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:08.783846 14290 tablet_service.cc:1511] Processing CreateTablet for tablet 25d39c5ba6de4fbd8f025024428fbd57 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:08.747234 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d39c5ba6de4fbd8f025024428fbd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.785599 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d39c5ba6de4fbd8f025024428fbd57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.799949 14418 ts_tablet_manager.cc:1434] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.113s	user 0.017s	sys 0.013s
I20260709 13:17:08.802961 14418 tablet_bootstrap.cc:492] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:08.804354 14367 tablet_service.cc:1511] Processing CreateTablet for tablet e8fbf1e78cfb4a15820b9812967ec58c (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:08.805671 14367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8fbf1e78cfb4a15820b9812967ec58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.813360 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:08.814498 14304 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:08.814990 14429 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:08.815131 14193 leader_election.cc:343] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:08.821252 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:08.822608 14438 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:08.823164 14438 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:08.824023 14438 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.840221 14293 tablet_service.cc:1511] Processing CreateTablet for tablet 1f44936b303148f4848621766631d925 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:08.833035 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 1f44936b303148f4848621766631d925 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:08.841533 14293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f44936b303148f4848621766631d925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.847819 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f44936b303148f4848621766631d925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.837741 14420 tablet_bootstrap.cc:492] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:08.853682 14420 ts_tablet_manager.cc:1403] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.217s	user 0.003s	sys 0.014s
I20260709 13:17:08.854214 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:08.855612 14192 leader_election.cc:343] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:08.856076 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:08.856810 14431 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:08.856734 14420 raft_consensus.cc:359] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.857532 14420 raft_consensus.cc:385] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:08.858608 14219 tablet_service.cc:1511] Processing CreateTablet for tablet e8fbf1e78cfb4a15820b9812967ec58c (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:08.866837 14219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8fbf1e78cfb4a15820b9812967ec58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.862584 14420 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:08.870430 14419 tablet_bootstrap.cc:492] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:08.870899 14419 ts_tablet_manager.cc:1403] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.387s	user 0.014s	sys 0.006s
I20260709 13:17:08.873133 14126 catalog_manager.cc:5697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:08.875025 14420 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.877130 14420 ts_tablet_manager.cc:1434] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 13:17:08.879290 14420 tablet_bootstrap.cc:492] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:08.878022 14215 tablet_service.cc:1511] Processing CreateTablet for tablet f6ebdaafff10446f814e66697ebf67ef (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:08.873718 14419 raft_consensus.cc:359] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.883744 14419 raft_consensus.cc:385] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:08.884148 14419 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:08.886065 14418 tablet_bootstrap.cc:654] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:08.892745 14287 tablet_service.cc:1511] Processing CreateTablet for tablet f6ebdaafff10446f814e66697ebf67ef (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:08.893680 14364 tablet_service.cc:1511] Processing CreateTablet for tablet f6ebdaafff10446f814e66697ebf67ef (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:08.894212 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ebdaafff10446f814e66697ebf67ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.894954 14364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ebdaafff10446f814e66697ebf67ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.896867 14288 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac406834d504a57b52386e2ae4c5235 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:08.898156 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac406834d504a57b52386e2ae4c5235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.899857 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ebdaafff10446f814e66697ebf67ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.885035 14419 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.903455 14419 ts_tablet_manager.cc:1434] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:17:08.908674 14213 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac406834d504a57b52386e2ae4c5235 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:08.916473 14419 tablet_bootstrap.cc:492] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:08.916579 14213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac406834d504a57b52386e2ae4c5235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.924990 14361 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac406834d504a57b52386e2ae4c5235 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:08.926385 14361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac406834d504a57b52386e2ae4c5235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.933383 14290 tablet_service.cc:1511] Processing CreateTablet for tablet f235d077faa24a89832f2f8f181b0ef1 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:08.934728 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f235d077faa24a89832f2f8f181b0ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.934767 14365 tablet_service.cc:1511] Processing CreateTablet for tablet 1f44936b303148f4848621766631d925 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:08.936188 14365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f44936b303148f4848621766631d925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.940748 14420 tablet_bootstrap.cc:654] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:08.947043 14419 tablet_bootstrap.cc:654] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:08.949352 14218 tablet_service.cc:1511] Processing CreateTablet for tablet f235d077faa24a89832f2f8f181b0ef1 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:08.950642 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f235d077faa24a89832f2f8f181b0ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.955858 14367 tablet_service.cc:1511] Processing CreateTablet for tablet f235d077faa24a89832f2f8f181b0ef1 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:08.957125 14217 tablet_service.cc:1511] Processing CreateTablet for tablet 487d8e21fe1a4de4a365bd3c1f91947b (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:08.957123 14367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f235d077faa24a89832f2f8f181b0ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.958375 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 487d8e21fe1a4de4a365bd3c1f91947b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.962553 14366 tablet_service.cc:1511] Processing CreateTablet for tablet 487d8e21fe1a4de4a365bd3c1f91947b (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:08.962960 14418 tablet_bootstrap.cc:492] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:08.963472 14418 ts_tablet_manager.cc:1403] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.161s	user 0.007s	sys 0.007s
I20260709 13:17:08.963822 14366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 487d8e21fe1a4de4a365bd3c1f91947b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.964905 14288 tablet_service.cc:1511] Processing CreateTablet for tablet 2b16e1f580c44c1f984f63473c6a267d (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:08.966177 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b16e1f580c44c1f984f63473c6a267d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.966419 14418 raft_consensus.cc:359] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.966748 14215 tablet_service.cc:1511] Processing CreateTablet for tablet 2b16e1f580c44c1f984f63473c6a267d (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:08.967180 14418 raft_consensus.cc:385] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:08.967506 14418 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:08.967952 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b16e1f580c44c1f984f63473c6a267d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.968364 14418 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:08.970276 14287 tablet_service.cc:1511] Processing CreateTablet for tablet 487d8e21fe1a4de4a365bd3c1f91947b (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:08.970773 14418 ts_tablet_manager.cc:1434] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:08.971455 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 487d8e21fe1a4de4a365bd3c1f91947b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.971706 14418 tablet_bootstrap.cc:492] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:08.980472 14364 tablet_service.cc:1511] Processing CreateTablet for tablet 2b16e1f580c44c1f984f63473c6a267d (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:08.981917 14364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b16e1f580c44c1f984f63473c6a267d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.001844 14420 tablet_bootstrap.cc:492] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:09.002355 14420 ts_tablet_manager.cc:1403] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.012s
I20260709 13:17:09.008307 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 87ac8217d9b74cd1a2ee70c8667d998a (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:09.009565 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ac8217d9b74cd1a2ee70c8667d998a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.005262 14420 raft_consensus.cc:359] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.014272 14420 raft_consensus.cc:385] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.014714 14420 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.015596 14420 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.021214 14287 tablet_service.cc:1511] Processing CreateTablet for tablet 87ac8217d9b74cd1a2ee70c8667d998a (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:09.027043 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ac8217d9b74cd1a2ee70c8667d998a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.027719 14418 tablet_bootstrap.cc:654] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.029165 14420 ts_tablet_manager.cc:1434] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:17:09.035663 14420 tablet_bootstrap.cc:492] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:09.039542 14367 tablet_service.cc:1511] Processing CreateTablet for tablet 87ac8217d9b74cd1a2ee70c8667d998a (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:09.040868 14367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ac8217d9b74cd1a2ee70c8667d998a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.047927 14217 tablet_service.cc:1511] Processing CreateTablet for tablet bf13dfd8a7f54be7b9ae796572d0961b (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:09.049206 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf13dfd8a7f54be7b9ae796572d0961b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.056922 14290 tablet_service.cc:1511] Processing CreateTablet for tablet bf13dfd8a7f54be7b9ae796572d0961b (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:09.062707 14438 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.063228 14438 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.063997 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 18418e3cab2e42b1a301f8068587c987 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:09.065194 14438 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:09.065302 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18418e3cab2e42b1a301f8068587c987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.061537 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf13dfd8a7f54be7b9ae796572d0961b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.066980 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:09.067900 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:09.068639 14344 leader_election.cc:343] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:09.069406 14342 leader_election.cc:343] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.069856 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:09.070998 14438 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:09.072424 14419 tablet_bootstrap.cc:492] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:09.072191 14287 tablet_service.cc:1511] Processing CreateTablet for tablet 18418e3cab2e42b1a301f8068587c987 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:09.073305 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18418e3cab2e42b1a301f8068587c987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.073599 14419 ts_tablet_manager.cc:1403] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.157s	user 0.017s	sys 0.006s
I20260709 13:17:09.076639 14419 raft_consensus.cc:359] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } }
I20260709 13:17:09.077304 14419 raft_consensus.cc:385] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.078747 14418 tablet_bootstrap.cc:492] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:09.079221 14418 ts_tablet_manager.cc:1403] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.014s
I20260709 13:17:09.082257 14420 tablet_bootstrap.cc:654] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.082106 14418 raft_consensus.cc:359] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.077595 14419 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.085963 14366 tablet_service.cc:1511] Processing CreateTablet for tablet bf13dfd8a7f54be7b9ae796572d0961b (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:09.086274 14419 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } }
I20260709 13:17:09.086653 14418 raft_consensus.cc:385] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.088088 14418 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.088863 14418 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.089565 14215 tablet_service.cc:1511] Processing CreateTablet for tablet dd40ac1ac2b5420abcc4468ffaf0c1fe (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:09.090880 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40ac1ac2b5420abcc4468ffaf0c1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.091248 14418 ts_tablet_manager.cc:1434] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:09.092209 14418 tablet_bootstrap.cc:492] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:09.092864 14419 ts_tablet_manager.cc:1434] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:17:09.093183 14293 tablet_service.cc:1511] Processing CreateTablet for tablet dd40ac1ac2b5420abcc4468ffaf0c1fe (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:09.093959 14419 tablet_bootstrap.cc:492] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:09.094456 14293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40ac1ac2b5420abcc4468ffaf0c1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.098807 14364 tablet_service.cc:1511] Processing CreateTablet for tablet 18418e3cab2e42b1a301f8068587c987 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:09.100306 14366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf13dfd8a7f54be7b9ae796572d0961b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.105477 14361 tablet_service.cc:1511] Processing CreateTablet for tablet dd40ac1ac2b5420abcc4468ffaf0c1fe (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:09.109959 14418 tablet_bootstrap.cc:654] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.111349 14364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18418e3cab2e42b1a301f8068587c987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.111579 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:09.112089 14361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40ac1ac2b5420abcc4468ffaf0c1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.113529 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.113936 14419 tablet_bootstrap.cc:654] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:09.125198 14175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:09.131215 14420 tablet_bootstrap.cc:492] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:09.131714 14420 ts_tablet_manager.cc:1403] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.000s
I20260709 13:17:09.153064 14366 tablet_service.cc:1511] Processing CreateTablet for tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:09.159147 14438 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.153316 14420 raft_consensus.cc:359] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.161188 14420 raft_consensus.cc:385] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.161019 14438 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.164702 14420 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.166167 14438 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:09.166141 14217 tablet_service.cc:1511] Processing CreateTablet for tablet bbf8c75a86f64f6cb1dd8780d0365f85 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:09.167963 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf8c75a86f64f6cb1dd8780d0365f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.168257 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:09.169205 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:09.170874 14431 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.170976 14342 leader_election.cc:343] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.171288 14364 tablet_service.cc:1511] Processing CreateTablet for tablet e674623b78de49129be2dde67c041ef9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:09.171394 14431 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.173491 14431 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.164347 14419 tablet_bootstrap.cc:492] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:09.176247 14419 ts_tablet_manager.cc:1403] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.014s
I20260709 13:17:09.177767 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:09.177827 14215 tablet_service.cc:1511] Processing CreateTablet for tablet e674623b78de49129be2dde67c041ef9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:17:09.179935 14193 leader_election.cc:343] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.180336 14419 raft_consensus.cc:359] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.181077 14419 raft_consensus.cc:385] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.181386 14419 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.162562 14288 tablet_service.cc:1511] Processing CreateTablet for tablet e674623b78de49129be2dde67c041ef9 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:09.182634 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e674623b78de49129be2dde67c041ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.183945 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 808ea406abb545e0aae5a5ddd3964180 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:09.174937 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:09.186123 14378 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:09.161675 14366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.190277 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:09.191578 14431 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.191816 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e674623b78de49129be2dde67c041ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.191993 14431 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.192466 14431 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.153509 14293 tablet_service.cc:1511] Processing CreateTablet for tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:09.193187 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808ea406abb545e0aae5a5ddd3964180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.193886 14293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.195410 14429 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.195947 14429 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.198256 14429 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.199549 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:09.171744 14420 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.176014 14361 tablet_service.cc:1511] Processing CreateTablet for tablet bbf8c75a86f64f6cb1dd8780d0365f85 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:09.199862 14287 tablet_service.cc:1511] Processing CreateTablet for tablet 808ea406abb545e0aae5a5ddd3964180 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:09.200266 14229 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:09.200932 14361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf8c75a86f64f6cb1dd8780d0365f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.186273 14290 tablet_service.cc:1511] Processing CreateTablet for tablet bbf8c75a86f64f6cb1dd8780d0365f85 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 13:17:09.177167 14344 leader_election.cc:343] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.201951 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:09.200958 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808ea406abb545e0aae5a5ddd3964180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.206542 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:09.206763 14438 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:09.208356 14267 leader_election.cc:343] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.209184 14270 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:09.209647 14367 tablet_service.cc:1511] Processing CreateTablet for tablet 808ea406abb545e0aae5a5ddd3964180 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:09.210476 14429 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.210870 14429 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.211068 14367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808ea406abb545e0aae5a5ddd3964180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.211225 14429 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.214282 14419 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.217662 14364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e674623b78de49129be2dde67c041ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.213647 14431 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.226639 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:09.227284 14304 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.230688 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf8c75a86f64f6cb1dd8780d0365f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.232085 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:09.232717 14378 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.232888 14418 tablet_bootstrap.cc:492] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:09.234295 14288 tablet_service.cc:1511] Processing CreateTablet for tablet a7157daf9a3647f4af1d12bf4530f984 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:09.235610 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7157daf9a3647f4af1d12bf4530f984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.236793 14213 tablet_service.cc:1511] Processing CreateTablet for tablet 43b3afc4354948bea829c90a4536aa96 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:09.238121 14213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b3afc4354948bea829c90a4536aa96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.240798 14418 ts_tablet_manager.cc:1403] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.016s
I20260709 13:17:09.251513 14286 tablet_service.cc:1511] Processing CreateTablet for tablet 43b3afc4354948bea829c90a4536aa96 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:09.252948 14286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b3afc4354948bea829c90a4536aa96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.253674 14420 ts_tablet_manager.cc:1434] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.008s
I20260709 13:17:09.242295 14431 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.260717 14420 tablet_bootstrap.cc:492] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:09.258181 14365 tablet_service.cc:1511] Processing CreateTablet for tablet 43b3afc4354948bea829c90a4536aa96 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:09.266637 14365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b3afc4354948bea829c90a4536aa96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.267323 14418 raft_consensus.cc:359] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.268079 14418 raft_consensus.cc:385] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.267872 14292 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3646e03a744053ae5fd190c43a27e4 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:09.268389 14418 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.269199 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3646e03a744053ae5fd190c43a27e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.274427 14419 ts_tablet_manager.cc:1434] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.097s	user 0.012s	sys 0.000s
I20260709 13:17:09.275507 14419 tablet_bootstrap.cc:492] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:09.276955 14363 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3646e03a744053ae5fd190c43a27e4 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:09.278333 14363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3646e03a744053ae5fd190c43a27e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.284665 14216 tablet_service.cc:1511] Processing CreateTablet for tablet a7157daf9a3647f4af1d12bf4530f984 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:09.285998 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7157daf9a3647f4af1d12bf4530f984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.261474 14429 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.288506 14219 tablet_service.cc:1511] Processing CreateTablet for tablet eb8ce7d4df824e4e9d0842d3d4d65698 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:09.290616 14219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8ce7d4df824e4e9d0842d3d4d65698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.291018 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:09.291648 14229 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.265148 14378 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:09.291215 14429 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.263427 14304 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:09.256254 14366 tablet_service.cc:1511] Processing CreateTablet for tablet a7157daf9a3647f4af1d12bf4530f984 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:09.294755 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:09.296129 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3646e03a744053ae5fd190c43a27e4 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:09.302172 14366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7157daf9a3647f4af1d12bf4530f984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.302330 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3646e03a744053ae5fd190c43a27e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.269156 14418 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.315220 14377 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.315454 14418 ts_tablet_manager.cc:1434] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 13:17:09.309463 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:09.323925 14431 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:09.324414 14431 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:09.325217 14431 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.326409 14418 tablet_bootstrap.cc:492] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:09.332727 14419 tablet_bootstrap.cc:654] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.333916 14212 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1da5440c0e48a6bc637b43fa41215e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:09.334640 14286 tablet_service.cc:1511] Processing CreateTablet for tablet eb8ce7d4df824e4e9d0842d3d4d65698 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:09.335210 14212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1da5440c0e48a6bc637b43fa41215e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.335966 14286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8ce7d4df824e4e9d0842d3d4d65698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.303992 14229 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:09.342312 14270 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:09.343246 14429 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:09.343743 14429 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:09.344228 14418 tablet_bootstrap.cc:654] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.344708 14429 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.350648 14377 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:09.349272 14288 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1da5440c0e48a6bc637b43fa41215e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:09.354020 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1da5440c0e48a6bc637b43fa41215e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.337543 14365 tablet_service.cc:1511] Processing CreateTablet for tablet eb8ce7d4df824e4e9d0842d3d4d65698 (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:09.336998 14420 tablet_bootstrap.cc:654] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.366241 14366 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1da5440c0e48a6bc637b43fa41215e (DEFAULT_TABLE table=test-workload [id=3a60586503ca4ae1977f1f1edfb94727]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:09.374050 14453 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.376344 14453 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.378532 14453 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.380935 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:09.382463 14193 leader_election.cc:343] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.382719 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:09.384703 14192 leader_election.cc:343] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.385131 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:09.386209 14453 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:09.386946 14365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8ce7d4df824e4e9d0842d3d4d65698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.387524 14454 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.387957 14454 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } }
I20260709 13:17:09.388018 14126 catalog_manager.cc:5697] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:09.390693 14438 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:09.392024 14366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1da5440c0e48a6bc637b43fa41215e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:09.397209 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:09.398113 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:09.398829 14267 leader_election.cc:343] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:09.399688 14270 leader_election.cc:343] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.400193 14270 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:09.403210 14419 tablet_bootstrap.cc:492] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:09.403710 14419 ts_tablet_manager.cc:1403] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.128s	user 0.019s	sys 0.023s
I20260709 13:17:09.406852 14454 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:09.406877 14419 raft_consensus.cc:359] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.409018 14419 raft_consensus.cc:385] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.409392 14419 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.411012 14419 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.411363 14454 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:09.413169 14419 ts_tablet_manager.cc:1434] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:17:09.417834 14419 tablet_bootstrap.cc:492] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
W20260709 13:17:09.427678 14344 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:09.430753 14419 tablet_bootstrap.cc:654] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.431597 14126 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:09.440271 14419 tablet_bootstrap.cc:492] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:09.440866 14419 ts_tablet_manager.cc:1403] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.009s
I20260709 13:17:09.444469 14419 raft_consensus.cc:359] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.445359 14419 raft_consensus.cc:385] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.445756 14419 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.446754 14419 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.447638 14418 tablet_bootstrap.cc:492] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:09.448645 14420 tablet_bootstrap.cc:492] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:09.449167 14420 ts_tablet_manager.cc:1403] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.189s	user 0.017s	sys 0.000s
I20260709 13:17:09.450029 14419 ts_tablet_manager.cc:1434] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.006s
I20260709 13:17:09.448179 14418 ts_tablet_manager.cc:1403] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.122s	user 0.008s	sys 0.008s
I20260709 13:17:09.451092 14419 tablet_bootstrap.cc:492] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:09.452869 14420 raft_consensus.cc:359] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.453715 14420 raft_consensus.cc:385] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.453580 14418 raft_consensus.cc:359] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } }
I20260709 13:17:09.454206 14420 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.454527 14418 raft_consensus.cc:385] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.454964 14418 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.455140 14420 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.455786 14418 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } }
I20260709 13:17:09.457633 14419 tablet_bootstrap.cc:654] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.457729 14420 ts_tablet_manager.cc:1434] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:09.458278 14418 ts_tablet_manager.cc:1434] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:17:09.459370 14418 tablet_bootstrap.cc:492] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:09.467872 14418 tablet_bootstrap.cc:654] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.469318 14419 tablet_bootstrap.cc:492] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:09.469921 14419 ts_tablet_manager.cc:1403] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.009s
I20260709 13:17:09.472528 14420 tablet_bootstrap.cc:492] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:09.473315 14419 raft_consensus.cc:359] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.474296 14419 raft_consensus.cc:385] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.474686 14419 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.475864 14419 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.478763 14419 ts_tablet_manager.cc:1434] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:17:09.479645 14418 tablet_bootstrap.cc:492] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:09.480062 14418 ts_tablet_manager.cc:1403] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:17:09.480798 14420 tablet_bootstrap.cc:654] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.482686 14419 tablet_bootstrap.cc:492] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:09.482610 14418 raft_consensus.cc:359] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.483548 14418 raft_consensus.cc:385] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.483860 14418 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.484628 14418 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.490577 14419 tablet_bootstrap.cc:654] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.498526 14418 ts_tablet_manager.cc:1434] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.008s
I20260709 13:17:09.499895 14418 tablet_bootstrap.cc:492] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:09.508849 14418 tablet_bootstrap.cc:654] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.513466 14419 tablet_bootstrap.cc:492] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:09.519790 14419 ts_tablet_manager.cc:1403] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.022s
I20260709 13:17:09.523314 14419 raft_consensus.cc:359] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.524469 14419 raft_consensus.cc:385] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.524909 14419 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.526137 14419 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.534953 14419 ts_tablet_manager.cc:1434] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.005s
I20260709 13:17:09.536516 14419 tablet_bootstrap.cc:492] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:09.544565 14419 tablet_bootstrap.cc:654] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.548334 14418 tablet_bootstrap.cc:492] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:09.549130 14418 ts_tablet_manager.cc:1403] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.014s
I20260709 13:17:09.552995 14418 raft_consensus.cc:359] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.554006 14418 raft_consensus.cc:385] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.554368 14418 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.555312 14418 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.556849 14419 tablet_bootstrap.cc:492] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:09.557435 14419 ts_tablet_manager.cc:1403] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:17:09.558480 14418 ts_tablet_manager.cc:1434] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:09.559059 14420 tablet_bootstrap.cc:492] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:09.559497 14420 ts_tablet_manager.cc:1403] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.087s	user 0.038s	sys 0.034s
I20260709 13:17:09.559809 14418 tablet_bootstrap.cc:492] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:09.560572 14419 raft_consensus.cc:359] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.561331 14419 raft_consensus.cc:385] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.561659 14419 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.562157 14420 raft_consensus.cc:359] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.562464 14419 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.562871 14420 raft_consensus.cc:385] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.563218 14420 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.564033 14420 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.564566 14419 ts_tablet_manager.cc:1434] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:09.566493 14419 tablet_bootstrap.cc:492] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:09.569705 14420 ts_tablet_manager.cc:1434] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:09.570672 14420 tablet_bootstrap.cc:492] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:09.571200 14418 tablet_bootstrap.cc:654] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.572847 14419 tablet_bootstrap.cc:654] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.576740 14420 tablet_bootstrap.cc:654] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.584955 14419 tablet_bootstrap.cc:492] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:09.585510 14419 ts_tablet_manager.cc:1403] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.019s	user 0.001s	sys 0.015s
I20260709 13:17:09.588465 14419 raft_consensus.cc:359] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.589214 14419 raft_consensus.cc:385] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.589540 14419 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.591756 14419 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.593998 14419 ts_tablet_manager.cc:1434] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:09.595418 14419 tablet_bootstrap.cc:492] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:09.599507 14420 tablet_bootstrap.cc:492] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:09.600167 14420 ts_tablet_manager.cc:1403] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.015s
I20260709 13:17:09.601567 14419 tablet_bootstrap.cc:654] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.606822 14420 raft_consensus.cc:359] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.609082 14420 raft_consensus.cc:385] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.609499 14420 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.610131 14419 tablet_bootstrap.cc:492] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:09.610165 14418 tablet_bootstrap.cc:492] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:09.610690 14419 ts_tablet_manager.cc:1403] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:17:09.610841 14418 ts_tablet_manager.cc:1403] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.019s
I20260709 13:17:09.610212 14420 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.613343 14419 raft_consensus.cc:359] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.614027 14419 raft_consensus.cc:385] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.613759 14418 raft_consensus.cc:359] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.614408 14419 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.614634 14418 raft_consensus.cc:385] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.615000 14418 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.615185 14419 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.615769 14418 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.617439 14419 ts_tablet_manager.cc:1434] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:09.618247 14418 ts_tablet_manager.cc:1434] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:09.619429 14418 tablet_bootstrap.cc:492] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:09.620122 14419 tablet_bootstrap.cc:492] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:09.625115 14418 tablet_bootstrap.cc:654] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.620246 14420 ts_tablet_manager.cc:1434] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:17:09.626579 14420 tablet_bootstrap.cc:492] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:09.627238 14419 tablet_bootstrap.cc:654] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.629324 14453 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.629889 14453 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.635249 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:09.636227 14420 tablet_bootstrap.cc:654] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.636873 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:09.643549 14418 tablet_bootstrap.cc:492] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:09.637714 14304 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:09.646634 14418 ts_tablet_manager.cc:1403] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260709 13:17:09.650923 14418 raft_consensus.cc:359] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.651944 14418 raft_consensus.cc:385] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.652343 14418 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.653517 14418 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.655675 14453 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.657042 14418 ts_tablet_manager.cc:1434] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
W20260709 13:17:09.638739 14192 leader_election.cc:343] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.658140 14420 tablet_bootstrap.cc:492] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:09.658326 14418 tablet_bootstrap.cc:492] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:09.658737 14420 ts_tablet_manager.cc:1403] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.011s
I20260709 13:17:09.661293 14193 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:09.661868 14420 raft_consensus.cc:359] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.662539 14431 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.662789 14420 raft_consensus.cc:385] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.663201 14420 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.663252 14431 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.664286 14420 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.666339 14431 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.674219 14420 ts_tablet_manager.cc:1434] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.004s
I20260709 13:17:09.675416 14420 tablet_bootstrap.cc:492] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:09.675216 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:09.676137 14304 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:09.667007 14418 tablet_bootstrap.cc:654] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.682816 14420 tablet_bootstrap.cc:654] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.667984 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:09.683727 14377 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:09.666558 14453 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.684846 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:09.686179 14431 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.686661 14431 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.687193 14431 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.688696 14418 tablet_bootstrap.cc:492] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:09.689312 14418 ts_tablet_manager.cc:1403] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 13:17:09.685365 14453 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.691824 14453 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.692862 14418 raft_consensus.cc:359] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.693773 14418 raft_consensus.cc:385] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.694149 14418 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.695631 14418 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.698385 14418 ts_tablet_manager.cc:1434] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:17:09.710412 14418 tablet_bootstrap.cc:492] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:09.718586 14418 tablet_bootstrap.cc:654] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.728104 14458 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.728813 14458 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.731536 14481 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:09.733176 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:09.735352 14270 leader_election.cc:343] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.737982 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:09.739894 14267 leader_election.cc:343] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.740525 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:09.741693 14429 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:09.742682 14458 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.746515 14464 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.747170 14464 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } }
I20260709 13:17:09.745201 14431 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.752780 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:09.753434 14303 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.756054 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:09.757010 14302 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:09.758505 14342 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:09.759630 14438 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.760104 14438 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.760524 14438 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.763334 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:09.765229 14344 leader_election.cc:343] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.766232 14464 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:09.780063 14438 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } }
I20260709 13:17:09.783214 14303 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:09.786494 14453 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.787720 14458 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:09.791797 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:09.791895 14431 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.795408 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:09.797137 14377 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.796689 14453 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.799751 14418 tablet_bootstrap.cc:492] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:09.800398 14418 ts_tablet_manager.cc:1403] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.096s	user 0.018s	sys 0.004s
W20260709 13:17:09.796264 14192 leader_election.cc:343] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.809067 14419 tablet_bootstrap.cc:492] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:09.809538 14419 ts_tablet_manager.cc:1403] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.190s	user 0.063s	sys 0.099s
I20260709 13:17:09.806102 14418 raft_consensus.cc:359] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.810257 14418 raft_consensus.cc:385] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.810554 14418 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.809845 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:09.811558 14303 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.812340 14418 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.814374 14438 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:09.820688 14377 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:09.821476 14303 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:09.814112 14419 raft_consensus.cc:359] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.822314 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:09.822669 14419 raft_consensus.cc:385] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.823158 14419 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.823475 14453 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.824054 14453 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.825306 14419 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.825939 14342 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:09.826819 14438 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:09.827277 14438 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:09.828202 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:09.828089 14438 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } }
I20260709 13:17:09.828697 14453 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.829048 14378 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:09.829355 14453 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:09.831228 14453 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:09.831894 14453 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:09.832526 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:09.834293 14481 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.834370 14458 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:09.835063 14481 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.835644 14481 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.828202 14419 ts_tablet_manager.cc:1434] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:17:09.838222 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:09.840363 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:09.838202 14419 tablet_bootstrap.cc:492] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
W20260709 13:17:09.842092 14193 leader_election.cc:343] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.841004 14420 tablet_bootstrap.cc:492] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
W20260709 13:17:09.843566 14344 leader_election.cc:343] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.843895 14420 ts_tablet_manager.cc:1403] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.169s	user 0.053s	sys 0.049s
I20260709 13:17:09.833139 14453 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.846383 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:09.847139 14303 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.848266 14418 ts_tablet_manager.cc:1434] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.002s
I20260709 13:17:09.851796 14458 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.852346 14458 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.852764 14481 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.855676 14418 tablet_bootstrap.cc:492] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:09.858136 14420 raft_consensus.cc:359] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.858973 14420 raft_consensus.cc:385] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:09.858872 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:09.859431 14420 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:09.859755 14228 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:09.860154 14420 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.866366 14270 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:09.868234 14467 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.869007 14464 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.869103 14467 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.869534 14464 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.870899 14420 ts_tablet_manager.cc:1434] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:17:09.871914 14420 tablet_bootstrap.cc:492] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:09.868290 14454 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.872231 14464 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:09.872283 14454 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.872716 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:09.872822 14454 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.873433 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:09.874116 14467 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:09.869122 14419 tablet_bootstrap.cc:654] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:09.875548 14342 leader_election.cc:343] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.876379 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:09.877612 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:09.878352 14376 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.878832 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:09.882121 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:09.883433 14344 leader_election.cc:343] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:09.883533 14193 leader_election.cc:343] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.884002 14304 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
W20260709 13:17:09.884894 14344 leader_election.cc:343] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:09.885258 14420 tablet_bootstrap.cc:654] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.885226 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:09.885509 14344 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:09.886456 14467 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:09.886806 14467 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.887168 14467 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.887036 14454 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.887300 14464 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:09.889732 14418 tablet_bootstrap.cc:654] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:09.898634 14431 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.901093 14431 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.877609 14481 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.922930 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:09.923653 14229 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.919926 14458 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.934100 14454 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.979259 14458 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.979041 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:09.938414 14431 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:09.935503 14376 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:09.979882 14458 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.981673 14454 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.988804 14464 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.000242 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:10.000842 14378 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:09.998059 14126 catalog_manager.cc:5697] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.003007 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.005266 14419 tablet_bootstrap.cc:492] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:10.005857 14419 ts_tablet_manager.cc:1403] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.168s	user 0.015s	sys 0.010s
I20260709 13:17:10.008687 14496 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.992076 14454 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.003934 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:09.997610 14464 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.013361 14431 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.014918 14227 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.009989 14496 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:09.994374 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.019275 14453 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.023046 14420 tablet_bootstrap.cc:492] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.029181 14420 ts_tablet_manager.cc:1403] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.157s	user 0.018s	sys 0.013s
I20260709 13:17:10.024338 14458 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.024559 14454 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.024478 14303 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:10.026103 14438 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.026355 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:10.026808 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.027697 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.028908 14419 raft_consensus.cc:359] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.031780 14496 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.031678 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:10.034135 14419 raft_consensus.cc:385] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.035910 14419 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.032433 14453 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:10.037215 14375 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
W20260709 13:17:10.037503 14270 leader_election.cc:343] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:10.038178 14267 leader_election.cc:343] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.037906 14453 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.039176 14267 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:10.039559 14464 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:10.040011 14496 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.040357 14496 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.040696 14496 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.041777 14127 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.042475 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.019578 14431 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.043995 14419 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.037286 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.035596 14438 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.046357 14467 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.046702 14374 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:10.030752 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:10.049003 14438 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:17:10.049611 14270 leader_election.cc:343] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.049763 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:10.050531 14431 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.050808 14467 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:10.041019 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:10.051196 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:10.051707 14270 leader_election.cc:343] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.051851 14304 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:10.052601 14270 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:10.053073 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:10.053573 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:10.054198 14303 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:10.054631 14420 raft_consensus.cc:359] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } }
W20260709 13:17:10.055176 14344 leader_election.cc:343] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.055260 14420 raft_consensus.cc:385] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.055606 14454 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.055655 14420 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.056104 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:10.056643 14458 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.056489 14420 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } }
I20260709 13:17:10.057191 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:10.056108 14454 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:10.057878 14344 leader_election.cc:343] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.057859 14454 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.053599 14302 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.058290 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.035495 14229 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:10.063702 14419 ts_tablet_manager.cc:1434] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.002s
I20260709 13:17:10.064479 14419 tablet_bootstrap.cc:492] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:10.062949 14467 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.066350 14467 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.066401 14378 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:10.066757 14467 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.067862 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:10.071626 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:10.070606 14342 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:10.072930 14420 ts_tablet_manager.cc:1434] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:17:10.068457 14374 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:10.073210 14438 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.073819 14420 tablet_bootstrap.cc:492] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.074519 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:10.073669 14438 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.075762 14438 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.077085 14453 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.077440 14453 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.077742 14453 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.078636 14302 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:10.079751 14193 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:17:10.081339 14344 leader_election.cc:343] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.082312 14495 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.081362 14431 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.083096 14495 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:10.083181 14431 raft_consensus.cc:697] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:10.084167 14495 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.084337 14431 consensus_queue.cc:237] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.084807 14438 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.095129 14418 tablet_bootstrap.cc:492] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:10.095607 14418 ts_tablet_manager.cc:1403] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.247s	user 0.014s	sys 0.009s
I20260709 13:17:10.096251 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:10.097348 14464 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.097865 14464 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:10.098259 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:10.098691 14464 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.097484 14496 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:10.107532 14193 leader_election.cc:343] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.107818 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:10.108088 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:10.108583 14374 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.100467 14453 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.101764 14454 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.109747 14496 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.113672 14481 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:10.113718 14270 leader_election.cc:343] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.120589 14454 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.121301 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:10.122287 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:17:10.123206 14344 leader_election.cc:343] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:10.130304 14175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:10.132432 14418 raft_consensus.cc:359] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.133229 14374 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:10.133381 14418 raft_consensus.cc:385] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.133893 14418 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.135115 14419 tablet_bootstrap.cc:654] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.135152 14418 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.137008 14438 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:10.137871 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:10.138732 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:17:10.139174 14270 leader_election.cc:343] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.139317 14302 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.140376 14420 tablet_bootstrap.cc:654] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.140221 14267 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:10.141693 14458 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.142575 14453 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.143909 14418 ts_tablet_manager.cc:1434] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.002s
I20260709 13:17:10.144590 14418 tablet_bootstrap.cc:492] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:10.146013 14458 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:10.148240 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:10.148883 14377 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.149093 14458 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.161051 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:17:10.162971 14193 leader_election.cc:343] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.167678 14467 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.169173 14378 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:10.169934 14377 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:10.170965 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:10.168423 14302 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:10.171784 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:17:10.172629 14344 leader_election.cc:343] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.172935 14453 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.173434 14453 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:10.174281 14453 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.171034 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:10.176021 14458 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.176198 14342 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:10.177018 14438 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.177525 14420 tablet_bootstrap.cc:492] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.177546 14438 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:10.178414 14420 ts_tablet_manager.cc:1403] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.006s
I20260709 13:17:10.179823 14467 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:10.181777 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:10.181670 14438 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.182536 14302 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 1: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:17:10.183192 14419 tablet_bootstrap.cc:492] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:10.183625 14419 ts_tablet_manager.cc:1403] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.119s	user 0.009s	sys 0.011s
I20260709 13:17:10.183655 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.185015 14467 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.186620 14419 raft_consensus.cc:359] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.187354 14419 raft_consensus.cc:385] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.187639 14419 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.183679 14420 raft_consensus.cc:359] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.188536 14420 raft_consensus.cc:385] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.188396 14419 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.188937 14420 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.189864 14418 tablet_bootstrap.cc:654] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.190478 14419 ts_tablet_manager.cc:1434] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:10.189997 14420 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.191926 14419 tablet_bootstrap.cc:492] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:10.192787 14420 ts_tablet_manager.cc:1434] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:17:10.194393 14420 tablet_bootstrap.cc:492] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.201941 14420 tablet_bootstrap.cc:654] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.202989 14125 catalog_manager.cc:5697] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.215332 14419 tablet_bootstrap.cc:654] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.215281 14418 tablet_bootstrap.cc:492] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:10.227947 14418 ts_tablet_manager.cc:1403] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.003s
I20260709 13:17:10.228632 14127 catalog_manager.cc:5697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.230526 14418 raft_consensus.cc:359] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.232868 14418 raft_consensus.cc:385] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.233142 14418 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.233800 14418 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.236593 14458 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.237131 14458 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.239427 14458 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.240556 14418 ts_tablet_manager.cc:1434] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:17:10.241468 14418 tablet_bootstrap.cc:492] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:10.241418 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.241755 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:10.242457 14377 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
W20260709 13:17:10.243263 14270 leader_election.cc:343] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.244230 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:10.245736 14458 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.246383 14458 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.246881 14458 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.258074 14453 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.258920 14453 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.262758 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:10.264146 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.265132 14377 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 1: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:17:10.266764 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.268079 14486 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.272696 14126 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.274331 14126 catalog_manager.cc:5697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.277925 14453 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.282590 14486 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.280563 14418 tablet_bootstrap.cc:654] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.280141 14458 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.290187 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:17:10.291909 14270 leader_election.cc:343] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.292301 14438 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.293103 14420 tablet_bootstrap.cc:492] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.293530 14420 ts_tablet_manager.cc:1403] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.100s	user 0.040s	sys 0.051s
I20260709 13:17:10.292833 14124 catalog_manager.cc:5697] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.294107 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:10.294656 14377 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.294929 14124 catalog_manager.cc:5697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.296252 14420 raft_consensus.cc:359] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.296862 14420 raft_consensus.cc:385] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.297307 14420 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.296845 14124 catalog_manager.cc:5697] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.298101 14420 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.300132 14420 ts_tablet_manager.cc:1434] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:17:10.301024 14420 tablet_bootstrap.cc:492] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.308279 14438 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.308969 14438 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.313139 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:10.315316 14420 tablet_bootstrap.cc:654] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.317952 14227 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.320220 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:10.319185 14438 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:10.320995 14303 raft_consensus.cc:2393] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 1: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:17:10.323755 14342 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.324816 14464 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.330533 14418 tablet_bootstrap.cc:492] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:10.331019 14418 ts_tablet_manager.cc:1403] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.009s
I20260709 13:17:10.331542 14377 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:10.333053 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:10.331785 14419 tablet_bootstrap.cc:492] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:10.342658 14419 ts_tablet_manager.cc:1403] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.151s	user 0.025s	sys 0.024s
I20260709 13:17:10.343776 14418 raft_consensus.cc:359] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.334271 14496 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.338271 14464 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.339463 14438 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.347785 14418 raft_consensus.cc:385] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.348065 14496 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:10.348313 14418 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.331355 14458 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.348978 14496 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.349188 14418 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.351455 14418 ts_tablet_manager.cc:1434] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:17:10.345641 14420 tablet_bootstrap.cc:492] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.345687 14419 raft_consensus.cc:359] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.355930 14420 ts_tablet_manager.cc:1403] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.007s
I20260709 13:17:10.355842 14419 raft_consensus.cc:385] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.356709 14419 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.346017 14486 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.359141 14420 raft_consensus.cc:359] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.359865 14420 raft_consensus.cc:385] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.360177 14420 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.360977 14420 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.363329 14420 ts_tablet_manager.cc:1434] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:17:10.364295 14464 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.364743 14464 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.366716 14464 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:10.367375 14420 tablet_bootstrap.cc:492] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.371300 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:10.372414 14418 tablet_bootstrap.cc:492] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:10.372910 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:10.374181 14420 tablet_bootstrap.cc:654] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:10.374303 14344 leader_election.cc:343] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:10.376155 14342 leader_election.cc:343] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.376731 14342 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.377686 14464 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.379210 14418 tablet_bootstrap.cc:654] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.386751 14420 tablet_bootstrap.cc:492] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.387466 14420 ts_tablet_manager.cc:1403] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:17:10.390502 14420 raft_consensus.cc:359] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.391188 14418 tablet_bootstrap.cc:492] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:10.391260 14420 raft_consensus.cc:385] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.391693 14418 ts_tablet_manager.cc:1403] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:17:10.391731 14420 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.392710 14420 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.394987 14420 ts_tablet_manager.cc:1434] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:10.394788 14418 raft_consensus.cc:359] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.395673 14418 raft_consensus.cc:385] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.395942 14418 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.396381 14420 tablet_bootstrap.cc:492] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.396711 14418 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.396202 14419 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.402184 14419 ts_tablet_manager.cc:1434] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:17:10.403174 14419 tablet_bootstrap.cc:492] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:10.403371 14418 ts_tablet_manager.cc:1434] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:17:10.404644 14418 tablet_bootstrap.cc:492] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:10.410775 14420 tablet_bootstrap.cc:654] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.423496 14418 tablet_bootstrap.cc:654] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.424566 14125 catalog_manager.cc:5697] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.433108 14438 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.433591 14438 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.435185 14486 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.435626 14438 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:10.437541 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:10.439899 14342 leader_election.cc:343] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.442045 14486 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.442507 14486 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.444747 14486 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.449870 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.451105 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:10.451848 14302 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:10.452775 14193 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.453899 14486 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.460502 14486 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.468261 14419 tablet_bootstrap.cc:654] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.464737 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:10.469492 14227 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:10.472739 14420 tablet_bootstrap.cc:492] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.473196 14420 ts_tablet_manager.cc:1403] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.002s
I20260709 13:17:10.474131 14418 tablet_bootstrap.cc:492] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:10.475446 14418 ts_tablet_manager.cc:1403] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.005s
I20260709 13:17:10.476557 14420 raft_consensus.cc:359] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.477026 14420 raft_consensus.cc:385] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.477188 14420 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.477985 14420 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.479974 14420 ts_tablet_manager.cc:1434] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:17:10.480634 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.480715 14420 tablet_bootstrap.cc:492] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.481913 14470 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.482275 14470 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.482661 14470 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.489388 14420 tablet_bootstrap.cc:654] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.489565 14470 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.493296 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:10.493817 14418 raft_consensus.cc:359] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.494496 14418 raft_consensus.cc:385] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.494761 14418 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
W20260709 13:17:10.495334 14342 leader_election.cc:343] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.495518 14418 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.497232 14419 tablet_bootstrap.cc:492] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:10.497694 14419 ts_tablet_manager.cc:1403] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.095s	user 0.007s	sys 0.005s
I20260709 13:17:10.497869 14418 ts_tablet_manager.cc:1434] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:17:10.498728 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:10.499228 14227 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.500556 14419 raft_consensus.cc:359] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.501255 14419 raft_consensus.cc:385] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.501523 14419 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.501905 14470 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:10.499269 14418 tablet_bootstrap.cc:492] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:10.502329 14419 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.505884 14227 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:10.507103 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.507320 14486 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.507797 14486 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.508219 14470 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.508896 14470 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:10.509876 14470 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.511639 14486 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.511778 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:10.512382 14302 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:10.508221 14419 ts_tablet_manager.cc:1434] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:10.513114 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.513741 14377 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:10.513670 14193 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:10.514940 14486 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.515247 14420 tablet_bootstrap.cc:492] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.515404 14486 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.515872 14486 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.516146 14419 tablet_bootstrap.cc:492] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:10.522835 14419 tablet_bootstrap.cc:654] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.522662 14486 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.525380 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:10.526083 14302 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.525380 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:10.528563 14418 tablet_bootstrap.cc:654] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.532579 14377 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.536795 14124 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.532303 14302 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:10.538250 14418 tablet_bootstrap.cc:492] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:10.538745 14418 ts_tablet_manager.cc:1403] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.003s
I20260709 13:17:10.539206 14377 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:10.539490 14193 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:10.532824 14420 ts_tablet_manager.cc:1403] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.009s
I20260709 13:17:10.540613 14481 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.532636 14486 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.541293 14419 tablet_bootstrap.cc:492] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:10.541769 14419 ts_tablet_manager.cc:1403] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.004s
I20260709 13:17:10.530290 14453 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:17:10.542276 14481 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:10.543121 14481 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.543295 14420 raft_consensus.cc:359] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.543944 14420 raft_consensus.cc:385] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.544229 14420 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.544833 14420 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.546802 14420 ts_tablet_manager.cc:1434] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:10.547672 14420 tablet_bootstrap.cc:492] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.550926 14418 raft_consensus.cc:359] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.551407 14418 raft_consensus.cc:385] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.551631 14418 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.552246 14418 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.553251 14420 tablet_bootstrap.cc:654] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.556778 14418 ts_tablet_manager.cc:1434] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:17:10.557724 14418 tablet_bootstrap.cc:492] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:10.563787 14418 tablet_bootstrap.cc:654] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.563599 14481 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.564962 14124 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.568521 14420 tablet_bootstrap.cc:492] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.568964 14420 ts_tablet_manager.cc:1403] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 13:17:10.569084 14419 raft_consensus.cc:359] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.569864 14419 raft_consensus.cc:385] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.572284 14420 raft_consensus.cc:359] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.570209 14419 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.574462 14419 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.576283 14419 ts_tablet_manager.cc:1434] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.001s
I20260709 13:17:10.576586 14420 raft_consensus.cc:385] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.576884 14420 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.577126 14419 tablet_bootstrap.cc:492] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:10.577534 14420 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.579852 14420 ts_tablet_manager.cc:1434] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:17:10.580754 14420 tablet_bootstrap.cc:492] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.586561 14420 tablet_bootstrap.cc:654] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.589380 14419 tablet_bootstrap.cc:654] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.589617 14496 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.589970 14303 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.594305 14486 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.599588 14464 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.605629 14420 tablet_bootstrap.cc:492] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.606130 14420 ts_tablet_manager.cc:1403] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:17:10.607092 14431 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:10.608439 14496 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.611687 14420 raft_consensus.cc:359] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.612524 14420 raft_consensus.cc:385] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.612810 14420 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.615043 14419 tablet_bootstrap.cc:492] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:10.615950 14420 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.618407 14420 ts_tablet_manager.cc:1434] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:10.619395 14420 tablet_bootstrap.cc:492] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.621026 14464 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:10.626228 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:10.621604 14464 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.629637 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:10.630398 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:10.631016 14227 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
W20260709 13:17:10.631140 14342 leader_election.cc:343] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.631790 14464 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:10.625746 14420 tablet_bootstrap.cc:654] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.633118 14431 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.633589 14431 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.634809 14493 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.637944 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:10.638029 14344 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:17:10.640376 14193 leader_election.cc:343] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.641631 14467 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.642588 14467 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.642992 14467 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.643620 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.644259 14378 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:10.645334 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.646229 14453 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.646631 14453 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.646991 14453 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.650465 14431 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.618220 14419 ts_tablet_manager.cc:1403] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.005s
I20260709 13:17:10.661957 14418 tablet_bootstrap.cc:492] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:10.662546 14418 ts_tablet_manager.cc:1403] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.008s
I20260709 13:17:10.663622 14453 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.667312 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:10.665697 14453 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.679378 14377 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.672024 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:10.684852 14467 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:10.686084 14193 leader_election.cc:343] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.689654 14377 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:10.690456 14493 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.665618 14418 raft_consensus.cc:359] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.691126 14418 raft_consensus.cc:385] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.691794 14464 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.691466 14418 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.693116 14418 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.695856 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.697096 14431 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.697865 14431 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:10.699409 14438 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.705119 14467 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:10.706259 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:10.706965 14227 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.713487 14420 tablet_bootstrap.cc:492] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.714021 14420 ts_tablet_manager.cc:1403] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.095s	user 0.028s	sys 0.034s
I20260709 13:17:10.719686 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:17:10.721414 14342 leader_election.cc:343] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.723368 14304 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.723912 14227 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:10.724759 14420 raft_consensus.cc:359] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.725409 14344 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.726951 14438 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.725422 14420 raft_consensus.cc:385] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.727672 14438 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:10.728328 14420 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.729230 14438 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.730780 14420 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.699457 14431 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.735253 14420 ts_tablet_manager.cc:1434] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
I20260709 13:17:10.736238 14420 tablet_bootstrap.cc:492] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.695261 14419 raft_consensus.cc:359] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.739223 14493 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.739806 14493 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.743690 14493 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.739362 14419 raft_consensus.cc:385] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.744334 14419 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.744807 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.747143 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:10.747871 14227 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:10.748629 14418 ts_tablet_manager.cc:1434] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.086s	user 0.013s	sys 0.013s
I20260709 13:17:10.748878 14420 tablet_bootstrap.cc:654] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.748919 14270 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:10.749433 14453 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.749810 14493 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.756896 14493 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.757372 14418 tablet_bootstrap.cc:492] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:10.761904 14419 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.767625 14454 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.770471 14419 ts_tablet_manager.cc:1434] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.000s
I20260709 13:17:10.771504 14419 tablet_bootstrap.cc:492] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:10.772032 14124 catalog_manager.cc:5697] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.778272 14419 tablet_bootstrap.cc:654] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.768654 14418 tablet_bootstrap.cc:654] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.789139 14453 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.789743 14453 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.791507 14419 tablet_bootstrap.cc:492] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:10.792012 14419 ts_tablet_manager.cc:1403] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.001s
I20260709 13:17:10.797564 14419 raft_consensus.cc:359] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.798882 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:10.798545 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.799055 14481 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:10.799664 14304 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 1: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:17:10.799916 14378 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:10.799119 14419 raft_consensus.cc:385] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.800011 14227 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.801021 14419 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.801759 14419 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.802125 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.803890 14419 ts_tablet_manager.cc:1434] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:17:10.804248 14486 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.804889 14419 tablet_bootstrap.cc:492] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:10.806967 14453 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.815459 14486 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.820307 14496 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:10.821668 14419 tablet_bootstrap.cc:654] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.833904 14486 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.834527 14486 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.840019 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:10.841598 14193 leader_election.cc:343] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.846835 14420 tablet_bootstrap.cc:492] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.847277 14420 ts_tablet_manager.cc:1403] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.008s
I20260709 13:17:10.849212 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.849901 14420 raft_consensus.cc:359] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:10.850456 14192 leader_election.cc:343] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:10.850581 14420 raft_consensus.cc:385] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.850932 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:10.851132 14486 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.851450 14420 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.851732 14486 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:10.852290 14420 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.852470 14418 tablet_bootstrap.cc:492] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:10.853052 14418 ts_tablet_manager.cc:1403] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.001s
I20260709 13:17:10.853976 14420 ts_tablet_manager.cc:1434] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:10.854877 14420 tablet_bootstrap.cc:492] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.855372 14418 raft_consensus.cc:359] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.856032 14418 raft_consensus.cc:385] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.856294 14418 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.856405 14419 tablet_bootstrap.cc:492] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:10.856841 14419 ts_tablet_manager.cc:1403] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.014s
I20260709 13:17:10.856953 14418 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.858606 14418 ts_tablet_manager.cc:1434] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:17:10.859308 14418 tablet_bootstrap.cc:492] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:10.859432 14419 raft_consensus.cc:359] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.860119 14419 raft_consensus.cc:385] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.860399 14419 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.861042 14420 tablet_bootstrap.cc:654] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.861393 14419 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.864048 14419 ts_tablet_manager.cc:1434] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:10.865068 14418 tablet_bootstrap.cc:654] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.865636 14419 tablet_bootstrap.cc:492] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:10.874684 14419 tablet_bootstrap.cc:654] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.876159 14418 tablet_bootstrap.cc:492] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:10.876619 14418 ts_tablet_manager.cc:1403] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.017s	user 0.002s	sys 0.013s
I20260709 13:17:10.879146 14127 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.881598 14420 tablet_bootstrap.cc:492] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.882228 14420 ts_tablet_manager.cc:1403] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.016s
I20260709 13:17:10.882292 14418 raft_consensus.cc:359] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.882975 14418 raft_consensus.cc:385] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.883247 14418 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.884088 14418 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.886307 14418 ts_tablet_manager.cc:1434] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:10.885738 14420 raft_consensus.cc:359] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.886679 14420 raft_consensus.cc:385] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.887013 14420 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.887995 14420 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.890298 14418 tablet_bootstrap.cc:492] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:10.894505 14420 ts_tablet_manager.cc:1434] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:17:10.896169 14420 tablet_bootstrap.cc:492] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.915414 14486 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.915997 14486 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.917961 14419 tablet_bootstrap.cc:492] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:10.918066 14486 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.918954 14419 ts_tablet_manager.cc:1403] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.054s	user 0.027s	sys 0.015s
I20260709 13:17:10.919294 14420 tablet_bootstrap.cc:654] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.920007 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:10.920636 14301 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:10.921578 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:10.922187 14378 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:10.921934 14419 raft_consensus.cc:359] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.922650 14419 raft_consensus.cc:385] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.922909 14419 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.923612 14419 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.924912 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:10.925499 14419 ts_tablet_manager.cc:1434] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:17:10.925572 14486 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:10.926164 14486 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.926508 14419 tablet_bootstrap.cc:492] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:10.926556 14486 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.928239 14418 tablet_bootstrap.cc:654] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.933653 14419 tablet_bootstrap.cc:654] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.933317 14486 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.938544 14420 tablet_bootstrap.cc:492] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:10.938791 14486 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:10.939077 14420 ts_tablet_manager.cc:1403] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.006s
I20260709 13:17:10.939878 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:10.940528 14303 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.942154 14418 tablet_bootstrap.cc:492] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:10.942036 14420 raft_consensus.cc:359] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.942747 14418 ts_tablet_manager.cc:1403] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.009s
I20260709 13:17:10.942778 14420 raft_consensus.cc:385] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.943143 14419 tablet_bootstrap.cc:492] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:10.943303 14420 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.943634 14419 ts_tablet_manager.cc:1403] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.004s
I20260709 13:17:10.946579 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:10.947120 14420 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.947162 14378 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:10.949260 14420 ts_tablet_manager.cc:1434] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:17:10.950327 14419 raft_consensus.cc:359] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.950299 14418 raft_consensus.cc:359] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.951076 14419 raft_consensus.cc:385] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.951171 14418 raft_consensus.cc:385] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:10.951408 14419 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.951555 14418 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:10.952216 14419 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.952419 14418 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:10.953085 14420 tablet_bootstrap.cc:492] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:10.958767 14418 ts_tablet_manager.cc:1434] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:17:10.959789 14418 tablet_bootstrap.cc:492] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:10.962687 14420 tablet_bootstrap.cc:654] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.954252 14419 ts_tablet_manager.cc:1434] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:17:10.965559 14418 tablet_bootstrap.cc:654] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:10.965991 14419 tablet_bootstrap.cc:492] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:10.974874 14378 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:10.975843 14303 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:10.977371 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:10.982533 14486 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:10.983208 14486 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:10.984273 14486 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.017455 14431 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.018271 14431 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.025199 14419 tablet_bootstrap.cc:654] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.026994 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:11.028605 14431 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.029392 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:11.031227 14418 tablet_bootstrap.cc:492] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:11.031847 14418 ts_tablet_manager.cc:1403] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.032s
I20260709 13:17:11.032437 14193 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:11.033180 14431 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:11.035733 14418 raft_consensus.cc:359] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.036186 14420 tablet_bootstrap.cc:492] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:11.037101 14420 ts_tablet_manager.cc:1403] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.006s
I20260709 13:17:11.036479 14418 raft_consensus.cc:385] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.039273 14418 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.039817 14420 raft_consensus.cc:359] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.040133 14418 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.040684 14420 raft_consensus.cc:385] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.041067 14420 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.041978 14418 ts_tablet_manager.cc:1434] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:17:11.042019 14420 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.044430 14420 ts_tablet_manager.cc:1434] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:11.045433 14420 tablet_bootstrap.cc:492] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:11.049186 14419 tablet_bootstrap.cc:492] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:11.049628 14419 ts_tablet_manager.cc:1403] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.084s	user 0.005s	sys 0.005s
I20260709 13:17:11.051424 14420 tablet_bootstrap.cc:654] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.050634 14124 catalog_manager.cc:5697] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.056339 14418 tablet_bootstrap.cc:492] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:11.063019 14420 tablet_bootstrap.cc:492] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:11.063498 14420 ts_tablet_manager.cc:1403] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:17:11.063772 14418 tablet_bootstrap.cc:654] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.063941 14496 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.064458 14496 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.066511 14496 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.066357 14420 raft_consensus.cc:359] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.067039 14420 raft_consensus.cc:385] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.067313 14420 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.067948 14420 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.068547 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.069123 14229 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:11.070429 14270 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:11.052109 14419 raft_consensus.cc:359] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.071976 14419 raft_consensus.cc:385] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.075795 14548 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.076274 14548 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.072252 14419 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.077731 14420 ts_tablet_manager.cc:1434] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.005s
I20260709 13:17:11.078449 14548 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.078703 14420 tablet_bootstrap.cc:492] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:11.081074 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:11.082136 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:11.083863 14267 leader_election.cc:343] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.084692 14420 tablet_bootstrap.cc:654] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.084952 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.077947 14419 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.086082 14303 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
W20260709 13:17:11.086709 14344 leader_election.cc:343] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.087318 14454 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:11.087659 14454 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.087949 14419 ts_tablet_manager.cc:1434] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:17:11.087970 14454 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.088883 14419 tablet_bootstrap.cc:492] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:11.096273 14418 tablet_bootstrap.cc:492] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:11.096786 14418 ts_tablet_manager.cc:1403] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.023s
I20260709 13:17:11.099433 14418 raft_consensus.cc:359] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.100129 14418 raft_consensus.cc:385] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.100437 14418 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.101133 14418 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.096331 14419 tablet_bootstrap.cc:654] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.105218 14458 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.105696 14418 ts_tablet_manager.cc:1434] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:11.105703 14458 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.106079 14342 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:11.106814 14418 tablet_bootstrap.cc:492] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:11.108202 14549 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:11.108800 14549 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.108341 14458 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.109324 14549 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.111589 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.112354 14229 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:11.114225 14270 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:11.114790 14431 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:11.115381 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:11.116894 14267 leader_election.cc:343] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.118376 14493 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:11.118867 14493 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.119282 14493 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.122095 14496 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.123003 14418 tablet_bootstrap.cc:654] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.122685 14496 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.126358 14301 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.137756 14481 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:11.148551 14548 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:11.153033 14438 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:17:11.152310 14175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:11.166045 14458 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.166813 14458 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.170792 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.173599 14458 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.174474 14419 tablet_bootstrap.cc:492] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:11.174635 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:11.199000 14419 ts_tablet_manager.cc:1403] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.024s
I20260709 13:17:11.199173 14374 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 1: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:17:11.176890 14496 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.178062 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:11.183435 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.161365 14454 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.207065 14227 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:11.200459 14267 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:11.222254 14458 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.225966 14418 tablet_bootstrap.cc:492] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:11.226430 14418 ts_tablet_manager.cc:1403] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.013s
I20260709 13:17:11.228425 14486 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.228897 14486 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.229534 14454 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.230309 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:11.230731 14486 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.230863 14377 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.228902 14270 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:11.231775 14458 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:11.231837 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:11.233055 14192 leader_election.cc:343] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.234473 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:11.235332 14419 raft_consensus.cc:359] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.236863 14419 raft_consensus.cc:385] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.237098 14419 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.239131 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:11.239703 14228 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:11.239919 14193 leader_election.cc:343] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.240367 14193 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:11.240602 14549 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.241431 14486 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:11.242105 14377 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:11.242935 14549 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.243065 14418 raft_consensus.cc:359] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.243844 14418 raft_consensus.cc:385] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.244014 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:11.244122 14418 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.244652 14302 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.244935 14418 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.247082 14418 ts_tablet_manager.cc:1434] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:17:11.246949 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:11.247687 14454 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:11.248152 14454 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:11.248853 14454 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.251447 14418 tablet_bootstrap.cc:492] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:11.252833 14302 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:11.259801 14418 tablet_bootstrap.cc:654] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.262287 14419 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.264591 14225 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.270159 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:11.277210 14419 ts_tablet_manager.cc:1434] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.000s
I20260709 13:17:11.227919 14493 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:11.278175 14344 leader_election.cc:343] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.280442 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:11.280565 14228 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:11.281050 14227 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.282238 14493 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.283133 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:11.278235 14419 tablet_bootstrap.cc:492] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
W20260709 13:17:11.284729 14267 leader_election.cc:343] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.285216 14342 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:11.286109 14549 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:11.287616 14549 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:11.288610 14549 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.302675 14458 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:11.307130 14227 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:11.307660 14420 tablet_bootstrap.cc:492] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:11.308099 14420 ts_tablet_manager.cc:1403] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.230s	user 0.064s	sys 0.066s
I20260709 13:17:11.308377 14438 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.314697 14270 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:11.315932 14438 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.316383 14458 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:11.316857 14458 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:11.322559 14438 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.325030 14420 raft_consensus.cc:359] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.325544 14420 raft_consensus.cc:385] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.325805 14420 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.326542 14420 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.328480 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:11.317679 14458 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:11.329879 14342 leader_election.cc:343] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.336210 14420 ts_tablet_manager.cc:1434] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:17:11.336287 14453 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:11.337756 14420 tablet_bootstrap.cc:492] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:11.323220 14548 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:17:11.346088 14438 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.354871 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.370677 14438 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.378145 14438 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.370384 14227 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:11.383399 14124 catalog_manager.cc:5697] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.386546 14419 tablet_bootstrap.cc:654] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.386782 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:11.387532 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.388587 14420 tablet_bootstrap.cc:654] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:11.393626 14344 leader_election.cc:343] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.404613 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:11.405488 14302 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:11.399750 14438 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:11.403599 14453 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.418190 14126 catalog_manager.cc:5697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.412340 14481 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:17:11.414191 14438 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.422384 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:11.435109 14549 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:11.427392 14438 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.421098 14453 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.455744 14418 tablet_bootstrap.cc:492] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:11.456277 14418 ts_tablet_manager.cc:1403] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.205s	user 0.015s	sys 0.029s
I20260709 13:17:11.435537 14549 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.460532 14549 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.459754 14589 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.470018 14589 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.474795 14453 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.467193 14467 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:17:11.476012 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:11.476657 14301 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:11.477841 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:11.478061 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.478698 14589 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.478644 14227 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:11.479215 14583 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:11.479604 14583 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.479938 14583 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.488082 14418 raft_consensus.cc:359] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.488716 14418 raft_consensus.cc:385] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.488988 14418 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.489547 14418 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.492070 14548 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.492627 14548 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.494776 14548 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.496526 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:11.497143 14549 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.499099 14549 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.501823 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:11.502516 14374 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:11.503244 14438 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.508852 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:17:11.509473 14193 leader_election.cc:343] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.509677 14431 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:11.510169 14431 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.510531 14431 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.510768 14481 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:11.516223 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.520645 14419 tablet_bootstrap.cc:492] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:11.521123 14419 ts_tablet_manager.cc:1403] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.243s	user 0.016s	sys 0.002s
I20260709 13:17:11.512466 14418 ts_tablet_manager.cc:1434] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 13:17:11.526134 14418 tablet_bootstrap.cc:492] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:11.521293 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:11.522356 14344 leader_election.cc:343] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.522953 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:11.527992 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:11.525566 14124 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.528533 14228 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.530443 14419 raft_consensus.cc:359] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.524685 14438 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.531330 14419 raft_consensus.cc:385] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.531726 14419 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.534241 14419 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.537283 14431 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.538156 14419 ts_tablet_manager.cc:1434] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 13:17:11.539129 14419 tablet_bootstrap.cc:492] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:11.541010 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:11.541626 14301 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.541684 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:11.542577 14583 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:11.539721 14344 leader_election.cc:343] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.554872 14573 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:17:11.556519 14228 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
W20260709 13:17:11.557334 14342 leader_election.cc:343] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.558203 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:11.558990 14589 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:11.564812 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:11.565443 14302 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.574599 14593 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.575284 14593 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:11.564055 14342 leader_election.cc:343] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.593259 14301 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:11.593343 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:11.593961 14378 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.586892 14431 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.591483 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:11.601002 14583 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.611197 14420 tablet_bootstrap.cc:492] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:11.611766 14420 ts_tablet_manager.cc:1403] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.274s	user 0.027s	sys 0.027s
I20260709 13:17:11.606385 14589 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:11.615381 14593 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.617413 14418 tablet_bootstrap.cc:654] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.605037 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:11.621614 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.624811 14419 tablet_bootstrap.cc:654] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:11.626518 14344 leader_election.cc:343] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.613219 14589 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:11.627651 14583 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:11.627867 14589 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.628579 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:11.628748 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:11.628674 14583 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:11.629285 14300 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.629927 14583 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.625592 14302 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
W20260709 13:17:11.634025 14342 leader_election.cc:343] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.647532 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:11.648543 14593 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:11.634486 14378 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:11.648775 14193 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:11.648957 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:11.651993 14228 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.652675 14573 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:11.658051 14573 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:11.658803 14573 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.671383 14420 raft_consensus.cc:359] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.679087 14420 raft_consensus.cc:385] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.679471 14420 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.682214 14420 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.688625 14420 ts_tablet_manager.cc:1434] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.003s
I20260709 13:17:11.689219 14454 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:11.692593 14420 tablet_bootstrap.cc:492] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:11.697819 14300 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:11.704010 14124 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.727269 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:11.728240 14589 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:11.728721 14589 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:11.729542 14589 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.735491 14418 tablet_bootstrap.cc:492] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:11.735939 14418 ts_tablet_manager.cc:1403] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.210s	user 0.018s	sys 0.033s
I20260709 13:17:11.746708 14454 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:11.749753 14125 catalog_manager.cc:5697] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.759076 14419 tablet_bootstrap.cc:492] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:11.759526 14419 ts_tablet_manager.cc:1403] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.221s	user 0.004s	sys 0.013s
I20260709 13:17:11.753166 14228 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:11.764900 14419 raft_consensus.cc:359] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.765695 14419 raft_consensus.cc:385] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.766003 14419 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.769773 14418 raft_consensus.cc:359] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.770529 14418 raft_consensus.cc:385] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.770790 14418 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.771409 14418 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.773324 14418 ts_tablet_manager.cc:1434] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.000s
I20260709 13:17:11.774166 14418 tablet_bootstrap.cc:492] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:11.777498 14420 tablet_bootstrap.cc:654] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.777328 14419 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.782546 14419 ts_tablet_manager.cc:1434] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:17:11.782058 14126 catalog_manager.cc:5697] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.783485 14419 tablet_bootstrap.cc:492] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:11.784752 14126 catalog_manager.cc:5697] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.797360 14419 tablet_bootstrap.cc:654] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.800015 14418 tablet_bootstrap.cc:654] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.801939 14589 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.802480 14589 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.804991 14589 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.805439 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.806238 14225 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:11.806685 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:11.807296 14302 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:11.807829 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:11.811404 14593 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:11.821480 14593 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.821910 14593 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.832453 14419 tablet_bootstrap.cc:492] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:11.832931 14419 ts_tablet_manager.cc:1403] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.013s
I20260709 13:17:11.834514 14593 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.835543 14419 raft_consensus.cc:359] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.836423 14419 raft_consensus.cc:385] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.836756 14419 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.837555 14419 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.838827 14593 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.841049 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:11.841590 14418 tablet_bootstrap.cc:492] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:11.841617 14302 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.842150 14418 ts_tablet_manager.cc:1403] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.003s
I20260709 13:17:11.843459 14419 ts_tablet_manager.cc:1434] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
W20260709 13:17:11.843544 14267 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f -> Peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Couldn't send request to peer 181bbac22422408c87cd13b7fe3008f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:11.844379 14419 tablet_bootstrap.cc:492] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:11.844978 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:11.845017 14418 raft_consensus.cc:359] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.845806 14225 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.850931 14420 tablet_bootstrap.cc:492] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:11.851277 14302 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:11.851460 14420 ts_tablet_manager.cc:1403] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.002s
I20260709 13:17:11.852964 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:11.853052 14225 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:11.853953 14583 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.845805 14418 raft_consensus.cc:385] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.854449 14418 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.854406 14583 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.855893 14419 tablet_bootstrap.cc:654] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.856067 14228 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.856606 14583 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:11.858251 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:11.862967 14342 leader_election.cc:343] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.864140 14583 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:11.865365 14589 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:11.865926 14589 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:11.867625 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:11.869688 14344 leader_election.cc:343] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.870281 14344 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:11.871598 14583 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:11.873642 14420 raft_consensus.cc:359] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.874456 14420 raft_consensus.cc:385] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:11.874699 14420 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.875278 14420 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.877311 14420 ts_tablet_manager.cc:1434] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.001s
I20260709 13:17:11.885043 14418 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.886231 14593 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:11.866773 14589 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.891601 14418 ts_tablet_manager.cc:1434] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:17:11.893131 14418 tablet_bootstrap.cc:492] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:11.895864 14420 tablet_bootstrap.cc:492] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:11.917443 14419 tablet_bootstrap.cc:492] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:11.917964 14419 ts_tablet_manager.cc:1403] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.074s	user 0.023s	sys 0.041s
I20260709 13:17:11.918485 14458 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:11.920249 14125 catalog_manager.cc:5697] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 2, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.929596 14420 tablet_bootstrap.cc:654] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.933385 14458 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.933904 14458 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.938864 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:11.939512 14378 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:11.940821 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:11.941651 14496 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:11.942044 14496 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.942381 14496 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.943089 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:11.943853 14419 raft_consensus.cc:359] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.944736 14419 raft_consensus.cc:385] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:11.944883 14270 leader_election.cc:343] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.945097 14419 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:11.937323 14458 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.945941 14419 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.957840 14419 ts_tablet_manager.cc:1434] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:17:11.958696 14419 tablet_bootstrap.cc:492] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:11.962236 14573 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.962720 14573 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.965441 14573 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.965827 14419 tablet_bootstrap.cc:654] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:11.966140 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:11.966748 14378 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:11.967938 14192 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:11.971163 14573 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:11.971521 14573 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.971436 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:11.971913 14573 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:11.973014 14193 leader_election.cc:343] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.950089 14496 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.985292 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:11.985998 14378 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:11.987737 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:17:11.989454 14270 leader_election.cc:343] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:11.990278 14496 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:11.994180 14420 tablet_bootstrap.cc:492] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:11.994413 14378 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:11.994704 14420 ts_tablet_manager.cc:1403] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.014s
I20260709 13:17:11.995553 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:11.996588 14458 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:11.997035 14458 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:12.002164 14458 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.004652 14573 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:11.997197 14420 raft_consensus.cc:359] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.007293 14420 raft_consensus.cc:385] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.007411 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:11.998796 14418 tablet_bootstrap.cc:654] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.006454 14493 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:12.008757 14193 leader_election.cc:343] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.007609 14420 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.008373 14493 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.011229 14420 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.013288 14420 ts_tablet_manager.cc:1434] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:17:12.018520 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:12.019147 14377 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.018627 14493 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.019052 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:12.022816 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:12.022964 14267 leader_election.cc:343] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.023475 14420 tablet_bootstrap.cc:492] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
W20260709 13:17:12.024147 14270 leader_election.cc:343] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.024592 14270 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:12.025615 14493 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.026814 14377 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:12.028057 14192 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:12.028888 14486 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:12.029341 14486 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:12.031196 14573 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.031740 14486 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.034148 14418 tablet_bootstrap.cc:492] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:12.036846 14420 tablet_bootstrap.cc:654] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.038637 14418 ts_tablet_manager.cc:1403] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.146s	user 0.012s	sys 0.000s
I20260709 13:17:12.039580 14419 tablet_bootstrap.cc:492] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:12.040028 14419 ts_tablet_manager.cc:1403] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.082s	user 0.039s	sys 0.026s
I20260709 13:17:12.037688 14124 catalog_manager.cc:5697] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.043238 14419 raft_consensus.cc:359] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.045679 14419 raft_consensus.cc:385] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.046275 14419 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.047048 14418 raft_consensus.cc:359] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.047740 14418 raft_consensus.cc:385] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.048007 14418 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.047885 14419 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.048859 14418 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.050906 14420 tablet_bootstrap.cc:492] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:12.051280 14419 ts_tablet_manager.cc:1434] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:17:12.051326 14420 ts_tablet_manager.cc:1403] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 13:17:12.052294 14419 tablet_bootstrap.cc:492] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:12.054190 14420 raft_consensus.cc:359] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.054806 14420 raft_consensus.cc:385] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.055085 14420 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.055775 14420 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.057719 14420 ts_tablet_manager.cc:1434] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:17:12.058251 14419 tablet_bootstrap.cc:654] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.058631 14420 tablet_bootstrap.cc:492] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:12.062829 14418 ts_tablet_manager.cc:1434] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:17:12.070804 14420 tablet_bootstrap.cc:654] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.073365 14573 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.074620 14418 tablet_bootstrap.cc:492] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:12.077718 14419 tablet_bootstrap.cc:492] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:12.074941 14126 catalog_manager.cc:5697] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.078193 14419 ts_tablet_manager.cc:1403] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.006s
I20260709 13:17:12.080721 14419 raft_consensus.cc:359] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.081398 14419 raft_consensus.cc:385] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.081657 14419 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.082413 14419 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.084223 14418 tablet_bootstrap.cc:654] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.084611 14419 ts_tablet_manager.cc:1434] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:17:12.088649 14419 tablet_bootstrap.cc:492] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:12.094138 14419 tablet_bootstrap.cc:654] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.105895 14420 tablet_bootstrap.cc:492] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:12.106475 14420 ts_tablet_manager.cc:1403] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.000s
I20260709 13:17:12.109148 14420 raft_consensus.cc:359] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.109818 14420 raft_consensus.cc:385] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.110098 14420 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.110725 14420 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.111688 14431 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:12.112737 14420 ts_tablet_manager.cc:1434] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:17:12.111644 14302 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.113639 14420 tablet_bootstrap.cc:492] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:12.120965 14486 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.123816 14486 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.132301 14418 tablet_bootstrap.cc:492] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:12.132788 14418 ts_tablet_manager.cc:1403] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.058s	user 0.030s	sys 0.001s
I20260709 13:17:12.141685 14486 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.143702 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:12.144454 14375 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:12.145164 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:12.144294 14589 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:12.146991 14193 leader_election.cc:343] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.149190 14419 tablet_bootstrap.cc:492] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:12.149631 14419 ts_tablet_manager.cc:1403] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.005s
I20260709 13:17:12.152434 14419 raft_consensus.cc:359] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.152882 14589 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.153081 14419 raft_consensus.cc:385] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.153371 14419 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.154924 14192 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:12.155898 14419 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.158169 14481 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.158793 14419 ts_tablet_manager.cc:1434] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:12.159678 14419 tablet_bootstrap.cc:492] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:12.158541 14481 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.163323 14481 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.164984 14458 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.165438 14458 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.166064 14419 tablet_bootstrap.cc:654] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.168255 14458 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.168603 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:12.169325 14227 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:12.170552 14270 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:12.171973 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:12.173125 14267 leader_election.cc:343] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.173236 14458 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.173588 14458 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.173945 14458 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.192005 14418 raft_consensus.cc:359] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.193049 14418 raft_consensus.cc:385] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.193337 14418 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.184636 14481 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.197453 14420 tablet_bootstrap.cc:654] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.197896 14418 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.202387 14419 tablet_bootstrap.cc:492] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:12.204612 14419 ts_tablet_manager.cc:1403] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.012s
I20260709 13:17:12.208745 14458 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.210798 14458 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.211628 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:12.212256 14227 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.215672 14481 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.216241 14418 ts_tablet_manager.cc:1434] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.002s
I20260709 13:17:12.217387 14418 tablet_bootstrap.cc:492] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:12.218159 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:12.220001 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:12.220590 14302 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:12.221040 14267 leader_election.cc:343] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.221859 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:12.222450 14375 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.235037 14375 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:12.236092 14192 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:12.237040 14481 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:12.237687 14481 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:12.238520 14481 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.241268 14302 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
W20260709 13:17:12.242005 14175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:12.250842 14419 raft_consensus.cc:359] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.251528 14419 raft_consensus.cc:385] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.251784 14419 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.252347 14438 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:12.249481 14227 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:12.252413 14419 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.256417 14420 tablet_bootstrap.cc:492] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:12.266868 14375 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.267064 14418 tablet_bootstrap.cc:654] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.262897 14270 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:12.270087 14420 ts_tablet_manager.cc:1403] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.157s	user 0.020s	sys 0.007s
I20260709 13:17:12.270599 14419 ts_tablet_manager.cc:1434] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
I20260709 13:17:12.271633 14419 tablet_bootstrap.cc:492] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:12.273550 14458 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:12.277599 14458 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:12.278465 14458 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.282037 14420 raft_consensus.cc:359] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.282697 14420 raft_consensus.cc:385] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.282972 14420 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.283700 14420 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.289561 14593 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.290611 14419 tablet_bootstrap.cc:654] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.292975 14227 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.292500 14125 catalog_manager.cc:5697] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.304998 14418 tablet_bootstrap.cc:492] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:12.305575 14418 ts_tablet_manager.cc:1403] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.005s
I20260709 13:17:12.308526 14418 raft_consensus.cc:359] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.309324 14418 raft_consensus.cc:385] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.309749 14418 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.312043 14418 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.311064 14637 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:12.289726 14420 ts_tablet_manager.cc:1434] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:17:12.321236 14418 ts_tablet_manager.cc:1434] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:17:12.321477 14420 tablet_bootstrap.cc:492] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:12.322521 14637 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:12.323928 14583 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.322259 14418 tablet_bootstrap.cc:492] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:12.324390 14583 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.327286 14583 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:12.328552 14486 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.328717 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:12.329206 14486 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.330400 14225 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:12.332284 14486 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.332566 14418 tablet_bootstrap.cc:654] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.333858 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:12.334486 14377 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:12.338482 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:12.342903 14486 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.343377 14486 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.347390 14486 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.346442 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:12.343940 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:12.351594 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:12.361004 14639 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.361584 14639 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:12.362411 14193 leader_election.cc:343] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.362008 14639 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:12.363201 14342 leader_election.cc:343] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.366673 14125 catalog_manager.cc:5697] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.382087 14639 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.387634 14493 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.388190 14493 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.389917 14639 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:12.390529 14493 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.392138 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:12.394287 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:12.395449 14486 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.396045 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:12.396178 14270 leader_election.cc:343] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.397284 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:17:12.397581 14267 leader_election.cc:343] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.398066 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:12.398351 14228 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 1: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:17:12.399225 14342 leader_election.cc:343] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.399466 14496 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.400964 14418 tablet_bootstrap.cc:492] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:12.401364 14418 ts_tablet_manager.cc:1403] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.000s
I20260709 13:17:12.401162 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:12.402235 14637 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.403610 14486 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.404532 14419 tablet_bootstrap.cc:492] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:12.404624 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:12.404948 14419 ts_tablet_manager.cc:1403] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.133s	user 0.007s	sys 0.010s
I20260709 13:17:12.405388 14375 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:12.407348 14419 raft_consensus.cc:359] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.407840 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:12.408093 14419 raft_consensus.cc:385] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.408396 14419 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
W20260709 13:17:12.409215 14193 leader_election.cc:343] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.409139 14419 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.409727 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:12.410485 14486 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:12.411185 14419 ts_tablet_manager.cc:1434] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:17:12.412050 14419 tablet_bootstrap.cc:492] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:12.399519 14420 tablet_bootstrap.cc:654] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.417582 14419 tablet_bootstrap.cc:654] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.417395 14418 raft_consensus.cc:359] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.419843 14418 raft_consensus.cc:385] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.420210 14418 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.420935 14418 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.425294 14418 ts_tablet_manager.cc:1434] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:17:12.426251 14418 tablet_bootstrap.cc:492] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:12.437054 14420 tablet_bootstrap.cc:492] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:12.437268 14419 tablet_bootstrap.cc:492] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:12.437541 14420 ts_tablet_manager.cc:1403] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.004s
I20260709 13:17:12.437772 14419 ts_tablet_manager.cc:1403] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.007s
I20260709 13:17:12.439762 14419 raft_consensus.cc:359] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.440392 14419 raft_consensus.cc:385] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.440215 14420 raft_consensus.cc:359] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.440717 14419 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.440922 14420 raft_consensus.cc:385] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.442541 14228 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:12.441350 14420 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.443435 14420 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.441367 14419 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.443953 14637 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.446062 14420 ts_tablet_manager.cc:1434] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:17:12.446913 14420 tablet_bootstrap.cc:492] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:12.445755 14419 ts_tablet_manager.cc:1434] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.003s
I20260709 13:17:12.449456 14419 tablet_bootstrap.cc:492] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:12.452769 14418 tablet_bootstrap.cc:654] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.456434 14420 tablet_bootstrap.cc:654] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.458375 14419 tablet_bootstrap.cc:654] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.468530 14420 tablet_bootstrap.cc:492] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:12.468823 14418 tablet_bootstrap.cc:492] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:12.469019 14420 ts_tablet_manager.cc:1403] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:17:12.470769 14300 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:12.471547 14420 raft_consensus.cc:359] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.472229 14420 raft_consensus.cc:385] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.472488 14420 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.472895 14640 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.474900 14420 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.477150 14420 ts_tablet_manager.cc:1434] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:17:12.477919 14418 ts_tablet_manager.cc:1403] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.008s
I20260709 13:17:12.478068 14420 tablet_bootstrap.cc:492] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:12.480953 14227 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.487795 14418 raft_consensus.cc:359] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.488521 14418 raft_consensus.cc:385] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.488804 14418 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.488808 14496 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.489564 14418 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.491546 14418 ts_tablet_manager.cc:1434] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:17:12.492451 14418 tablet_bootstrap.cc:492] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:12.499823 14486 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.500512 14486 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.504601 14486 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.504997 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:12.505697 14375 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:12.507021 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:12.507670 14302 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:12.507876 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:12.508774 14481 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.509250 14481 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.509606 14418 tablet_bootstrap.cc:654] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.509688 14481 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.516966 14481 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.520574 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:12.521126 14377 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.523073 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:12.523626 14304 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.532516 14493 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:12.539894 14304 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:12.541236 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:12.542358 14486 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:12.542831 14486 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:12.543639 14486 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.548593 14453 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.549823 14640 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.550522 14640 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.554411 14640 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:12.555459 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:12.556340 14302 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:12.557925 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:12.559077 14640 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.565483 14640 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.566525 14640 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.555402 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:12.560797 14377 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
W20260709 13:17:12.571128 14344 leader_election.cc:343] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.572729 14481 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.580582 14420 tablet_bootstrap.cc:654] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.592610 14640 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.612473 14300 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:12.643020 14654 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:12.644049 14418 tablet_bootstrap.cc:492] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:12.644516 14418 ts_tablet_manager.cc:1403] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.152s	user 0.034s	sys 0.042s
I20260709 13:17:12.655045 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:17:12.656833 14344 leader_election.cc:343] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.688591 14418 raft_consensus.cc:359] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.689352 14418 raft_consensus.cc:385] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.689623 14418 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.690302 14418 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.695585 14640 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:12.696218 14658 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:12.698129 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:12.709883 14420 tablet_bootstrap.cc:492] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:12.710386 14420 ts_tablet_manager.cc:1403] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.233s	user 0.033s	sys 0.016s
I20260709 13:17:12.716570 14420 raft_consensus.cc:359] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.717233 14420 raft_consensus.cc:385] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.717490 14420 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.719715 14418 ts_tablet_manager.cc:1434] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.075s	user 0.012s	sys 0.009s
I20260709 13:17:12.720603 14418 tablet_bootstrap.cc:492] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:12.721309 14420 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.727903 14419 tablet_bootstrap.cc:492] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:12.728375 14419 ts_tablet_manager.cc:1403] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.279s	user 0.024s	sys 0.028s
I20260709 13:17:12.729867 14300 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.734207 14420 ts_tablet_manager.cc:1434] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:17:12.732126 14419 raft_consensus.cc:359] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.734654 14419 raft_consensus.cc:385] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.734997 14419 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.735697 14419 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.738289 14419 ts_tablet_manager.cc:1434] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:17:12.738840 14420 tablet_bootstrap.cc:492] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:12.739341 14419 tablet_bootstrap.cc:492] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:12.741103 14658 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.745872 14300 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:12.747251 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:12.748059 14640 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:12.748521 14640 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:12.749272 14640 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.751844 14420 tablet_bootstrap.cc:654] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.742744 14124 catalog_manager.cc:5697] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.756855 14418 tablet_bootstrap.cc:654] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.758472 14419 tablet_bootstrap.cc:654] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.764737 14418 tablet_bootstrap.cc:492] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:12.765255 14418 ts_tablet_manager.cc:1403] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:17:12.771842 14420 tablet_bootstrap.cc:492] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:12.772315 14420 ts_tablet_manager.cc:1403] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.000s
I20260709 13:17:12.776568 14486 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.768282 14418 raft_consensus.cc:359] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.777649 14418 raft_consensus.cc:385] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.777978 14418 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.778609 14419 tablet_bootstrap.cc:492] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:12.778640 14418 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.779706 14419 ts_tablet_manager.cc:1403] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.016s
I20260709 13:17:12.780860 14418 ts_tablet_manager.cc:1434] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:17:12.781852 14418 tablet_bootstrap.cc:492] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:12.783385 14637 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.783864 14637 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.786036 14419 raft_consensus.cc:359] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.786952 14419 raft_consensus.cc:385] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.787288 14419 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.787590 14637 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:12.788141 14419 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.789253 14418 tablet_bootstrap.cc:654] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.790036 14419 ts_tablet_manager.cc:1434] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:12.790982 14419 tablet_bootstrap.cc:492] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:12.791060 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:12.794827 14344 leader_election.cc:343] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.788365 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:12.796186 14300 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:12.797770 14419 tablet_bootstrap.cc:654] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.797945 14342 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:12.799608 14637 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.800000 14637 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.800338 14637 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.806761 14420 raft_consensus.cc:359] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.807695 14420 raft_consensus.cc:385] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.808079 14420 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.809244 14125 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:12.810010 14420 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.821450 14420 ts_tablet_manager.cc:1434] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:17:12.823727 14637 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.827082 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:12.827723 14304 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.838865 14304 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:12.840571 14342 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:12.841920 14640 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:12.842579 14640 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:12.843721 14640 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.848560 14420 tablet_bootstrap.cc:492] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
W20260709 13:17:12.849630 14267 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Couldn't send request to peer 181bbac22422408c87cd13b7fe3008f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:12.849514 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:17:12.852820 14344 leader_election.cc:343] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.854117 14637 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:12.856139 14420 tablet_bootstrap.cc:654] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.869020 14420 tablet_bootstrap.cc:492] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:12.869647 14420 ts_tablet_manager.cc:1403] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:17:12.873142 14637 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.873623 14637 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.875876 14637 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:12.872838 14420 raft_consensus.cc:359] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.876869 14420 raft_consensus.cc:385] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.876906 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:12.877198 14420 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.877977 14420 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:12.878465 14342 leader_election.cc:343] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.880136 14420 ts_tablet_manager.cc:1434] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:17:12.873556 14127 catalog_manager.cc:5697] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:12.876698 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:12.882246 14229 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:12.883483 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:12.884657 14637 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.884997 14637 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.885304 14418 tablet_bootstrap.cc:492] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:12.885336 14637 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.885912 14418 ts_tablet_manager.cc:1403] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.104s	user 0.018s	sys 0.019s
I20260709 13:17:12.886004 14420 tablet_bootstrap.cc:492] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:12.890543 14419 tablet_bootstrap.cc:492] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:12.891037 14419 ts_tablet_manager.cc:1403] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.100s	user 0.037s	sys 0.022s
I20260709 13:17:12.892236 14420 tablet_bootstrap.cc:654] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.893357 14418 raft_consensus.cc:359] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.894050 14418 raft_consensus.cc:385] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.894317 14418 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.894968 14418 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.896225 14419 raft_consensus.cc:359] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.897302 14419 raft_consensus.cc:385] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.897725 14419 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.898852 14419 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.902659 14419 ts_tablet_manager.cc:1434] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:12.904158 14419 tablet_bootstrap.cc:492] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:12.911064 14496 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.914839 14418 ts_tablet_manager.cc:1434] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:17:12.921007 14419 tablet_bootstrap.cc:654] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.924623 14418 tablet_bootstrap.cc:492] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:12.926550 14637 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.928730 14637 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:12.930142 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:17:12.931854 14342 leader_election.cc:343] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.932765 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:12.933475 14227 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.936440 14419 tablet_bootstrap.cc:492] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:12.937096 14419 ts_tablet_manager.cc:1403] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.012s
I20260709 13:17:12.939002 14496 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.939762 14496 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.946903 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:12.947559 14228 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:12.947992 14420 tablet_bootstrap.cc:492] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:12.948426 14420 ts_tablet_manager.cc:1403] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.042s
I20260709 13:17:12.949862 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:12.951388 14267 leader_election.cc:343] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:12.951200 14420 raft_consensus.cc:359] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.951874 14420 raft_consensus.cc:385] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.952008 14496 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.952188 14420 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.953030 14420 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.953683 14270 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:12.955070 14420 ts_tablet_manager.cc:1434] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:12.955472 14496 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.955879 14496 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.956012 14420 tablet_bootstrap.cc:492] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:12.956342 14496 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.961560 14660 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.962029 14660 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.962568 14420 tablet_bootstrap.cc:654] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.964841 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:12.965561 14304 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:12.966535 14486 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:12.967922 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:12.968508 14193 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:12.968736 14374 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:12.969173 14227 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:12.969533 14486 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:12.969938 14486 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.970122 14660 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.970296 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:12.970315 14486 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.971446 14637 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:12.954886 14419 raft_consensus.cc:359] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.972155 14419 raft_consensus.cc:385] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.979907 14419 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.973026 14418 tablet_bootstrap.cc:654] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:12.983549 14420 tablet_bootstrap.cc:492] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:12.984045 14420 ts_tablet_manager.cc:1403] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.010s
I20260709 13:17:12.972172 14637 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:12.980381 14486 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.990029 14637 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.990860 14486 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:12.988327 14420 raft_consensus.cc:359] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.993757 14420 raft_consensus.cc:385] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:12.994478 14420 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:12.995193 14420 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:12.995597 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:12.996249 14375 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.996841 14420 ts_tablet_manager.cc:1434] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:17:12.997731 14420 tablet_bootstrap.cc:492] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:12.995597 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:12.998490 14300 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:12.995515 14419 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.004967 14420 tablet_bootstrap.cc:654] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.007278 14418 tablet_bootstrap.cc:492] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:13.007890 14418 ts_tablet_manager.cc:1403] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.000s
I20260709 13:17:13.009895 14420 tablet_bootstrap.cc:492] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:13.010424 14420 ts_tablet_manager.cc:1403] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.005s
I20260709 13:17:13.011360 14418 raft_consensus.cc:359] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.012027 14418 raft_consensus.cc:385] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.012287 14418 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.013371 14375 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:13.015414 14420 raft_consensus.cc:359] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.015614 14419 ts_tablet_manager.cc:1434] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.078s	user 0.002s	sys 0.005s
I20260709 13:17:13.016319 14420 raft_consensus.cc:385] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.016721 14420 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.018117 14420 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.020594 14420 ts_tablet_manager.cc:1434] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:17:13.021507 14420 tablet_bootstrap.cc:492] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:13.022276 14419 tablet_bootstrap.cc:492] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:13.024931 14496 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.028390 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:13.029019 14227 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.031402 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:13.032248 14486 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.034811 14486 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:13.013157 14418 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.035624 14486 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.039341 14300 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:13.042846 14660 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.047894 14420 tablet_bootstrap.cc:654] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.053336 14227 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:13.054864 14270 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:13.053666 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:13.055859 14493 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.056406 14493 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:17:13.057061 14267 leader_election.cc:343] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.057380 14493 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.057881 14637 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.057152 14126 catalog_manager.cc:5697] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:13.058447 14637 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.061342 14420 tablet_bootstrap.cc:492] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:13.061980 14420 ts_tablet_manager.cc:1403] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.003s
I20260709 13:17:13.069483 14486 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.069416 14420 raft_consensus.cc:359] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.070533 14420 raft_consensus.cc:385] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.070132 14486 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.070833 14420 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.071534 14420 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.073493 14486 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.078881 14637 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:13.079027 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:13.082738 14496 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.084791 14420 ts_tablet_manager.cc:1434] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:17:13.037225 14418 ts_tablet_manager.cc:1434] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:17:13.080405 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:13.086865 14418 tablet_bootstrap.cc:492] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:13.088513 14342 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:13.090127 14419 tablet_bootstrap.cc:654] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.093602 14420 tablet_bootstrap.cc:492] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:13.095041 14640 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.101862 14125 catalog_manager.cc:5697] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.120663 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:13.121587 14300 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:13.078159 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:13.132961 14418 tablet_bootstrap.cc:654] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.141307 14420 tablet_bootstrap.cc:654] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.144802 14486 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.145335 14486 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.149613 14227 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.160957 14496 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.158424 14192 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:13.161476 14496 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.162209 14486 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.167100 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:13.167737 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:13.168138 14496 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.168393 14229 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:13.167142 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:13.168103 14302 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:13.172179 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:13.172297 14419 tablet_bootstrap.cc:492] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:13.169528 14496 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.172851 14419 ts_tablet_manager.cc:1403] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.151s	user 0.014s	sys 0.012s
I20260709 13:17:13.172974 14496 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.175416 14496 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.176936 14496 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.177306 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:13.177350 14419 raft_consensus.cc:359] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.177354 14496 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.178188 14419 raft_consensus.cc:385] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.178262 14229 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 1: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:17:13.178576 14419 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.178618 14496 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.179319 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:13.179257 14419 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.180351 14573 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.180761 14573 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.181169 14573 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.181561 14419 ts_tablet_manager.cc:1434] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:13.182768 14419 tablet_bootstrap.cc:492] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:13.183651 14418 tablet_bootstrap.cc:492] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:13.184092 14418 ts_tablet_manager.cc:1403] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.011s
I20260709 13:17:13.170312 14378 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:13.186596 14486 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.188225 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:13.188994 14377 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:13.192349 14637 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.194166 14420 tablet_bootstrap.cc:492] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:13.194640 14420 ts_tablet_manager.cc:1403] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.008s
I20260709 13:17:13.195137 14573 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.197057 14496 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.201682 14573 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.202580 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:13.200142 14420 raft_consensus.cc:359] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.199733 14419 tablet_bootstrap.cc:654] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.203202 14378 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.203266 14420 raft_consensus.cc:385] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.205318 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:13.205495 14420 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.206067 14227 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 1: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:17:13.198187 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:13.197449 14418 raft_consensus.cc:359] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.208326 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:13.206620 14420 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.206729 14496 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.211675 14377 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:13.210793 14420 ts_tablet_manager.cc:1434] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.003s
I20260709 13:17:13.210994 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:13.212975 14420 tablet_bootstrap.cc:492] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:13.213668 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:13.214699 14493 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.215358 14493 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.220343 14420 tablet_bootstrap.cc:654] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.227821 14458 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.228264 14493 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.228430 14458 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.230196 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:13.230953 14302 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 1: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:17:13.206872 14418 raft_consensus.cc:385] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.221670 14378 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:13.236279 14458 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.241652 14637 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:13.244450 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:13.254231 14420 tablet_bootstrap.cc:492] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:13.254784 14420 ts_tablet_manager.cc:1403] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.007s
I20260709 13:17:13.239602 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:13.259912 14270 leader_election.cc:343] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.239230 14418 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
W20260709 13:17:13.262264 14267 leader_election.cc:343] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.262439 14418 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.263096 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:13.264344 14458 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.265161 14418 ts_tablet_manager.cc:1434] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.001s
I20260709 13:17:13.265035 14458 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.266214 14420 raft_consensus.cc:359] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.266986 14420 raft_consensus.cc:385] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.267297 14420 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.242249 14126 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.268038 14420 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.268990 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:13.269739 14420 ts_tablet_manager.cc:1434] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:17:13.274706 14420 tablet_bootstrap.cc:492] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:13.269810 14229 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:13.270738 14431 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.279945 14431 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.283331 14458 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.284184 14431 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.285008 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:13.287611 14420 tablet_bootstrap.cc:654] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.272416 14496 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.268241 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:13.293154 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:13.266180 14418 tablet_bootstrap.cc:492] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
W20260709 13:17:13.297724 14193 leader_election.cc:343] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.300136 14573 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.296119 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:13.317912 14496 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.315491 14573 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:13.330756 14573 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.338404 14453 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.338901 14453 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.341194 14453 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.344120 14496 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.344296 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:13.325465 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:13.345866 14378 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
W20260709 13:17:13.349975 14192 leader_election.cc:343] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.350723 14377 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:13.353480 14175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:13.350754 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:13.355974 14431 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.356499 14431 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.356947 14431 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.357098 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:13.358964 14419 tablet_bootstrap.cc:492] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:13.360522 14419 ts_tablet_manager.cc:1403] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.178s	user 0.025s	sys 0.057s
I20260709 13:17:13.363603 14419 raft_consensus.cc:359] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.372249 14431 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.374354 14419 raft_consensus.cc:385] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.374878 14419 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.375748 14420 tablet_bootstrap.cc:492] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:13.376245 14420 ts_tablet_manager.cc:1403] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.022s
I20260709 13:17:13.376238 14419 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.380679 14419 ts_tablet_manager.cc:1434] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.003s
I20260709 13:17:13.381646 14419 tablet_bootstrap.cc:492] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
W20260709 13:17:13.389978 14193 leader_election.cc:343] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.390439 14193 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:13.391496 14486 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.392925 14420 raft_consensus.cc:359] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.393646 14420 raft_consensus.cc:385] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.393937 14420 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.394605 14420 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.400451 14420 ts_tablet_manager.cc:1434] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:17:13.401423 14420 tablet_bootstrap.cc:492] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:13.404321 14431 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.407320 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:13.407994 14304 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.410488 14229 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.424592 14583 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.429563 14593 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.430974 14304 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:13.422801 14127 catalog_manager.cc:5697] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.434487 14193 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:13.435961 14486 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.436390 14486 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:13.437081 14486 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.429670 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:13.442729 14418 tablet_bootstrap.cc:654] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.453735 14419 tablet_bootstrap.cc:654] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.440907 14378 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.471529 14639 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:17:13.496768 14377 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.499161 14486 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:13.536681 14458 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:13.544773 14486 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.545346 14486 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.547322 14486 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.548097 14420 tablet_bootstrap.cc:654] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.555104 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:13.556296 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:13.560539 14193 leader_election.cc:343] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:13.573494 14192 leader_election.cc:343] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.574023 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:13.574781 14431 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.589339 14419 tablet_bootstrap.cc:492] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:13.590044 14419 ts_tablet_manager.cc:1403] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.209s	user 0.022s	sys 0.021s
I20260709 13:17:13.601822 14378 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
W20260709 13:17:13.605516 14696 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:13.611243 14419 raft_consensus.cc:359] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.611956 14419 raft_consensus.cc:385] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.612237 14419 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.612758 14419 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.615837 14419 ts_tablet_manager.cc:1434] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 13:17:13.614452 14125 catalog_manager.cc:5697] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.622756 14660 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.624118 14639 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.626194 14701 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.627023 14418 tablet_bootstrap.cc:492] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:13.627491 14418 ts_tablet_manager.cc:1403] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.362s	user 0.017s	sys 0.013s
I20260709 13:17:13.628331 14496 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.628830 14496 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.628571 14419 tablet_bootstrap.cc:492] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:13.630136 14418 raft_consensus.cc:359] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.630752 14418 raft_consensus.cc:385] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.631009 14418 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.631630 14418 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.633164 14660 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.633884 14418 ts_tablet_manager.cc:1434] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:17:13.633615 14660 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.634693 14418 tablet_bootstrap.cc:492] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:13.635494 14660 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.637033 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:13.638768 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:13.640233 14192 leader_election.cc:343] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.640728 14418 tablet_bootstrap.cc:654] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.646454 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:13.648166 14270 leader_election.cc:343] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:13.649506 14193 leader_election.cc:343] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.650022 14193 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:13.650686 14431 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.654560 14420 tablet_bootstrap.cc:492] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:13.655100 14420 ts_tablet_manager.cc:1403] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.254s	user 0.008s	sys 0.007s
I20260709 13:17:13.651355 14496 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.658449 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:13.675238 14420 raft_consensus.cc:359] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.676221 14420 raft_consensus.cc:385] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.676558 14420 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.677386 14420 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:13.686337 14267 leader_election.cc:343] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.686781 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:13.688205 14496 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.691360 14420 ts_tablet_manager.cc:1434] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:17:13.694514 14420 tablet_bootstrap.cc:492] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:13.698669 14660 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.699092 14660 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.700888 14660 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.702093 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:13.702304 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:13.702874 14374 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:13.702919 14302 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:13.704183 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:13.704962 14431 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.705312 14431 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.705631 14418 tablet_bootstrap.cc:492] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:13.705678 14431 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.706272 14418 ts_tablet_manager.cc:1403] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.025s
I20260709 13:17:13.712788 14431 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.715593 14418 raft_consensus.cc:359] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.716293 14418 raft_consensus.cc:385] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.716146 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:13.716575 14418 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.716730 14374 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.718192 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:13.718772 14304 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.719115 14431 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.724009 14419 tablet_bootstrap.cc:654] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.728294 14420 tablet_bootstrap.cc:654] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.728470 14374 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:13.729887 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:13.730576 14431 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.731251 14431 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:13.732100 14431 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.717242 14418 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.737975 14419 tablet_bootstrap.cc:492] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:13.738446 14419 ts_tablet_manager.cc:1403] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.110s	user 0.009s	sys 0.004s
I20260709 13:17:13.741086 14419 raft_consensus.cc:359] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.742748 14418 ts_tablet_manager.cc:1434] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:17:13.744005 14304 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:13.746102 14420 tablet_bootstrap.cc:492] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:13.746578 14420 ts_tablet_manager.cc:1403] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.000s
I20260709 13:17:13.748026 14486 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.749069 14420 raft_consensus.cc:359] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.750391 14418 tablet_bootstrap.cc:492] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:13.750435 14419 raft_consensus.cc:385] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.754237 14419 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.754966 14419 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.750460 14127 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.758169 14486 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.761183 14419 ts_tablet_manager.cc:1434] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:17:13.762132 14419 tablet_bootstrap.cc:492] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:13.749748 14420 raft_consensus.cc:385] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.766101 14420 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.766782 14420 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.768779 14420 ts_tablet_manager.cc:1434] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.000s
I20260709 13:17:13.769608 14420 tablet_bootstrap.cc:492] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:13.775223 14420 tablet_bootstrap.cc:654] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.779660 14419 tablet_bootstrap.cc:654] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.784014 14420 tablet_bootstrap.cc:492] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:13.784479 14420 ts_tablet_manager.cc:1403] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:17:13.784530 14418 tablet_bootstrap.cc:654] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.786839 14420 raft_consensus.cc:359] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.787427 14420 raft_consensus.cc:385] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.787709 14420 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.788322 14420 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.797901 14420 ts_tablet_manager.cc:1434] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:17:13.798832 14420 tablet_bootstrap.cc:492] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:13.804689 14420 tablet_bootstrap.cc:654] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.805190 14418 tablet_bootstrap.cc:492] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:13.805662 14418 ts_tablet_manager.cc:1403] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.005s
I20260709 13:17:13.809629 14419 tablet_bootstrap.cc:492] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:13.810206 14419 ts_tablet_manager.cc:1403] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.002s
I20260709 13:17:13.812894 14419 raft_consensus.cc:359] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.813553 14419 raft_consensus.cc:385] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.813829 14419 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.814448 14419 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.816553 14419 ts_tablet_manager.cc:1434] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:13.809506 14418 raft_consensus.cc:359] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.817873 14418 raft_consensus.cc:385] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.818217 14418 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.818224 14419 tablet_bootstrap.cc:492] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:13.819023 14418 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.821146 14418 ts_tablet_manager.cc:1434] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:17:13.824167 14419 tablet_bootstrap.cc:654] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.824119 14639 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.824715 14639 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.826996 14418 tablet_bootstrap.cc:492] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:13.827831 14639 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:13.832273 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:13.829243 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:13.833463 14225 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:13.834828 14419 tablet_bootstrap.cc:492] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:13.834707 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:13.835264 14419 ts_tablet_manager.cc:1403] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:17:13.835544 14639 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.835948 14639 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.836268 14639 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.837829 14419 raft_consensus.cc:359] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.838507 14419 raft_consensus.cc:385] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.838771 14419 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.841418 14658 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.841887 14658 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.844003 14658 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:17:13.844013 14342 leader_election.cc:343] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.845024 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:13.846294 14192 leader_election.cc:343] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.846210 14419 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.847564 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:13.848886 14193 leader_election.cc:343] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.849257 14193 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:13.850247 14486 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:13.841220 14418 tablet_bootstrap.cc:654] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.853101 14419 ts_tablet_manager.cc:1434] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:17:13.861006 14658 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.867951 14418 tablet_bootstrap.cc:492] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:13.868942 14418 ts_tablet_manager.cc:1403] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.012s
I20260709 13:17:13.872340 14418 raft_consensus.cc:359] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.873116 14418 raft_consensus.cc:385] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:13.873435 14418 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:13.874125 14418 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.875861 14419 tablet_bootstrap.cc:492] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:13.876179 14418 ts_tablet_manager.cc:1434] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:13.850277 14639 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.881457 14418 tablet_bootstrap.cc:492] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:13.881934 14419 tablet_bootstrap.cc:654] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.881587 14658 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:13.883432 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:13.884019 14300 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.887945 14418 tablet_bootstrap.cc:654] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.896543 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:13.897347 14227 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.900527 14658 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.901077 14658 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.904488 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:13.905969 14192 leader_election.cc:343] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.906515 14658 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.906584 14300 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:13.907804 14342 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:13.909130 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:13.910044 14301 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:13.911878 14583 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:13.915337 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:13.916273 14658 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.916690 14658 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.917117 14658 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.926842 14701 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.927510 14701 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.930132 14583 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:13.931234 14583 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.931778 14701 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.931964 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:13.933152 14267 leader_election.cc:343] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.934312 14639 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:13.934336 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:13.936913 14225 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:13.929380 14658 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.938534 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:13.941747 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:13.942381 14301 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.944607 14701 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.945152 14701 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.945657 14701 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.951297 14639 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.951927 14639 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.958751 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:13.959160 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:13.959646 14228 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:13.959990 14300 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:13.961257 14344 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:13.963631 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:17:13.966152 14192 leader_election.cc:343] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.966794 14658 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:13.967546 14583 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:13.968019 14583 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.968411 14583 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:13.987942 14227 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:13.995200 14640 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.995870 14640 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:13.998479 14640 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:14.001763 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:14.002669 14229 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:14.005599 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:14.007339 14640 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.007426 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:14.007809 14640 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.008291 14640 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:14.009078 14342 leader_election.cc:343] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:13.958786 14639 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:14.019057 14420 tablet_bootstrap.cc:492] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:14.019549 14420 ts_tablet_manager.cc:1403] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.221s	user 0.036s	sys 0.052s
I20260709 13:17:14.022251 14420 raft_consensus.cc:359] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.022953 14420 raft_consensus.cc:385] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.023252 14420 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.023888 14420 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.025656 14420 ts_tablet_manager.cc:1434] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:14.026567 14420 tablet_bootstrap.cc:492] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:14.032176 14420 tablet_bootstrap.cc:654] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:13.992923 14301 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:14.043572 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:14.044377 14658 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.044831 14658 raft_consensus.cc:697] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:14.045593 14658 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.048169 14127 catalog_manager.cc:5697] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.048606 14583 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.050047 14701 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.050473 14419 tablet_bootstrap.cc:492] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:14.051509 14419 ts_tablet_manager.cc:1403] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.176s	user 0.034s	sys 0.052s
I20260709 13:17:14.053941 14640 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.057045 14583 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:14.054329 14419 raft_consensus.cc:359] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.058161 14640 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:14.057308 14420 tablet_bootstrap.cc:492] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:14.060002 14420 ts_tablet_manager.cc:1403] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 13:17:14.060150 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:14.060667 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:14.061273 14301 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.061333 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:17:14.063356 14342 leader_election.cc:343] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.063211 14420 raft_consensus.cc:359] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.060777 14228 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.063886 14420 raft_consensus.cc:385] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.064165 14420 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.064899 14701 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:14.064810 14420 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.058835 14419 raft_consensus.cc:385] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.066514 14419 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.067267 14419 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.067708 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:17:14.069034 14267 leader_election.cc:343] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.069310 14419 ts_tablet_manager.cc:1434] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:17:14.070255 14419 tablet_bootstrap.cc:492] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:14.071790 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:14.072361 14225 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.072731 14418 tablet_bootstrap.cc:492] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:14.073170 14418 ts_tablet_manager.cc:1403] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.192s	user 0.046s	sys 0.071s
I20260709 13:17:14.075793 14419 tablet_bootstrap.cc:654] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.075732 14418 raft_consensus.cc:359] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.076442 14418 raft_consensus.cc:385] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.076715 14418 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.051350 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:14.077363 14418 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.078917 14420 ts_tablet_manager.cc:1434] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:17:14.078187 14227 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.079869 14418 ts_tablet_manager.cc:1434] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:14.080816 14418 tablet_bootstrap.cc:492] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:14.080899 14228 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:14.083694 14420 tablet_bootstrap.cc:492] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:14.087217 14418 tablet_bootstrap.cc:654] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.087934 14301 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:14.089133 14342 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:14.090019 14640 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.090545 14640 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:14.091393 14640 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.092516 14418 tablet_bootstrap.cc:492] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:14.092675 14420 tablet_bootstrap.cc:654] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.093196 14418 ts_tablet_manager.cc:1403] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:17:14.096230 14418 raft_consensus.cc:359] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.096738 14419 tablet_bootstrap.cc:492] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:14.096930 14418 raft_consensus.cc:385] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.097215 14419 ts_tablet_manager.cc:1403] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:17:14.097337 14418 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.146028 14486 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.147748 14486 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.149977 14227 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:14.151355 14419 raft_consensus.cc:359] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.152447 14419 raft_consensus.cc:385] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.158192 14419 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.168768 14225 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:14.175329 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:14.176823 14458 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.177536 14458 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:14.178953 14486 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:14.178948 14458 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.186393 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:14.190397 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:17:14.191857 14192 leader_election.cc:343] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.192902 14496 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.193694 14593 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.193732 14496 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.194447 14593 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:14.195536 14593 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.197892 14496 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:14.200035 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:14.200896 14377 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:14.202857 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:14.203017 14419 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.209985 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:14.210767 14496 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.210883 14228 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:14.211253 14496 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.211290 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:14.211793 14496 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:14.220278 14193 leader_election.cc:343] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.220813 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:14.221555 14431 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.227595 14420 tablet_bootstrap.cc:492] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:14.227241 14126 catalog_manager.cc:5697] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.228364 14420 ts_tablet_manager.cc:1403] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.147s	user 0.005s	sys 0.006s
I20260709 13:17:14.232366 14496 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.234012 14418 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.235754 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:14.236596 14418 ts_tablet_manager.cc:1434] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.143s	user 0.006s	sys 0.000s
I20260709 13:17:14.240861 14458 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.238157 14228 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.241420 14458 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.233326 14420 raft_consensus.cc:359] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.243229 14420 raft_consensus.cc:385] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.243584 14420 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.244486 14420 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.245761 14496 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:14.248773 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:14.249313 14377 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.250350 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:14.251354 14225 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:14.252511 14418 tablet_bootstrap.cc:492] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:14.255601 14486 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.256824 14458 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:14.259647 14377 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:14.260337 14419 ts_tablet_manager.cc:1434] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.163s	user 0.009s	sys 0.005s
I20260709 13:17:14.261706 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:14.262993 14458 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.263513 14458 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:14.264487 14458 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.265357 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:14.264607 14228 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:14.266750 14267 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:14.267537 14496 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.270429 14419 tablet_bootstrap.cc:492] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:14.280579 14420 ts_tablet_manager.cc:1434] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.005s
I20260709 13:17:14.281473 14496 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.283497 14431 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.283033 14127 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.284014 14431 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.285708 14431 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:14.287055 14125 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.293021 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:14.298084 14192 leader_election.cc:343] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.306278 14486 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.322733 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:14.335883 14419 tablet_bootstrap.cc:654] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.340323 14420 tablet_bootstrap.cc:492] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:14.347813 14126 catalog_manager.cc:5697] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:14.353724 14193 leader_election.cc:343] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.354317 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:14.355499 14573 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.366868 14418 tablet_bootstrap.cc:654] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.368299 14640 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.375671 14593 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.379216 14593 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.381906 14593 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:14.385505 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:14.386425 14302 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 1: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:17:14.395526 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:14.412611 14419 tablet_bootstrap.cc:492] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:14.413165 14419 ts_tablet_manager.cc:1403] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.143s	user 0.023s	sys 0.031s
I20260709 13:17:14.412465 14127 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.416703 14419 raft_consensus.cc:359] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.417403 14419 raft_consensus.cc:385] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.417675 14419 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.418555 14419 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.427016 14419 ts_tablet_manager.cc:1434] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:14.427886 14418 tablet_bootstrap.cc:492] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:14.428262 14419 tablet_bootstrap.cc:492] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:14.428438 14418 ts_tablet_manager.cc:1403] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.000s
I20260709 13:17:14.423089 14344 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:14.431314 14640 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.441479 14419 tablet_bootstrap.cc:654] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.421327 14420 tablet_bootstrap.cc:654] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.445698 14640 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.459362 14640 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.463091 14420 tablet_bootstrap.cc:492] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:14.463703 14420 ts_tablet_manager.cc:1403] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.124s	user 0.008s	sys 0.009s
W20260709 13:17:14.464110 14175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:14.466521 14420 raft_consensus.cc:359] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.467308 14420 raft_consensus.cc:385] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.467604 14420 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.469452 14418 raft_consensus.cc:359] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.470129 14418 raft_consensus.cc:385] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.472836 14418 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.475664 14418 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.480638 14418 ts_tablet_manager.cc:1434] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:17:14.480692 14420 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.481854 14418 tablet_bootstrap.cc:492] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:14.485692 14431 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.486203 14431 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.487356 14419 tablet_bootstrap.cc:492] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:14.487828 14419 ts_tablet_manager.cc:1403] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.002s
I20260709 13:17:14.488178 14431 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:14.488581 14418 tablet_bootstrap.cc:654] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.491724 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:14.495963 14192 leader_election.cc:343] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.499200 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:14.499801 14419 raft_consensus.cc:359] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.500535 14419 raft_consensus.cc:385] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.500821 14419 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.501902 14419 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.502130 14418 tablet_bootstrap.cc:492] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:14.503023 14418 ts_tablet_manager.cc:1403] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:17:14.504719 14419 ts_tablet_manager.cc:1434] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:17:14.505949 14419 tablet_bootstrap.cc:492] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:14.518440 14431 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.529006 14431 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.514910 14418 raft_consensus.cc:359] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.532210 14418 raft_consensus.cc:385] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.532378 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:14.507028 14302 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:14.533916 14419 tablet_bootstrap.cc:654] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:14.534060 14192 leader_election.cc:343] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.507895 14637 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.506278 14458 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.538925 14458 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.541064 14458 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:14.542655 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:14.543494 14419 tablet_bootstrap.cc:492] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:14.543634 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:14.543989 14419 ts_tablet_manager.cc:1403] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.006s
I20260709 13:17:14.544329 14227 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:14.502184 14420 ts_tablet_manager.cc:1434] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:17:14.532549 14418 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.546969 14431 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:17:14.547235 14193 leader_election.cc:343] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.548437 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:14.547729 14193 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:14.551921 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:14.552909 14493 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.553272 14493 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.553575 14493 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.556640 14420 tablet_bootstrap.cc:492] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:14.557382 14418 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.559943 14377 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:14.559968 14193 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:14.562291 14418 ts_tablet_manager.cc:1434] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.003s
I20260709 13:17:14.562621 14419 raft_consensus.cc:359] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.563333 14419 raft_consensus.cc:385] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:14.563613 14419 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:14.564275 14419 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.564801 14736 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:14.565357 14418 tablet_bootstrap.cc:492] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:14.565277 14658 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.565253 14736 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.571511 14419 ts_tablet_manager.cc:1434] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:17:14.571122 14640 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.573578 14736 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.582607 14419 tablet_bootstrap.cc:492] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:14.594115 14431 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.597189 14637 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.614187 14640 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.614784 14640 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.625401 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:14.626989 14301 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:14.613071 14637 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.620291 14640 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:14.628396 14493 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.632889 14658 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.631971 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:14.632895 14583 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.633630 14736 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.634634 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:14.660190 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:14.660831 14377 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.661521 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:14.662432 14228 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.664387 14583 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:14.664752 14583 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.665071 14583 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.654244 14640 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:17:14.649134 14493 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:14.642184 14418 tablet_bootstrap.cc:654] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.647002 14658 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.672413 14377 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:14.689157 14431 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:14.699460 14225 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:14.704646 14419 tablet_bootstrap.cc:654] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.690572 14637 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:14.692550 14658 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:14.758795 14736 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:14.772742 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:14.773444 14300 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:14.780241 14420 tablet_bootstrap.cc:654] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:14.781011 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:14.783023 14377 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.785009 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:14.778748 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:14.786492 14227 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 1: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:17:14.774983 14583 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.788373 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:14.790867 14303 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:14.807276 14228 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:14.808233 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:14.808420 14374 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 2: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:14.808836 14496 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.811039 14342 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:14.812944 14593 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:14.791354 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:14.808472 14458 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:17:14.814087 14496 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.814502 14496 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:14.814805 14458 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:14.815204 14496 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.817301 14303 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:14.820462 14583 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:14.821260 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:14.822021 14226 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:14.826320 14192 leader_election.cc:343] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:14.828956 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:14.829609 14303 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.870891 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:14.895797 14193 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:14.896677 14431 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:14.878002 14493 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.922245 14418 tablet_bootstrap.cc:492] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:14.923802 14418 ts_tablet_manager.cc:1403] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.359s	user 0.020s	sys 0.009s
I20260709 13:17:14.940321 14420 tablet_bootstrap.cc:492] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:14.940968 14420 ts_tablet_manager.cc:1403] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.385s	user 0.026s	sys 0.024s
W20260709 13:17:14.954667 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49193.2us
W20260709 13:17:14.923022 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 108503us
I20260709 13:17:14.926941 14493 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:14.969657 14303 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:14.973161 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:14.985716 14419 tablet_bootstrap.cc:492] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:14.986271 14419 ts_tablet_manager.cc:1403] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.409s	user 0.025s	sys 0.014s
I20260709 13:17:14.986900 14431 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:14.979846 14583 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:14.988427 14431 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:15.010007 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 52342.4us
I20260709 13:17:15.008256 14126 catalog_manager.cc:5697] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.038100 14583 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:15.039479 14583 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.004359 14226 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:15.081063 14493 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.058259 14573 raft_consensus.cc:2764] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:17:15.082736 14420 raft_consensus.cc:359] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.083453 14420 raft_consensus.cc:385] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.083740 14420 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.093230 14420 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:15.103734 14751 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:17:15.141541 14420 ts_tablet_manager.cc:1434] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.200s	user 0.008s	sys 0.001s
I20260709 13:17:15.146042 14418 raft_consensus.cc:359] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.146891 14418 raft_consensus.cc:385] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.147183 14418 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.166031 14420 tablet_bootstrap.cc:492] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:15.169416 14418 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.179214 14419 raft_consensus.cc:359] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.179941 14419 raft_consensus.cc:385] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.180230 14419 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.182843 14419 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.184544 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:15.185300 14222 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:15.200809 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:15.201507 14376 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:15.203299 14270 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:15.204090 14493 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.204425 14493 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.204751 14493 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.208814 14418 ts_tablet_manager.cc:1434] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.285s	user 0.007s	sys 0.001s
I20260709 13:17:15.212560 14420 tablet_bootstrap.cc:654] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.214232 14418 tablet_bootstrap.cc:492] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:15.214340 14419 ts_tablet_manager.cc:1434] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.228s	user 0.015s	sys 0.017s
I20260709 13:17:15.250846 14496 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:15.254526 14419 tablet_bootstrap.cc:492] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:15.245774 14493 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.253983 14127 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.259864 14493 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.261503 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:15.264010 14375 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.270320 14573 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.275293 14573 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.275878 14125 catalog_manager.cc:5697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 2, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.277350 14573 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.277144 14375 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:15.285995 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:15.287961 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:15.288723 14226 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.291132 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:15.292192 14496 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.292762 14496 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:17:15.295398 14193 leader_election.cc:343] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.293767 14496 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.291085 14493 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.309110 14493 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.308847 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:15.319566 14420 tablet_bootstrap.cc:492] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:15.318864 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:15.375844 14773 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:17:15.410739 14420 ts_tablet_manager.cc:1403] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.245s	user 0.035s	sys 0.037s
I20260709 13:17:15.314949 14226 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:15.322693 14493 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.410697 14225 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:15.413761 14419 tablet_bootstrap.cc:654] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.425379 14458 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:17:15.416793 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:15.428696 14418 tablet_bootstrap.cc:654] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.413841 14420 raft_consensus.cc:359] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.432713 14420 raft_consensus.cc:385] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:15.425683 14192 leader_election.cc:343] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.433223 14192 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:17:15.434636 14267 leader_election.cc:343] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.435539 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:15.436115 14763 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.437775 14458 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.437817 14420 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.439080 14420 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.440861 14458 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.441212 14458 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.441624 14420 ts_tablet_manager.cc:1434] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:17:15.442948 14420 tablet_bootstrap.cc:492] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:15.450719 14420 tablet_bootstrap.cc:654] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.455879 14458 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.470297 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:15.470922 14227 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.473466 14418 tablet_bootstrap.cc:492] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:15.474201 14418 ts_tablet_manager.cc:1403] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.264s	user 0.011s	sys 0.009s
I20260709 13:17:15.478221 14227 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:15.479907 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:15.480794 14773 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.481256 14773 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:15.484153 14458 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.500053 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:17:15.514541 14267 leader_election.cc:343] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.534130 14420 tablet_bootstrap.cc:492] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:15.534766 14420 ts_tablet_manager.cc:1403] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.092s	user 0.019s	sys 0.004s
I20260709 13:17:15.482084 14773 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.538461 14420 raft_consensus.cc:359] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.540565 14420 raft_consensus.cc:385] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.541006 14420 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.528388 14418 raft_consensus.cc:359] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.542058 14418 raft_consensus.cc:385] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.542512 14418 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.543521 14418 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.546947 14418 ts_tablet_manager.cc:1434] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:17:15.548328 14418 tablet_bootstrap.cc:492] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:15.544726 14420 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.550709 14420 ts_tablet_manager.cc:1434] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:17:15.552100 14420 tablet_bootstrap.cc:492] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:15.566048 14420 tablet_bootstrap.cc:654] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.572374 14226 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:15.569195 14418 tablet_bootstrap.cc:654] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:15.592370 14192 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Couldn't send request to peer 181bbac22422408c87cd13b7fe3008f9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.597919 14583 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:15.613006 14420 tablet_bootstrap.cc:492] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:15.614133 14420 ts_tablet_manager.cc:1403] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.005s
I20260709 13:17:15.621600 14420 raft_consensus.cc:359] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.624238 14420 raft_consensus.cc:385] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.625061 14420 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.626482 14420 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.630800 14420 ts_tablet_manager.cc:1434] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:17:15.637532 14301 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:15.643832 14420 tablet_bootstrap.cc:492] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:15.642091 14419 tablet_bootstrap.cc:492] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:15.644749 14583 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:15.645395 14419 ts_tablet_manager.cc:1403] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.406s	user 0.102s	sys 0.089s
I20260709 13:17:15.649829 14418 tablet_bootstrap.cc:492] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:15.650358 14418 ts_tablet_manager.cc:1403] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.010s
I20260709 13:17:15.653075 14418 raft_consensus.cc:359] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.653928 14418 raft_consensus.cc:385] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.654260 14418 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.655174 14418 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.657650 14418 ts_tablet_manager.cc:1434] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:15.642696 14127 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.660104 14420 tablet_bootstrap.cc:654] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.660638 14419 raft_consensus.cc:359] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.660400 14127 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.661288 14419 raft_consensus.cc:385] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.662531 14418 tablet_bootstrap.cc:492] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:15.661623 14419 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.665542 14419 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.665836 14760 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:15.667685 14419 ts_tablet_manager.cc:1434] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:17:15.668694 14419 tablet_bootstrap.cc:492] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:15.669598 14418 tablet_bootstrap.cc:654] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.679977 14418 tablet_bootstrap.cc:492] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:15.680546 14418 ts_tablet_manager.cc:1403] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.002s
I20260709 13:17:15.682298 14493 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.682772 14493 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.683250 14496 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:15.683604 14420 tablet_bootstrap.cc:492] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:15.684051 14420 ts_tablet_manager.cc:1403] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 13:17:15.685506 14493 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.686682 14420 raft_consensus.cc:359] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.687325 14420 raft_consensus.cc:385] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.687582 14420 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.688670 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:15.689644 14419 tablet_bootstrap.cc:654] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.691421 14420 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:15.692222 14267 leader_election.cc:343] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.697662 14418 raft_consensus.cc:359] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.698511 14418 raft_consensus.cc:385] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.698683 14573 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.698808 14418 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.699159 14573 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.699940 14418 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.700320 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:15.699174 14420 ts_tablet_manager.cc:1434] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:17:15.702344 14573 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.702988 14420 tablet_bootstrap.cc:492] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
W20260709 13:17:15.704222 14270 leader_election.cc:343] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.707993 14418 ts_tablet_manager.cc:1434] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 13:17:15.708032 14419 tablet_bootstrap.cc:492] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:15.708630 14419 ts_tablet_manager.cc:1403] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.002s
I20260709 13:17:15.705569 14270 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:15.709087 14418 tablet_bootstrap.cc:492] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:15.711519 14420 tablet_bootstrap.cc:654] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.711375 14419 raft_consensus.cc:359] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.710147 14773 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.718334 14419 raft_consensus.cc:385] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.718765 14419 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.719769 14419 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.720940 14418 tablet_bootstrap.cc:654] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.721879 14419 ts_tablet_manager.cc:1434] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:17:15.713158 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:15.714208 14175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:15.729002 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:15.728679 14760 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.730582 14760 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:15.732417 14192 leader_election.cc:343] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.736429 14419 tablet_bootstrap.cc:492] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
W20260709 13:17:15.743268 14193 leader_election.cc:343] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.743827 14193 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:15.744937 14431 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.747431 14760 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.751243 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:15.752826 14192 leader_election.cc:343] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.742297 14769 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.754101 14769 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.756351 14769 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:15.757885 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:15.763259 14342 leader_election.cc:343] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.763967 14573 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.764503 14573 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.766655 14573 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.770321 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:15.780820 14192 leader_election.cc:343] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.785123 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:15.785929 14225 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:15.786916 14420 tablet_bootstrap.cc:492] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:15.787514 14420 ts_tablet_manager.cc:1403] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.009s
I20260709 13:17:15.790807 14420 raft_consensus.cc:359] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.792872 14420 raft_consensus.cc:385] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.791266 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:15.793092 14418 tablet_bootstrap.cc:492] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:15.793896 14755 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:15.795995 14344 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:15.797101 14779 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.797485 14779 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.797832 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:15.792163 14419 tablet_bootstrap.cc:654] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.797875 14779 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.793728 14299 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
W20260709 13:17:15.804531 14193 leader_election.cc:343] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.804997 14193 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:15.806108 14573 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.793195 14420 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.807695 14779 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.810073 14418 ts_tablet_manager.cc:1403] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.008s
I20260709 13:17:15.808758 14420 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.812115 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:15.810364 14769 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.811203 14779 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:17:15.813542 14342 leader_election.cc:343] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.808168 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:15.814944 14419 tablet_bootstrap.cc:492] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:15.815393 14419 ts_tablet_manager.cc:1403] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.000s
I20260709 13:17:15.818153 14573 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.818701 14573 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.819149 14573 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.813333 14769 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.846670 14420 ts_tablet_manager.cc:1434] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:17:15.847836 14420 tablet_bootstrap.cc:492] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:15.852669 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:15.851488 14769 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:15.854669 14418 raft_consensus.cc:359] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.854660 14419 raft_consensus.cc:359] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.855547 14418 raft_consensus.cc:385] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.855741 14419 raft_consensus.cc:385] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.855906 14418 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.856251 14419 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.857084 14419 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.857363 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:15.858158 14225 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.857612 14760 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.859961 14419 ts_tablet_manager.cc:1434] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.044s	user 0.017s	sys 0.020s
I20260709 13:17:15.859809 14760 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.861258 14419 tablet_bootstrap.cc:492] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:15.863761 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:15.864959 14760 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.866886 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:15.869401 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:15.870230 14779 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.870970 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:15.871762 14419 tablet_bootstrap.cc:654] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:15.872339 14193 leader_election.cc:343] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.873173 14225 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:15.856722 14418 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.874984 14376 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
I20260709 13:17:15.876101 14344 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:15.877462 14779 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.878000 14779 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:15.878466 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:15.878886 14779 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.879577 14802 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:15.879997 14802 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.880357 14802 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.884570 14419 tablet_bootstrap.cc:492] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:15.885066 14419 ts_tablet_manager.cc:1403] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 13:17:15.885248 14418 ts_tablet_manager.cc:1434] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.073s	user 0.016s	sys 0.003s
I20260709 13:17:15.886415 14418 tablet_bootstrap.cc:492] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:15.888549 14419 raft_consensus.cc:359] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.889345 14419 raft_consensus.cc:385] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.889670 14419 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.892187 14573 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.903403 14493 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.890525 14419 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.905867 14419 ts_tablet_manager.cc:1434] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:17:15.904028 14493 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.910912 14419 tablet_bootstrap.cc:492] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:15.912035 14493 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.914577 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:15.907218 14418 tablet_bootstrap.cc:654] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.914085 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:15.915620 14225 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 1: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:17:15.916626 14270 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:15.917841 14583 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.918538 14583 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.921811 14583 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:15.922386 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:15.923187 14227 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 1: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:17:15.928833 14802 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.929884 14493 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.932386 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:17:15.933892 14193 leader_election.cc:343] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.936556 14419 tablet_bootstrap.cc:654] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.937388 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:15.912580 14420 tablet_bootstrap.cc:654] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.947155 14418 tablet_bootstrap.cc:492] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:15.947618 14418 ts_tablet_manager.cc:1403] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.061s	user 0.005s	sys 0.006s
I20260709 13:17:15.947463 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:15.948164 14298 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.948308 14342 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:15.950613 14583 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.950810 14493 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.956139 14418 raft_consensus.cc:359] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.957036 14418 raft_consensus.cc:385] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.957373 14418 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.957569 14298 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:15.943037 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:15.957597 14583 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:15.958436 14418 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.967423 14419 tablet_bootstrap.cc:492] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:15.968103 14418 ts_tablet_manager.cc:1434] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:17:15.969046 14418 tablet_bootstrap.cc:492] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:15.969408 14419 ts_tablet_manager.cc:1403] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.010s
W20260709 13:17:15.959411 14192 leader_election.cc:343] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:15.972293 14419 raft_consensus.cc:359] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.973058 14419 raft_consensus.cc:385] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:15.973388 14419 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:15.974154 14419 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.977139 14419 ts_tablet_manager.cc:1434] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:15.977731 14126 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.979537 14419 tablet_bootstrap.cc:492] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:15.983700 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:15.984791 14771 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.944363 14802 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.944566 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:15.985839 14376 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:15.986290 14771 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:15.987684 14771 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:15.989356 14419 tablet_bootstrap.cc:654] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.939339 14573 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:15.994762 14376 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:15.995854 14418 tablet_bootstrap.cc:654] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:15.996519 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:15.997725 14573 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:15.998543 14573 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:15.999497 14573 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.013469 14420 tablet_bootstrap.cc:492] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:16.014405 14420 ts_tablet_manager.cc:1403] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.167s	user 0.008s	sys 0.004s
I20260709 13:17:16.016323 14419 tablet_bootstrap.cc:492] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:16.016878 14419 ts_tablet_manager.cc:1403] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.010s
I20260709 13:17:16.019487 14419 raft_consensus.cc:359] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.020196 14419 raft_consensus.cc:385] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.020537 14419 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.021435 14419 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.022505 14769 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.023025 14769 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.025148 14769 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:16.026153 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:16.026824 14227 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:16.028214 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:16.029063 14769 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.029920 14419 ts_tablet_manager.cc:1434] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:16.029888 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:16.031335 14769 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.031507 14299 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:16.031827 14769 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.020584 14418 tablet_bootstrap.cc:492] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:16.032689 14418 ts_tablet_manager.cc:1403] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.001s
I20260709 13:17:16.033552 14493 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.034046 14493 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.035899 14418 raft_consensus.cc:359] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.036639 14418 raft_consensus.cc:385] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.036931 14418 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.037299 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:16.035933 14493 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:16.037629 14418 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.038805 14419 tablet_bootstrap.cc:492] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:16.040185 14418 ts_tablet_manager.cc:1434] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:16.041033 14378 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:16.041333 14418 tablet_bootstrap.cc:492] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:16.043464 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:16.044250 14755 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.044600 14755 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.044935 14755 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.049553 14420 raft_consensus.cc:359] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.050431 14420 raft_consensus.cc:385] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.050693 14420 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.037400 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:16.051303 14420 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.070595 14227 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:16.057153 14376 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.071903 14420 ts_tablet_manager.cc:1434] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.002s
I20260709 13:17:16.070135 14418 tablet_bootstrap.cc:654] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.072871 14420 tablet_bootstrap.cc:492] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:16.061160 14755 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.050901 14419 tablet_bootstrap.cc:654] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.076192 14755 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:16.079528 14420 tablet_bootstrap.cc:654] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.079588 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:16.081652 14227 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.066872 14493 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:17:16.065655 14769 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.089766 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:16.090057 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:16.090384 14378 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.092764 14420 tablet_bootstrap.cc:492] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:16.093287 14420 ts_tablet_manager.cc:1403] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 13:17:16.090595 14299 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.096942 14420 raft_consensus.cc:359] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.097841 14420 raft_consensus.cc:385] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.098170 14420 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.099233 14420 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.100533 14299 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:16.101984 14342 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:16.102653 14420 ts_tablet_manager.cc:1434] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:17:16.103036 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:16.103819 14229 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.103895 14583 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.104557 14420 tablet_bootstrap.cc:492] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Bootstrap starting.
I20260709 13:17:16.104954 14583 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:16.105867 14583 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.111177 14227 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:16.111872 14420 tablet_bootstrap.cc:654] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.116832 14493 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.132622 14493 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.134449 14493 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:16.137104 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:16.138027 14228 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 0.
I20260709 13:17:16.140669 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:16.142661 14267 leader_election.cc:343] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.144369 14270 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:16.054297 14127 catalog_manager.cc:5697] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.145380 14270 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:16.127266 14378 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:16.127506 14769 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:16.146485 14496 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.146822 14496 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.147152 14496 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.146893 14126 catalog_manager.cc:5697] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.148518 14773 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.149142 14773 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:16.150115 14773 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.157009 14496 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.163956 14458 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.171273 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:16.172060 14228 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.177650 14229 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:16.179940 14127 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.187659 14418 tablet_bootstrap.cc:492] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:16.188192 14418 ts_tablet_manager.cc:1403] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.051s
I20260709 13:17:16.189493 14419 tablet_bootstrap.cc:492] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:16.189589 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:16.190009 14419 ts_tablet_manager.cc:1403] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.151s	user 0.020s	sys 0.019s
W20260709 13:17:16.191169 14267 leader_election.cc:343] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.194741 14418 raft_consensus.cc:359] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.195439 14418 raft_consensus.cc:385] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.195729 14418 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.188099 14496 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:16.192665 14419 raft_consensus.cc:359] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.197598 14419 raft_consensus.cc:385] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.198483 14419 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.211207 14418 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.212981 14802 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.214237 14419 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.215870 14418 ts_tablet_manager.cc:1434] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:17:16.213107 14228 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:16.220474 14270 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:16.217900 14418 tablet_bootstrap.cc:492] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:16.221998 14496 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.222606 14496 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:16.223645 14496 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.228034 14419 ts_tablet_manager.cc:1434] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:17:16.228816 14420 tablet_bootstrap.cc:492] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: No bootstrap required, opened a new log
I20260709 13:17:16.229523 14420 ts_tablet_manager.cc:1403] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent bootstrapping tablet: real 0.125s	user 0.019s	sys 0.003s
I20260709 13:17:16.215345 14802 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.239177 14420 raft_consensus.cc:359] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.240060 14420 raft_consensus.cc:385] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.240407 14420 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.242383 14420 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.245589 14802 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:16.246428 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:16.247035 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:16.247946 14193 leader_election.cc:343] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:16.248420 14192 leader_election.cc:343] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.248788 14192 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:16.249154 14420 ts_tablet_manager.cc:1434] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:17:16.243314 14127 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.251041 14802 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.251883 14419 tablet_bootstrap.cc:492] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:16.272377 14419 tablet_bootstrap.cc:654] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.277138 14418 tablet_bootstrap.cc:654] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.283223 14764 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.318773 14125 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 0 to 1, leader changed from <none> to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.327523 14418 tablet_bootstrap.cc:492] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:16.329632 14419 tablet_bootstrap.cc:492] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:16.330143 14419 ts_tablet_manager.cc:1403] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.017s
I20260709 13:17:16.332424 14418 ts_tablet_manager.cc:1403] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.022s
I20260709 13:17:16.332674 14419 raft_consensus.cc:359] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.333307 14419 raft_consensus.cc:385] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.333580 14419 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.334236 14779 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.334192 14419 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.334861 14418 raft_consensus.cc:359] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.335510 14418 raft_consensus.cc:385] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.335780 14418 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.336352 14419 ts_tablet_manager.cc:1434] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:16.336508 14418 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.337303 14419 tablet_bootstrap.cc:492] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Bootstrap starting.
I20260709 13:17:16.343753 14419 tablet_bootstrap.cc:654] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.345016 14418 ts_tablet_manager.cc:1434] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:17:16.346094 14418 tablet_bootstrap.cc:492] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:16.358505 14418 tablet_bootstrap.cc:654] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.364339 14418 tablet_bootstrap.cc:492] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:16.364778 14418 ts_tablet_manager.cc:1403] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:17:16.367233 14418 raft_consensus.cc:359] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.367705 14419 tablet_bootstrap.cc:492] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: No bootstrap required, opened a new log
I20260709 13:17:16.367873 14418 raft_consensus.cc:385] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.368181 14419 ts_tablet_manager.cc:1403] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.012s
I20260709 13:17:16.368196 14418 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.369515 14418 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.370666 14419 raft_consensus.cc:359] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.371328 14419 raft_consensus.cc:385] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.371599 14419 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.372208 14419 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.373216 14418 ts_tablet_manager.cc:1434] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:16.374178 14419 ts_tablet_manager.cc:1434] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:16.374209 14418 tablet_bootstrap.cc:492] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:16.380825 14418 tablet_bootstrap.cc:654] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.389312 14418 tablet_bootstrap.cc:492] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:16.389808 14418 ts_tablet_manager.cc:1403] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.006s
I20260709 13:17:16.392241 14418 raft_consensus.cc:359] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.392869 14418 raft_consensus.cc:385] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.393131 14418 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.393690 14418 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.395226 14418 ts_tablet_manager.cc:1434] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:16.396261 14802 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.396432 14418 tablet_bootstrap.cc:492] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Bootstrap starting.
I20260709 13:17:16.396761 14802 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.398803 14802 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:16.399499 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:16.399761 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:16.400048 14299 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 0.
W20260709 13:17:16.401047 14192 leader_election.cc:343] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:16.401502 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:16.402351 14802 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.402813 14802 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.403230 14802 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.405463 14418 tablet_bootstrap.cc:654] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:16.412665 14769 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.413273 14769 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.412063 14802 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.415566 14769 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:16.416101 14418 tablet_bootstrap.cc:492] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: No bootstrap required, opened a new log
I20260709 13:17:16.416560 14418 ts_tablet_manager.cc:1403] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:17:16.417013 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:16.417273 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:16.417307 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:16.417923 14299 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.417980 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:16.418501 14298 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 1: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:17:16.419169 14418 raft_consensus.cc:359] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.419878 14418 raft_consensus.cc:385] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:16.420133 14418 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Initialized, Role: FOLLOWER
I20260709 13:17:16.420261 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:16.420928 14802 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:16.421406 14769 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.421268 14418 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.422294 14372 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.423600 14418 ts_tablet_manager.cc:1434] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:16.425980 14299 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:16.427414 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:16.428151 14802 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.428360 14769 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:16.429421 14802 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:16.430229 14802 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.436928 14372 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:16.442721 14125 catalog_manager.cc:5697] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.446192 14298 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.453225 14802 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.465726 14802 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.484019 14769 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.484525 14769 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.487275 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:16.487524 14769 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:16.487954 14228 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:16.488320 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:16.488924 14298 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:16.489939 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:16.491250 14769 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.491627 14769 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.491940 14769 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.502053 14769 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.504160 14769 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:16.504956 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:16.505084 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:16.505604 14228 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.505729 14299 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.511642 14228 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:16.512939 14344 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:16.513298 14802 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.515327 14779 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.515851 14779 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:16.516660 14779 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.517928 14769 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.518383 14769 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.520444 14769 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:16.520515 14299 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:16.522828 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:16.523465 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:16.525049 14298 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:16.526409 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:16.527261 14228 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 0.
I20260709 13:17:16.528292 14769 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:16.528687 14769 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.529026 14769 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.535810 14769 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.538390 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:16.538968 14227 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.541978 14769 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:16.546237 14227 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:16.546142 14764 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:16.546396 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:16.547482 14303 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.555850 14344 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:16.556739 14764 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:16.557219 14764 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:16.558717 14303 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:17:16.562192 14764 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:16.566959 14771 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.568856 14496 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.559995 14125 catalog_manager.cc:5697] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.590993 14583 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.592273 14493 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.615728 14493 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:16.633271 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 60515.7us
I20260709 13:17:16.666234 14126 catalog_manager.cc:5697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.693682 14372 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:16.701611 14773 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.948727 14771 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.953044 14845 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.966341 14760 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:16.971653 14583 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.021361 14764 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.034695 14779 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:17.751082 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:17.776428 14855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:17.776502 14856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:17.777570 14858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:17.779623 13122 server_base.cc:1061] running on GCE node
I20260709 13:17:17.780781 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:17.781010 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:17.781211 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603037781193 us; error 0 us; skew 500 ppm
I20260709 13:17:17.782099 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:17.787290 13122 webserver.cc:533] Webserver started at http://127.12.208.132:37807/ using document root <none> and password file <none>
I20260709 13:17:17.787993 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:17.788275 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:17.788673 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:17.790320 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-3-root/instance:
uuid: "cebb34ac155340899a38c728707ddc0d"
format_stamp: "Formatted at 2026-07-09 13:17:17 on dist-test-slave-ll1f"
I20260709 13:17:17.797956 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:17:17.806478 14863 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.807471 13122 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:17:17.807832 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-3-root
uuid: "cebb34ac155340899a38c728707ddc0d"
format_stamp: "Formatted at 2026-07-09 13:17:17 on dist-test-slave-ll1f"
I20260709 13:17:17.808277 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:17.892140 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:17.893991 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:17.896965 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:17.900065 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:17.900319 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.900580 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:17.900779 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:17.953751 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.132:33137
I20260709 13:17:17.953882 14925 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.132:33137 every 8 connection(s)
I20260709 13:17:17.962345 13122 auto_leader_rebalancer-test.cc:384] add a tserver: cebb34ac155340899a38c728707ddc0d
I20260709 13:17:17.987695 14926 heartbeater.cc:344] Connected to a master server at 127.12.208.190:37027
I20260709 13:17:17.988302 14926 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:17.989240 14926 heartbeater.cc:507] Master 127.12.208.190:37027 requested a full tablet report, sending...
I20260709 13:17:17.991411 14126 ts_manager.cc:194] Registered new tserver with Master: cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:17.993319 14126 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36074
I20260709 13:17:18.975401 14376 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:18.981436 14301 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:18.981498 14225 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:18.983785 14779 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:18.985765 14779 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:18.996620 14926 heartbeater.cc:499] Master 127.12.208.190:37027 was elected leader, sending a full tablet report...
I20260709 13:17:19.002319 14779 raft_consensus.cc:2955] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:19.004417 14225 raft_consensus.cc:2955] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
W20260709 13:17:19.009514 14341 consensus_peers.cc:597] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cab4884dfe6c4e24a9430e2449523d61. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.019393 14301 raft_consensus.cc:2955] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:19.032552 14126 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:19.056663 14225 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:19.068296 14301 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.069591 14378 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.069594 14760 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:19.071256 14854 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.080111 14760 raft_consensus.cc:2955] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
W20260709 13:17:19.083032 14192 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98310add35f94d0685fee6cc0aba55a2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.081853 14378 raft_consensus.cc:2955] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:19.090265 14301 raft_consensus.cc:2955] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:19.104557 14125 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.118597 14301 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:19.129776 14376 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.131726 14225 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.131774 14853 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:19.132881 14773 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.142915 14853 raft_consensus.cc:2955] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
W20260709 13:17:19.146384 14267 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 487d8e21fe1a4de4a365bd3c1f91947b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.151887 14376 raft_consensus.cc:2955] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:19.158506 14372 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:19.165654 14225 raft_consensus.cc:2955] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:19.167691 14126 catalog_manager.cc:5697] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
W20260709 13:17:19.175547 14341 consensus_peers.cc:597] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65fa0102e1144f94a57015823294e331. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.176374 14303 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.179164 14779 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.179629 14228 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.180914 14931 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.191926 14845 raft_consensus.cc:2955] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:19.207036 14301 raft_consensus.cc:2955] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:19.208606 14227 raft_consensus.cc:2955] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:19.223688 14126 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.563099 14958 ts_tablet_manager.cc:933] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:19.565439 14958 tablet_copy_client.cc:323] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:19.589159 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet cab4884dfe6c4e24a9430e2449523d61 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:19.589767 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet cab4884dfe6c4e24a9430e2449523d61 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-cab4884dfe6c4e24a9430e2449523d61
I20260709 13:17:19.598135 14388 tablet_copy_source_session.cc:215] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:19.602939 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab4884dfe6c4e24a9430e2449523d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:19.623588 14958 tablet_copy_client.cc:806] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:19.624351 14958 tablet_copy_client.cc:670] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:19.628326 14958 tablet_copy_client.cc:538] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:19.634644 14958 tablet_bootstrap.cc:492] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:19.648428 14962 ts_tablet_manager.cc:933] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:19.653296 14962 tablet_copy_client.cc:323] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.130:44127
I20260709 13:17:19.657572 14958 tablet_bootstrap.cc:492] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:19.659137 14958 tablet_bootstrap.cc:492] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:19.660190 14958 ts_tablet_manager.cc:1403] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.026s	user 0.024s	sys 0.000s
I20260709 13:17:19.674443 14966 ts_tablet_manager.cc:933] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:19.673465 14958 raft_consensus.cc:359] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:19.675487 14958 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:19.678467 14958 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:19.688700 14314 tablet_copy_service.cc:140] P bee4f7fc1b4740dc875537c79309664f: Received BeginTabletCopySession request for tablet 487d8e21fe1a4de4a365bd3c1f91947b from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:45306)
I20260709 13:17:19.688970 14958 ts_tablet_manager.cc:1434] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.005s
I20260709 13:17:19.689383 14314 tablet_copy_service.cc:161] P bee4f7fc1b4740dc875537c79309664f: Beginning new tablet copy session on tablet 487d8e21fe1a4de4a365bd3c1f91947b from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:45306: session id = cebb34ac155340899a38c728707ddc0d-487d8e21fe1a4de4a365bd3c1f91947b
I20260709 13:17:19.698320 14314 tablet_copy_source_session.cc:215] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:19.702489 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-cab4884dfe6c4e24a9430e2449523d61 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:19.702992 14962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 487d8e21fe1a4de4a365bd3c1f91947b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:19.703035 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-cab4884dfe6c4e24a9430e2449523d61 on tablet cab4884dfe6c4e24a9430e2449523d61 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:19.722469 14962 tablet_copy_client.cc:806] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:19.723204 14962 tablet_copy_client.cc:670] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:19.723379 14966 tablet_copy_client.cc:323] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:17:19.732035 14962 tablet_copy_client.cc:538] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:19.741467 14962 tablet_bootstrap.cc:492] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:19.759274 14958 ts_tablet_manager.cc:933] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:19.776840 14239 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet 98310add35f94d0685fee6cc0aba55a2 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:17:19.778332 14239 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet 98310add35f94d0685fee6cc0aba55a2 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-98310add35f94d0685fee6cc0aba55a2
I20260709 13:17:19.787025 14239 tablet_copy_source_session.cc:215] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:19.790685 14958 tablet_copy_client.cc:323] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:19.792466 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet 65fa0102e1144f94a57015823294e331 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:19.793027 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet 65fa0102e1144f94a57015823294e331 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-65fa0102e1144f94a57015823294e331
I20260709 13:17:19.806895 14966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98310add35f94d0685fee6cc0aba55a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:19.809230 14388 tablet_copy_source_session.cc:215] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:19.813573 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fa0102e1144f94a57015823294e331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:19.824397 14966 tablet_copy_client.cc:806] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:19.825237 14966 tablet_copy_client.cc:670] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:19.830796 14962 tablet_bootstrap.cc:492] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:19.831655 14966 tablet_copy_client.cc:538] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:19.832007 14962 tablet_bootstrap.cc:492] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:19.832877 14962 ts_tablet_manager.cc:1403] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.092s	user 0.031s	sys 0.008s
I20260709 13:17:19.838649 14962 raft_consensus.cc:359] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:19.839514 14962 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:19.840230 14962 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:19.841821 14966 tablet_bootstrap.cc:492] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:19.843123 14962 ts_tablet_manager.cc:1434] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:19.844842 14314 tablet_copy_service.cc:342] P bee4f7fc1b4740dc875537c79309664f: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-487d8e21fe1a4de4a365bd3c1f91947b received from {username='slave'} at 127.0.0.1:45306
I20260709 13:17:19.845274 14314 tablet_copy_service.cc:434] P bee4f7fc1b4740dc875537c79309664f: ending tablet copy session cebb34ac155340899a38c728707ddc0d-487d8e21fe1a4de4a365bd3c1f91947b on tablet 487d8e21fe1a4de4a365bd3c1f91947b with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:19.848057 14958 tablet_copy_client.cc:806] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:19.848699 14958 tablet_copy_client.cc:670] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:19.855191 14958 tablet_copy_client.cc:538] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:19.867619 14958 tablet_bootstrap.cc:492] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:19.895458 14958 tablet_bootstrap.cc:492] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:19.896270 14966 tablet_bootstrap.cc:492] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:19.896703 14958 tablet_bootstrap.cc:492] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:19.897135 14966 tablet_bootstrap.cc:492] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:19.897569 14958 ts_tablet_manager.cc:1403] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.009s
I20260709 13:17:19.897809 14966 ts_tablet_manager.cc:1403] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.009s
I20260709 13:17:19.900842 14958 raft_consensus.cc:359] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:19.901841 14958 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:19.901895 14966 raft_consensus.cc:359] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:19.902879 14966 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:19.902675 14958 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:19.903651 14966 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:19.906345 14966 ts_tablet_manager.cc:1434] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:17:19.907092 14958 ts_tablet_manager.cc:1434] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:19.908551 14239 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-98310add35f94d0685fee6cc0aba55a2 received from {username='slave'} at 127.0.0.1:57812
I20260709 13:17:19.909061 14239 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-98310add35f94d0685fee6cc0aba55a2 on tablet 98310add35f94d0685fee6cc0aba55a2 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:19.909433 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-65fa0102e1144f94a57015823294e331 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:19.909886 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-65fa0102e1144f94a57015823294e331 on tablet 65fa0102e1144f94a57015823294e331 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:20.149297 14901 raft_consensus.cc:1217] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:20.192160 14901 raft_consensus.cc:1217] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:20.254845 14901 raft_consensus.cc:1217] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:20.323827 14901 raft_consensus.cc:1217] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:20.546959 14779 raft_consensus.cc:1064] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:20.549185 14779 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:20.555955 14228 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.555958 14901 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.557875 14303 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.559293 14845 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.560146 14978 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.561489 14779 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.605942 14971 raft_consensus.cc:1064] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:20.614974 14971 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:20.620558 14901 raft_consensus.cc:2955] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:20.617924 14779 raft_consensus.cc:2955] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:20.652756 14303 raft_consensus.cc:2955] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:20.641659 14126 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:20.710686 14953 raft_consensus.cc:1064] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:20.713692 14953 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:20.741658 14901 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.742349 14372 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.744122 14853 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:20.752415 14225 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.759016 14988 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.762251 14988 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.808722 14953 raft_consensus.cc:2955] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:20.822434 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 91637.4us
I20260709 13:17:20.823500 14376 raft_consensus.cc:2955] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:20.837152 14845 raft_consensus.cc:1064] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:20.839707 14845 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:20.843328 14228 raft_consensus.cc:2955] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:20.865125 14901 raft_consensus.cc:2955] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:20.902751 14900 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.905850 14303 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.908699 14997 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.913561 14999 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:20.921415 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 91416.4us
I20260709 13:17:20.927503 14229 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.944651 14901 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.947043 14125 catalog_manager.cc:5697] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.949084 14854 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.961689 14376 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:20.961885 14225 raft_consensus.cc:2955] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:20.970626 14301 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:20.972205 14376 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.974254 14303 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:20.978045 14978 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:20.984226 14978 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.989076 14978 raft_consensus.cc:2955] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:20.993134 14303 raft_consensus.cc:2955] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:20.998708 14900 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.000344 14988 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.008642 14953 raft_consensus.cc:2955] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.010306 14126 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.015666 14227 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.019903 14853 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.022161 14112 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 487d8e21fe1a4de4a365bd3c1f91947b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:21.023649 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cab4884dfe6c4e24a9430e2449523d61 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:21.027288 14901 raft_consensus.cc:2955] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:21.028470 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 48378.8us
I20260709 13:17:21.033390 14227 raft_consensus.cc:2955] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.039815 14900 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.041337 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet cab4884dfe6c4e24a9430e2449523d61 with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:21.042497 14854 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:21.050416 14303 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.052541 14126 catalog_manager.cc:5697] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.077539 15004 tablet_replica.cc:333] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:17:21.083181 14993 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:21.084862 14978 raft_consensus.cc:2955] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.101048 14900 raft_consensus.cc:2955] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.102221 14984 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:21.103653 15004 raft_consensus.cc:2243] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.107378 15004 raft_consensus.cc:2272] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.109584 14303 raft_consensus.cc:2955] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.123636 15004 ts_tablet_manager.cc:1916] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:21.143224 14229 raft_consensus.cc:2955] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.141017 14125 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.153280 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet 487d8e21fe1a4de4a365bd3c1f91947b with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47058
I20260709 13:17:21.156997 14854 raft_consensus.cc:2955] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.170264 14901 raft_consensus.cc:2955] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.175735 14376 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:21.177758 15004 ts_tablet_manager.cc:1929] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:21.178375 15004 log.cc:1199] T cab4884dfe6c4e24a9430e2449523d61 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/cab4884dfe6c4e24a9430e2449523d61
I20260709 13:17:21.180411 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet cab4884dfe6c4e24a9430e2449523d61 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:21.181936 14372 raft_consensus.cc:2955] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.184353 14899 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.170493 14900 raft_consensus.cc:2955] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.190323 14301 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.190963 14299 raft_consensus.cc:2955] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.168870 15008 tablet_replica.cc:333] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:17:21.200024 14993 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.201746 14845 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.211042 14993 raft_consensus.cc:2955] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.212719 14301 raft_consensus.cc:2955] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.221223 15008 raft_consensus.cc:2243] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.222151 15008 raft_consensus.cc:2272] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.222568 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 65fa0102e1144f94a57015823294e331 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:21.222510 14126 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.225303 15008 ts_tablet_manager.cc:1916] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:21.251153 14227 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:21.255012 15008 ts_tablet_manager.cc:1929] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:21.255573 15008 log.cc:1199] T 487d8e21fe1a4de4a365bd3c1f91947b P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/487d8e21fe1a4de4a365bd3c1f91947b
I20260709 13:17:21.258196 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet 487d8e21fe1a4de4a365bd3c1f91947b (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:21.257773 14125 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:21.259895 14900 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.263753 14854 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.266218 14900 raft_consensus.cc:2955] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.271180 14854 raft_consensus.cc:2955] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.273177 14899 raft_consensus.cc:2955] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.279532 14372 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.282339 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 98310add35f94d0685fee6cc0aba55a2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:21.285130 14983 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:21.295279 14124 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.297749 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet 65fa0102e1144f94a57015823294e331 with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:21.302064 15004 tablet_replica.cc:333] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:17:21.303226 15004 raft_consensus.cc:2243] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.304121 15004 raft_consensus.cc:2272] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.303906 14376 raft_consensus.cc:2955] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:21.308200 15004 ts_tablet_manager.cc:1916] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:21.326174 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet 98310add35f94d0685fee6cc0aba55a2 with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54352
I20260709 13:17:21.342227 15009 tablet_replica.cc:333] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:17:21.344343 15009 raft_consensus.cc:2243] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.345594 15009 raft_consensus.cc:2272] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.349277 15004 ts_tablet_manager.cc:1929] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:21.349762 15004 log.cc:1199] T 65fa0102e1144f94a57015823294e331 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/65fa0102e1144f94a57015823294e331
I20260709 13:17:21.350100 15009 ts_tablet_manager.cc:1916] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:21.351393 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet 65fa0102e1144f94a57015823294e331 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:21.365324 15009 ts_tablet_manager.cc:1929] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:21.365681 15009 log.cc:1199] T 98310add35f94d0685fee6cc0aba55a2 P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/98310add35f94d0685fee6cc0aba55a2
I20260709 13:17:21.367024 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet 98310add35f94d0685fee6cc0aba55a2 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:22.385211 14227 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:22.391321 14372 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:22.392058 14192 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99c124265b9c42a5a1adf047554812b4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.393185 14984 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.393694 14299 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:22.395761 14984 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.402400 14854 raft_consensus.cc:2955] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.404016 14372 raft_consensus.cc:2955] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.407366 14303 raft_consensus.cc:2955] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.427271 14127 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.455262 14372 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:22.475353 14299 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:22.476878 14227 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:22.477687 14341 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca72c82f0b3e4842b7c74a63118d3360. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.480109 14931 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.480967 15010 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:22.494161 15010 raft_consensus.cc:2955] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.495170 14227 raft_consensus.cc:2955] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.515830 14303 raft_consensus.cc:2955] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.528214 14124 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:22.529088 14301 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:17:22.565527 14267 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b16e1f580c44c1f984f63473c6a267d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.566155 14227 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:22.572504 14953 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.572894 14372 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:22.574194 14988 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.594774 14988 raft_consensus.cc:2955] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.598662 14229 raft_consensus.cc:2955] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.600059 14378 raft_consensus.cc:2955] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.614683 14126 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.619655 14301 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:22.631651 14378 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:22.632560 14267 consensus_peers.cc:597] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46b663177bbd4fbdbe452c58cdba8307. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:22.633436 14988 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.634655 14229 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:22.636812 14988 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.646341 14953 raft_consensus.cc:2955] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.647863 14228 raft_consensus.cc:2955] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.649151 14372 raft_consensus.cc:2955] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.661721 14126 catalog_manager.cc:5697] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:22.848618 15033 ts_tablet_manager.cc:933] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:22.850607 15033 tablet_copy_client.cc:323] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:17:22.852109 14239 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet 99c124265b9c42a5a1adf047554812b4 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:17:22.852550 14239 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet 99c124265b9c42a5a1adf047554812b4 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-99c124265b9c42a5a1adf047554812b4
I20260709 13:17:22.857153 14239 tablet_copy_source_session.cc:215] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:22.860062 15033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c124265b9c42a5a1adf047554812b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.872372 15033 tablet_copy_client.cc:806] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:22.872998 15033 tablet_copy_client.cc:670] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:22.876840 15033 tablet_copy_client.cc:538] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:22.883210 15033 tablet_bootstrap.cc:492] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:22.901420 15033 tablet_bootstrap.cc:492] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:22.902438 15033 tablet_bootstrap.cc:492] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:22.903208 15033 ts_tablet_manager.cc:1403] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.008s
I20260709 13:17:22.906827 15033 raft_consensus.cc:359] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:22.907755 15033 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:22.908344 15033 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:22.912204 15033 ts_tablet_manager.cc:1434] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:22.913971 14239 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-99c124265b9c42a5a1adf047554812b4 received from {username='slave'} at 127.0.0.1:57812
I20260709 13:17:22.914438 14239 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-99c124265b9c42a5a1adf047554812b4 on tablet 99c124265b9c42a5a1adf047554812b4 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:22.972008 15033 ts_tablet_manager.cc:933] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:22.974144 15033 tablet_copy_client.cc:323] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:22.975522 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet ca72c82f0b3e4842b7c74a63118d3360 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:22.975978 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet ca72c82f0b3e4842b7c74a63118d3360 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-ca72c82f0b3e4842b7c74a63118d3360
I20260709 13:17:22.980746 14388 tablet_copy_source_session.cc:215] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:22.983224 15033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca72c82f0b3e4842b7c74a63118d3360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.995277 15033 tablet_copy_client.cc:806] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:22.998404 15033 tablet_copy_client.cc:670] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:23.003499 15038 ts_tablet_manager.cc:933] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:23.009904 15033 tablet_copy_client.cc:538] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:23.012351 15038 tablet_copy_client.cc:323] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.130:44127
I20260709 13:17:23.014134 14314 tablet_copy_service.cc:140] P bee4f7fc1b4740dc875537c79309664f: Received BeginTabletCopySession request for tablet 2b16e1f580c44c1f984f63473c6a267d from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:45306)
I20260709 13:17:23.014686 14314 tablet_copy_service.cc:161] P bee4f7fc1b4740dc875537c79309664f: Beginning new tablet copy session on tablet 2b16e1f580c44c1f984f63473c6a267d from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:45306: session id = cebb34ac155340899a38c728707ddc0d-2b16e1f580c44c1f984f63473c6a267d
I20260709 13:17:23.020581 15033 tablet_bootstrap.cc:492] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:23.025985 14314 tablet_copy_source_session.cc:215] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:23.031833 15038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b16e1f580c44c1f984f63473c6a267d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.055889 15033 tablet_bootstrap.cc:492] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.057106 15033 tablet_bootstrap.cc:492] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:23.057893 15033 ts_tablet_manager.cc:1403] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.010s
I20260709 13:17:23.060853 15033 raft_consensus.cc:359] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:23.061735 15033 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:23.062453 15033 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:23.065179 15033 ts_tablet_manager.cc:1434] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:23.065840 15038 tablet_copy_client.cc:806] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:23.068693 15041 ts_tablet_manager.cc:933] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:23.068887 15038 tablet_copy_client.cc:670] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:23.070559 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-ca72c82f0b3e4842b7c74a63118d3360 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:23.071085 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-ca72c82f0b3e4842b7c74a63118d3360 on tablet ca72c82f0b3e4842b7c74a63118d3360 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:23.071574 15041 tablet_copy_client.cc:323] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.130:44127
I20260709 13:17:23.077055 15038 tablet_copy_client.cc:538] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:23.087002 15038 tablet_bootstrap.cc:492] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:23.087409 14314 tablet_copy_service.cc:140] P bee4f7fc1b4740dc875537c79309664f: Received BeginTabletCopySession request for tablet 46b663177bbd4fbdbe452c58cdba8307 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:45306)
I20260709 13:17:23.087988 14314 tablet_copy_service.cc:161] P bee4f7fc1b4740dc875537c79309664f: Beginning new tablet copy session on tablet 46b663177bbd4fbdbe452c58cdba8307 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:45306: session id = cebb34ac155340899a38c728707ddc0d-46b663177bbd4fbdbe452c58cdba8307
I20260709 13:17:23.095722 14314 tablet_copy_source_session.cc:215] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:23.098943 15041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b663177bbd4fbdbe452c58cdba8307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.121217 15038 tablet_bootstrap.cc:492] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.121745 15041 tablet_copy_client.cc:806] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:23.122177 15038 tablet_bootstrap.cc:492] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:23.122423 15041 tablet_copy_client.cc:670] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:23.122968 15038 ts_tablet_manager.cc:1403] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.003s
I20260709 13:17:23.125687 15038 raft_consensus.cc:359] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:23.126279 15041 tablet_copy_client.cc:538] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:23.126528 15038 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:23.127149 15038 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:23.131021 15038 ts_tablet_manager.cc:1434] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:23.132706 14314 tablet_copy_service.cc:342] P bee4f7fc1b4740dc875537c79309664f: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-2b16e1f580c44c1f984f63473c6a267d received from {username='slave'} at 127.0.0.1:45306
I20260709 13:17:23.133128 14314 tablet_copy_service.cc:434] P bee4f7fc1b4740dc875537c79309664f: ending tablet copy session cebb34ac155340899a38c728707ddc0d-2b16e1f580c44c1f984f63473c6a267d on tablet 2b16e1f580c44c1f984f63473c6a267d with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:23.137115 15041 tablet_bootstrap.cc:492] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:23.162155 15041 tablet_bootstrap.cc:492] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:23.162963 15041 tablet_bootstrap.cc:492] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:23.163661 15041 ts_tablet_manager.cc:1403] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.016s
I20260709 13:17:23.166482 15041 raft_consensus.cc:359] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:23.167295 15041 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:23.169127 15041 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:23.172096 15041 ts_tablet_manager.cc:1434] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:23.174122 14314 tablet_copy_service.cc:342] P bee4f7fc1b4740dc875537c79309664f: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-46b663177bbd4fbdbe452c58cdba8307 received from {username='slave'} at 127.0.0.1:45306
I20260709 13:17:23.174546 14314 tablet_copy_service.cc:434] P bee4f7fc1b4740dc875537c79309664f: ending tablet copy session cebb34ac155340899a38c728707ddc0d-46b663177bbd4fbdbe452c58cdba8307 on tablet 46b663177bbd4fbdbe452c58cdba8307 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:23.243778 14900 raft_consensus.cc:1217] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:23.435020 14900 raft_consensus.cc:1217] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:23.491165 14900 raft_consensus.cc:1217] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:23.516606 14900 raft_consensus.cc:1217] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:23.788424 14854 raft_consensus.cc:1064] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:23.790254 14854 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:23.800848 14900 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:23.801584 14378 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:23.802676 14303 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:23.803154 15046 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:23.804651 14854 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:23.805486 15015 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:23.827288 15046 raft_consensus.cc:2955] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:23.829149 14303 raft_consensus.cc:2955] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:23.831091 14372 raft_consensus.cc:2955] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:23.841104 14900 raft_consensus.cc:2955] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:23.852427 14126 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.888509 14228 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:23.904551 14900 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:23.905396 14303 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:23.907231 15046 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:23.910326 14854 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:23.921070 14854 raft_consensus.cc:2955] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:23.924995 14900 raft_consensus.cc:2955] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:23.927632 14303 raft_consensus.cc:2955] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:23.939332 14124 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:23.943636 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 99c124265b9c42a5a1adf047554812b4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:23.962800 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet 99c124265b9c42a5a1adf047554812b4 with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47058
I20260709 13:17:23.964838 15055 tablet_replica.cc:333] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:17:23.966318 15055 raft_consensus.cc:2243] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:23.967113 15055 raft_consensus.cc:2272] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:23.970956 15055 ts_tablet_manager.cc:1916] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:23.984365 15055 ts_tablet_manager.cc:1929] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:23.984794 15055 log.cc:1199] T 99c124265b9c42a5a1adf047554812b4 P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/99c124265b9c42a5a1adf047554812b4
I20260709 13:17:23.986282 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet 99c124265b9c42a5a1adf047554812b4 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:24.001009 14953 raft_consensus.cc:1064] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:24.002918 14953 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:24.011415 14900 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.011801 14372 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.013020 14988 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.014540 14228 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.015841 14988 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.021369 14988 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.031495 15029 raft_consensus.cc:2955] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.031414 14900 raft_consensus.cc:2955] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.058971 14372 raft_consensus.cc:2955] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.064795 14228 raft_consensus.cc:2955] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.070086 15061 raft_consensus.cc:1064] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:24.072624 15061 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:24.073060 14126 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.079542 14988 raft_consensus.cc:1064] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:24.083248 14988 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:24.106184 14303 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:24.107528 14229 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.108492 14375 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.109953 15029 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.111007 14988 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.132042 14229 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.132517 14227 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.132732 14899 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.133852 15010 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.134127 15029 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.134955 14953 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.139604 14901 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.143363 14900 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.144918 14988 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.148541 14303 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.150832 15029 raft_consensus.cc:2955] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.153625 14900 raft_consensus.cc:2955] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.150722 15061 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:17:24.169145 15059 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:24.194916 15062 raft_consensus.cc:2955] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.207828 14299 raft_consensus.cc:2955] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.224156 14112 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b16e1f580c44c1f984f63473c6a267d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:24.226608 14126 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.232285 15029 raft_consensus.cc:2955] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.248103 14900 raft_consensus.cc:2955] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.253353 14127 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.223850 14228 raft_consensus.cc:2955] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:24.259581 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 92974.9us
I20260709 13:17:24.264864 14375 raft_consensus.cc:2955] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.261595 14223 raft_consensus.cc:2955] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.289242 14900 raft_consensus.cc:2955] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:24.324138 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 52511.2us
W20260709 13:17:24.358065 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83727.1us
I20260709 13:17:24.378487 14127 catalog_manager.cc:5697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.382181 14229 raft_consensus.cc:2955] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:24.399501 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 72837.6us
I20260709 13:17:24.422605 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b16e1f580c44c1f984f63473c6a267d with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47058
I20260709 13:17:24.425349 15055 tablet_replica.cc:333] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:17:24.427897 15055 raft_consensus.cc:2243] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.430573 15055 raft_consensus.cc:2272] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.443351 15055 ts_tablet_manager.cc:1916] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:24.490139 15055 ts_tablet_manager.cc:1929] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:24.502004 15055 log.cc:1199] T 2b16e1f580c44c1f984f63473c6a267d P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/2b16e1f580c44c1f984f63473c6a267d
I20260709 13:17:24.506480 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet 2b16e1f580c44c1f984f63473c6a267d (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:24.511834 14301 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:24.527024 14900 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.528960 14988 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:24.545046 14372 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:24.547132 14988 raft_consensus.cc:2955] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.550789 14376 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.549026 14900 raft_consensus.cc:2955] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.553304 14229 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.553913 14901 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:24.556223 15076 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:24.557441 15026 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:24.559429 14112 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 46b663177bbd4fbdbe452c58cdba8307 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:24.562649 15075 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:24.569979 14126 catalog_manager.cc:5697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.569162 14226 raft_consensus.cc:2955] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.568995 14372 raft_consensus.cc:2955] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.567276 15076 raft_consensus.cc:2955] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.593060 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet 46b663177bbd4fbdbe452c58cdba8307 with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:24.597070 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca72c82f0b3e4842b7c74a63118d3360 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:24.605122 15078 tablet_replica.cc:333] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:17:24.612147 14124 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.613301 14900 raft_consensus.cc:2955] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:24.633883 15078 raft_consensus.cc:2243] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.636184 15078 raft_consensus.cc:2272] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.641958 15078 ts_tablet_manager.cc:1916] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:24.655184 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet ca72c82f0b3e4842b7c74a63118d3360 with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54352
I20260709 13:17:24.675319 15078 ts_tablet_manager.cc:1929] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:24.676090 15078 log.cc:1199] T 46b663177bbd4fbdbe452c58cdba8307 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/46b663177bbd4fbdbe452c58cdba8307
I20260709 13:17:24.677057 15079 tablet_replica.cc:333] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:17:24.678035 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet 46b663177bbd4fbdbe452c58cdba8307 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:24.678198 15079 raft_consensus.cc:2243] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:24.679010 15079 raft_consensus.cc:2272] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:24.681874 15079 ts_tablet_manager.cc:1916] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:24.695355 15079 ts_tablet_manager.cc:1929] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:24.695748 15079 log.cc:1199] T ca72c82f0b3e4842b7c74a63118d3360 P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/ca72c82f0b3e4842b7c74a63118d3360
I20260709 13:17:24.697402 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet ca72c82f0b3e4842b7c74a63118d3360 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:25.717830 14229 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:25.726820 14303 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:25.728273 14376 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:25.728574 14192 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd40ac1ac2b5420abcc4468ffaf0c1fe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:25.728703 15081 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:25.729698 15050 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.737210 15082 raft_consensus.cc:2955] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.738899 14376 raft_consensus.cc:2955] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.743896 14303 raft_consensus.cc:2955] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.753159 14126 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.760013 14229 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:25.769497 14376 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:25.771025 14303 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:25.773175 15082 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:25.774329 15050 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:25.779899 14192 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f80782a117e14a308698329b8639179e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:25.789912 15081 raft_consensus.cc:2955] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.791810 14299 raft_consensus.cc:2955] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.793090 14376 raft_consensus.cc:2955] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.817193 14372 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:25.819336 14125 catalog_manager.cc:5697] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.824241 14299 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:25.825472 14341 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f44936b303148f4848621766631d925. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:25.825485 14229 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:25.826480 15063 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.827713 15059 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.847749 15059 raft_consensus.cc:2955] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.849464 14299 raft_consensus.cc:2955] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.849534 14229 raft_consensus.cc:2955] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.870661 14124 catalog_manager.cc:5697] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.871703 14299 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:17:25.880862 14267 consensus_peers.cc:597] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f286c75a82eb4a2284617cd66deff360. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:25.881556 14376 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:25.884042 14229 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:25.884095 15075 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.886890 15075 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.906816 15075 raft_consensus.cc:2955] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.917979 14376 raft_consensus.cc:2955] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.929934 14228 raft_consensus.cc:2955] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:25.943053 14124 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.281482 15103 ts_tablet_manager.cc:933] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:26.286635 15103 tablet_copy_client.cc:323] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:17:26.288829 14239 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet f80782a117e14a308698329b8639179e from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:17:26.289429 14239 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet f80782a117e14a308698329b8639179e from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-f80782a117e14a308698329b8639179e
I20260709 13:17:26.298231 14239 tablet_copy_source_session.cc:215] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:26.303659 15103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80782a117e14a308698329b8639179e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.317317 15103 tablet_copy_client.cc:806] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:26.318028 15103 tablet_copy_client.cc:670] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:26.321136 15105 ts_tablet_manager.cc:933] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:26.322613 15103 tablet_copy_client.cc:538] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:26.331969 15103 tablet_bootstrap.cc:492] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:26.349432 15105 tablet_copy_client.cc:323] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:17:26.353451 14239 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet dd40ac1ac2b5420abcc4468ffaf0c1fe from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:17:26.354043 14239 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet dd40ac1ac2b5420abcc4468ffaf0c1fe from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-dd40ac1ac2b5420abcc4468ffaf0c1fe
I20260709 13:17:26.362367 15103 tablet_bootstrap.cc:492] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:26.363510 15103 tablet_bootstrap.cc:492] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:26.364288 15103 ts_tablet_manager.cc:1403] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.007s
I20260709 13:17:26.364369 14239 tablet_copy_source_session.cc:215] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:26.368193 15103 raft_consensus.cc:359] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:26.369199 15103 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:26.369977 15103 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:26.388454 15109 ts_tablet_manager.cc:933] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:26.391938 15103 ts_tablet_manager.cc:1434] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.027s	user 0.018s	sys 0.007s
I20260709 13:17:26.397604 15109 tablet_copy_client.cc:323] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:26.398559 14239 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-f80782a117e14a308698329b8639179e received from {username='slave'} at 127.0.0.1:57812
I20260709 13:17:26.399076 14239 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-f80782a117e14a308698329b8639179e on tablet f80782a117e14a308698329b8639179e with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:26.402076 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet 1f44936b303148f4848621766631d925 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:26.402621 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet 1f44936b303148f4848621766631d925 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-1f44936b303148f4848621766631d925
I20260709 13:17:26.414130 14388 tablet_copy_source_session.cc:215] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:26.415119 15105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40ac1ac2b5420abcc4468ffaf0c1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.431713 15109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f44936b303148f4848621766631d925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.446518 15109 tablet_copy_client.cc:806] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:26.447167 15109 tablet_copy_client.cc:670] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:26.458242 15105 tablet_copy_client.cc:806] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:26.458937 15105 tablet_copy_client.cc:670] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:26.462903 15109 tablet_copy_client.cc:538] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:26.463977 15105 tablet_copy_client.cc:538] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:26.467667 15103 ts_tablet_manager.cc:933] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:26.469473 15103 tablet_copy_client.cc:323] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.130:44127
I20260709 13:17:26.472661 15109 tablet_bootstrap.cc:492] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:26.472921 14314 tablet_copy_service.cc:140] P bee4f7fc1b4740dc875537c79309664f: Received BeginTabletCopySession request for tablet f286c75a82eb4a2284617cd66deff360 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:45306)
I20260709 13:17:26.473479 14314 tablet_copy_service.cc:161] P bee4f7fc1b4740dc875537c79309664f: Beginning new tablet copy session on tablet f286c75a82eb4a2284617cd66deff360 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:45306: session id = cebb34ac155340899a38c728707ddc0d-f286c75a82eb4a2284617cd66deff360
I20260709 13:17:26.478056 15105 tablet_bootstrap.cc:492] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:26.487366 14314 tablet_copy_source_session.cc:215] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:26.491029 15103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f286c75a82eb4a2284617cd66deff360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:26.516108 15103 tablet_copy_client.cc:806] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:26.516891 15103 tablet_copy_client.cc:670] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:26.521484 15103 tablet_copy_client.cc:538] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:26.526404 15109 tablet_bootstrap.cc:492] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:26.527706 15109 tablet_bootstrap.cc:492] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:26.530212 15109 ts_tablet_manager.cc:1403] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.004s
I20260709 13:17:26.531105 15105 tablet_bootstrap.cc:492] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:26.532172 15105 tablet_bootstrap.cc:492] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:26.536303 15103 tablet_bootstrap.cc:492] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:26.538283 15109 raft_consensus.cc:359] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:26.539273 15109 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:26.537103 15105 ts_tablet_manager.cc:1403] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.025s
I20260709 13:17:26.540009 15109 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:26.549026 15109 ts_tablet_manager.cc:1434] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:17:26.552870 15105 raft_consensus.cc:359] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:26.555590 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-1f44936b303148f4848621766631d925 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:26.556092 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-1f44936b303148f4848621766631d925 on tablet 1f44936b303148f4848621766631d925 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:26.553941 15105 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:26.567554 15105 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:26.571393 15105 ts_tablet_manager.cc:1434] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:17:26.573413 14239 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-dd40ac1ac2b5420abcc4468ffaf0c1fe received from {username='slave'} at 127.0.0.1:57812
I20260709 13:17:26.573891 14239 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-dd40ac1ac2b5420abcc4468ffaf0c1fe on tablet dd40ac1ac2b5420abcc4468ffaf0c1fe with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:26.584461 15103 tablet_bootstrap.cc:492] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:26.585567 15103 tablet_bootstrap.cc:492] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:26.586681 15103 ts_tablet_manager.cc:1403] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.012s
I20260709 13:17:26.589741 15103 raft_consensus.cc:359] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:26.590701 15103 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:26.591392 15103 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:26.594139 15103 ts_tablet_manager.cc:1434] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:26.595959 14314 tablet_copy_service.cc:342] P bee4f7fc1b4740dc875537c79309664f: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-f286c75a82eb4a2284617cd66deff360 received from {username='slave'} at 127.0.0.1:45306
I20260709 13:17:26.596397 14314 tablet_copy_service.cc:434] P bee4f7fc1b4740dc875537c79309664f: ending tablet copy session cebb34ac155340899a38c728707ddc0d-f286c75a82eb4a2284617cd66deff360 on tablet f286c75a82eb4a2284617cd66deff360 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:26.661731 14900 raft_consensus.cc:1217] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:26.736824 14900 raft_consensus.cc:1217] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:26.775676 14900 raft_consensus.cc:1217] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:26.900553 14900 raft_consensus.cc:1217] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:27.058388 15074 raft_consensus.cc:1064] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:27.060659 15074 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:27.068427 14303 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.068670 14900 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.070330 15117 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.071681 14376 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.072522 15074 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.078969 15117 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.094424 15074 raft_consensus.cc:2955] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.098119 14372 raft_consensus.cc:2955] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.098181 14900 raft_consensus.cc:2955] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.115101 14125 catalog_manager.cc:5697] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.118949 14303 raft_consensus.cc:2955] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.146708 15074 raft_consensus.cc:1064] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:27.149495 15074 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:27.155853 14372 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.157399 15117 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:27.164508 14900 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.170823 15117 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.181778 14228 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:27.183727 14301 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.185426 15111 raft_consensus.cc:2955] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.186430 15081 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:27.192353 14900 raft_consensus.cc:2955] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.200052 14901 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.206331 15081 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.211404 14124 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.218010 14301 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.226377 14372 raft_consensus.cc:2955] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.221957 14303 raft_consensus.cc:2955] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.231992 15117 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.263049 14229 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:27.263761 15132 raft_consensus.cc:2955] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.265738 14301 raft_consensus.cc:2955] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.274276 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f80782a117e14a308698329b8639179e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:27.278225 14900 raft_consensus.cc:2955] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.291227 14899 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.294440 15081 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.301124 14127 catalog_manager.cc:5697] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.304251 15117 raft_consensus.cc:2955] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.309177 14375 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.311473 14899 raft_consensus.cc:2955] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.315686 15117 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.318145 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd40ac1ac2b5420abcc4468ffaf0c1fe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:27.320926 14375 raft_consensus.cc:2955] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.324607 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet f80782a117e14a308698329b8639179e with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47058
I20260709 13:17:27.351251 15059 raft_consensus.cc:1064] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:27.335888 15133 tablet_replica.cc:333] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:17:27.360479 14124 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.357142 15059 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:27.385842 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet dd40ac1ac2b5420abcc4468ffaf0c1fe with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54352
I20260709 13:17:27.388298 14899 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.389063 14301 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.390143 15096 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:27.389062 14228 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.390174 15135 tablet_replica.cc:333] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:17:27.391837 15135 raft_consensus.cc:2243] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:27.392019 15119 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:27.392763 15135 raft_consensus.cc:2272] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:27.393484 15133 raft_consensus.cc:2243] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:27.394379 15133 raft_consensus.cc:2272] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:27.396469 15119 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.407778 15135 ts_tablet_manager.cc:1916] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:27.410847 15133 ts_tablet_manager.cc:1916] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:27.429558 15096 raft_consensus.cc:2955] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.465983 15135 ts_tablet_manager.cc:1929] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:27.466507 15135 log.cc:1199] T dd40ac1ac2b5420abcc4468ffaf0c1fe P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/dd40ac1ac2b5420abcc4468ffaf0c1fe
I20260709 13:17:27.468165 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet dd40ac1ac2b5420abcc4468ffaf0c1fe (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:27.473456 14899 raft_consensus.cc:2955] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.501072 14124 catalog_manager.cc:5697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.509871 15133 ts_tablet_manager.cc:1929] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:27.510540 15133 log.cc:1199] T f80782a117e14a308698329b8639179e P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/f80782a117e14a308698329b8639179e
I20260709 13:17:27.512400 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet f80782a117e14a308698329b8639179e (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:27.514853 14228 raft_consensus.cc:2955] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.516034 15102 raft_consensus.cc:1064] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:27.518592 14375 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:27.519061 14301 raft_consensus.cc:2955] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.534541 14228 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.535290 14899 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.535899 15063 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.522547 15102 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:27.552755 15059 raft_consensus.cc:2955] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.560027 14223 raft_consensus.cc:2955] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.562785 15063 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.567571 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f44936b303148f4848621766631d925 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:27.575837 14899 raft_consensus.cc:2955] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.576635 14127 catalog_manager.cc:5697] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.609040 14899 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.610630 14375 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.611536 14223 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:27.611464 15075 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:27.612538 15140 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:27.613346 15102 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:27.615327 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f44936b303148f4848621766631d925 with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54352
I20260709 13:17:27.616346 15135 tablet_replica.cc:333] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:17:27.617307 15135 raft_consensus.cc:2243] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:27.618110 15135 raft_consensus.cc:2272] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:27.623301 15135 ts_tablet_manager.cc:1916] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:27.644974 15135 ts_tablet_manager.cc:1929] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:27.645462 15135 log.cc:1199] T 1f44936b303148f4848621766631d925 P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/1f44936b303148f4848621766631d925
I20260709 13:17:27.648177 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet 1f44936b303148f4848621766631d925 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:27.658291 15140 raft_consensus.cc:2955] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.660943 14223 raft_consensus.cc:2955] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.664362 14900 raft_consensus.cc:2955] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.673583 14372 raft_consensus.cc:2955] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.680104 14127 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.696949 14301 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:27.708106 14372 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.710053 15140 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:27.712919 14900 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:27.715279 15140 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.721124 15075 raft_consensus.cc:2955] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.724702 14372 raft_consensus.cc:2955] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.740447 14900 raft_consensus.cc:2955] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.743363 14112 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f286c75a82eb4a2284617cd66deff360 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:27.745357 14125 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:27.759367 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet f286c75a82eb4a2284617cd66deff360 with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:27.767356 15145 tablet_replica.cc:333] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:17:27.768417 15145 raft_consensus.cc:2243] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:27.769081 15145 raft_consensus.cc:2272] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:27.774313 15145 ts_tablet_manager.cc:1916] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:27.786971 15145 ts_tablet_manager.cc:1929] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:27.787460 15145 log.cc:1199] T f286c75a82eb4a2284617cd66deff360 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/f286c75a82eb4a2284617cd66deff360
I20260709 13:17:27.788962 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet f286c75a82eb4a2284617cd66deff360 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:28.830055 14375 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:17:28.837250 14341 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e674623b78de49129be2dde67c041ef9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.838135 14299 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:28.838168 14223 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:28.839684 15148 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:28.841301 15059 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.849890 15139 raft_consensus.cc:2955] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:28.854970 14299 raft_consensus.cc:2955] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:28.859112 14228 raft_consensus.cc:2955] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:28.881412 14228 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:28.883111 14127 catalog_manager.cc:5697] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:28.895285 14372 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:28.896411 14192 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbf8c75a86f64f6cb1dd8780d0365f85. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.897419 15074 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:28.899753 14299 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:28.901454 15074 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.909051 15117 raft_consensus.cc:2955] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:28.911533 14372 raft_consensus.cc:2955] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:28.931295 14372 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:28.936163 14299 raft_consensus.cc:2955] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:28.939541 14125 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:28.952984 14301 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:28.953430 14223 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:28.955025 14341 consensus_peers.cc:597] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 76a21260793b426d8f662c772b5b2a03. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.960835 15059 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.970930 15148 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.979104 15139 raft_consensus.cc:2955] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:28.980569 14301 raft_consensus.cc:2955] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:28.983932 14223 raft_consensus.cc:2955] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:28.997319 14125 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:29.005661 14301 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:17:29.014937 14267 consensus_peers.cc:597] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43b3afc4354948bea829c90a4536aa96. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:29.016155 14376 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:29.017555 15159 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:29.018824 14223 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:29.020710 15075 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:29.032990 15140 raft_consensus.cc:2955] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:29.035418 14376 raft_consensus.cc:2955] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:29.038626 14223 raft_consensus.cc:2955] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:29.061158 14126 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:29.293883 15165 ts_tablet_manager.cc:933] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:29.295773 15165 tablet_copy_client.cc:323] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:29.297406 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet e674623b78de49129be2dde67c041ef9 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:29.297945 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet e674623b78de49129be2dde67c041ef9 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-e674623b78de49129be2dde67c041ef9
I20260709 13:17:29.303988 14388 tablet_copy_source_session.cc:215] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:29.307659 15165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e674623b78de49129be2dde67c041ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.321089 15165 tablet_copy_client.cc:806] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:29.321630 15165 tablet_copy_client.cc:670] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:29.325313 15165 tablet_copy_client.cc:538] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:29.332772 15165 tablet_bootstrap.cc:492] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:29.351688 15165 tablet_bootstrap.cc:492] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:29.352675 15165 tablet_bootstrap.cc:492] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:29.353363 15165 ts_tablet_manager.cc:1403] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:17:29.356031 15165 raft_consensus.cc:359] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:29.356884 15165 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:29.357539 15165 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:29.361716 15165 ts_tablet_manager.cc:1434] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.001s
I20260709 13:17:29.372110 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-e674623b78de49129be2dde67c041ef9 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:29.372638 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-e674623b78de49129be2dde67c041ef9 on tablet e674623b78de49129be2dde67c041ef9 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:29.419866 15165 ts_tablet_manager.cc:933] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:29.421537 15165 tablet_copy_client.cc:323] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.130:44127
I20260709 13:17:29.423923 14314 tablet_copy_service.cc:140] P bee4f7fc1b4740dc875537c79309664f: Received BeginTabletCopySession request for tablet 43b3afc4354948bea829c90a4536aa96 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:45306)
I20260709 13:17:29.424484 14314 tablet_copy_service.cc:161] P bee4f7fc1b4740dc875537c79309664f: Beginning new tablet copy session on tablet 43b3afc4354948bea829c90a4536aa96 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:45306: session id = cebb34ac155340899a38c728707ddc0d-43b3afc4354948bea829c90a4536aa96
I20260709 13:17:29.428213 15170 ts_tablet_manager.cc:933] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:29.437458 15170 tablet_copy_client.cc:323] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:29.439067 15172 ts_tablet_manager.cc:933] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:29.439802 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet 76a21260793b426d8f662c772b5b2a03 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:29.440380 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet 76a21260793b426d8f662c772b5b2a03 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-76a21260793b426d8f662c772b5b2a03
I20260709 13:17:29.450660 15172 tablet_copy_client.cc:323] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:17:29.454212 14388 tablet_copy_source_session.cc:215] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:29.455636 14239 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet bbf8c75a86f64f6cb1dd8780d0365f85 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:17:29.456210 14239 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet bbf8c75a86f64f6cb1dd8780d0365f85 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-bbf8c75a86f64f6cb1dd8780d0365f85
I20260709 13:17:29.461035 15170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a21260793b426d8f662c772b5b2a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.461018 14314 tablet_copy_source_session.cc:215] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:29.467509 14239 tablet_copy_source_session.cc:215] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:29.468833 15165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b3afc4354948bea829c90a4536aa96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.471011 15172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbf8c75a86f64f6cb1dd8780d0365f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:29.487010 15172 tablet_copy_client.cc:806] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:29.487583 15172 tablet_copy_client.cc:670] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:29.489699 15165 tablet_copy_client.cc:806] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:29.490334 15165 tablet_copy_client.cc:670] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:29.491328 15172 tablet_copy_client.cc:538] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:29.493311 15170 tablet_copy_client.cc:806] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:29.493870 15170 tablet_copy_client.cc:670] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:29.494585 15165 tablet_copy_client.cc:538] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:29.498054 15170 tablet_copy_client.cc:538] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:29.501645 15172 tablet_bootstrap.cc:492] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:29.509306 15165 tablet_bootstrap.cc:492] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:29.531510 15170 tablet_bootstrap.cc:492] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:29.546617 15165 tablet_bootstrap.cc:492] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:29.547698 15165 tablet_bootstrap.cc:492] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:29.548609 15165 ts_tablet_manager.cc:1403] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.004s
I20260709 13:17:29.551779 15165 raft_consensus.cc:359] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:29.565068 15165 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:29.566218 15165 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:29.569224 15172 tablet_bootstrap.cc:492] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:29.570194 15172 tablet_bootstrap.cc:492] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:29.570907 15172 ts_tablet_manager.cc:1403] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.005s
I20260709 13:17:29.573719 15172 raft_consensus.cc:359] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:29.574558 15172 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:29.575227 15172 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:29.577920 15172 ts_tablet_manager.cc:1434] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:17:29.580220 14239 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-bbf8c75a86f64f6cb1dd8780d0365f85 received from {username='slave'} at 127.0.0.1:57812
I20260709 13:17:29.580730 14239 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-bbf8c75a86f64f6cb1dd8780d0365f85 on tablet bbf8c75a86f64f6cb1dd8780d0365f85 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:29.583313 15165 ts_tablet_manager.cc:1434] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:17:29.584836 14314 tablet_copy_service.cc:342] P bee4f7fc1b4740dc875537c79309664f: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-43b3afc4354948bea829c90a4536aa96 received from {username='slave'} at 127.0.0.1:45306
I20260709 13:17:29.585235 14314 tablet_copy_service.cc:434] P bee4f7fc1b4740dc875537c79309664f: ending tablet copy session cebb34ac155340899a38c728707ddc0d-43b3afc4354948bea829c90a4536aa96 on tablet 43b3afc4354948bea829c90a4536aa96 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:29.589249 15170 tablet_bootstrap.cc:492] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:29.590058 15170 tablet_bootstrap.cc:492] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:29.590601 15170 ts_tablet_manager.cc:1403] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.060s	user 0.020s	sys 0.008s
I20260709 13:17:29.592702 15170 raft_consensus.cc:359] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:29.593335 15170 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:29.593885 15170 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:29.595896 15170 ts_tablet_manager.cc:1434] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:29.597477 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-76a21260793b426d8f662c772b5b2a03 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:29.597954 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-76a21260793b426d8f662c772b5b2a03 on tablet 76a21260793b426d8f662c772b5b2a03 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:29.689280 14900 raft_consensus.cc:1217] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:29.958051 14900 raft_consensus.cc:1217] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:30.025242 14900 raft_consensus.cc:1217] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:30.030625 14900 raft_consensus.cc:1217] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:30.231665 15148 raft_consensus.cc:1064] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:30.233645 15148 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:30.243764 14900 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.248111 14227 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.250123 15178 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.251297 15059 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.251843 14301 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.256441 15059 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.272089 15148 raft_consensus.cc:2955] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.274147 14299 raft_consensus.cc:2955] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.287010 14900 raft_consensus.cc:2955] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.292558 14126 catalog_manager.cc:5697] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.306553 14227 raft_consensus.cc:2955] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.338181 14372 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:30.345034 14900 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:30.346679 14223 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:30.348013 15059 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:30.349583 15178 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:30.357870 15139 raft_consensus.cc:2955] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.363265 14899 raft_consensus.cc:2955] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.374408 14226 raft_consensus.cc:2955] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.383172 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e674623b78de49129be2dde67c041ef9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:30.398917 14127 catalog_manager.cc:5697] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.410637 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet e674623b78de49129be2dde67c041ef9 with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54352
I20260709 13:17:30.415047 15187 tablet_replica.cc:333] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:17:30.416230 15187 raft_consensus.cc:2243] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.417057 15187 raft_consensus.cc:2272] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.420346 15187 ts_tablet_manager.cc:1916] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:30.437009 15187 ts_tablet_manager.cc:1929] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:30.437427 15187 log.cc:1199] T e674623b78de49129be2dde67c041ef9 P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/e674623b78de49129be2dde67c041ef9
I20260709 13:17:30.439023 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet e674623b78de49129be2dde67c041ef9 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:30.477546 15059 raft_consensus.cc:1064] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:30.479934 15059 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:30.486748 14301 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.487296 14899 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.488567 15059 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.488603 14226 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.489569 15178 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.490497 15148 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.525190 15178 raft_consensus.cc:2955] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.528168 14226 raft_consensus.cc:2955] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.533097 14303 raft_consensus.cc:2955] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.540777 14899 raft_consensus.cc:2955] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.547016 14126 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.551870 15159 raft_consensus.cc:1064] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:30.560171 15074 raft_consensus.cc:1064] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:30.554574 15159 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:30.562673 15074 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:30.585597 14372 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:30.596030 14226 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.598129 15194 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:30.599597 14303 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.602442 14900 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.602929 14376 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.604172 15194 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.605298 14376 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.605918 15117 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.606385 14900 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:30.609560 15146 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:30.611109 15117 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:30.616266 14899 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:30.619406 15148 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:30.623651 15194 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:30.624547 14299 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:30.626152 15178 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:30.644227 15059 raft_consensus.cc:2955] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.660848 14299 raft_consensus.cc:2955] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.662266 14897 raft_consensus.cc:2955] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.668351 14899 raft_consensus.cc:2955] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:30.674057 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49417.4us
I20260709 13:17:30.657428 15194 raft_consensus.cc:2955] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:30.681423 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 76a21260793b426d8f662c772b5b2a03 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:30.709903 14126 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.729061 14227 raft_consensus.cc:2955] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:30.751127 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 64057.6us
W20260709 13:17:31.688460 14268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.030s	sys 0.032s
W20260709 13:17:31.689527 14268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.030s	sys 0.032s
I20260709 13:17:31.686069 15219 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.718829 15219 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.724560 15219 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:31.796414 15215 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.796995 15215 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.799386 15215 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:31.816180 15208 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.816915 15208 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.819378 15208 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:17:31.820699 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 104225us
I20260709 13:17:31.819833 14125 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:31.823086 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:31.823807 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:31.832114 15218 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.832769 15218 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.835884 15218 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:31.837589 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:31.844020 15224 raft_consensus.cc:2955] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:31.852802 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:31.856361 15226 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.857069 15226 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } }
I20260709 13:17:31.859323 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet 76a21260793b426d8f662c772b5b2a03 with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:31.865080 15226 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:31.871865 15230 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:17:31.872685 15230 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.873958 15228 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:31.874640 15228 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.891975 15210 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.892535 15210 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:31.893415 15228 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:31.894802 15210 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:31.895900 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:31.876820 15227 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.896806 15227 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.899698 15227 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:31.901731 15210 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.902562 15210 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.904945 15210 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:31.905800 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:31.881500 15223 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:17:31.908078 15223 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.883131 15222 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:17:31.883878 15221 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:31.882951 14897 raft_consensus.cc:2955] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:31.885074 15220 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:31.888403 15235 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:31.896137 15230 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:31.875095 15233 tablet_replica.cc:333] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:17:31.926415 15218 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.927009 15218 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:31.929119 15218 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:31.929936 15227 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.930444 15227 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.932456 15227 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:31.928892 14124 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37080 (request call id 197) took 1205 ms. Trace:
I20260709 13:17:31.912451 15220 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.940604 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:31.941277 15220 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:31.941977 15075 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.942847 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:31.951107 14227 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:17:31.947324 14376 raft_consensus.cc:2955] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:31.951025 15075 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.954213 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:31.954514 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:31.957746 14299 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:17:31.956459 15075 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:31.961156 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:31.961323 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:31.962256 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:31.962457 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:31.918749 15221 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.962235 15075 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:31.965266 15075 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.965760 15075 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.958446 15234 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.971659 14193 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:31.964598 15220 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:31.980150 15209 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:31.934795 14124 rpcz_store.cc:276] 0709 13:17:30.723179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.723332 (+   153us) service_pool.cc:224] Handling call
0709 13:17:31.928773 (+1205441us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:17:31.913481 15222 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.967381 15223 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:31.973279 14304 raft_consensus.cc:2955] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:31.981915 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:31.982632 15227 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.987545 15231 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:17:31.990754 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51114.2us
I20260709 13:17:31.986934 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:31.996661 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:31.998373 15075 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.995687 15228 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:31.999346 15228 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:31.934499 15235 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:32.005103 15239 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:32.006974 15230 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:32.008209 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.007519 15230 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.009442 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:31.990783 15209 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:31.982785 15234 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:32.016080 15075 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:32.018656 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:31.986780 15220 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.003674 15231 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.020323 15209 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.006693 15239 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.033375 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:32.010398 15222 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:31.996202 15227 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.037442 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.043085 15239 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:32.038196 15216 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:32.055446 15230 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:32.064632 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.066190 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.036173 15208 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:32.079135 14267 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:32.081508 14267 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:32.082083 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.089543 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:32.092768 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:32.093050 15075 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.094293 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:32.095235 15213 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.095811 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.096040 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.097301 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.097481 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.098889 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.100240 15210 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:32.100399 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.100844 15210 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:32.098876 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.098891 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.101711 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.106208 15209 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.106850 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:32.107928 14227 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 2: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:17:32.108769 15210 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:32.074762 15221 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:32.123401 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.110641 15218 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.111399 15213 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.055783 15216 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.130676 15235 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:32.112150 15214 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.113881 15231 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:32.115216 15227 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:32.116888 15234 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:32.118487 15220 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:32.077658 15208 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.109993 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:32.129313 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:32.151432 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.143932 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.155004 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.161068 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.160411 15241 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:32.164467 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.163467 15241 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.154976 15219 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.169445 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.152354 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.152565 15231 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:32.172227 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.175063 14193 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:32.176785 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:32.177520 15075 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.184064 15226 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.166756 15214 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:32.172708 15231 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.194957 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:32.195350 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.200470 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.201164 14301 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 2: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:17:32.202045 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.194757 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.205824 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.203541 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.208673 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.208876 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.202315 14373 raft_consensus.cc:2955] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:32.212404 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.218236 15241 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:32.218420 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:32.219010 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.220736 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.223869 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.226464 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:32.227352 15220 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.209694 15214 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:32.242754 15209 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:32.235747 15226 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:17:32.245348 15216 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:32.244333 15226 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:32.248149 14229 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.213977 15231 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:32.259106 15208 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:32.258884 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.253123 15211 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:32.262246 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.263550 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:32.266713 15245 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.273077 14295 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.262391 15211 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.288347 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.248636 15226 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:17:32.294199 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 116471us
I20260709 13:17:32.296324 14342 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.297127 15220 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.297463 14342 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.298236 15220 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.298604 14342 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.299337 15241 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.300202 14342 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.301260 15223 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.301306 14342 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.301971 15214 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:32.302269 15241 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.302546 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.303328 15241 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.304898 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:32.304411 15231 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.307200 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.310155 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:32.314203 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:32.304916 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.315078 15227 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.290757 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.317066 14867 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:32.328274 15246 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.327235 15211 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:32.336378 14342 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.337836 14342 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.335469 15220 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:32.335551 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:32.350194 15233 raft_consensus.cc:2243] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.351374 15228 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:32.353709 15220 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.354132 15220 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:32.355012 15220 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.356751 15223 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.358783 15220 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.360073 14127 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:32.367074 15233 raft_consensus.cc:2272] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.373415 15228 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.373286 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.374925 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.376083 15223 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.378300 15233 ts_tablet_manager.cc:1916] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:32.376742 15231 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:32.384732 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 53658.8us
I20260709 13:17:32.394255 14297 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:32.399416 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:32.401988 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.404325 15208 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.410141 15226 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.412348 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.402380 14342 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.414371 15235 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.414952 15248 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.422926 14897 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.426261 14373 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.426838 15227 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:32.430001 15075 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:32.415628 14342 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.446544 15075 raft_consensus.cc:2955] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:32.458436 14374 raft_consensus.cc:2955] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:32.460546 15241 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:32.464954 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49403.2us
I20260709 13:17:32.468128 14112 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43b3afc4354948bea829c90a4536aa96 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:32.480445 14124 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.513705 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:32.517889 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:32.524978 14899 raft_consensus.cc:2955] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:32.526975 14374 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:32.535647 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.541424 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.545817 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.548101 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:32.560523 14222 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:32.571545 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet 43b3afc4354948bea829c90a4536aa96 with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:32.577505 14192 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:32.579735 14295 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.584867 15226 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.594667 14899 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:32.617022 15226 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:32.624292 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.626384 15233 ts_tablet_manager.cc:1929] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:32.638945 15248 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.646656 15233 log.cc:1199] T 76a21260793b426d8f662c772b5b2a03 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/76a21260793b426d8f662c772b5b2a03
I20260709 13:17:32.648258 15233 tablet_replica.cc:333] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:17:32.648994 15233 raft_consensus.cc:2243] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.639858 14192 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.650470 15217 raft_consensus.cc:2955] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:32.653968 15248 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:32.654997 15248 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:32.666422 14295 raft_consensus.cc:2955] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:32.675743 15226 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.677248 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.679265 15226 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.689685 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:32.691119 15208 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.693565 15233 raft_consensus.cc:2272] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.697000 15233 ts_tablet_manager.cc:1916] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:32.697953 14125 catalog_manager.cc:5697] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.699532 14125 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.705410 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet 76a21260793b426d8f662c772b5b2a03 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:32.707715 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bbf8c75a86f64f6cb1dd8780d0365f85 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:32.711028 15248 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:32.720512 14899 raft_consensus.cc:2955] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:32.721861 15233 ts_tablet_manager.cc:1929] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:32.722389 15233 log.cc:1199] T 43b3afc4354948bea829c90a4536aa96 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/43b3afc4354948bea829c90a4536aa96
W20260709 13:17:32.722998 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2c80 after lost signal to thread 13125
W20260709 13:17:32.724217 14399 debug-util.cc:398] Leaking SignalData structure 0x7b0800195640 after lost signal to thread 14161
W20260709 13:17:32.725409 14399 debug-util.cc:398] Leaking SignalData structure 0x7b0800333ca0 after lost signal to thread 14253
W20260709 13:17:32.726428 14399 debug-util.cc:398] Leaking SignalData structure 0x7b0800333400 after lost signal to thread 14328
W20260709 13:17:32.727415 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfd60 after lost signal to thread 14402
W20260709 13:17:32.728441 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4a80 after lost signal to thread 14925
W20260709 13:17:32.728834 14399 debug-util.cc:398] Leaking SignalData structure 0x7b0800206580 after lost signal to thread 15188
W20260709 13:17:32.729132 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08002c50a0 after lost signal to thread 15198
I20260709 13:17:32.745041 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet bbf8c75a86f64f6cb1dd8780d0365f85 with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47058
I20260709 13:17:32.755496 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet 43b3afc4354948bea829c90a4536aa96 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:32.776113 15253 tablet_replica.cc:333] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:17:32.780200 15253 raft_consensus.cc:2243] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.781162 15253 raft_consensus.cc:2272] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.790112 15253 ts_tablet_manager.cc:1916] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:32.805146 15253 ts_tablet_manager.cc:1929] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:32.805505 15253 log.cc:1199] T bbf8c75a86f64f6cb1dd8780d0365f85 P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/bbf8c75a86f64f6cb1dd8780d0365f85
I20260709 13:17:32.807258 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet bbf8c75a86f64f6cb1dd8780d0365f85 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:33.070444 14295 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.071879 15248 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.094357 14374 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.095709 15211 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.824275 14298 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:33.832367 14223 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:33.832453 14267 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 475079f88bce40fea814453c8c4bfaac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:33.834654 15218 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.836513 14371 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:33.837991 15218 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.848121 15218 raft_consensus.cc:2955] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:33.850169 14374 raft_consensus.cc:2955] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:33.855137 14229 raft_consensus.cc:2955] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:33.873545 14373 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:33.880929 14125 catalog_manager.cc:5697] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:33.891863 14341 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fde6831a789b45549658b2c2146dd650. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:33.894416 14297 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:33.898005 15237 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.905658 14220 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:33.929829 15237 raft_consensus.cc:2955] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:33.930569 14297 raft_consensus.cc:2955] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:33.939371 15235 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.957337 14377 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:33.972164 14126 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.056108 14298 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:34.058518 15241 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.062124 14229 raft_consensus.cc:2955] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:34.182403 14222 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:34.212941 14341 consensus_peers.cc:597] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b3646e03a744053ae5fd190c43a27e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:34.536518 15237 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:17:34.542368 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 309660us
W20260709 13:17:34.646063 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58938.9us
I20260709 13:17:34.774586 15293 ts_tablet_manager.cc:933] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:17:34.786532 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 52804.2us
W20260709 13:17:34.787616 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 59780.8us
I20260709 13:17:34.773255 15295 raft_consensus.cc:2955] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:34.820309 15299 ts_tablet_manager.cc:933] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:34.822431 15293 tablet_copy_client.cc:323] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:34.855208 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet fde6831a789b45549658b2c2146dd650 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:34.856014 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet fde6831a789b45549658b2c2146dd650 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-fde6831a789b45549658b2c2146dd650
W20260709 13:17:34.859587 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 92025.9us
I20260709 13:17:34.866219 15302 ts_tablet_manager.cc:933] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:34.876257 14225 raft_consensus.cc:2955] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:34.868086 14388 tablet_copy_source_session.cc:215] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:34.869930 15299 tablet_copy_client.cc:323] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.130:44127
I20260709 13:17:34.888867 14314 tablet_copy_service.cc:140] P bee4f7fc1b4740dc875537c79309664f: Received BeginTabletCopySession request for tablet 475079f88bce40fea814453c8c4bfaac from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:45306)
I20260709 13:17:34.889519 14314 tablet_copy_service.cc:161] P bee4f7fc1b4740dc875537c79309664f: Beginning new tablet copy session on tablet 475079f88bce40fea814453c8c4bfaac from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:45306: session id = cebb34ac155340899a38c728707ddc0d-475079f88bce40fea814453c8c4bfaac
I20260709 13:17:34.896710 14298 raft_consensus.cc:2955] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:34.899921 14314 tablet_copy_source_session.cc:215] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:34.904460 15299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475079f88bce40fea814453c8c4bfaac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.929452 15293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde6831a789b45549658b2c2146dd650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.929102 14124 catalog_manager.cc:5697] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:34.963527 15302 tablet_copy_client.cc:323] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:34.966423 14377 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:34.982682 15293 tablet_copy_client.cc:806] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:34.993933 15293 tablet_copy_client.cc:670] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:34.996201 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet 6b3646e03a744053ae5fd190c43a27e4 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:34.996975 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet 6b3646e03a744053ae5fd190c43a27e4 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-6b3646e03a744053ae5fd190c43a27e4
I20260709 13:17:35.012315 15293 tablet_copy_client.cc:538] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:35.020434 14300 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:35.020674 14225 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:34.987934 15299 tablet_copy_client.cc:806] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:35.021711 15299 tablet_copy_client.cc:670] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:35.021934 15295 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.024037 15266 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:35.030970 15299 tablet_copy_client.cc:538] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:17:35.031121 14341 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52ca7fe34f2a4185a741b8aebabd8bfc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:35.024708 14388 tablet_copy_source_session.cc:215] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:35.048228 15295 raft_consensus.cc:2955] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:35.049642 15302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3646e03a744053ae5fd190c43a27e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.051870 15293 tablet_bootstrap.cc:492] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:35.060261 14298 raft_consensus.cc:2955] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:35.095644 15302 tablet_copy_client.cc:806] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:35.098285 15302 tablet_copy_client.cc:670] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:35.099277 14225 raft_consensus.cc:2955] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:35.098397 15299 tablet_bootstrap.cc:492] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:35.114524 15302 tablet_copy_client.cc:538] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:35.150748 15302 tablet_bootstrap.cc:492] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:35.159837 14125 catalog_manager.cc:5697] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:35.240564 15302 tablet_bootstrap.cc:492] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.242228 15302 tablet_bootstrap.cc:492] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:35.243129 15302 ts_tablet_manager.cc:1403] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.017s
I20260709 13:17:35.245607 15293 tablet_bootstrap.cc:492] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.249203 15302 raft_consensus.cc:359] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:35.250227 15302 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:35.250850 15293 tablet_bootstrap.cc:492] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:35.251403 15302 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:35.252400 15293 ts_tablet_manager.cc:1403] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.201s	user 0.018s	sys 0.014s
I20260709 13:17:35.262916 15299 tablet_bootstrap.cc:492] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.267491 15299 tablet_bootstrap.cc:492] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:35.268337 15299 ts_tablet_manager.cc:1403] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.170s	user 0.021s	sys 0.008s
I20260709 13:17:35.265749 15293 raft_consensus.cc:359] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:35.273280 15293 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:35.272413 15299 raft_consensus.cc:359] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:35.274107 15293 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:35.274657 15299 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:35.287726 15299 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:35.288816 15302 ts_tablet_manager.cc:1434] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.029s
I20260709 13:17:35.291905 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-6b3646e03a744053ae5fd190c43a27e4 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:35.292380 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-6b3646e03a744053ae5fd190c43a27e4 on tablet 6b3646e03a744053ae5fd190c43a27e4 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:35.293231 15299 ts_tablet_manager.cc:1434] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:17:35.296525 14314 tablet_copy_service.cc:342] P bee4f7fc1b4740dc875537c79309664f: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-475079f88bce40fea814453c8c4bfaac received from {username='slave'} at 127.0.0.1:45306
I20260709 13:17:35.296963 14314 tablet_copy_service.cc:434] P bee4f7fc1b4740dc875537c79309664f: ending tablet copy session cebb34ac155340899a38c728707ddc0d-475079f88bce40fea814453c8c4bfaac on tablet 475079f88bce40fea814453c8c4bfaac with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:35.301416 15293 ts_tablet_manager.cc:1434] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:17:35.309984 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-fde6831a789b45549658b2c2146dd650 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:35.310464 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-fde6831a789b45549658b2c2146dd650 on tablet fde6831a789b45549658b2c2146dd650 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:35.343135 14899 raft_consensus.cc:1217] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:17:35.581408 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5060 after lost signal to thread 13125
W20260709 13:17:35.582507 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5740 after lost signal to thread 14161
W20260709 13:17:35.583738 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa7c0 after lost signal to thread 14253
W20260709 13:17:35.584895 14922 debug-util.cc:398] Leaking SignalData structure 0x7b080019fac0 after lost signal to thread 14328
I20260709 13:17:35.585464 14899 raft_consensus.cc:1217] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:17:35.586189 14922 debug-util.cc:398] Leaking SignalData structure 0x7b0800291a60 after lost signal to thread 14402
W20260709 13:17:35.587370 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08002ede80 after lost signal to thread 14925
I20260709 13:17:35.623226 15293 ts_tablet_manager.cc:933] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:35.666806 15293 tablet_copy_client.cc:323] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:35.679688 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet 52ca7fe34f2a4185a741b8aebabd8bfc from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:35.680299 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet 52ca7fe34f2a4185a741b8aebabd8bfc from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-52ca7fe34f2a4185a741b8aebabd8bfc
I20260709 13:17:35.691406 14388 tablet_copy_source_session.cc:215] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:35.691457 14899 raft_consensus.cc:1217] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:35.711282 15293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ca7fe34f2a4185a741b8aebabd8bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.740139 15293 tablet_copy_client.cc:806] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:35.740935 15293 tablet_copy_client.cc:670] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:35.746647 15293 tablet_copy_client.cc:538] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:35.770241 15293 tablet_bootstrap.cc:492] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:35.854195 15293 tablet_bootstrap.cc:492] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.855305 15293 tablet_bootstrap.cc:492] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:35.856114 15293 ts_tablet_manager.cc:1403] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.086s	user 0.021s	sys 0.015s
I20260709 13:17:35.904033 15282 raft_consensus.cc:1064] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:35.905437 15293 raft_consensus.cc:359] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:35.906348 15293 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:35.906844 15282 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:35.907022 15293 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:35.915306 15293 ts_tablet_manager.cc:1434] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.059s	user 0.002s	sys 0.004s
I20260709 13:17:35.917165 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-52ca7fe34f2a4185a741b8aebabd8bfc received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:35.917622 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-52ca7fe34f2a4185a741b8aebabd8bfc on tablet 52ca7fe34f2a4185a741b8aebabd8bfc with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:35.936865 14899 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:35.939522 15316 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:35.960867 14370 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:35.962874 15278 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:35.974866 14223 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:35.976552 15316 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.016316 15278 raft_consensus.cc:2955] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.024757 14223 raft_consensus.cc:2955] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.056092 14370 raft_consensus.cc:2955] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.175751 14900 raft_consensus.cc:2955] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.251133 14900 raft_consensus.cc:1217] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:17:36.254153 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 90819.6us
W20260709 13:17:36.280640 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 76092.6us
I20260709 13:17:36.308295 14126 catalog_manager.cc:5697] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.326520 15324 raft_consensus.cc:1064] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
W20260709 13:17:36.344871 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 109215us
I20260709 13:17:36.341188 15324 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:36.432020 15339 raft_consensus.cc:1064] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:36.436813 14296 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.439318 15341 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:36.450034 14222 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.452214 15325 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:36.486879 14900 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.477273 15339 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:36.504549 15295 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:36.516554 14300 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:36.533658 14223 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.535384 15338 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:36.536676 14901 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.545226 15330 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:36.555348 14222 raft_consensus.cc:2955] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.553583 15338 raft_consensus.cc:2955] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.587814 14124 catalog_manager.cc:5697] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.587119 14901 raft_consensus.cc:2955] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.606864 14112 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 475079f88bce40fea814453c8c4bfaac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:36.630193 14300 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.630733 14900 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.632021 14222 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.631814 15325 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.632763 15295 raft_consensus.cc:2955] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.635627 15342 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:36.636723 15334 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:36.637616 14300 raft_consensus.cc:2955] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.642258 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet 475079f88bce40fea814453c8c4bfaac with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47058
I20260709 13:17:36.645365 14899 raft_consensus.cc:2955] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.691972 15339 raft_consensus.cc:2955] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.694494 15356 tablet_replica.cc:333] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:17:36.702205 14222 raft_consensus.cc:2955] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.709501 15340 raft_consensus.cc:1064] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:36.712234 15340 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:36.715764 14223 raft_consensus.cc:2955] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.717474 14300 raft_consensus.cc:2955] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.725320 14901 raft_consensus.cc:2955] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.727998 15356 raft_consensus.cc:2243] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.729012 15356 raft_consensus.cc:2272] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.735136 14227 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.736220 14900 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.737694 15295 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.739943 15334 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:36.744565 15356 ts_tablet_manager.cc:1916] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:36.744889 14296 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:36.747421 14124 catalog_manager.cc:5697] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.753510 14126 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.771631 15295 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:36.796139 14370 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:36.840124 14900 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.865063 15356 ts_tablet_manager.cc:1929] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:36.865671 15356 log.cc:1199] T 475079f88bce40fea814453c8c4bfaac P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/475079f88bce40fea814453c8c4bfaac
I20260709 13:17:36.856760 15341 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:17:36.867938 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet 475079f88bce40fea814453c8c4bfaac (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:36.894013 14298 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.902729 14900 raft_consensus.cc:2955] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.917249 15340 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:36.930058 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 59733.6us
I20260709 13:17:36.931332 14301 raft_consensus.cc:2955] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.934747 14370 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:36.891820 15339 raft_consensus.cc:2955] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.941318 14899 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:17:36.944097 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51200.4us
I20260709 13:17:36.950788 15344 raft_consensus.cc:2955] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.970451 14223 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:36.971482 14225 raft_consensus.cc:2955] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.974397 14126 catalog_manager.cc:5697] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:36.944159 15324 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:17:36.991098 15342 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:37.003070 14899 raft_consensus.cc:2955] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:37.022709 15334 raft_consensus.cc:2955] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:37.027698 14900 raft_consensus.cc:2955] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:37.021723 14125 catalog_manager.cc:5697] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.038830 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b3646e03a744053ae5fd190c43a27e4 with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:37.045729 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fde6831a789b45549658b2c2146dd650 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:37.043464 14296 raft_consensus.cc:2955] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:37.068077 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b3646e03a744053ae5fd190c43a27e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:37.068221 15365 tablet_replica.cc:333] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:17:37.073135 15365 raft_consensus.cc:2243] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.086493 15365 raft_consensus.cc:2272] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:37.076541 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 49350us
I20260709 13:17:37.084393 14124 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:37.095924 15365 ts_tablet_manager.cc:1916] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:37.102923 14370 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:37.128831 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet fde6831a789b45549658b2c2146dd650 with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54352
I20260709 13:17:37.135004 14900 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:37.139885 15339 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:37.156241 15339 raft_consensus.cc:2955] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:37.158005 14900 raft_consensus.cc:2955] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:37.168056 14225 raft_consensus.cc:2955] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:37.178781 14223 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:37.188906 14124 catalog_manager.cc:5697] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:37.189580 15342 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:37.200656 14223 raft_consensus.cc:2955] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:37.234905 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet 52ca7fe34f2a4185a741b8aebabd8bfc with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54352
I20260709 13:17:37.242036 15366 tablet_replica.cc:333] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:17:37.246371 15366 raft_consensus.cc:2243] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.258396 15366 raft_consensus.cc:2272] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.259016 15365 ts_tablet_manager.cc:1929] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:37.259964 15365 log.cc:1199] T 6b3646e03a744053ae5fd190c43a27e4 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/6b3646e03a744053ae5fd190c43a27e4
I20260709 13:17:37.260520 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52ca7fe34f2a4185a741b8aebabd8bfc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:37.264729 15366 ts_tablet_manager.cc:1916] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:37.268532 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet 6b3646e03a744053ae5fd190c43a27e4 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:37.300091 15366 ts_tablet_manager.cc:1929] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:37.300684 15366 log.cc:1199] T fde6831a789b45549658b2c2146dd650 P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/fde6831a789b45549658b2c2146dd650
I20260709 13:17:37.306037 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet fde6831a789b45549658b2c2146dd650 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:37.307138 15366 tablet_replica.cc:333] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:17:37.308352 15366 raft_consensus.cc:2243] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.309208 15366 raft_consensus.cc:2272] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.312932 15366 ts_tablet_manager.cc:1916] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:37.339018 15366 ts_tablet_manager.cc:1929] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:37.339533 15366 log.cc:1199] T 52ca7fe34f2a4185a741b8aebabd8bfc P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/52ca7fe34f2a4185a741b8aebabd8bfc
I20260709 13:17:37.341429 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet 52ca7fe34f2a4185a741b8aebabd8bfc (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:38.211136 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:38.462430 14223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:38.518215 14223 raft_consensus.cc:606] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:38.559108 15371 raft_consensus.cc:993] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:38.559715 15364 raft_consensus.cc:1081] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:38.577625 14373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:17:38.578298 14373 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.578656 14373 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.590508 14373 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:38.603511 14371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:38.604235 14371 raft_consensus.cc:606] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:38.605309 14373 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:38.608953 14225 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:38.610939 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:38.611644 14223 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:38.611958 14223 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:38.612403 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:38.613004 14300 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.612653 14223 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:38.614588 14223 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.621084 14223 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:38.622980 14373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:38.623574 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:38.623919 14373 raft_consensus.cc:606] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:38.624480 15334 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.624950 15334 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:38.625816 15334 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:38.621431 14300 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:38.639606 14373 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:38.645025 14192 consensus_peers.cc:597] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ede0d59e482a4cff952455ca90001863. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.646050 15371 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.652976 14300 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:38.662024 15361 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:38.668351 14124 catalog_manager.cc:5697] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:38.697010 15367 raft_consensus.cc:2955] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:38.707218 14300 raft_consensus.cc:2955] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:38.733491 14373 raft_consensus.cc:2955] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:38.743238 15339 raft_consensus.cc:993] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:38.743841 15339 raft_consensus.cc:1081] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:38.745054 14225 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:38.746743 14126 catalog_manager.cc:5697] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:38.748070 14296 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:17:38.748616 14296 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.748977 14296 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.758155 14296 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:38.760248 14296 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:38.764072 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:38.764818 14220 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.769754 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:38.770606 14371 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:38.770989 14371 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:38.771839 14371 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:38.773134 14371 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.804836 14220 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:38.813321 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:38.814649 15375 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.815280 15375 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:38.807240 14296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:17:38.817623 15375 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:38.818620 14296 raft_consensus.cc:606] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:38.822350 14370 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:38.823796 14192 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8fbf1e78cfb4a15820b9812967ec58c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.825578 15364 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.830312 14371 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:38.831687 14373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:38.832369 14373 raft_consensus.cc:606] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:17:38.831058 14296 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:38.834913 15364 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.840612 14376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:38.841243 14376 raft_consensus.cc:606] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:17:38.862550 14376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fde6831a789b45549658b2c2146dd650"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:38.863131 14376 raft_consensus.cc:606] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:17:38.870718 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:17:38.872375 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:38.876211 15324 raft_consensus.cc:993] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:38.876724 15324 raft_consensus.cc:1081] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:38.890853 14296 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:17:38.892656 14296 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.893397 14296 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.951875 15378 raft_consensus.cc:2955] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:38.958884 14370 raft_consensus.cc:2955] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:38.971242 14296 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:38.992372 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:38.992937 14225 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.997056 14124 catalog_manager.cc:5697] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.010926 15278 raft_consensus.cc:993] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:39.011391 15278 raft_consensus.cc:1081] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:39.014900 14370 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47074
W20260709 13:17:39.018193 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49751.4us
I20260709 13:17:39.015690 14370 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:39.022660 14370 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.028682 14124 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:39.029417 14370 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:39.032316 14370 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:39.033412 14300 raft_consensus.cc:2955] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:39.040316 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:39.040987 14223 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.038520 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:39.042152 14301 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:39.042462 14301 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:39.043179 14301 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:39.043972 14301 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.048141 14223 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:39.054369 14376 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:39.055537 14301 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:39.069380 14344 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:39.070411 15324 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:39.070896 15324 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:39.071815 15324 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:39.099676 15334 raft_consensus.cc:993] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:39.100245 15334 raft_consensus.cc:1081] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:39.102988 14901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50016
I20260709 13:17:39.103677 14901 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:39.104108 14901 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.110131 14223 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:39.113273 14124 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.121670 14901 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:39.126194 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:39.126760 14300 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.126771 15339 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:39.133324 14341 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6ebdaafff10446f814e66697ebf67ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:39.136240 14225 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:17:39.136945 14220 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:39.142858 15324 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.144465 15324 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:39.144865 15324 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:39.147054 15324 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:39.148551 15324 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.150348 14304 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:39.154551 15373 raft_consensus.cc:993] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:39.155134 15373 raft_consensus.cc:1081] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:39.161538 14897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50016
I20260709 13:17:39.151346 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:39.151759 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:39.155261 14301 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.162164 14897 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:39.162657 14897 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.164561 15375 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:39.165153 15375 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:39.165980 15375 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:39.169818 14300 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:39.175428 15339 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:39.176929 15373 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.151880 14296 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:39.182724 14901 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:39.186290 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:39.187934 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:39.190222 14376 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:39.190517 14376 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:39.173607 14897 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:39.206454 14376 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:39.226425 14376 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.234895 14225 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.245340 15395 ts_tablet_manager.cc:933] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
W20260709 13:17:39.238632 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 52458.3us
I20260709 13:17:39.243217 15398 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:39.246158 15339 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:17:39.250635 15334 raft_consensus.cc:2955] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:39.252003 14124 catalog_manager.cc:5697] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 2 to 3, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 3 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.256676 14376 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:39.270170 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:39.272060 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:39.271030 14897 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:39.282708 14370 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:39.295630 14370 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:39.296538 14370 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:39.297542 14370 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.278070 14222 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:39.302381 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58613.8us
I20260709 13:17:39.311223 14370 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:39.308105 14225 raft_consensus.cc:2955] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:39.331780 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:39.344035 14222 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:39.329931 15395 tablet_copy_client.cc:323] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:17:39.349746 14223 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:39.330564 15398 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:17:39.365181 15406 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:17:39.370025 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 44726.9us
I20260709 13:17:39.374472 15404 ts_tablet_manager.cc:933] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:39.367411 14126 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:39.381172 15404 tablet_copy_client.cc:323] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:17:39.376150 15406 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:17:39.399155 14238 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet e8fbf1e78cfb4a15820b9812967ec58c from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:17:39.406543 14238 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet e8fbf1e78cfb4a15820b9812967ec58c from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-e8fbf1e78cfb4a15820b9812967ec58c
I20260709 13:17:39.399168 14239 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet ede0d59e482a4cff952455ca90001863 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:17:39.418787 14239 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet ede0d59e482a4cff952455ca90001863 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-ede0d59e482a4cff952455ca90001863
I20260709 13:17:39.429296 14220 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.443271 15400 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:39.444624 15406 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:39.471998 14239 tablet_copy_source_session.cc:215] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:39.478153 14238 tablet_copy_source_session.cc:215] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:39.529577 14370 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.533663 14300 raft_consensus.cc:2955] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:39.540405 15395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ede0d59e482a4cff952455ca90001863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.472275 15398 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:39.568465 14301 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.491410 14371 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:17:39.595147 15404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8fbf1e78cfb4a15820b9812967ec58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.616437 15405 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:17:39.618842 15339 raft_consensus.cc:993] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:39.619438 15339 raft_consensus.cc:1081] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:39.623047 14900 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fde6831a789b45549658b2c2146dd650"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50016
I20260709 13:17:39.623649 14900 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:39.623929 14900 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.634799 14900 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:39.648550 14223 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:39.658982 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:39.659699 14376 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:39.660032 14376 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:39.660557 15417 ts_tablet_manager.cc:933] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:39.660820 14376 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:39.662461 14376 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.654016 14900 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:39.672709 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:39.673321 14229 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.658541 15370 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:17:39.699265 15417 tablet_copy_client.cc:323] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:39.702116 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet f6ebdaafff10446f814e66697ebf67ef from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:39.702968 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet f6ebdaafff10446f814e66697ebf67ef from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-f6ebdaafff10446f814e66697ebf67ef
W20260709 13:17:39.733990 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 135161us
I20260709 13:17:39.738049 14370 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:39.754945 14376 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:39.757040 14229 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:39.771427 14388 tablet_copy_source_session.cc:215] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:39.767093 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:39.773186 15398 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:17:39.773481 15418 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:17:39.773746 15398 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:17:39.774688 15398 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:39.797319 15417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ebdaafff10446f814e66697ebf67ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.829563 14127 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.879146 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:39.910615 14371 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:17:39.935720 14341 consensus_peers.cc:597] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb8ce7d4df824e4e9d0842d3d4d65698. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:39.954564 15395 tablet_copy_client.cc:806] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:39.955201 15395 tablet_copy_client.cc:670] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:39.955405 14374 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:17:39.961699 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50541.4us
I20260709 13:17:39.981644 14225 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:40.003759 15404 tablet_copy_client.cc:806] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:40.004550 15404 tablet_copy_client.cc:670] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:39.980861 15338 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:17:39.993418 15398 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:17:40.032225 14297 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:40.053670 15395 tablet_copy_client.cc:538] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:40.059492 15324 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:17:40.067203 15417 tablet_copy_client.cc:806] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:40.071214 14229 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:40.071907 15417 tablet_copy_client.cc:670] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:40.074440 15406 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:40.082150 15404 tablet_copy_client.cc:538] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:40.086012 14370 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:40.096943 15398 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:40.097631 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 410406us
I20260709 13:17:40.102492 14297 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:40.107041 14124 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.111280 15417 tablet_copy_client.cc:538] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:40.112798 15398 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:40.108918 14124 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:40.127928 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 152332us
I20260709 13:17:40.147202 15404 tablet_bootstrap.cc:492] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:40.145656 15395 tablet_bootstrap.cc:492] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:40.117400 15324 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 13:17:40.217046 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 204082us
I20260709 13:17:40.217886 14225 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:40.220512 15375 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:40.287191 15438 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:17:40.288514 15440 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.075s	user 0.003s	sys 0.000s
I20260709 13:17:40.301800 14222 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:40.307499 15436 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:17:40.311532 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62441.1us
I20260709 13:17:40.320343 15417 tablet_bootstrap.cc:492] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:40.327737 15405 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:40.425777 15394 raft_consensus.cc:2955] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:40.435619 14296 raft_consensus.cc:2955] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:40.552356 14377 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:17:40.627815 15451 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:40.712273 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:40.847949 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 53722.9us
I20260709 13:17:40.857496 15456 ts_tablet_manager.cc:933] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:17:40.866104 15454 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.143s	user 0.001s	sys 0.001s
I20260709 13:17:40.872181 15463 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:17:40.881531 15417 tablet_bootstrap.cc:492] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:17:40.883520 15458 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.172s	user 0.004s	sys 0.000s
I20260709 13:17:40.892656 15395 tablet_bootstrap.cc:492] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:40.897640 15417 tablet_bootstrap.cc:492] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:40.906622 15417 ts_tablet_manager.cc:1403] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.587s	user 0.025s	sys 0.019s
I20260709 13:17:40.907313 15395 tablet_bootstrap.cc:492] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:40.913141 15395 ts_tablet_manager.cc:1403] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.767s	user 0.024s	sys 0.044s
W20260709 13:17:40.929344 15452 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.350s	user 0.000s	sys 0.002s
I20260709 13:17:40.944092 14127 catalog_manager.cc:5697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.995867 15404 tablet_bootstrap.cc:492] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:41.047816 15456 tablet_copy_client.cc:323] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:41.037154 15404 tablet_bootstrap.cc:492] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:41.090835 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet eb8ce7d4df824e4e9d0842d3d4d65698 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:41.157095 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet eb8ce7d4df824e4e9d0842d3d4d65698 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-eb8ce7d4df824e4e9d0842d3d4d65698
I20260709 13:17:41.131292 15404 ts_tablet_manager.cc:1403] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.984s	user 0.020s	sys 0.056s
I20260709 13:17:41.238901 14369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:41.239728 14369 raft_consensus.cc:606] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:41.245550 14369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:41.246459 14369 raft_consensus.cc:606] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:17:41.262923 14222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:41.263689 14222 raft_consensus.cc:606] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:41.266980 14222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:41.267683 14222 raft_consensus.cc:606] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
W20260709 13:17:41.419890 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 258964us
I20260709 13:17:41.471127 15395 raft_consensus.cc:359] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:41.493693 15395 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:41.494086 14296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:17:41.494836 14296 raft_consensus.cc:606] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:41.494632 15395 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:41.497735 15395 ts_tablet_manager.cc:1434] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.575s	user 0.007s	sys 0.019s
I20260709 13:17:41.481109 15417 raft_consensus.cc:359] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:41.155249 14221 raft_consensus.cc:2955] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:41.489099 15405 raft_consensus.cc:993] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:41.570127 15405 raft_consensus.cc:1081] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:41.499478 14372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e674623b78de49129be2dde67c041ef9"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:41.571182 14372 raft_consensus.cc:606] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:17:41.517755 15437 raft_consensus.cc:993] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:41.572265 15437 raft_consensus.cc:1081] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:41.524832 14388 tablet_copy_source_session.cc:215] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:41.477738 15404 raft_consensus.cc:359] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:41.573292 15404 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:41.574062 15404 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:41.576728 15404 ts_tablet_manager.cc:1434] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.416s	user 0.017s	sys 0.000s
I20260709 13:17:41.563918 15380 raft_consensus.cc:993] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:41.578161 15380 raft_consensus.cc:1081] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:41.579861 15417 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:41.580783 15417 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:41.582753 14238 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-e8fbf1e78cfb4a15820b9812967ec58c received from {username='slave'} at 127.0.0.1:57812
I20260709 13:17:41.583295 14238 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-e8fbf1e78cfb4a15820b9812967ec58c on tablet e8fbf1e78cfb4a15820b9812967ec58c with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:41.601753 15456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb8ce7d4df824e4e9d0842d3d4d65698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:41.610894 14897 raft_consensus.cc:1217] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:41.584769 15417 ts_tablet_manager.cc:1434] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.674s	user 0.007s	sys 0.010s
W20260709 13:17:41.617857 15417 ts_tablet_manager.cc:1467] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Tablet startup took 710ms
W20260709 13:17:41.618245 15417 ts_tablet_manager.cc:1469] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Trace:
0709 13:17:39.567017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.567195 (+   178us) service_pool.cc:224] Handling call
0709 13:17:39.660847 (+ 93652us) ts_tablet_manager.cc:934] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
0709 13:17:39.795601 (+134754us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:39.991861 (+196260us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:40.006758 (+ 14897us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:40.066390 (+ 59632us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:40.066680 (+   290us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:40.066969 (+   289us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:40.067028 (+    59us) inbound_call.cc:177] Queueing success response
0709 13:17:40.319867 (+252839us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:17:40.911073 (+591206us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:17:41.263485 (+352412us) tablet_replica.cc:261] Starting instrumentation
0709 13:17:41.264110 (+   625us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":418,"mutex_wait_us":48660,"raft.queue_time_us":340,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":76,"tablet-copy.queue_time_us":92634,"tablet-download-pool.queue_time_us":113,"tablet-download-pool.run_cpu_time_us":1273,"tablet-download-pool.run_wall_time_us":19577,"thread_start_us":100034,"threads_started":2}
I20260709 13:17:41.623163 14374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47074
I20260709 13:17:41.623864 14374 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.624282 14374 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:41.628443 15395 ts_tablet_manager.cc:1467] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Tablet startup took 705ms
I20260709 13:17:41.635878 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:41.636992 14296 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:17:41.637593 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:41.637678 14296 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.638373 14296 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:41.633478 15395 ts_tablet_manager.cc:1469] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Trace:
0709 13:17:39.119703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.119834 (+   131us) service_pool.cc:224] Handling call
0709 13:17:39.245744 (+125910us) ts_tablet_manager.cc:934] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
0709 13:17:39.509175 (+263431us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:39.795511 (+286336us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:39.795660 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:39.901760 (+106100us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:39.939686 (+ 37926us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:39.954116 (+ 14430us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:39.954174 (+    58us) inbound_call.cc:177] Queueing success response
0709 13:17:40.145180 (+191006us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:17:40.922543 (+777363us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:17:40.959279 (+ 36736us) tablet_replica.cc:261] Starting instrumentation
0709 13:17:40.960179 (+   900us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":26918,"mutex_wait_us":175,"raft.queue_time_us":124,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"tablet-copy.queue_time_us":111553,"tablet-download-pool.queue_time_us":121,"tablet-download-pool.run_cpu_time_us":1820,"tablet-download-pool.run_wall_time_us":97308,"thread_start_us":125215,"threads_started":2}
I20260709 13:17:41.654953 14238 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-ede0d59e482a4cff952455ca90001863 received from {username='slave'} at 127.0.0.1:57812
I20260709 13:17:41.655505 14238 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-ede0d59e482a4cff952455ca90001863 on tablet ede0d59e482a4cff952455ca90001863 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:41.647042 14374 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:41.676465 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:41.676905 14897 raft_consensus.cc:1217] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:41.677073 14301 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.677702 14301 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:41.682164 15448 raft_consensus.cc:993] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:41.682737 15448 raft_consensus.cc:1081] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:41.675973 14374 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:41.685364 14296 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:41.686508 14300 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.688354 14296 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:41.688026 14301 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:41.698518 14301 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.701601 14900 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e674623b78de49129be2dde67c041ef9"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50016
I20260709 13:17:41.702316 14900 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.709925 14900 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.712291 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:41.712749 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:41.713073 14224 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.713400 14373 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.713745 14373 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:41.713831 14301 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:41.714689 14373 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:41.700886 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-f6ebdaafff10446f814e66697ebf67ef received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:41.718508 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-f6ebdaafff10446f814e66697ebf67ef on tablet f6ebdaafff10446f814e66697ebf67ef with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:41.718993 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:41.719596 14226 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.724732 15324 raft_consensus.cc:993] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:41.724876 15456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50016 (request call id 268) took 1222 ms. Trace:
I20260709 13:17:41.725287 15324 raft_consensus.cc:1081] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:41.725383 15456 rpcz_store.cc:276] 0709 13:17:40.502970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.503159 (+   189us) service_pool.cc:224] Handling call
0709 13:17:40.857919 (+354760us) ts_tablet_manager.cc:934] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
0709 13:17:41.600379 (+742460us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:41.613257 (+ 12878us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:41.613381 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:41.724110 (+110729us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:41.724381 (+   271us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:41.724746 (+   365us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:41.724801 (+    55us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":137571,"tablet-copy.queue_time_us":306312,"thread_start_us":253204,"threads_started":2}
I20260709 13:17:41.725749 14900 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:41.717269 14342 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:41.732832 14226 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:17:41.734182 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:41.738233 14900 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:41.727972 14373 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.731479 15456 tablet_copy_client.cc:806] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:41.741772 14372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:17:41.742724 14372 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.743206 14372 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.743229 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:41.748911 14900 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50016
I20260709 13:17:41.743183 15380 raft_consensus.cc:993] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:41.750090 14900 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.737675 15401 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.760555 14900 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.756002 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:41.761468 14376 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.761763 14376 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:41.762590 14376 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:41.763700 14376 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.760142 14226 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.739627 15399 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.765337 15367 raft_consensus.cc:1081] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:41.771486 14900 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:41.771796 15399 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:41.753283 15456 tablet_copy_client.cc:670] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:41.783519 15399 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:41.787858 14900 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:41.787703 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:41.812475 14301 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.820927 14900 raft_consensus.cc:1217] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:41.827648 15456 tablet_copy_client.cc:538] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:41.839838 14301 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:41.798765 14377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:17:41.850757 14377 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.851171 14377 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.806411 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:41.852406 14371 raft_consensus.cc:3055] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.852705 14371 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:41.853406 14371 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:41.854667 14371 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.790759 14372 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:41.847398 14373 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:17:41.805961 14224 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:41.848709 14376 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:41.858673 14226 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:41.869978 14372 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:41.870885 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:41.862226 15401 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:41.880080 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:41.880923 14301 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.887322 14371 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:41.887821 15462 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.888378 15462 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:17:41.894865 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:41.895630 14220 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.895992 14220 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:41.896749 14220 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:41.906913 15401 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:41.907609 14301 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:41.873406 14865 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:41.910872 15463 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.889243 15462 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:41.914814 14342 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:41.915841 14377 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:41.921713 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52494.2us
I20260709 13:17:41.922119 14377 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:41.922605 15324 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.923177 15324 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:41.924129 15324 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:41.940026 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:41.940682 14223 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.941012 14223 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:41.941726 14223 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:41.942934 14223 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.951686 14126 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.953305 15456 tablet_bootstrap.cc:492] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:41.905476 14220 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.963320 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:41.964203 14296 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.973711 15463 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:17:41.975878 15463 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:41.989053 14296 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:41.990094 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:41.990967 15334 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.991453 15334 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:41.992439 15334 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:41.995177 14223 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:42.010079 14124 catalog_manager.cc:5697] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 2 to 3, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 3 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.043797 14125 catalog_manager.cc:5697] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.092753 15411 raft_consensus.cc:1064] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:42.096450 15411 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:42.116847 14220 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:42.163942 14369 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:42.173012 14300 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.174853 15324 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:42.177330 14900 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.197358 14220 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.182417 15324 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:17:42.222203 15411 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:17:42.229290 14296 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:42.230952 15476 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:42.245173 15415 raft_consensus.cc:1064] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:42.248371 15415 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:42.275270 15324 raft_consensus.cc:2955] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:42.285313 14901 raft_consensus.cc:2955] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:42.298856 14220 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:42.303452 15411 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:42.309823 15361 raft_consensus.cc:1064] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:42.328665 14229 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:42.330588 15361 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:42.333021 14229 raft_consensus.cc:2955] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:42.335405 14377 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.335624 15489 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:42.345906 14900 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.345944 14296 raft_consensus.cc:2955] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:42.371347 15430 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:42.374473 14304 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.373489 15430 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:17:42.387636 15367 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:42.393719 14126 catalog_manager.cc:5697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.402822 14223 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:42.404981 15437 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.351044 15456 tablet_bootstrap.cc:492] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:42.406916 14126 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:42.409447 15456 tablet_bootstrap.cc:492] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:42.442811 15456 ts_tablet_manager.cc:1403] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.537s	user 0.028s	sys 0.013s
I20260709 13:17:42.446682 15456 raft_consensus.cc:359] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:42.449772 15456 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:42.450601 15456 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:42.458366 15456 ts_tablet_manager.cc:1434] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:17:42.461567 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-eb8ce7d4df824e4e9d0842d3d4d65698 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:42.462182 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-eb8ce7d4df824e4e9d0842d3d4d65698 on tablet eb8ce7d4df824e4e9d0842d3d4d65698 with peer cebb34ac155340899a38c728707ddc0d
W20260709 13:17:42.477386 15510 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:17:42.481055 14369 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:42.482656 14371 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:42.493129 15489 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:42.502641 14127 catalog_manager.cc:5697] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.504626 14127 catalog_manager.cc:5697] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:42.523422 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 63161.8us
W20260709 13:17:42.583065 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 122132us
I20260709 13:17:42.493175 15463 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
W20260709 13:17:42.591082 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51761.1us
I20260709 13:17:42.638840 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:42.709692 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 117603us
I20260709 13:17:42.716187 14296 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:42.736066 14900 raft_consensus.cc:1217] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:17:42.746805 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 160594us
I20260709 13:17:42.751571 15528 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:42.758611 14300 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:42.783866 14221 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:42.787134 14224 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:42.796934 15527 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:42.805635 15324 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:42.811698 15324 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:42.817497 14377 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.818476 14900 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.824286 14372 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:42.836073 14300 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:42.869823 15521 raft_consensus.cc:2955] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:42.883705 15361 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.886945 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:42.887614 14300 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:42.889575 14301 raft_consensus.cc:2955] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:42.891109 15463 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:42.945668 14369 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:42.957871 14900 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:42.958375 15430 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.959826 15528 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:42.970525 15527 raft_consensus.cc:2955] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:42.978117 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 103152us
I20260709 13:17:42.979182 15522 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.976312 14372 raft_consensus.cc:2955] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:42.982944 14900 raft_consensus.cc:2955] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:42.989517 15524 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:17:43.021552 14897 raft_consensus.cc:2955] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.037240 14127 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.066660 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6ebdaafff10446f814e66697ebf67ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:17:43.071082 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 58089.1us
I20260709 13:17:43.074502 14126 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:43.098722 14111 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet f6ebdaafff10446f814e66697ebf67ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:17:43.140678 14222 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:43.142125 15430 raft_consensus.cc:2955] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.144194 14377 raft_consensus.cc:2955] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.157011 14229 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:43.166453 14900 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:43.168834 15415 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:43.173535 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet f6ebdaafff10446f814e66697ebf67ef with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54352
W20260709 13:17:43.183730 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 71503.7us
I20260709 13:17:43.183770 14369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f44936b303148f4848621766631d925"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:43.184629 14369 raft_consensus.cc:606] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:17:43.189548 15334 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:43.189551 14300 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:43.189393 15361 raft_consensus.cc:2955] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.193025 15547 tablet_replica.cc:333] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:17:43.194115 15547 raft_consensus.cc:2243] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.194628 14897 raft_consensus.cc:2955] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.202266 14224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:43.203137 14224 raft_consensus.cc:606] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:43.207000 14369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:43.210541 14369 raft_consensus.cc:606] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:17:43.212188 15547 raft_consensus.cc:2272] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.214267 14229 raft_consensus.cc:2955] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.220512 15371 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:43.223521 14222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:43.224140 14222 raft_consensus.cc:606] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:43.226883 15526 raft_consensus.cc:1064] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:43.229480 15526 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:43.234133 14901 raft_consensus.cc:2955] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.246177 14300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:17:43.246982 14127 catalog_manager.cc:5697] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.246855 14300 raft_consensus.cc:606] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:43.253482 14222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:43.260097 14301 raft_consensus.cc:2955] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.271952 14296 raft_consensus.cc:2955] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.278690 15547 ts_tablet_manager.cc:1916] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:43.295920 15527 raft_consensus.cc:993] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:43.296473 15324 raft_consensus.cc:1081] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:43.298671 14900 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f44936b303148f4848621766631d925"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50016
I20260709 13:17:43.299312 14900 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.299723 14900 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.313063 14900 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:43.316494 15545 raft_consensus.cc:993] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:43.328122 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:43.328753 14229 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.328933 15521 raft_consensus.cc:1081] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:43.331708 14900 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:43.329559 14127 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.340655 14229 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:43.342911 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:43.345021 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:43.345674 14372 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.345992 14372 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:43.352999 15324 raft_consensus.cc:993] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:43.348842 14372 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:43.360953 15476 raft_consensus.cc:1081] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:43.345054 15519 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.366024 14897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50016
I20260709 13:17:43.366640 14897 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.367012 14897 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.368583 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet e8fbf1e78cfb4a15820b9812967ec58c with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47058
I20260709 13:17:43.372354 14372 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.375471 14897 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:43.377982 15371 raft_consensus.cc:993] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:43.378577 15371 raft_consensus.cc:1081] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:43.378026 15547 ts_tablet_manager.cc:1929] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:43.382164 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:43.390646 14229 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.387818 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:43.393472 14371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:17:43.395233 14371 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.395750 14371 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:43.398115 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 67953.5us
I20260709 13:17:43.400029 14301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54360
I20260709 13:17:43.400383 14229 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:43.400861 14301 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.401407 14301 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.401598 14372 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:43.414827 14225 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:43.398978 15547 log.cc:1199] T f6ebdaafff10446f814e66697ebf67ef P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/f6ebdaafff10446f814e66697ebf67ef
I20260709 13:17:43.431145 15550 tablet_replica.cc:333] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:17:43.432602 15550 raft_consensus.cc:2243] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.393285 14897 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:43.437497 14867 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:43.439389 15463 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:43.433620 15550 raft_consensus.cc:2272] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.439934 15463 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:17:43.440019 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet f6ebdaafff10446f814e66697ebf67ef (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:43.441318 14296 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:43.443967 14371 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:43.446471 15324 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:43.448487 14225 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:43.449569 14301 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:43.420836 14369 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.457551 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:43.458235 14225 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.458602 14225 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:43.451711 15476 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:17:43.462971 15334 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:43.459415 14225 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:43.466492 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:43.467150 14229 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:43.467535 14229 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:43.468470 14371 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:43.470384 14301 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:43.470919 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:43.471709 14298 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.456481 15519 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:17:43.474864 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:17:43.474695 15519 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:43.475483 14897 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:43.475504 14900 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.478447 14229 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:43.479871 14229 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.487512 14229 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:17:43.489171 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:43.457160 14369 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:43.493681 14298 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:17:43.495411 15550 ts_tablet_manager.cc:1916] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:43.491907 15527 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:17:43.497534 15448 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:43.501330 14225 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.508327 14900 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:43.523836 14369 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:43.526924 14900 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:43.526952 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:43.525465 14369 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.543350 15448 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:43.567605 14225 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:43.548300 15517 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:17:43.614259 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45212.4us
W20260709 13:17:43.547735 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 64644.4us
I20260709 13:17:43.493217 15463 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:43.629179 15448 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:43.654785 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 115866us
W20260709 13:17:43.687495 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 141038us
I20260709 13:17:43.708950 14126 catalog_manager.cc:5697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.710094 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8fbf1e78cfb4a15820b9812967ec58c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:43.711561 15517 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:43.723781 14222 raft_consensus.cc:606] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:43.747916 14222 raft_consensus.cc:630] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Rejecting request to transfer leadership because tablet server 181bbac22422408c87cd13b7fe3008f9 is not a voter in the active config
I20260709 13:17:43.752667 15550 ts_tablet_manager.cc:1929] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:43.757058 15550 log.cc:1199] T e8fbf1e78cfb4a15820b9812967ec58c P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/e8fbf1e78cfb4a15820b9812967ec58c
I20260709 13:17:43.743094 15517 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:43.771530 15560 raft_consensus.cc:993] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:43.772354 15560 raft_consensus.cc:1081] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:43.782687 15558 raft_consensus.cc:2955] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.793727 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet e8fbf1e78cfb4a15820b9812967ec58c (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
W20260709 13:17:43.800402 15383 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:17:43.803365 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 76545.5us
I20260709 13:17:43.812922 14297 raft_consensus.cc:2955] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.797678 14369 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
W20260709 13:17:43.816282 15324 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:17:43.852262 14222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53830
I20260709 13:17:43.852955 14222 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:43.853350 14222 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.855950 14900 raft_consensus.cc:2955] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:43.870187 14126 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:43.892198 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 259988us
I20260709 13:17:43.893671 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:43.895582 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:17:43.906947 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 183217us
I20260709 13:17:44.024564 14377 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:44.041455 15519 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:17:44.042254 15565 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:44.049373 14124 catalog_manager.cc:5697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 2 to 3, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.057206 14124 catalog_manager.cc:5697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:44.064766 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 340247us
I20260709 13:17:44.071049 14222 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:44.073134 14222 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:44.109700 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:44.110411 14371 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.111931 14222 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:17:44.114575 15577 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:17:44.123324 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:44.123974 14297 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:44.124315 14297 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:44.125164 14297 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:44.127651 14297 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.135481 14297 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:44.142850 14193 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:44.135869 14222 raft_consensus.cc:2955] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:44.144466 15545 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:44.144367 15552 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:44.145133 15545 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:44.146087 15545 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:44.153851 14377 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:44.155978 14224 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:44.141611 14371 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:44.163158 14297 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:44.163668 14127 catalog_manager.cc:5697] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.165000 15448 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:44.173979 14301 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:44.181095 15549 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:44.186705 15448 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:44.229208 14897 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:44.231065 15566 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:44.246511 14227 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:44.258277 14900 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:44.294814 14223 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:44.296144 15411 raft_consensus.cc:2955] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:44.298393 14297 raft_consensus.cc:2955] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:44.305892 15448 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:44.321590 14223 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:44.345492 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eb8ce7d4df824e4e9d0842d3d4d65698 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:44.384603 15437 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:44.408939 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 76621us
I20260709 13:17:44.436197 14377 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:44.442737 14297 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:44.444660 14897 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:44.447230 15430 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:44.454068 14111 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet eb8ce7d4df824e4e9d0842d3d4d65698 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:17:44.461485 14127 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.463382 15563 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:44.513633 15463 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:44.495239 15526 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:17:44.557830 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 65878.3us
I20260709 13:17:44.590667 14897 raft_consensus.cc:2955] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:44.636237 14124 catalog_manager.cc:5697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.650849 14297 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.771894 15371 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:44.782423 14369 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.795281 14297 raft_consensus.cc:2955] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:44.796849 14900 raft_consensus.cc:2955] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:44.808355 15539 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:44.776861 15522 raft_consensus.cc:2955] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:44.860970 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 56049.8us
I20260709 13:17:44.903555 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:44.920089 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet eb8ce7d4df824e4e9d0842d3d4d65698 with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:44.980791 14125 catalog_manager.cc:5697] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:45.224944 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet ede0d59e482a4cff952455ca90001863 with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47058
I20260709 13:17:45.230159 15522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53822 (request call id 72) took 1034 ms. Trace:
I20260709 13:17:45.231496 15610 tablet_replica.cc:333] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:17:45.230743 15522 rpcz_store.cc:276] 0709 13:17:44.195499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.236458 (+ 40959us) service_pool.cc:224] Handling call
0709 13:17:44.336360 (+ 99902us) log.cc:844] Serialized 508 byte log entry
0709 13:17:44.561915 (+225555us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b5400336920. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded001dbe 00007f8ded00c930 00007f8ded00c8d8 00007f8ded00c858 00007f8ded00c813 00007f8ded00ba9c 00007f8df2ef7626 00007f8df2ef1dd8 00007f8ded0487cb 00007f8ded04b2c0
0709 13:17:45.229997 (+668082us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10109,"raft.queue_time_us":10355,"raft.run_cpu_time_us":1332,"raft.run_wall_time_us":1330,"spinlock_wait_cycles":77648128,"thread_start_us":93127,"threads_started":1,"wal-append.queue_time_us":88498}
I20260709 13:17:45.233232 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ede0d59e482a4cff952455ca90001863 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:17:45.235527 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 203243us
I20260709 13:17:45.243242 15607 tablet_replica.cc:333] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
W20260709 13:17:45.248837 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 204969us
W20260709 13:17:45.250775 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 218212us
I20260709 13:17:45.322438 15607 raft_consensus.cc:2243] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.334715 15607 raft_consensus.cc:2272] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.338356 15607 ts_tablet_manager.cc:1916] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:45.344702 15610 raft_consensus.cc:2243] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.351352 15610 raft_consensus.cc:2272] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.359452 15610 ts_tablet_manager.cc:1916] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:45.412423 15607 ts_tablet_manager.cc:1929] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:45.413173 15607 log.cc:1199] T eb8ce7d4df824e4e9d0842d3d4d65698 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/eb8ce7d4df824e4e9d0842d3d4d65698
I20260709 13:17:45.415261 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet eb8ce7d4df824e4e9d0842d3d4d65698 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:45.434624 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:45.459563 15610 ts_tablet_manager.cc:1929] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:45.468302 15610 log.cc:1199] T ede0d59e482a4cff952455ca90001863 P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/ede0d59e482a4cff952455ca90001863
I20260709 13:17:45.470988 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet ede0d59e482a4cff952455ca90001863 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:45.551764 14295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:17:45.552732 14295 raft_consensus.cc:606] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:45.558148 14369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:45.558764 14369 raft_consensus.cc:606] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:45.562402 14224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:45.563072 14224 raft_consensus.cc:606] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:45.566109 14224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:45.566713 14224 raft_consensus.cc:606] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:45.569326 14369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:45.570025 14369 raft_consensus.cc:606] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:17:45.572703 14224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ede0d59e482a4cff952455ca90001863"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:45.573378 14224 raft_consensus.cc:606] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:17:45.574747 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:45.576601 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:45.668558 15334 raft_consensus.cc:993] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:45.669085 15334 raft_consensus.cc:1081] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:45.674238 14302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:17:45.674803 14302 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.675096 14302 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.679986 14302 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:45.682982 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:45.683483 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:45.683837 14224 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.684059 14374 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.684343 14374 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:45.685175 14374 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:45.687049 14374 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.696979 15371 raft_consensus.cc:993] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:45.697592 15371 raft_consensus.cc:1081] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:45.701197 14371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:17:45.701745 14371 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.702102 14371 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.711120 14371 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:45.713330 14371 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:45.714097 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:45.714746 14227 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.682422 14302 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:45.716706 14374 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:45.714892 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:45.715135 14227 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:45.718596 14295 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.718938 14227 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:45.720424 14227 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.727777 14224 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:45.731675 15371 raft_consensus.cc:993] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:45.727843 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:45.734930 15371 raft_consensus.cc:1081] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:45.733417 14227 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:45.735962 15612 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.730587 14295 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:45.736618 14374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:17:45.737202 14374 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.737584 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:45.738003 15612 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:45.737576 14374 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.740963 15612 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:45.738634 15598 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.743139 15598 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:45.744084 15598 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:45.750332 14374 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:45.754031 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:45.754698 14227 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.755105 14227 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:45.755192 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:45.755889 14295 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.756042 14227 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:45.757206 14227 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.767815 14374 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:45.770512 14295 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:45.772086 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:45.773279 15334 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.773772 15334 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:45.777046 15334 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:45.813467 15557 raft_consensus.cc:993] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:45.813995 15557 raft_consensus.cc:1081] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:45.902765 14899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50016
I20260709 13:17:45.903543 14899 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.903970 14899 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.010782 15521 raft_consensus.cc:993] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:46.011484 15521 raft_consensus.cc:1081] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:46.013265 14900 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ede0d59e482a4cff952455ca90001863"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50026
I20260709 13:17:46.013873 14900 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.014287 14900 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.050266 14227 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
W20260709 13:17:46.059751 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49940.9us
I20260709 13:17:46.084242 14900 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:46.086872 14900 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:46.100803 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:46.101409 14223 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.101687 14223 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:46.102389 14223 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:46.103605 14223 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.103507 14899 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:46.105978 14899 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:46.106616 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:46.107200 14376 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.107472 14376 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:46.108157 14376 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:46.110670 14376 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.099166 14126 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.113569 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:46.115921 14302 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.122043 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:46.123797 14297 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.129617 14376 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:46.132827 14223 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:46.134614 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:46.136562 15615 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.137090 15615 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:17:46.137972 15615 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:46.138274 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:46.143401 15554 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.143958 15554 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:17:46.144934 15554 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:46.147528 14297 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:46.155215 14302 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:46.190950 15601 raft_consensus.cc:993] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:46.204334 14125 catalog_manager.cc:5697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.215716 14124 catalog_manager.cc:5697] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.216105 15601 raft_consensus.cc:1081] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:46.232843 14302 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:17:46.264519 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49615.9us
I20260709 13:17:46.266530 14227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53830
I20260709 13:17:46.267202 14227 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.267596 14227 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.272759 14220 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.276443 14227 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:46.288645 14227 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:46.289343 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:46.289944 14299 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:46.290252 14299 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:46.279428 15598 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:46.291002 14299 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:46.292354 14299 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.293493 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:46.294199 14369 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.296283 15617 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:46.300226 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 81430.4us
I20260709 13:17:46.307756 14227 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.309202 15557 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.311605 14227 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.315732 15625 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:17:46.325526 14299 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:17:46.331250 14193 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:46.341984 14374 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.344179 15521 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.344801 15521 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:46.345760 15521 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:46.353873 15612 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:17:46.378366 14302 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.380406 15598 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.425985 14127 catalog_manager.cc:5697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:17:46.481921 14369 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:17:46.506354 14125 catalog_manager.cc:5697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.578890 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:46.628533 14295 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:17:46.638643 14267 consensus_peers.cc:597] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80f2fbd6ece74e2fa8bbfcc96a1f45b5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:46.643613 14369 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:46.659235 15601 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:46.660403 14302 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:46.663956 15615 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:46.672999 14223 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:46.675755 15554 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:46.676227 15401 raft_consensus.cc:2955] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:46.685443 14223 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:46.689000 14371 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:46.691040 15554 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:46.696991 14369 raft_consensus.cc:2955] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
W20260709 13:17:46.711295 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61741.8us
I20260709 13:17:46.720208 14299 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:46.740455 14126 catalog_manager.cc:5697] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 3, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:46.759688 14267 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2582e91d201c4063b3eff5158b611448. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:46.774559 14369 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:46.775277 14299 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:46.777822 15401 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:46.808357 15401 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:17:46.843638 14223 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:46.808601 15615 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:17:46.897081 14302 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:46.950165 14374 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:17:46.954413 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 114293us
I20260709 13:17:46.956231 15361 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 13:17:46.960619 15626 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:17:46.986805 15371 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:47.012395 15624 raft_consensus.cc:2955] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.026871 14374 raft_consensus.cc:2955] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.042095 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:47.049489 14223 raft_consensus.cc:2955] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.049408 14125 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.059933 15658 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:47.135524 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 85859.4us
I20260709 13:17:47.208053 14229 raft_consensus.cc:2955] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.226992 14295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:40120
W20260709 13:17:47.231662 15664 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:17:47.232378 15672 ts_tablet_manager.cc:933] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:47.227867 14295 raft_consensus.cc:606] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:47.289678 15672 tablet_copy_client.cc:323] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.130:44127
I20260709 13:17:47.309274 14297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:17:47.310042 14297 raft_consensus.cc:606] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:47.295377 14124 catalog_manager.cc:5697] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.314848 14374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:47.316593 14374 raft_consensus.cc:606] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:47.321380 14220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:47.322213 14220 raft_consensus.cc:606] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:47.324035 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 13:17:47.332729 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86083.2us
I20260709 13:17:47.341962 14369 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:47.343582 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:47.350219 14314 tablet_copy_service.cc:140] P bee4f7fc1b4740dc875537c79309664f: Received BeginTabletCopySession request for tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:45306)
I20260709 13:17:47.350917 14314 tablet_copy_service.cc:161] P bee4f7fc1b4740dc875537c79309664f: Beginning new tablet copy session on tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:45306: session id = cebb34ac155340899a38c728707ddc0d-80f2fbd6ece74e2fa8bbfcc96a1f45b5
I20260709 13:17:47.363483 15673 ts_tablet_manager.cc:933] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:47.365715 14314 tablet_copy_source_session.cc:215] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:47.395531 15672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:47.411794 15539 raft_consensus.cc:993] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:47.412863 15539 raft_consensus.cc:1081] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:47.423712 15675 raft_consensus.cc:993] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:47.423094 15673 tablet_copy_client.cc:323] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.130:44127
I20260709 13:17:47.424726 15678 raft_consensus.cc:1081] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:47.427441 14314 tablet_copy_service.cc:140] P bee4f7fc1b4740dc875537c79309664f: Received BeginTabletCopySession request for tablet 2582e91d201c4063b3eff5158b611448 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:45306)
I20260709 13:17:47.428695 14374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47074
I20260709 13:17:47.428100 14299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54360
I20260709 13:17:47.429517 14374 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:47.429826 14299 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:47.430171 14374 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.428984 14314 tablet_copy_service.cc:161] P bee4f7fc1b4740dc875537c79309664f: Beginning new tablet copy session on tablet 2582e91d201c4063b3eff5158b611448 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:45306: session id = cebb34ac155340899a38c728707ddc0d-2582e91d201c4063b3eff5158b611448
I20260709 13:17:47.430442 14299 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.440907 14374 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:47.448702 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:47.449235 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:47.449946 14229 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.450754 14299 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:47.452558 14374 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:47.449393 14297 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:47.453943 14297 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:47.454717 14297 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:47.455170 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:47.455432 14299 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:47.455780 14227 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:47.455972 14297 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.456175 14227 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:47.457010 14227 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:47.458277 14227 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.458977 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:17:47.459524 14901 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.468182 14227 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:47.470026 14270 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:47.470996 15678 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:47.472289 15678 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:47.457037 14314 tablet_copy_source_session.cc:215] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:47.477412 14901 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:47.480732 14229 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:47.477603 14297 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:47.482530 14344 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:47.483724 15598 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:47.485142 15598 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:47.486080 15598 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:47.481626 15678 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:47.492741 15673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2582e91d201c4063b3eff5158b611448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:47.524889 15673 tablet_copy_client.cc:806] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:47.525615 15673 tablet_copy_client.cc:670] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:47.510160 15672 tablet_copy_client.cc:806] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
W20260709 13:17:47.535833 14341 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f235d077faa24a89832f2f8f181b0ef1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:47.536373 15672 tablet_copy_client.cc:670] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:47.536737 14297 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:47.539350 15598 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.539456 14125 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.544296 14229 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:47.546059 15557 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.551538 15673 tablet_copy_client.cc:538] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:47.553395 15672 tablet_copy_client.cc:538] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:47.563848 14124 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.573729 15678 raft_consensus.cc:993] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:47.574281 15676 raft_consensus.cc:1081] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:47.575963 14227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53830
I20260709 13:17:47.576565 14227 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:47.576936 14227 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.578032 15672 tablet_bootstrap.cc:492] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:47.584695 15557 raft_consensus.cc:2955] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.591847 14227 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:47.595033 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:47.595669 14295 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:47.595999 14295 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:47.595259 14229 raft_consensus.cc:2955] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.597194 14295 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:47.598826 14295 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.615043 15673 tablet_bootstrap.cc:492] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:47.616909 14124 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.618369 14295 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:47.628100 14193 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:47.629374 15661 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:47.629912 15661 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:47.630825 15661 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:47.633081 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:47.633687 14369 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.643452 14227 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:47.620739 14220 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:47.658510 14299 raft_consensus.cc:2955] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.645617 14369 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:47.676184 14126 catalog_manager.cc:5697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.716596 14369 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:47.718101 15661 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:47.729302 14192 consensus_peers.cc:597] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cde980445ec54bac8c99f8e77669bffa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:47.737593 14298 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:47.742584 15661 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:47.746033 15672 tablet_bootstrap.cc:492] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:47.749648 15672 tablet_bootstrap.cc:492] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:47.750526 15672 ts_tablet_manager.cc:1403] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.173s	user 0.042s	sys 0.039s
I20260709 13:17:47.760560 15672 raft_consensus.cc:359] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:47.761658 15672 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:47.761046 15367 raft_consensus.cc:2955] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.762768 15672 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:47.767527 15672 ts_tablet_manager.cc:1434] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.006s
I20260709 13:17:47.777495 14314 tablet_copy_service.cc:342] P bee4f7fc1b4740dc875537c79309664f: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-80f2fbd6ece74e2fa8bbfcc96a1f45b5 received from {username='slave'} at 127.0.0.1:45306
I20260709 13:17:47.778231 14314 tablet_copy_service.cc:434] P bee4f7fc1b4740dc875537c79309664f: ending tablet copy session cebb34ac155340899a38c728707ddc0d-80f2fbd6ece74e2fa8bbfcc96a1f45b5 on tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:47.777375 14374 raft_consensus.cc:2955] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.804872 14125 catalog_manager.cc:5697] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.818014 14295 raft_consensus.cc:2955] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:47.847894 15673 tablet_bootstrap.cc:492] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:47.849038 15673 tablet_bootstrap.cc:492] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:47.849942 15673 ts_tablet_manager.cc:1403] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.235s	user 0.040s	sys 0.050s
I20260709 13:17:47.853727 15673 raft_consensus.cc:359] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:47.854681 15673 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:47.855366 15673 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:47.858160 15673 ts_tablet_manager.cc:1434] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:17:47.859074 15598 raft_consensus.cc:993] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:47.859622 15598 raft_consensus.cc:1081] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:47.868069 14220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53824
I20260709 13:17:47.868690 14220 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:47.869087 14220 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.882177 14314 tablet_copy_service.cc:342] P bee4f7fc1b4740dc875537c79309664f: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-2582e91d201c4063b3eff5158b611448 received from {username='slave'} at 127.0.0.1:45306
I20260709 13:17:47.882692 14314 tablet_copy_service.cc:434] P bee4f7fc1b4740dc875537c79309664f: ending tablet copy session cebb34ac155340899a38c728707ddc0d-2582e91d201c4063b3eff5158b611448 on tablet 2582e91d201c4063b3eff5158b611448 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:47.886317 14220 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:47.895103 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:47.895769 14297 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.898200 14220 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:47.903509 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:47.904270 14374 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:47.904628 14374 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:47.905537 14374 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:47.929059 14374 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.930732 14220 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.937613 14297 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:47.945607 15557 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:48.032687 15673 ts_tablet_manager.cc:933] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:48.045603 14297 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.047768 15620 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.063584 14227 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:48.072053 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:48.073208 14374 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:48.075979 15367 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.076514 15367 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:48.071548 15627 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:17:48.077435 15367 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:48.091743 15673 tablet_copy_client.cc:323] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
W20260709 13:17:48.130581 15692 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:17:48.147673 14901 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:48.155021 14297 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.151558 15627 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:17:48.162673 15367 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.168177 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet f235d077faa24a89832f2f8f181b0ef1 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:48.168840 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet f235d077faa24a89832f2f8f181b0ef1 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-f235d077faa24a89832f2f8f181b0ef1
I20260709 13:17:48.173607 14125 catalog_manager.cc:5697] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.176851 14388 tablet_copy_source_session.cc:215] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:48.186352 15673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f235d077faa24a89832f2f8f181b0ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:48.199896 14899 raft_consensus.cc:1217] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:48.266011 14369 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.267918 15539 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.283723 15672 ts_tablet_manager.cc:933] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:48.312183 15672 tablet_copy_client.cc:323] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:17:48.314751 14238 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet cde980445ec54bac8c99f8e77669bffa from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:17:48.315368 14238 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet cde980445ec54bac8c99f8e77669bffa from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-cde980445ec54bac8c99f8e77669bffa
I20260709 13:17:48.324306 14899 raft_consensus.cc:1217] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:48.344856 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:48.350382 14238 tablet_copy_source_session.cc:215] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:48.360709 15672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde980445ec54bac8c99f8e77669bffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:48.388538 15673 tablet_copy_client.cc:806] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:48.416651 15673 tablet_copy_client.cc:670] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:48.422254 15673 tablet_copy_client.cc:538] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:48.474148 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:48.602545 14295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:17:48.603250 14295 raft_consensus.cc:606] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:48.612890 15672 tablet_copy_client.cc:806] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:48.613565 15672 tablet_copy_client.cc:670] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:48.571900 15673 tablet_bootstrap.cc:492] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:48.620167 14227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:48.620733 14227 raft_consensus.cc:606] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:48.635061 15672 tablet_copy_client.cc:538] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:48.658179 14295 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.668084 14369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e531770baa044bc49820df7e47c608eb"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:48.668733 14369 raft_consensus.cc:606] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:48.671401 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:48.673121 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:48.673362 15702 raft_consensus.cc:993] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:48.666481 15539 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:17:48.674006 15702 raft_consensus.cc:1081] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:48.680691 14229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53830
I20260709 13:17:48.682106 14229 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.682469 14229 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.688208 15672 tablet_bootstrap.cc:492] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:48.713308 14369 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.714869 15367 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.722434 15702 raft_consensus.cc:1064] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:48.775750 15672 tablet_bootstrap.cc:492] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:48.776155 15675 raft_consensus.cc:1064] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:48.776738 15672 tablet_bootstrap.cc:492] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:48.777483 15672 ts_tablet_manager.cc:1403] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.000s
I20260709 13:17:48.778776 15675 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:48.725147 15702 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:48.792797 15672 raft_consensus.cc:359] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:48.798957 14229 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:48.793735 15672 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:48.800369 15672 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:48.801723 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:48.802340 14295 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.802659 14295 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:48.825572 15672 ts_tablet_manager.cc:1434] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.048s	user 0.011s	sys 0.000s
I20260709 13:17:48.833319 14295 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:48.834434 14238 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-cde980445ec54bac8c99f8e77669bffa received from {username='slave'} at 127.0.0.1:57812
I20260709 13:17:48.835206 14238 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-cde980445ec54bac8c99f8e77669bffa on tablet cde980445ec54bac8c99f8e77669bffa with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:48.834604 14295 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.846186 14220 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:48.848953 15627 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:48.851768 14901 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:48.854593 14376 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:48.856509 15678 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:48.858639 15678 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:48.884276 14227 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:48.892870 15676 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:48.896325 14899 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:48.897717 14376 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:48.899951 15678 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:48.909417 15699 raft_consensus.cc:993] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:48.910071 15699 raft_consensus.cc:1081] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:48.912113 14297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e531770baa044bc49820df7e47c608eb"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:17:48.912866 14297 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.913304 14297 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.930631 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:17:48.931354 14899 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.936502 14297 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:48.949548 14295 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:48.943715 14229 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:48.951058 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:48.952288 14297 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:48.953166 15367 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.946480 14899 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:48.953907 15367 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:48.958770 15367 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:48.978106 15673 tablet_bootstrap.cc:492] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:17:48.984196 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55419.5us
W20260709 13:17:48.985124 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50199.3us
I20260709 13:17:48.990291 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:48.990945 14227 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.985630 15678 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:48.993572 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:48.994233 14376 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.994544 14376 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:48.995345 14376 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:48.996629 14376 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:49.005975 14227 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:49.008093 14270 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:49.011307 15722 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:49.011894 15722 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:49.012851 15722 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:49.014196 14376 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:49.027598 14369 raft_consensus.cc:2955] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.001214 15676 raft_consensus.cc:2955] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.032773 14901 raft_consensus.cc:2955] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.053190 14126 catalog_manager.cc:5697] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.070078 15673 tablet_bootstrap.cc:492] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:49.097848 15694 raft_consensus.cc:993] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:49.116586 15361 raft_consensus.cc:1081] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
W20260709 13:17:49.122056 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 51139.7us
I20260709 13:17:49.111886 15673 ts_tablet_manager.cc:1403] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.540s	user 0.038s	sys 0.023s
I20260709 13:17:49.120860 14124 catalog_manager.cc:5697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.133087 14369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:17:49.133721 14369 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.134140 14369 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:49.152722 14369 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:49.162878 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:49.163640 14227 raft_consensus.cc:3055] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:49.163964 14227 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:49.166127 14369 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:17:49.166857 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48809.9us
I20260709 13:17:49.171131 15673 raft_consensus.cc:359] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:49.172227 15673 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:49.175639 15675 raft_consensus.cc:2955] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.185391 14227 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:49.186757 14227 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:49.190685 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:49.191375 14299 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:49.172959 15673 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:49.199692 14899 raft_consensus.cc:2955] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.205367 14227 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:49.218391 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:49.224251 15710 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:49.224840 15710 raft_consensus.cc:697] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:49.225844 15710 consensus_queue.cc:237] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:49.228585 15673 ts_tablet_manager.cc:1434] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.000s
I20260709 13:17:49.201821 14299 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:49.263677 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-f235d077faa24a89832f2f8f181b0ef1 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:49.264183 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-f235d077faa24a89832f2f8f181b0ef1 on tablet f235d077faa24a89832f2f8f181b0ef1 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:49.278623 14899 raft_consensus.cc:1217] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:49.297855 14127 catalog_manager.cc:5697] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.309916 14227 raft_consensus.cc:2955] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.312868 14376 raft_consensus.cc:2955] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:49.327808 15733 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:17:49.367657 14227 raft_consensus.cc:2955] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.392704 14901 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:49.393162 14299 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:49.394912 15367 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:49.398299 15539 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:49.460817 14125 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.498492 14899 raft_consensus.cc:1217] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:49.504863 14125 catalog_manager.cc:5697] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.561518 14297 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:49.582008 14901 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:49.583659 14376 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.587023 15722 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.588392 15722 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:49.591450 14376 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:49.598503 15675 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:49.605763 14299 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:49.615932 14225 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:49.617692 14298 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.619464 15722 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:49.625946 15696 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:49.630735 15731 raft_consensus.cc:2955] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.639464 14901 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:49.639598 14229 raft_consensus.cc:2955] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.642588 14225 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.644229 15678 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.646445 15702 raft_consensus.cc:2955] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.645525 15722 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:17:49.702268 14901 raft_consensus.cc:2955] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.716426 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.716992 14227 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.718736 15696 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.764812 14899 raft_consensus.cc:2955] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.783371 14112 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:49.793241 14126 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 4 to 5, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.798895 14112 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2582e91d201c4063b3eff5158b611448 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:49.810038 15367 raft_consensus.cc:1064] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:49.816635 15367 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:49.835500 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5 with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:49.933861 15749 tablet_replica.cc:333] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:17:49.935031 15749 raft_consensus.cc:2243] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.942800 14126 catalog_manager.cc:5697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.954452 14899 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:49.950416 14376 raft_consensus.cc:2955] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:49.965627 15749 raft_consensus.cc:2272] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.971499 14297 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:49.983445 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet 2582e91d201c4063b3eff5158b611448 with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47058
I20260709 13:17:49.996977 15749 ts_tablet_manager.cc:1916] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:49.996915 15698 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:50.007077 15750 tablet_replica.cc:333] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:17:50.009533 14369 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:50.033638 15750 raft_consensus.cc:2243] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.034565 15750 raft_consensus.cc:2272] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.038614 15750 ts_tablet_manager.cc:1916] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:50.042075 15694 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:50.021324 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:50.055547 15710 raft_consensus.cc:1064] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:50.058171 15710 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:50.070066 15694 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:17:50.096184 15749 ts_tablet_manager.cc:1929] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:17:50.108489 15749 log.cc:1199] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/80f2fbd6ece74e2fa8bbfcc96a1f45b5
I20260709 13:17:50.108799 14295 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:50.110489 15699 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:50.120992 14229 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:50.142658 15750 ts_tablet_manager.cc:1929] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:50.143313 15750 log.cc:1199] T 2582e91d201c4063b3eff5158b611448 P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/2582e91d201c4063b3eff5158b611448
I20260709 13:17:50.136224 15699 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
W20260709 13:17:50.151181 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 45381.5us
I20260709 13:17:50.151991 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet 80f2fbd6ece74e2fa8bbfcc96a1f45b5 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:50.155409 14900 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:50.156607 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet 2582e91d201c4063b3eff5158b611448 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:50.163329 14374 raft_consensus.cc:2955] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:50.160622 15367 raft_consensus.cc:2955] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:50.195794 15756 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:50.358386 15752 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:17:50.442191 14295 raft_consensus.cc:2955] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:50.451156 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 287262us
W20260709 13:17:50.453665 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 290980us
W20260709 13:17:50.576634 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 104297us
I20260709 13:17:50.611268 14374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:50.612106 14374 raft_consensus.cc:606] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
W20260709 13:17:50.625996 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 97970.4us
I20260709 13:17:50.635150 14125 catalog_manager.cc:5697] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:50.679113 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 45933.7us
W20260709 13:17:50.722003 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 134247us
W20260709 13:17:50.730671 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 100343us
I20260709 13:17:50.772188 15699 raft_consensus.cc:993] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:50.773118 15699 raft_consensus.cc:1081] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:50.777491 14900 raft_consensus.cc:2955] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:50.791925 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55952.4us
I20260709 13:17:50.792414 14298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:17:50.796849 14298 raft_consensus.cc:606] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:50.814291 14299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:17:50.816133 14299 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:50.816495 14299 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:50.859042 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 298946us
I20260709 13:17:50.872735 14229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:50.873307 14229 raft_consensus.cc:606] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:50.878252 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:50.880049 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:50.926443 15788 raft_consensus.cc:2955] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:50.953975 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 70249.3us
I20260709 13:17:50.956110 14299 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:17:50.975140 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63614.8us
I20260709 13:17:50.979187 14302 raft_consensus.cc:2955] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:50.981340 14220 raft_consensus.cc:2955] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:50.983378 14900 raft_consensus.cc:2955] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:51.016768 14297 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:51.017318 15676 raft_consensus.cc:993] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:51.017952 15676 raft_consensus.cc:1081] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:51.019196 15789 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:51.023936 15766 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:51.024469 15766 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:51.037418 15777 raft_consensus.cc:993] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:51.038028 15777 raft_consensus.cc:1081] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:51.025560 15766 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:51.041504 15766 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.058284 14372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:17:51.059350 14372 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:51.059824 14372 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.062680 14220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53830
I20260709 13:17:51.063295 14220 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:51.063659 14220 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.064749 14299 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:51.068709 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:51.070286 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:17:51.075959 14900 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.077181 14220 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:51.079687 14229 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:51.082578 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:51.083194 14295 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:51.083485 14295 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:51.084184 14295 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:51.085248 15794 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:51.090757 14220 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:51.093959 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:17:51.094485 14901 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.097749 14295 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.100116 14900 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:51.103909 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:51.106850 15794 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:51.107332 15794 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:51.104692 14901 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:17:51.111451 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:51.108172 15794 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:51.114449 15361 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:51.126116 15361 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:51.126924 14295 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:17:51.127502 15361 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:51.138368 14376 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:51.138911 14372 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:51.141115 14372 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:51.142829 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:17:51.143469 14901 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.143925 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:51.144595 14225 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:51.144891 14225 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:51.145735 14225 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:51.146970 14225 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.151057 14901 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:51.156495 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:51.158614 15760 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:51.159113 15760 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:51.160050 15760 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:51.232563 14225 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:51.271106 14127 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:51.273304 14127 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 3, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.295305 14125 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.307240 14124 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.320989 14220 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:51.324115 14376 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:51.333544 14900 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:51.335646 15760 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:51.338558 14225 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:51.341531 15760 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:51.343986 15766 raft_consensus.cc:2955] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:51.345045 14901 raft_consensus.cc:2955] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:51.347620 14900 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:51.349362 14299 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:51.351015 15759 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:51.352025 15777 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:51.358778 14225 raft_consensus.cc:2955] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:51.365868 15698 raft_consensus.cc:2955] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:51.374249 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f235d077faa24a89832f2f8f181b0ef1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:51.373601 14127 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:51.377295 14299 raft_consensus.cc:2955] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:51.380470 14900 raft_consensus.cc:2955] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:51.404023 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet f235d077faa24a89832f2f8f181b0ef1 with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54352
I20260709 13:17:51.416579 14124 catalog_manager.cc:5697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:51.438414 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cde980445ec54bac8c99f8e77669bffa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:51.443249 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet cde980445ec54bac8c99f8e77669bffa with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47058
I20260709 13:17:51.451047 15801 tablet_replica.cc:333] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:17:51.466863 15802 tablet_replica.cc:333] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:17:51.479835 15802 raft_consensus.cc:2243] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.482064 15801 raft_consensus.cc:2243] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:51.482699 15802 raft_consensus.cc:2272] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.483052 15801 raft_consensus.cc:2272] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:51.490391 15802 ts_tablet_manager.cc:1916] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:51.508235 15801 ts_tablet_manager.cc:1916] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:51.551824 14295 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:51.554775 15698 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:51.555331 14220 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:51.560245 15760 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:51.563067 15801 ts_tablet_manager.cc:1929] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:51.567510 15801 log.cc:1199] T f235d077faa24a89832f2f8f181b0ef1 P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/f235d077faa24a89832f2f8f181b0ef1
I20260709 13:17:51.569411 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet f235d077faa24a89832f2f8f181b0ef1 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:51.588415 15802 ts_tablet_manager.cc:1929] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:51.590729 15802 log.cc:1199] T cde980445ec54bac8c99f8e77669bffa P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/cde980445ec54bac8c99f8e77669bffa
I20260709 13:17:51.595268 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet cde980445ec54bac8c99f8e77669bffa (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:17:51.601655 14900 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:51.607453 15777 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:51.674155 14901 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:51.682430 15774 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:51.692831 14373 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:51.695313 15794 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:51.731042 14901 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:51.737358 15678 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:51.881104 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:52.022389 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:52.100132 14229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:52.100862 14229 raft_consensus.cc:606] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:52.104921 14376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:52.107049 14376 raft_consensus.cc:606] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:52.111555 14298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:17:52.112280 14298 raft_consensus.cc:606] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:52.115509 14376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:52.116102 14376 raft_consensus.cc:606] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:17:52.120707 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:52.122618 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:52.314541 15766 raft_consensus.cc:993] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:52.315114 15766 raft_consensus.cc:1081] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:52.316812 14299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:17:52.317355 14299 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.317746 14299 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.325747 14299 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:52.330153 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:52.330796 14220 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.331441 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:52.332180 14372 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:52.332474 14372 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:52.334193 14299 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:52.335968 14372 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:52.337262 14372 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.341049 14220 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:17:52.342303 14270 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:52.343108 15794 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:52.346936 15794 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:52.347879 15794 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:52.381042 14372 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:17:52.394101 14124 catalog_manager.cc:5697] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 2 to 3, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 3 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.399564 15760 raft_consensus.cc:993] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:52.404932 15760 raft_consensus.cc:1081] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:17:52.407442 14896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50016
I20260709 13:17:52.408057 14896 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.408421 14896 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.410459 15815 raft_consensus.cc:993] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:52.410954 15812 raft_consensus.cc:1081] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:52.414728 14220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53830
I20260709 13:17:52.415340 14220 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.415712 14220 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.425689 14896 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:52.445500 14220 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:52.451265 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:52.452032 14372 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.456997 14220 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:52.453205 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:52.462371 14299 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.462687 14299 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:52.463400 14299 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:52.464423 14299 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.501101 14372 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:52.512408 14192 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:52.513988 15698 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.514504 15698 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:52.515363 15698 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:52.545382 14299 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:52.608588 14896 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:52.609954 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:52.610690 14372 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.610982 14372 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:52.611732 14372 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:52.639011 15759 raft_consensus.cc:993] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:52.639569 15759 raft_consensus.cc:1081] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:52.641906 14376 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:17:52.642452 14376 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.642783 14376 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:52.651290 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65913.9us
I20260709 13:17:52.654541 14372 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.660838 14376 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:52.664309 14376 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:52.669931 14372 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:52.671415 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:52.676442 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:52.676604 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:52.677199 14298 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.677305 14229 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:52.677740 14229 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:52.678491 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:52.678491 14229 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:52.679147 14220 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.679730 14229 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.685424 14127 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.687711 14229 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:17:52.698711 14220 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:17:52.682044 15657 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.717290 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:17:52.735605 15774 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:52.748821 14298 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:17:52.761706 15774 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:52.762810 15774 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:52.800191 15657 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:17:52.820093 15657 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:52.821245 14376 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:52.845060 14126 catalog_manager.cc:5697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 2 to 3, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:52.850562 14341 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf286f2db09c4718a255c14e95c7e781. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:52.851624 14295 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:52.856624 15818 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:52.862772 14125 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.871523 14220 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:52.873304 15827 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:17:52.884501 14376 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:52.888042 15794 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.921047 15818 raft_consensus.cc:2955] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:52.925005 14295 raft_consensus.cc:2955] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:52.956463 14229 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:52.958068 15678 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.966456 14229 raft_consensus.cc:2955] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.025017 14127 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.077127 14373 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:53.097610 14372 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.098866 14300 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.102725 15824 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:53.107254 14341 consensus_peers.cc:597] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf13dfd8a7f54be7b9ae796572d0961b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.109771 14295 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:53.113375 15827 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:53.123706 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:53.165460 14229 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:53.175120 15777 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:17:53.192515 15834 raft_consensus.cc:2955] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.201848 14299 raft_consensus.cc:2955] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.207227 14300 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:53.212563 15820 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:53.214895 14373 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:53.214769 15818 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:53.223609 15826 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:53.259588 14229 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:53.293251 14227 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:53.294879 15774 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:53.293211 14220 raft_consensus.cc:2955] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.316031 14227 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:53.317643 15833 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:53.299520 14127 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.367498 14373 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:17:53.368319 14192 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7157daf9a3647f4af1d12bf4530f984. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.374158 14302 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:53.373735 15853 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:17:53.380365 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:53.393237 15698 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:53.429394 15862 ts_tablet_manager.cc:933] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:53.467155 14227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:53.468098 14227 raft_consensus.cc:606] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:17:53.472016 14302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:17:53.472645 14302 raft_consensus.cc:606] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:53.478341 15698 raft_consensus.cc:993] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:53.478910 15698 raft_consensus.cc:1081] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:53.493711 14372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:17:53.505195 14372 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:53.506359 15698 raft_consensus.cc:2955] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.507848 14371 raft_consensus.cc:2955] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.512215 14298 raft_consensus.cc:2955] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.513501 14377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:53.514091 14377 raft_consensus.cc:606] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:53.505728 14372 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.525910 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:53.527330 14372 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:53.529155 14372 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:53.529739 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:53.503870 15862 tablet_copy_client.cc:323] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:53.531855 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:53.532037 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet cf286f2db09c4718a255c14e95c7e781 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:53.532480 14227 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:53.532662 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet cf286f2db09c4718a255c14e95c7e781 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-cf286f2db09c4718a255c14e95c7e781
I20260709 13:17:53.535956 14126 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.536936 15774 raft_consensus.cc:993] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:53.537431 15774 raft_consensus.cc:1081] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:53.532821 14227 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:53.539311 14299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:17:53.539631 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:53.539827 14299 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:53.540190 14299 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.539338 14227 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:53.540196 14302 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.544122 14388 tablet_copy_source_session.cc:215] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:53.546984 14227 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.572377 14299 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:53.574441 14299 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:53.577332 14229 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:53.579840 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:53.580440 14220 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.581508 14302 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:53.582738 14342 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:53.584146 15862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf286f2db09c4718a255c14e95c7e781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:53.588713 15834 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:53.592226 14373 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:17:53.593258 14192 consensus_peers.cc:597] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8db981b8c9a4369a9fa90b9ecf4c80c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.597460 15834 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:53.603499 14299 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:53.605005 15698 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:53.606247 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:53.612659 15759 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:53.613034 14372 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:53.613740 14220 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:53.614070 14372 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:53.614998 14270 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:53.615813 15825 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:53.616465 15825 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:53.617311 15825 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:53.623970 14372 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:53.628242 14372 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.633167 15853 raft_consensus.cc:2955] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.635663 14371 raft_consensus.cc:2955] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.652140 15815 raft_consensus.cc:993] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:53.652695 15815 raft_consensus.cc:1081] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:53.654654 14229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53830
I20260709 13:17:53.655229 14229 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:53.655579 14229 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.663406 14229 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:53.665695 14229 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:53.666222 15862 tablet_copy_client.cc:806] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:53.669195 15862 tablet_copy_client.cc:670] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:53.671821 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:17:53.672434 14900 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.674000 15862 tablet_copy_client.cc:538] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:53.687371 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:53.688019 14302 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:53.688380 14302 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:53.690662 14900 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:53.692592 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:53.694059 15824 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:53.694751 15824 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:53.694799 14302 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:53.695693 15824 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:53.598495 15834 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:53.696148 14302 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.714283 14302 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:53.608846 14227 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:17:53.735098 14372 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:53.741264 14126 catalog_manager.cc:5697] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.752332 14302 raft_consensus.cc:2955] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:53.755261 14124 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.758026 14127 catalog_manager.cc:5697] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.750216 15867 ts_tablet_manager.cc:933] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:53.778738 15862 tablet_bootstrap.cc:492] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:53.834810 15867 tablet_copy_client.cc:323] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:17:53.849251 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet bf13dfd8a7f54be7b9ae796572d0961b from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:17:53.849936 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet bf13dfd8a7f54be7b9ae796572d0961b from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-bf13dfd8a7f54be7b9ae796572d0961b
I20260709 13:17:53.862321 14388 tablet_copy_source_session.cc:215] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:53.873085 15867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf13dfd8a7f54be7b9ae796572d0961b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:53.945086 15867 tablet_copy_client.cc:806] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:53.945808 15867 tablet_copy_client.cc:670] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:53.950860 15867 tablet_copy_client.cc:538] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:53.967309 15867 tablet_bootstrap.cc:492] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:53.981668 15862 tablet_bootstrap.cc:492] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:54.118742 15874 ts_tablet_manager.cc:933] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:54.130936 14377 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:54.150826 15825 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:54.167048 15862 tablet_bootstrap.cc:492] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:54.168008 15862 ts_tablet_manager.cc:1403] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.390s	user 0.020s	sys 0.036s
I20260709 13:17:54.190325 14126 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:17:54.193259 15874 tablet_copy_client.cc:323] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:17:54.199927 15862 raft_consensus.cc:359] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:54.200986 15862 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:54.210211 15862 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:54.219767 15862 ts_tablet_manager.cc:1434] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:17:54.317739 14229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:54.318439 14229 raft_consensus.cc:606] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:17:54.332346 14229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:54.333186 14229 raft_consensus.cc:606] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:17:54.339601 14114 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for d8db981b8c9a4369a9fa90b9ecf4c80c already in progress [suppressed 3 similar messages]
I20260709 13:17:54.356413 14229 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:54.358481 15867 tablet_bootstrap.cc:492] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:54.359586 15867 tablet_bootstrap.cc:492] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:54.360378 15867 ts_tablet_manager.cc:1403] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.393s	user 0.024s	sys 0.009s
I20260709 13:17:54.364022 15867 raft_consensus.cc:359] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:54.365033 15867 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:54.365869 15867 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:54.365564 14302 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:54.368970 15867 ts_tablet_manager.cc:1434] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:54.373334 15878 raft_consensus.cc:993] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:54.374094 15878 raft_consensus.cc:1081] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:17:54.382769 14900 raft_consensus.cc:1217] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:54.386096 14901 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:54.386219 14224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:54.386915 14224 raft_consensus.cc:606] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:17:54.389918 15881 ts_tablet_manager.cc:933] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:17:54.390528 15853 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:54.398039 14175 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:17:54.398701 14175 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for d8db981b8c9a4369a9fa90b9ecf4c80c already in progress
W20260709 13:17:54.399008 14175 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for d8db981b8c9a4369a9fa90b9ecf4c80c already in progress
W20260709 13:17:54.400826 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 43935.2us
I20260709 13:17:54.408910 15759 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:54.410773 15760 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:54.424008 14220 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:54.431167 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-cf286f2db09c4718a255c14e95c7e781 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:54.431668 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-cf286f2db09c4718a255c14e95c7e781 on tablet cf286f2db09c4718a255c14e95c7e781 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:54.432789 14387 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-bf13dfd8a7f54be7b9ae796572d0961b received from {username='slave'} at 127.0.0.1:37700
I20260709 13:17:54.433199 14387 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-bf13dfd8a7f54be7b9ae796572d0961b on tablet bf13dfd8a7f54be7b9ae796572d0961b with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:54.453298 15881 tablet_copy_client.cc:323] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:17:54.466291 14238 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet a7157daf9a3647f4af1d12bf4530f984 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:17:54.466905 14238 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet a7157daf9a3647f4af1d12bf4530f984 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-a7157daf9a3647f4af1d12bf4530f984
I20260709 13:17:54.475279 14371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:17:54.475883 14371 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:54.476227 14371 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:54.484515 14238 tablet_copy_source_session.cc:215] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:54.486131 14239 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet d8db981b8c9a4369a9fa90b9ecf4c80c from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:17:54.491350 14239 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet d8db981b8c9a4369a9fa90b9ecf4c80c from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-d8db981b8c9a4369a9fa90b9ecf4c80c
I20260709 13:17:54.494267 15678 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:54.486174 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 107892us
I20260709 13:17:54.526562 14239 tablet_copy_source_session.cc:215] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:54.535881 15874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7157daf9a3647f4af1d12bf4530f984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.532856 14371 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:54.551234 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:54.551827 14229 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:54.552110 14229 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:54.552810 14229 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:54.554322 14229 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:54.559947 15881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8db981b8c9a4369a9fa90b9ecf4c80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.576066 14371 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:54.780102 14299 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:17:54.788259 15889 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.213s	user 0.011s	sys 0.014s
I20260709 13:17:54.980602 14373 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 2. Current term is 3. Ops: []
W20260709 13:17:54.950834 15890 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.403s	user 0.005s	sys 0.000s
I20260709 13:17:55.011962 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:55.012741 14299 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:55.015069 15876 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.221s	user 0.000s	sys 0.011s
I20260709 13:17:55.027058 14299 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:17:55.079854 15874 tablet_copy_client.cc:806] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:55.060461 15881 tablet_copy_client.cc:806] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
W20260709 13:17:55.171165 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.446848 15881 tablet_copy_client.cc:670] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
W20260709 13:17:55.447036 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.261255 14227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.013s	sys 0.026s
I20260709 13:17:55.348016 15874 tablet_copy_client.cc:670] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
W20260709 13:17:55.450037 14227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.015s	sys 0.027s
W20260709 13:17:55.427119 14224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.012s	sys 0.009s
W20260709 13:17:55.443879 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9800 after lost signal to thread 13125
W20260709 13:17:55.452414 14224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.013s	sys 0.010s
W20260709 13:17:55.454209 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08000a03e0 after lost signal to thread 14161
W20260709 13:17:55.456645 14325 debug-util.cc:398] Leaking SignalData structure 0x7b080025b420 after lost signal to thread 14253
I20260709 13:17:55.458767 15886 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.474483 15886 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:17:55.490985 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08002a35e0 after lost signal to thread 14328
W20260709 13:17:55.492828 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08003575e0 after lost signal to thread 14402
I20260709 13:17:55.497934 15886 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:17:55.513499 14325 debug-util.cc:398] Leaking SignalData structure 0x7b0800339aa0 after lost signal to thread 14925
W20260709 13:17:55.522848 14229 consensus_meta.cc:287] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.968s	user 0.002s	sys 0.023s
I20260709 13:17:55.526566 14229 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:17:55.530248 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:55.539481 15880 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:55.543980 14267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.007s	sys 0.001s
W20260709 13:17:55.544428 14267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.007s	sys 0.001s
I20260709 13:17:55.549288 14342 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:55.552084 14127 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37072 (request call id 278) took 1058 ms. Trace:
I20260709 13:17:55.564301 14127 rpcz_store.cc:276] 0709 13:17:54.493237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.493392 (+   155us) service_pool.cc:224] Handling call
0709 13:17:55.460217 (+966825us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b54002c0010. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f680b2 00007f8df2ee1a89 00007f8df2e79da6 00007f8df2e4b088 00007f8df2f4937e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc
0709 13:17:55.551780 (+ 91563us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72155,"reported_tablets":1,"spinlock_wait_cycles":2216575360}
I20260709 13:17:55.574191 14125 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37096 (request call id 298) took 1152 ms. Trace:
I20260709 13:17:55.574681 14125 rpcz_store.cc:276] 0709 13:17:54.421486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.421635 (+   149us) service_pool.cc:224] Handling call
0709 13:17:55.573996 (+1152361us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7}
I20260709 13:17:55.581770 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:55.584429 15894 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:55.585080 15894 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:55.566926 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:55.585981 14893 raft_consensus.cc:1217] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:55.586375 15894 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:55.587244 14124 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36074 (request call id 168) took 1109 ms. Trace:
I20260709 13:17:55.591552 15760 raft_consensus.cc:1064] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:55.587635 14124 rpcz_store.cc:276] 0709 13:17:54.478117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.478265 (+   148us) service_pool.cc:224] Handling call
0709 13:17:55.511007 (+1032742us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54002c0010. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f680b2 00007f8df2ee1a89 00007f8df2e79da6 00007f8df2e4b088 00007f8df2f4937e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc
0709 13:17:55.564970 (+ 53963us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b5400152054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff6090 00007f8ded094f3a 00007f8df2e4b1cc 00007f8df2f4937e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc 00007f8df1409392 00007f8deb3c748c 00007f8deb3c68c6
0709 13:17:55.587062 (+ 22092us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17671,"reported_tablets":1,"spinlock_wait_cycles":2274352256}
I20260709 13:17:55.597340 15760 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:55.599206 15880 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:17:55.602532 15880 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:55.607570 15880 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:17:55.613770 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 106095us
W20260709 13:17:55.624357 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 100091us
I20260709 13:17:55.649209 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:55.653708 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 45103.7us
I20260709 13:17:55.689994 15834 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:17:55.691062 15834 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:55.704969 14899 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:55.706705 14123 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37080 (request call id 285) took 1166 ms. Trace:
I20260709 13:17:55.707242 14123 rpcz_store.cc:276] 0709 13:17:54.531761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.533611 (+  1850us) service_pool.cc:224] Handling call
0709 13:17:55.557192 (+1023581us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54002c0010. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f680b2 00007f8df2ee1a89 00007f8df2e79da6 00007f8df2e4b088 00007f8df2f4937e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc
0709 13:17:55.618812 (+ 61620us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b54002c0010. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f68640 00007f8df2e3fb76 00007f8df2f49c3e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc 00007f8df1409392 00007f8deb3c748c 00007f8deb3c68c6
0709 13:17:55.694221 (+ 75409us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":2118384768}
I20260709 13:17:55.715617 15834 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:55.716558 15834 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:17:55.723949 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.723953 15893 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:17:55.725397 15893 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:55.726111 15895 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:55.728121 15893 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:55.729949 15880 raft_consensus.cc:1064] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:55.732892 15880 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:55.717386 15834 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:17:55.751307 13127 debug-util.cc:398] Leaking SignalData structure 0x7b080000fc40 after lost signal to thread 14224
I20260709 13:17:55.752673 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:55.751091 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:17:55.755741 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 85697.8us
I20260709 13:17:55.751092 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:55.764734 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 121721us
I20260709 13:17:55.766021 14267 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:17:55.770220 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.826352 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.837345 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 68116.6us
I20260709 13:17:55.780290 14300 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:55.862640 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:55.863951 15895 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:55.902987 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:55.907940 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:55.915220 15827 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:17:55.934717 15834 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:55.955689 14301 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:55.955425 14124 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 2 to 3, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.970059 15908 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:55.970688 15908 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:55.978566 15678 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:55.979235 15908 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:55.984800 15872 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:56.003515 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 95498.4us
W20260709 13:17:56.028460 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 125609us
I20260709 13:17:56.027040 15872 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:17:56.028537 15908 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:17:56.064563 15872 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:56.095363 15872 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:17:56.095413 15910 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:17:56.095471 15907 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:17:56.094789 15911 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:17:56.076493 15899 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:17:56.117599 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 75354.4us
I20260709 13:17:56.085685 15886 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:56.087412 15908 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:56.127628 15911 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:56.129989 15908 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:56.130651 15899 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:17:56.142046 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 69434.2us
W20260709 13:17:56.203027 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 79921.1us
I20260709 13:17:56.097649 15910 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:56.208174 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:56.208508 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:56.209390 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:17:56.209914 14158 debug-util.cc:398] Leaking SignalData structure 0x7b0800040140 after lost signal to thread 13125
I20260709 13:17:56.145138 15907 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:56.218082 14226 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:56.218286 15907 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:56.219789 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:56.220312 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:56.202595 15911 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:56.241835 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:56.181882 15886 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:56.226490 14895 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:56.228478 15938 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:56.232455 15910 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:56.233682 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:56.234977 14225 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:56.236482 15915 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:56.239050 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:56.254293 15899 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:17:56.260151 14158 debug-util.cc:398] Leaking SignalData structure 0x7b080008b120 after lost signal to thread 14161
I20260709 13:17:56.260989 15915 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:17:56.261474 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08002eebe0 after lost signal to thread 14253
I20260709 13:17:56.278578 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:56.282887 14158 debug-util.cc:398] Leaking SignalData structure 0x7b0800354b80 after lost signal to thread 14328
W20260709 13:17:56.284140 14158 debug-util.cc:398] Leaking SignalData structure 0x7b080035f760 after lost signal to thread 14402
I20260709 13:17:56.285691 15834 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:56.285578 15872 raft_consensus.cc:2955] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:56.290622 15886 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:56.282786 15915 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:56.295190 15900 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:56.295337 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:17:56.295931 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 73404.5us
I20260709 13:17:56.277352 15938 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:56.310752 15938 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:56.317188 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:56.326342 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:56.326426 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:56.342651 14303 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:17:56.313733 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac680 after lost signal to thread 14925
W20260709 13:17:56.368937 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 43570.4us
I20260709 13:17:56.382181 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:56.302132 15900 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:56.381611 14303 raft_consensus.cc:2955] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:56.390179 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:56.377673 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:56.419559 15942 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:56.434152 15900 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:56.452404 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:17:56.455307 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 47517us
I20260709 13:17:56.463142 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:56.467577 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:56.474236 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:56.476719 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:56.468008 15912 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:56.491621 14224 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:56.496654 14270 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:56.498723 15678 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:56.499820 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.499544 15943 raft_consensus.cc:2955] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:56.500985 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:56.502184 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:56.503624 15902 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:56.482185 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 146199us
I20260709 13:17:56.508375 15904 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:56.508906 14897 raft_consensus.cc:2955] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:56.506999 14270 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:56.523831 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:56.529202 15946 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:56.531883 15928 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:17:56.521569 15900 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:56.544976 15902 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:17:56.539261 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:17:56.568792 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 356464us
I20260709 13:17:56.582650 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:56.586989 15880 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:56.597689 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:17:56.604192 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 88978.9us
I20260709 13:17:56.609514 15881 tablet_copy_client.cc:538] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:56.611007 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:56.612471 15874 tablet_copy_client.cc:538] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:56.614073 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:56.590758 15902 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:17:56.627259 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:56.635581 15886 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.636269 15886 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:56.638682 15886 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:56.668962 15774 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:56.688151 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:56.688151 14341 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:56.716208 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:56.718351 14341 consensus_peers.cc:597] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:56.716032 15902 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:56.739396 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 69304.9us
I20260709 13:17:56.731684 14229 raft_consensus.cc:2955] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:56.749691 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:56.753495 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:56.617018 14896 raft_consensus.cc:2955] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:56.771260 15874 tablet_bootstrap.cc:492] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:56.771572 15881 tablet_bootstrap.cc:492] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:17:56.771032 14297 raft_consensus.cc:2955] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:56.784566 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 93851.8us
W20260709 13:17:56.790535 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55080.4us
I20260709 13:17:56.789105 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:56.793406 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:56.798954 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:56.801131 15929 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:56.800004 15907 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:56.802664 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:56.803416 15936 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:56.803520 15907 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:56.804742 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:56.806690 15920 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:56.793310 14225 raft_consensus.cc:2955] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:56.844862 15960 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 13:17:56.877745 14124 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37096 (request call id 299) took 1078 ms. Trace:
I20260709 13:17:56.878777 14127 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:56.878783 15900 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:56.878168 14124 rpcz_store.cc:276] 0709 13:17:55.799096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.799317 (+   221us) service_pool.cc:224] Handling call
0709 13:17:56.877680 (+1078363us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:56.484877 (+     0us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b5400151ea8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df34489e1 00007f8df344764c 00007f8df0ad6adc 00007f8df0ac20a6 00007f8df0ac1d58 00007f8df0ac69f1 00007f8df0ac69a9 00007f8df0ac6939 00007f8df0ac6901 00007f8df0ac5b2d 000000000038f354
0709 13:17:56.485008 (+   131us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:56.485711 (+   703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:56.485769 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:17:56.505707 (+ 19938us) tablet.cc:662] Decoding operations
0709 13:17:56.529680 (+ 23973us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:56.542139 (+ 12459us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:56.578054 (+ 35915us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:56.589646 (+ 11592us) tablet.cc:701] Row locks acquired
0709 13:17:56.589689 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:17:56.589865 (+   176us) write_op.cc:270] Start()
0709 13:17:56.590130 (+   265us) write_op.cc:276] Timestamp: P: 1783603076589804 usec, L: 0
0709 13:17:56.590171 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:17:56.622135 (+ 31964us) log.cc:844] Serialized 603 byte log entry
0709 13:17:56.748974 (+126839us) op_driver.cc:464] REPLICATION: finished
0709 13:17:56.833551 (+ 84577us) write_op.cc:301] APPLY: starting
0709 13:17:56.858314 (+ 24763us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:56.860536 (+  2222us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:56.860578 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:56.860901 (+   323us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:56.861190 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:56.861252 (+    62us) write_op.cc:312] APPLY: finished
0709 13:17:56.861567 (+   315us) log.cc:844] Serialized 23 byte log entry
0709 13:17:56.861818 (+   251us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:56.861896 (+    78us) write_op.cc:454] Released schema lock
0709 13:17:56.861946 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:56.862420 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:56.862457 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":58609,"apply.run_cpu_time_us":2184,"apply.run_wall_time_us":41672,"num_ops":1,"prepare.queue_time_us":160434,"prepare.run_cpu_time_us":15505,"prepare.run_wall_time_us":512558,"raft.queue_time_us":89136,"raft.run_cpu_time_us":26761,"raft.run_wall_time_us":50493,"replication_time_us":158643,"spinlock_wait_cycles":2311552,"thread_start_us":223708,"threads_started":4,"wal-append.queue_time_us":36036}]]}
W20260709 13:17:56.948911 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 181305us
W20260709 13:17:57.004539 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54588.5us
I20260709 13:17:57.036720 14376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:57.099984 14376 raft_consensus.cc:606] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
W20260709 13:17:57.175261 15970 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:17:57.178058 15959 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:17:57.333173 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 78432.2us
W20260709 13:17:57.324041 15968 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:57.402470 15874 tablet_bootstrap.cc:492] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:57.405061 15874 tablet_bootstrap.cc:492] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:57.432610 15900 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:17:57.433272 15900 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:57.436182 15931 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:57.437856 15931 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:57.483209 14124 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:57.466320 15874 ts_tablet_manager.cc:1403] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.720s	user 0.045s	sys 0.044s
I20260709 13:17:57.511947 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:57.524255 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:57.548877 15874 raft_consensus.cc:359] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:57.551327 15900 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:57.557058 15874 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:57.583575 15931 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:57.586153 15874 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:57.589169 15874 ts_tablet_manager.cc:1434] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.083s	user 0.003s	sys 0.002s
W20260709 13:17:57.594547 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80984.9us
I20260709 13:17:57.597962 14297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:17:57.598531 14297 raft_consensus.cc:606] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:57.613989 14374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:17:57.614586 14374 raft_consensus.cc:606] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:17:57.618614 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 79048.2us
I20260709 13:17:57.623447 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:57.630427 14893 raft_consensus.cc:1217] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:57.642601 15962 raft_consensus.cc:993] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:57.643147 15902 raft_consensus.cc:1081] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:57.649607 14238 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-a7157daf9a3647f4af1d12bf4530f984 received from {username='slave'} at 127.0.0.1:57812
I20260709 13:17:57.647020 14303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:17:57.650172 14238 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-a7157daf9a3647f4af1d12bf4530f984 on tablet a7157daf9a3647f4af1d12bf4530f984 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:17:57.650441 14303 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:57.650848 14303 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.658126 14225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:17:57.662067 14225 raft_consensus.cc:606] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:57.665620 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:57.667732 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:57.667724 15678 raft_consensus.cc:993] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:57.668684 15678 raft_consensus.cc:1081] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:57.659081 14303 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:57.671028 14303 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:17:57.671816 14225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53830
I20260709 13:17:57.672372 14225 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:57.672690 14225 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.678457 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:57.679194 14221 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.706279 15881 tablet_bootstrap.cc:492] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:57.709708 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:17:57.713742 15794 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:57.709103 14221 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:17:57.707353 15881 tablet_bootstrap.cc:492] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:17:57.715768 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:57.716688 15984 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:57.716774 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:17:57.717381 15984 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:57.718540 15984 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:57.725826 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:57.727747 14374 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:57.728132 14374 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:57.728916 14374 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:17:57.734474 14374 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.735499 15881 ts_tablet_manager.cc:1403] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.964s	user 0.046s	sys 0.004s
I20260709 13:17:57.738529 15902 raft_consensus.cc:993] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:57.739019 15902 raft_consensus.cc:1081] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:17:57.748647 15931 raft_consensus.cc:993] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:57.750222 14225 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:57.751302 15977 raft_consensus.cc:1081] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:17:57.769099 14225 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:57.770233 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:17:57.773309 14896 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.780370 14374 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:17:57.796451 15881 raft_consensus.cc:359] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:57.797480 15881 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:17:57.808312 14896 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:57.809154 14893 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:57.798148 15881 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:17:57.814074 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:57.815619 15919 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:57.816182 15919 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:57.817132 15919 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:57.826572 15982 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:57.828764 15982 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.829164 15982 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:57.830438 15982 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:57.833719 15982 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.855798 14125 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 2 to 3, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 3 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:57.866861 14111 catalog_manager.cc:4755] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): ChangeConfig:REMOVE_PEER RPC failed for tablet bf13dfd8a7f54be7b9ae796572d0961b: Remote error: Service unavailable: leader transfer in progress
W20260709 13:17:57.917148 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 82376.8us
I20260709 13:17:57.926144 15881 ts_tablet_manager.cc:1434] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.190s	user 0.009s	sys 0.000s
I20260709 13:17:57.931438 14238 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-d8db981b8c9a4369a9fa90b9ecf4c80c received from {username='slave'} at 127.0.0.1:57812
I20260709 13:17:57.931905 14238 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-d8db981b8c9a4369a9fa90b9ecf4c80c on tablet d8db981b8c9a4369a9fa90b9ecf4c80c with peer cebb34ac155340899a38c728707ddc0d
W20260709 13:17:57.946378 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 123513us
I20260709 13:17:57.947855 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:17:57.953752 15977 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:57.960834 14229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53824
I20260709 13:17:57.961442 14229 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:57.961807 14229 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.967362 14302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54360
I20260709 13:17:57.967960 14302 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:57.968303 14302 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.976783 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:57.981511 14302 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:57.987143 14296 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:17:57.989488 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:17:57.990170 14896 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.994732 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:17:57.995335 14227 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:57.995627 14227 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:57.996363 14227 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:57.997401 14227 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:57.999784 14298 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:58.007054 14227 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:57.975497 14229 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:58.008976 14270 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:17:58.010443 15678 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:58.010545 14229 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:58.011003 15678 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:17:58.013531 15678 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:57.988080 14302 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:58.010077 14124 catalog_manager.cc:5697] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.039510 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:17:58.040251 14298 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.046761 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:17:58.047559 14374 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:58.047904 14374 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:17:58.048815 14374 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:58.050787 14374 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.058951 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:17:58.061885 14893 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.185501 14374 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:17:58.189211 14900 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Advancing to term 3
I20260709 13:17:58.193835 14375 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:58.195138 14896 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:17:58.219586 14893 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:17:58.342131 14298 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:17:58.394146 14900 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:58.396693 15794 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:17:58.412817 14111 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf13dfd8a7f54be7b9ae796572d0961b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 181bbac22422408c87cd13b7fe3008f9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:58.442899 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 380354us
I20260709 13:17:58.495025 14374 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:58.497960 14127 catalog_manager.cc:5697] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.499275 15957 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:58.511601 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 337929us
I20260709 13:17:58.534224 15977 raft_consensus.cc:1064] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:58.550984 14192 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:17:58.554342 15977 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:58.553224 15931 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:58.568290 15931 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:17:58.576758 14296 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:58.584515 14221 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:58.588691 14229 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:58.598707 14900 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:58.615517 14900 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:58.569339 15931 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:17:58.640820 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 65345.7us
I20260709 13:17:58.609979 15925 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:17:58.657734 16004 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:58.667877 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 74503.2us
I20260709 13:17:58.670003 14227 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:58.674413 15678 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:58.675848 15998 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:17:58.710573 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 109082us
W20260709 13:17:58.724637 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53031.1us
I20260709 13:17:58.737759 16008 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:58.776023 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 101350us
I20260709 13:17:58.812673 14896 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:17:58.826000 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72543.8us
W20260709 13:17:58.842346 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50348.6us
W20260709 13:17:58.843355 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50875.2us
I20260709 13:17:58.787858 15982 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:17:58.916306 15936 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:58.918064 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65335us
I20260709 13:17:58.734875 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:58.933835 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 206804us
I20260709 13:17:58.944495 14374 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:17:58.961206 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116073us
W20260709 13:17:58.972502 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 197072us
I20260709 13:17:58.951268 15907 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:17:58.989320 14302 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:59.032264 15774 raft_consensus.cc:1064] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:17:59.038019 16017 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:59.123998 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 156992us
I20260709 13:17:59.108657 15774 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:17:59.234673 16034 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:17:59.263340 14377 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:59.268903 14303 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:59.299347 14899 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:59.311384 15931 raft_consensus.cc:2955] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.282723 15907 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:17:59.318384 15977 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:59.329823 14897 raft_consensus.cc:2955] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.379209 16004 raft_consensus.cc:2955] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:17:59.430583 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4ea0 after lost signal to thread 13125
W20260709 13:17:59.431620 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08002860a0 after lost signal to thread 14161
W20260709 13:17:59.432853 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf320 after lost signal to thread 14253
I20260709 13:17:59.437466 14297 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:17:59.438047 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08000ce4e0 after lost signal to thread 14328
W20260709 13:17:59.439174 14399 debug-util.cc:398] Leaking SignalData structure 0x7b080036ed60 after lost signal to thread 14402
W20260709 13:17:59.440363 14399 debug-util.cc:398] Leaking SignalData structure 0x7b080031f260 after lost signal to thread 14925
I20260709 13:17:59.444758 15834 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:17:59.458954 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 99931.6us
I20260709 13:17:59.461339 14899 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:59.462983 14899 raft_consensus.cc:2955] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.465271 16012 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:59.464805 14375 raft_consensus.cc:2955] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.480037 16018 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:17:59.480602 16018 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:59.483608 16018 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:17:59.485270 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:17:59.486862 14227 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:59.487447 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:17:59.489176 14267 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:17:59.489939 16018 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:59.491731 14221 raft_consensus.cc:2955] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.494884 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:17:59.498188 16004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:47058 (request call id 87) took 1445 ms. Trace:
I20260709 13:17:59.498694 16004 rpcz_store.cc:276] 0709 13:17:58.052352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.052477 (+   125us) service_pool.cc:224] Handling call
0709 13:17:58.074962 (+ 22485us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b58004802d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8decfe80aa 00007f8ded06a447 00007f8ded08770a 00007f8ded08876a 00007f8ded08791b 00007f8ded09303c 00007f8ded0926b3 00007f8ded08a9fa 00007f8df20524c9 00007f8deb5cec54
0709 13:17:58.202218 (+127256us) log.cc:844] Serialized 508 byte log entry
0709 13:17:59.498090 (+1295872us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":220,"raft.run_cpu_time_us":1093,"raft.run_wall_time_us":1090,"spinlock_wait_cycles":2896256,"thread_start_us":9067,"threads_started":1,"wal-append.queue_time_us":18794,"wal-append.run_cpu_time_us":1638,"wal-append.run_wall_time_us":1005531}
I20260709 13:17:59.500696 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf286f2db09c4718a255c14e95c7e781 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:59.505576 15977 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:59.509287 15902 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:59.520799 14298 raft_consensus.cc:2955] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.560206 14124 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.562438 14124 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 3, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:59.587793 14111 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf13dfd8a7f54be7b9ae796572d0961b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 181bbac22422408c87cd13b7fe3008f9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.655115 15774 raft_consensus.cc:2955] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.660704 14896 raft_consensus.cc:2955] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.690920 14303 raft_consensus.cc:2955] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.695839 14221 raft_consensus.cc:2955] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.746620 14225 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:59.756412 14125 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 4 to 5, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.764475 14375 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:59.766045 15919 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:59.771852 14896 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:59.750754 14221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:59.775425 14221 raft_consensus.cc:606] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:17:59.777671 15977 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:59.785272 14894 raft_consensus.cc:2955] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.784868 15919 raft_consensus.cc:2955] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.787993 14375 raft_consensus.cc:2955] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.795822 14221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:59.800794 14221 raft_consensus.cc:606] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Received request to transfer leadership
W20260709 13:17:59.808871 14114 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for bf13dfd8a7f54be7b9ae796572d0961b already in progress [suppressed 2 similar messages]
I20260709 13:17:59.816737 14127 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 3 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.847496 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet cf286f2db09c4718a255c14e95c7e781 with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54352
I20260709 13:17:59.904009 14227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53822
I20260709 13:17:59.904758 14227 raft_consensus.cc:606] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Received request to transfer leadership
W20260709 13:17:59.912389 14175 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:17:59.912812 14175 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for bf13dfd8a7f54be7b9ae796572d0961b already in progress
W20260709 13:17:59.913092 14175 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for bf13dfd8a7f54be7b9ae796572d0961b already in progress
I20260709 13:17:59.915793 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a7157daf9a3647f4af1d12bf4530f984 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:17:59.930279 14114 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet a7157daf9a3647f4af1d12bf4530f984 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 5
I20260709 13:17:59.927372 16058 tablet_replica.cc:333] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:17:59.945897 14125 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 4 to 5, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:17:59.941512 16058 raft_consensus.cc:2243] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:59.950098 16058 raft_consensus.cc:2272] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:59.956881 16058 ts_tablet_manager.cc:1916] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:59.962978 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet a7157daf9a3647f4af1d12bf4530f984 with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54352
I20260709 13:17:59.973767 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:59.973744 14375 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:17:59.979327 14896 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:59.981930 15902 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:59.994158 14303 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:59.996914 15827 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:59.999974 16040 raft_consensus.cc:2955] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:00.001607 14894 raft_consensus.cc:2955] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:00.017508 14303 raft_consensus.cc:2955] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:00.032148 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d8db981b8c9a4369a9fa90b9ecf4c80c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:00.038846 14125 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 5 to 6, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 3 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.062762 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet d8db981b8c9a4369a9fa90b9ecf4c80c with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53822
I20260709 13:18:00.075309 16059 tablet_replica.cc:333] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:18:00.078019 16059 raft_consensus.cc:2243] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.081650 16058 ts_tablet_manager.cc:1929] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:18:00.082099 16059 raft_consensus.cc:2272] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.102869 16058 log.cc:1199] T cf286f2db09c4718a255c14e95c7e781 P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/cf286f2db09c4718a255c14e95c7e781
I20260709 13:18:00.108142 16059 ts_tablet_manager.cc:1916] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:00.109755 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet cf286f2db09c4718a255c14e95c7e781 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:18:00.128130 14303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:18:00.132093 16059 ts_tablet_manager.cc:1929] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:18:00.136183 16059 log.cc:1199] T d8db981b8c9a4369a9fa90b9ecf4c80c P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/d8db981b8c9a4369a9fa90b9ecf4c80c
I20260709 13:18:00.138005 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet d8db981b8c9a4369a9fa90b9ecf4c80c (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:18:00.138504 14303 raft_consensus.cc:606] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:00.145164 16058 tablet_replica.cc:333] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:18:00.146400 16058 raft_consensus.cc:2243] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.150471 16058 raft_consensus.cc:2272] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.152494 15907 raft_consensus.cc:993] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:18:00.152977 15907 raft_consensus.cc:1081] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:18:00.156766 14303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:18:00.157397 14303 raft_consensus.cc:606] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:00.161644 14375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:18:00.162168 14227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:18:00.162794 14227 raft_consensus.cc:606] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:18:00.162204 14375 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.168761 14375 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.171698 15977 raft_consensus.cc:993] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:18:00.172382 15977 raft_consensus.cc:1081] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:18:00.173667 14227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:18:00.178557 14227 raft_consensus.cc:606] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:00.176278 14894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50026
I20260709 13:18:00.179790 14894 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.180586 14894 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.181017 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:18:00.182932 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:00.187345 16058 ts_tablet_manager.cc:1916] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:00.195885 14894 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:00.204600 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:00.208351 14227 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.208961 14227 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:00.209944 14227 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:00.211490 14227 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.201231 14375 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:00.228125 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:00.228834 14225 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:00.229182 14225 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:00.230022 14225 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:00.237267 16029 raft_consensus.cc:993] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:18:00.237968 16029 raft_consensus.cc:1081] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:18:00.247130 14221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53830
I20260709 13:18:00.250243 14221 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.250785 14221 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.247692 14375 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:00.248409 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:00.253970 14303 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.248679 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:00.258235 14896 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.259594 14894 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:00.266629 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:00.267298 14377 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.270828 14303 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:00.272236 14225 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.274474 14377 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:00.275070 16058 ts_tablet_manager.cc:1929] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:18:00.280297 16058 log.cc:1199] T a7157daf9a3647f4af1d12bf4530f984 P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/a7157daf9a3647f4af1d12bf4530f984
I20260709 13:18:00.280970 14864 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:00.283677 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet a7157daf9a3647f4af1d12bf4530f984 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:18:00.284188 15949 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.287372 16029 raft_consensus.cc:993] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:18:00.290192 15982 raft_consensus.cc:1081] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:18:00.292965 14375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47074
I20260709 13:18:00.293569 14375 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.293983 14375 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.314836 14896 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:00.316395 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:00.317384 16040 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:00.317947 16040 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:00.319018 16040 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:00.334416 14127 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 3 to 4, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 4 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.351795 15949 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:00.353024 15949 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:00.367709 14227 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:00.368790 14225 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:00.369176 14375 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:00.374555 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:00.378474 14375 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:00.375398 14303 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:00.380694 14303 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:00.381425 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:00.382872 14303 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:00.372110 14221 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:00.384008 14303 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.386492 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:00.387070 14298 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.387254 14298 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:00.390487 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:00.381932 14896 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.392966 14298 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:00.394129 14298 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.395617 14375 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.387862 14221 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:00.406211 14896 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:00.400527 14303 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:00.403445 14127 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.407341 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:00.409011 15834 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:00.409504 15834 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:00.410390 15834 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:00.420464 14298 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:00.421763 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:00.422945 15919 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.423507 15919 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:00.424238 14375 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:00.424412 15919 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:00.445564 14127 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 2 to 3, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.453248 14125 catalog_manager.cc:5697] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.482436 15919 raft_consensus.cc:993] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:18:00.483013 15919 raft_consensus.cc:1081] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:18:00.488567 14377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:18:00.489224 14377 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.489590 14377 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.498633 14377 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:00.501573 14377 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:00.501703 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:00.502363 14221 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.503723 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:00.504024 14221 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:00.504379 14298 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.505137 14221 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:00.506271 14221 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.511467 14298 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:00.512974 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:00.513150 14221 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:00.513903 15834 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.514459 15834 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:00.515245 15834 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:00.528218 14125 catalog_manager.cc:5697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:00.655104 14111 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf13dfd8a7f54be7b9ae796572d0961b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:00.745595 14225 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:00.749084 16027 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:00.766562 14298 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:00.767920 16027 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:00.780697 14377 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:00.783097 16001 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:00.790572 14221 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:00.792431 15949 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:00.872865 14896 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:00.876451 15834 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:00.943455 14303 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:00.945519 14297 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:00.945431 15902 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:00.948285 15977 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:00.954751 14894 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:00.960103 16027 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:01.008792 14377 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.010147 14222 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.015164 15977 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.016407 16027 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:01.106276 14298 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:01.108197 15834 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:01.184039 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:01.361420 14297 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:01.383250 14375 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:18:01.383488 14267 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18418e3cab2e42b1a301f8068587c987. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.387070 16029 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:01.392558 14222 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:01.396837 16029 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:01.420096 15982 raft_consensus.cc:2955] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:01.424461 14377 raft_consensus.cc:2955] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:01.450217 14377 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:18:01.473316 14341 consensus_peers.cc:597] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c93ab0fd97734540911af5bd148751d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:01.476266 14303 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:01.477677 15902 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:01.517480 14227 raft_consensus.cc:2955] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:01.573206 14222 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:01.596364 14125 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index -1 to 4, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 3 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.656872 15902 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:01.716315 16086 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:18:01.719224 15834 raft_consensus.cc:2955] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:01.727350 14303 raft_consensus.cc:2955] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:01.867954 14229 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:01.991120 16098 ts_tablet_manager.cc:933] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:01.992681 14377 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:01.996429 16090 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:02.011026 14298 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:02.013335 16077 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:02.012677 14222 raft_consensus.cc:2955] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
W20260709 13:18:02.026634 14192 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ac406834d504a57b52386e2ae4c5235. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:02.031822 16098 tablet_copy_client.cc:323] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.130:44127
I20260709 13:18:02.039606 16095 raft_consensus.cc:2955] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:02.061877 14127 catalog_manager.cc:5697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.078718 16102 ts_tablet_manager.cc:933] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:02.083690 14314 tablet_copy_service.cc:140] P bee4f7fc1b4740dc875537c79309664f: Received BeginTabletCopySession request for tablet 18418e3cab2e42b1a301f8068587c987 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:45306)
I20260709 13:18:02.114526 14314 tablet_copy_service.cc:161] P bee4f7fc1b4740dc875537c79309664f: Beginning new tablet copy session on tablet 18418e3cab2e42b1a301f8068587c987 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:45306: session id = cebb34ac155340899a38c728707ddc0d-18418e3cab2e42b1a301f8068587c987
I20260709 13:18:02.090168 14375 raft_consensus.cc:2955] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:02.210323 14314 tablet_copy_source_session.cc:215] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:02.255834 14127 catalog_manager.cc:5697] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:02.276679 16102 tablet_copy_client.cc:323] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:18:02.317046 16098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18418e3cab2e42b1a301f8068587c987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.322094 14387 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet c93ab0fd97734540911af5bd148751d5 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:18:02.322718 14387 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet c93ab0fd97734540911af5bd148751d5 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-c93ab0fd97734540911af5bd148751d5
I20260709 13:18:02.327709 14377 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:02.335834 14387 tablet_copy_source_session.cc:215] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:02.352345 14297 raft_consensus.cc:2955] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:02.369601 14303 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:02.371774 16091 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:02.381572 16102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93ab0fd97734540911af5bd148751d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:02.387178 14341 consensus_peers.cc:597] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf37326f616a4b18aaaa6c2c405074bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:02.392275 14222 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:02.393718 15834 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:02.396327 16098 tablet_copy_client.cc:806] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:02.397043 16098 tablet_copy_client.cc:670] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:02.401337 15834 raft_consensus.cc:2955] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:02.414997 16098 tablet_copy_client.cc:538] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:02.455121 14124 catalog_manager.cc:5697] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.463971 14303 raft_consensus.cc:2955] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:02.526611 14222 raft_consensus.cc:2955] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:02.557674 16102 tablet_copy_client.cc:806] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:02.559881 16102 tablet_copy_client.cc:670] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:02.566955 16098 tablet_bootstrap.cc:492] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:18:02.569736 16102 tablet_copy_client.cc:538] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:02.580569 16115 ts_tablet_manager.cc:933] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
W20260709 13:18:02.599823 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 135090us
I20260709 13:18:02.607995 16102 tablet_bootstrap.cc:492] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:18:02.690155 16115 tablet_copy_client.cc:323] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:18:02.692750 14238 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet 2ac406834d504a57b52386e2ae4c5235 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:18:02.693370 14238 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet 2ac406834d504a57b52386e2ae4c5235 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-2ac406834d504a57b52386e2ae4c5235
I20260709 13:18:02.701766 14238 tablet_copy_source_session.cc:215] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:02.706808 16115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac406834d504a57b52386e2ae4c5235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.723670 14377 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:02.738194 16115 tablet_copy_client.cc:806] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:02.747838 14894 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:02.748194 16098 tablet_bootstrap.cc:492] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.747943 14303 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:02.738957 16115 tablet_copy_client.cc:670] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:02.751118 16027 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:02.749126 16098 tablet_bootstrap.cc:492] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:18:02.754662 16098 ts_tablet_manager.cc:1403] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.188s	user 0.030s	sys 0.000s
I20260709 13:18:02.756893 16115 tablet_copy_client.cc:538] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:02.753974 16092 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:18:02.757854 16098 raft_consensus.cc:359] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:02.787582 16098 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:18:02.791303 16098 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:02.785411 16115 tablet_bootstrap.cc:492] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:18:02.960711 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:02.978176 16124 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:18:02.984934 14303 raft_consensus.cc:2955] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:02.989259 16098 ts_tablet_manager.cc:1434] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.234s	user 0.007s	sys 0.001s
I20260709 13:18:02.981285 16027 raft_consensus.cc:2955] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:18:03.019775 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 107954us
I20260709 13:18:03.123027 14894 raft_consensus.cc:2955] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:03.132110 14314 tablet_copy_service.cc:342] P bee4f7fc1b4740dc875537c79309664f: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-18418e3cab2e42b1a301f8068587c987 received from {username='slave'} at 127.0.0.1:45306
I20260709 13:18:03.136904 14314 tablet_copy_service.cc:434] P bee4f7fc1b4740dc875537c79309664f: ending tablet copy session cebb34ac155340899a38c728707ddc0d-18418e3cab2e42b1a301f8068587c987 on tablet 18418e3cab2e42b1a301f8068587c987 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:18:03.194654 16102 tablet_bootstrap.cc:492] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:03.195678 16102 tablet_bootstrap.cc:492] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:18:03.196468 16102 ts_tablet_manager.cc:1403] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.589s	user 0.016s	sys 0.018s
I20260709 13:18:03.205754 16129 ts_tablet_manager.cc:933] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:03.245628 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47734.3us
I20260709 13:18:03.233129 16102 raft_consensus.cc:359] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:03.255549 16102 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:18:03.264006 16102 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:03.275605 16102 ts_tablet_manager.cc:1434] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.002s
I20260709 13:18:03.284583 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf13dfd8a7f54be7b9ae796572d0961b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:18:03.292142 14123 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 4 to 7, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 4 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:18:03.298789 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 355801us
I20260709 13:18:03.323589 14894 raft_consensus.cc:1217] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:18:03.324148 14375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65fa0102e1144f94a57015823294e331"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:18:03.324734 14375 raft_consensus.cc:606] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:03.345495 14369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:18:03.346365 14369 raft_consensus.cc:606] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:03.348778 16040 raft_consensus.cc:993] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:18:03.349553 16137 raft_consensus.cc:1081] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:18:03.360502 14369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:18:03.361302 14369 raft_consensus.cc:606] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:03.363824 14295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65fa0102e1144f94a57015823294e331"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:18:03.364626 14295 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:03.365041 14295 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.368175 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:03.369935 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:03.377224 14295 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:03.417651 14295 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:03.418061 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 173001us
I20260709 13:18:03.453373 14387 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-c93ab0fd97734540911af5bd148751d5 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:18:03.453933 14387 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-c93ab0fd97734540911af5bd148751d5 on tablet c93ab0fd97734540911af5bd148751d5 with peer cebb34ac155340899a38c728707ddc0d
W20260709 13:18:03.456418 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50325.5us
I20260709 13:18:03.458777 16091 raft_consensus.cc:993] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:18:03.459321 16091 raft_consensus.cc:1081] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:18:03.475920 16115 tablet_bootstrap.cc:492] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:03.476881 16115 tablet_bootstrap.cc:492] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:18:03.477560 16115 ts_tablet_manager.cc:1403] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.692s	user 0.022s	sys 0.011s
I20260709 13:18:03.486997 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:03.487676 14369 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:03.487984 14369 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:03.488941 16129 tablet_copy_client.cc:323] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:18:03.489463 14369 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:03.490228 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:03.490743 14894 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.490780 14369 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.496073 14229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53824
I20260709 13:18:03.496683 14229 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:03.497059 14229 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.499032 14369 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:03.502202 16136 raft_consensus.cc:993] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:18:03.502645 16136 raft_consensus.cc:1081] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:18:03.504043 14894 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:03.509480 14229 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:03.521590 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:03.522356 14369 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:03.522675 14369 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:03.523283 14229 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:03.524250 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:03.524374 14387 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet cf37326f616a4b18aaaa6c2c405074bf from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:18:03.526715 14894 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.532737 14387 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet cf37326f616a4b18aaaa6c2c405074bf from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-cf37326f616a4b18aaaa6c2c405074bf
I20260709 13:18:03.542868 14387 tablet_copy_source_session.cc:215] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:03.546096 16115 raft_consensus.cc:359] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:03.554263 16115 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:18:03.555073 16115 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:03.551520 14894 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:03.550328 14369 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:03.556049 16129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf37326f616a4b18aaaa6c2c405074bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.560063 14369 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.561265 16115 ts_tablet_manager.cc:1434] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.001s
I20260709 13:18:03.558933 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:03.562450 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:03.564343 14238 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-2ac406834d504a57b52386e2ae4c5235 received from {username='slave'} at 127.0.0.1:57812
I20260709 13:18:03.564790 14238 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-2ac406834d504a57b52386e2ae4c5235 on tablet 2ac406834d504a57b52386e2ae4c5235 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:18:03.564883 16134 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:03.565976 16134 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:03.566857 16134 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:03.567781 14369 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:03.568606 14229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53824
I20260709 13:18:03.569180 14229 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:03.569567 14229 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.563630 16107 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:03.570374 16107 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:03.571332 16107 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:03.577829 14894 raft_consensus.cc:1217] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:03.588145 14229 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:03.622682 14896 raft_consensus.cc:1217] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:03.622991 14229 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:03.625205 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:03.625890 14369 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:03.626183 14369 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:03.626868 14369 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:03.627657 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:03.628048 14369 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.628199 14295 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.645817 14369 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:03.647153 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:03.647996 16133 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:03.648432 16133 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:03.649731 14295 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:03.650477 16133 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:03.702332 16129 tablet_copy_client.cc:806] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:03.703027 16129 tablet_copy_client.cc:670] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:03.701381 14124 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 3, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.705260 14124 catalog_manager.cc:5697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 3, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.715401 16129 tablet_copy_client.cc:538] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:03.717289 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet bf13dfd8a7f54be7b9ae796572d0961b with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53822
I20260709 13:18:03.727545 16133 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:03.728161 16133 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:03.730506 14125 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.734151 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:03.735754 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:03.736272 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:03.738085 14192 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:03.738976 16107 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:03.741137 16133 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:03.763674 16146 raft_consensus.cc:1064] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:18:03.787559 16153 tablet_replica.cc:333] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:18:03.790910 16153 raft_consensus.cc:2243] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.796322 16153 raft_consensus.cc:2272] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.798310 16129 tablet_bootstrap.cc:492] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:18:03.803776 16146 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:03.819711 16153 ts_tablet_manager.cc:1916] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:03.847164 14894 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:03.849413 14229 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:03.852571 14369 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:03.874435 16121 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:03.877161 16121 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:03.882568 16121 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:03.885479 16153 ts_tablet_manager.cc:1929] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:18:03.888360 16153 log.cc:1199] T bf13dfd8a7f54be7b9ae796572d0961b P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/bf13dfd8a7f54be7b9ae796572d0961b
I20260709 13:18:03.898373 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet bf13dfd8a7f54be7b9ae796572d0961b (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:18:03.944505 16129 tablet_bootstrap.cc:492] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:03.945519 16129 tablet_bootstrap.cc:492] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:18:03.967052 16129 ts_tablet_manager.cc:1403] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.169s	user 0.020s	sys 0.009s
I20260709 13:18:03.968956 14369 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:03.970846 15982 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:04.009215 16109 raft_consensus.cc:1064] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:18:04.010349 16129 raft_consensus.cc:359] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:04.008870 14225 raft_consensus.cc:2955] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:04.011312 16129 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:18:04.012215 16109 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:04.012334 16129 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:04.019377 16129 ts_tablet_manager.cc:1434] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:18:04.020613 14894 raft_consensus.cc:2955] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:04.024343 14387 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-cf37326f616a4b18aaaa6c2c405074bf received from {username='slave'} at 127.0.0.1:37700
I20260709 13:18:04.024811 14387 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-cf37326f616a4b18aaaa6c2c405074bf on tablet cf37326f616a4b18aaaa6c2c405074bf with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:18:04.004968 16121 raft_consensus.cc:2955] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:04.089396 14896 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:04.097724 16146 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:04.092813 14125 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 4 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:04.103371 14375 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:04.117601 14375 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:04.119230 14896 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:04.119441 16133 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:04.123831 16133 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:04.128746 14295 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:04.112519 16107 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:18:04.131017 16109 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:04.149850 14893 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:04.151719 16107 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:04.195531 16133 raft_consensus.cc:2955] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:04.197649 14295 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:04.199316 16088 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:04.225574 14374 raft_consensus.cc:2955] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:04.226838 16092 raft_consensus.cc:1064] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:18:04.228828 16092 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:04.234850 14899 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:04.236950 16138 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:04.237375 14225 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:04.240322 16138 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:04.256646 14298 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:18:04.298813 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 53970.3us
W20260709 13:18:04.299450 16166 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 13:18:04.326457 16165 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:18:04.347338 14295 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:04.371032 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:04.384083 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 102731us
I20260709 13:18:04.394549 14369 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:04.418432 14298 raft_consensus.cc:2955] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:04.421106 14124 catalog_manager.cc:5697] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.441185 14229 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:18:04.455482 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 181165us
W20260709 13:18:04.456553 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 189133us
I20260709 13:18:04.458027 16137 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:04.597407 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 159006us
I20260709 13:18:04.691638 14894 raft_consensus.cc:2955] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:04.700023 14369 raft_consensus.cc:2955] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:04.722813 16193 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:04.751929 14893 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:18:04.793623 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 71773.3us
W20260709 13:18:04.821295 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 63385.8us
I20260709 13:18:04.705904 16119 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
W20260709 13:18:04.861312 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 399293us
I20260709 13:18:04.866174 14894 raft_consensus.cc:1217] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:18:04.918996 16200 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 13:18:04.950240 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 145832us
W20260709 13:18:05.016932 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 212068us
W20260709 13:18:05.021546 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 195235us
W20260709 13:18:05.025555 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56073.6us
I20260709 13:18:05.039383 16170 raft_consensus.cc:2955] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.052031 16200 raft_consensus.cc:2955] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.058612 14221 raft_consensus.cc:2955] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.096568 14297 raft_consensus.cc:2955] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:18:05.148456 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45862.4us
W20260709 13:18:05.150542 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 51806.9us
I20260709 13:18:05.220919 14112 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 18418e3cab2e42b1a301f8068587c987 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:18:05.236661 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 67811.2us
I20260709 13:18:05.254842 14124 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 5 to 6, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 3 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.270068 14893 raft_consensus.cc:2955] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:18:05.280676 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 123691us
I20260709 13:18:05.289197 14221 raft_consensus.cc:2955] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.311825 14894 raft_consensus.cc:2955] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.352440 16214 raft_consensus.cc:1064] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:18:05.357105 16214 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:05.427965 14229 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:05.458472 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet 18418e3cab2e42b1a301f8068587c987 with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47058
I20260709 13:18:05.666217 14893 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:05.669870 16202 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:05.670346 14125 catalog_manager.cc:5697] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.706395 14222 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:05.710067 16218 tablet_replica.cc:333] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:18:05.719328 16215 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:05.791409 14296 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:05.813431 16137 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:05.832412 14894 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:05.836509 16198 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:05.857945 14296 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:05.860422 16198 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:05.863770 16218 raft_consensus.cc:2243] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.871896 16218 raft_consensus.cc:2272] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.876521 16218 ts_tablet_manager.cc:1916] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:05.911717 14225 raft_consensus.cc:2955] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.908479 16172 raft_consensus.cc:2955] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.927786 16201 raft_consensus.cc:2955] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.929992 14295 raft_consensus.cc:2955] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.905771 14376 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:05.938005 14899 raft_consensus.cc:2955] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.943406 14894 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:05.946877 16181 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:05.948011 14302 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:05.954005 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ac406834d504a57b52386e2ae4c5235 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:05.959074 16202 raft_consensus.cc:2955] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.961261 14296 raft_consensus.cc:2955] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.968608 16181 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:05.968497 14899 raft_consensus.cc:2955] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.970774 14124 catalog_manager.cc:5697] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 3 to 4, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 1 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.980401 14302 raft_consensus.cc:2955] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:05.985898 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c93ab0fd97734540911af5bd148751d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:05.988270 16218 ts_tablet_manager.cc:1929] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:18:05.989555 16218 log.cc:1199] T 18418e3cab2e42b1a301f8068587c987 P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/18418e3cab2e42b1a301f8068587c987
I20260709 13:18:05.992763 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet 18418e3cab2e42b1a301f8068587c987 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:18:06.003973 14894 raft_consensus.cc:2955] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:06.008483 14125 catalog_manager.cc:5697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 3 to 4, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.038056 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ac406834d504a57b52386e2ae4c5235 with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47058
I20260709 13:18:06.039120 16218 tablet_replica.cc:333] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:18:06.040288 16218 raft_consensus.cc:2243] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.041282 16218 raft_consensus.cc:2272] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.067859 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet c93ab0fd97734540911af5bd148751d5 with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53822
I20260709 13:18:06.071936 16218 ts_tablet_manager.cc:1916] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:06.083771 14124 catalog_manager.cc:5697] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:06.106305 16226 tablet_replica.cc:333] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:18:06.107853 16226 raft_consensus.cc:2243] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.109257 16226 raft_consensus.cc:2272] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.115232 14376 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:06.126767 14894 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:06.129115 16179 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:06.136909 14295 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:06.142324 16181 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:06.146044 16172 raft_consensus.cc:2955] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:06.153127 14894 raft_consensus.cc:2955] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:06.154954 14302 raft_consensus.cc:2955] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:06.178969 16226 ts_tablet_manager.cc:1916] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:06.201195 14127 catalog_manager.cc:5697] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 4 to 5, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:06.205049 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf37326f616a4b18aaaa6c2c405074bf with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:06.219514 14212 tablet_service.cc:1558] Processing DeleteTablet for tablet cf37326f616a4b18aaaa6c2c405074bf with delete_type TABLET_DATA_TOMBSTONED (TS a9b2cf49ceed478480fb0f27ccf55d81 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53822
I20260709 13:18:06.211804 16218 ts_tablet_manager.cc:1929] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:06.224138 16218 log.cc:1199] T 2ac406834d504a57b52386e2ae4c5235 P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/2ac406834d504a57b52386e2ae4c5235
I20260709 13:18:06.228638 16226 ts_tablet_manager.cc:1929] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:06.231040 16226 log.cc:1199] T c93ab0fd97734540911af5bd148751d5 P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/c93ab0fd97734540911af5bd148751d5
I20260709 13:18:06.232604 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet 2ac406834d504a57b52386e2ae4c5235 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:18:06.233119 16226 tablet_replica.cc:333] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:18:06.233455 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet c93ab0fd97734540911af5bd148751d5 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:18:06.256428 16226 raft_consensus.cc:2243] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.257822 16226 raft_consensus.cc:2272] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.268007 16226 ts_tablet_manager.cc:1916] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:06.337088 16226 ts_tablet_manager.cc:1929] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:18:06.343415 16226 log.cc:1199] T cf37326f616a4b18aaaa6c2c405074bf P a9b2cf49ceed478480fb0f27ccf55d81: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/wals/cf37326f616a4b18aaaa6c2c405074bf
I20260709 13:18:06.345943 14114 catalog_manager.cc:5028] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): tablet cf37326f616a4b18aaaa6c2c405074bf (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:18:06.629945 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:06.716555 14295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:18:06.717296 14295 raft_consensus.cc:606] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:06.727988 14227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:18:06.728610 14227 raft_consensus.cc:606] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:06.731741 14227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:18:06.732342 14227 raft_consensus.cc:606] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
I20260709 13:18:06.736084 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:06.738030 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:06.744632 16121 raft_consensus.cc:993] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:18:06.745203 16163 raft_consensus.cc:1081] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:18:06.748560 14227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:53830
I20260709 13:18:06.749176 14227 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.749532 14227 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.757185 14227 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:06.764822 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:06.765621 14295 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:06.765956 14295 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:06.766800 14295 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:06.767907 14295 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.771173 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:06.771898 14376 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.858453 14227 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:06.864799 14376 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:06.928290 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:06.932003 16201 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:06.932629 16201 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:06.936375 16201 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:06.951411 14295 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:07.100692 16201 raft_consensus.cc:993] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:18:07.148386 14125 catalog_manager.cc:5697] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 3 to 4, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 4 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.166333 16232 raft_consensus.cc:1081] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
W20260709 13:18:07.230835 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 139380us
I20260709 13:18:07.279994 14896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50026
I20260709 13:18:07.280802 14896 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:07.281251 14896 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.306231 16229 raft_consensus.cc:993] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:18:07.306902 16229 raft_consensus.cc:1081] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:18:07.329865 14896 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:07.334169 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:07.334767 14227 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:07.335083 14227 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:07.335582 14373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:47084
I20260709 13:18:07.336241 14373 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:07.335889 14227 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:07.336660 14373 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.337049 14227 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.344866 14373 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:07.347128 14227 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:07.355219 14867 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:07.355437 14373 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:07.356290 16241 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:07.356484 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:07.357895 14297 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.357033 16241 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:07.357316 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:07.363762 14227 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:07.364156 14227 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:07.364131 16241 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:07.365166 14227 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:07.365638 14896 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:07.375211 14227 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.368129 14297 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:07.370589 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:07.382180 14373 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.389042 14342 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:07.390249 16235 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:07.390787 16235 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:07.391861 16235 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:07.392446 14373 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:07.394017 14227 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:07.440229 14127 catalog_manager.cc:5697] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:07.440907 14123 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 3, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 3 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:07.472383 14297 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:07.474172 16232 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:07.532606 14374 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:07.534300 16245 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:07.637928 14225 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:07.739233 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:07.742694 14376 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:07.752339 16245 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:07.758201 14192 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f6f055b9cea4c76a10e5e5ecf91ffc9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.758781 14227 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:07.760454 16241 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:07.765357 14295 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:07.767163 16247 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:07.788275 16232 raft_consensus.cc:2955] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:07.797724 14297 raft_consensus.cc:2955] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:07.805318 14302 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.807003 16172 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.816283 14374 raft_consensus.cc:2955] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:07.845389 14127 catalog_manager.cc:5697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:07.901441 14303 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:07.929921 14225 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.931300 16172 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:07.938216 14267 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c137013238f4b1dbae260e32cb316dc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.941138 14374 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:07.942826 16243 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.957767 14376 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:07.959291 16241 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:07.960292 14225 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:07.961699 16243 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:18:07.973587 14374 raft_consensus.cc:2955] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
W20260709 13:18:08.002247 16260 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:18:07.972625 16121 raft_consensus.cc:2955] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
W20260709 13:18:08.066234 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59714.1us
I20260709 13:18:08.085430 14125 catalog_manager.cc:5697] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
W20260709 13:18:08.118345 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 108476us
W20260709 13:18:08.121809 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60659.1us
I20260709 13:18:08.126406 14222 raft_consensus.cc:2955] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:08.129853 14376 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:18:08.253396 14341 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37975f772fc648329a8acae36d33a345. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:08.253836 14303 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:08.255359 14222 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:08.255234 16235 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:08.257762 16235 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:08.282647 16234 raft_consensus.cc:2955] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:08.288801 14303 raft_consensus.cc:2955] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:08.314924 14222 raft_consensus.cc:2955] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:08.325331 14127 catalog_manager.cc:5697] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 2, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 1 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.333707 14376 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:08.352622 16279 ts_tablet_manager.cc:933] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:18:08.375494 16279 tablet_copy_client.cc:323] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.129:38445
I20260709 13:18:08.377645 14238 tablet_copy_service.cc:140] P a9b2cf49ceed478480fb0f27ccf55d81: Received BeginTabletCopySession request for tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:57812)
I20260709 13:18:08.378278 14238 tablet_copy_service.cc:161] P a9b2cf49ceed478480fb0f27ccf55d81: Beginning new tablet copy session on tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:57812: session id = cebb34ac155340899a38c728707ddc0d-0f6f055b9cea4c76a10e5e5ecf91ffc9
I20260709 13:18:08.392587 14238 tablet_copy_source_session.cc:215] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:08.398641 14303 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:08.400235 16242 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:08.403110 14341 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4e025a69a5c42f3be03aeed0ac9a998. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:08.403596 16281 ts_tablet_manager.cc:933] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:08.406100 16279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.429136 16235 raft_consensus.cc:2955] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:08.431085 14297 raft_consensus.cc:2955] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:08.446980 14227 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:08.448639 16278 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:08.455472 14127 catalog_manager.cc:5697] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.455992 14227 raft_consensus.cc:2955] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:18:08.463001 16281 tablet_copy_client.cc:323] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.130:44127
I20260709 13:18:08.465358 14314 tablet_copy_service.cc:140] P bee4f7fc1b4740dc875537c79309664f: Received BeginTabletCopySession request for tablet 8c137013238f4b1dbae260e32cb316dc from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:45306)
I20260709 13:18:08.465976 14314 tablet_copy_service.cc:161] P bee4f7fc1b4740dc875537c79309664f: Beginning new tablet copy session on tablet 8c137013238f4b1dbae260e32cb316dc from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:45306: session id = cebb34ac155340899a38c728707ddc0d-8c137013238f4b1dbae260e32cb316dc
I20260709 13:18:08.484542 16279 tablet_copy_client.cc:806] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:08.485296 16279 tablet_copy_client.cc:670] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:08.491055 16279 tablet_copy_client.cc:538] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:08.494989 14314 tablet_copy_source_session.cc:215] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:08.529281 14376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47058
I20260709 13:18:08.529906 14376 raft_consensus.cc:606] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:18:08.534351 14376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47058
I20260709 13:18:08.534956 14376 raft_consensus.cc:606] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:18:08.536201 14111 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for a4e025a69a5c42f3be03aeed0ac9a998 already in progress
I20260709 13:18:08.534974 16281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c137013238f4b1dbae260e32cb316dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.558938 14376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47058
I20260709 13:18:08.559536 14376 raft_consensus.cc:606] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:18:08.565966 14175 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:18:08.566349 14175 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for a4e025a69a5c42f3be03aeed0ac9a998 already in progress
W20260709 13:18:08.566664 14175 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for a4e025a69a5c42f3be03aeed0ac9a998 already in progress
I20260709 13:18:08.573259 16279 tablet_bootstrap.cc:492] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:18:08.592352 16281 tablet_copy_client.cc:806] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:08.592981 16281 tablet_copy_client.cc:670] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:08.613920 16281 tablet_copy_client.cc:538] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:08.641840 16281 tablet_bootstrap.cc:492] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:18:08.696573 16279 tablet_bootstrap.cc:492] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:08.697641 16279 tablet_bootstrap.cc:492] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:18:08.698446 16279 ts_tablet_manager.cc:1403] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.126s	user 0.027s	sys 0.002s
I20260709 13:18:08.701692 16279 raft_consensus.cc:359] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:08.727337 16279 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:18:08.728157 16279 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:08.750715 16279 ts_tablet_manager.cc:1434] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:18:08.754683 16281 tablet_bootstrap.cc:492] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:08.755755 16281 tablet_bootstrap.cc:492] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:18:08.758498 16281 ts_tablet_manager.cc:1403] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.117s	user 0.020s	sys 0.005s
I20260709 13:18:08.766973 16281 raft_consensus.cc:359] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:08.767964 16281 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:18:08.774947 14238 tablet_copy_service.cc:342] P a9b2cf49ceed478480fb0f27ccf55d81: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-0f6f055b9cea4c76a10e5e5ecf91ffc9 received from {username='slave'} at 127.0.0.1:57812
I20260709 13:18:08.778049 14238 tablet_copy_service.cc:434] P a9b2cf49ceed478480fb0f27ccf55d81: ending tablet copy session cebb34ac155340899a38c728707ddc0d-0f6f055b9cea4c76a10e5e5ecf91ffc9 on tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:18:08.778272 16281 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:08.780311 16281 ts_tablet_manager.cc:1434] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.001s
I20260709 13:18:08.782200 14314 tablet_copy_service.cc:342] P bee4f7fc1b4740dc875537c79309664f: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-8c137013238f4b1dbae260e32cb316dc received from {username='slave'} at 127.0.0.1:45306
I20260709 13:18:08.782672 14314 tablet_copy_service.cc:434] P bee4f7fc1b4740dc875537c79309664f: ending tablet copy session cebb34ac155340899a38c728707ddc0d-8c137013238f4b1dbae260e32cb316dc on tablet 8c137013238f4b1dbae260e32cb316dc with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:18:08.812536 16279 ts_tablet_manager.cc:933] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:08.836817 16281 ts_tablet_manager.cc:933] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:08.844426 16279 tablet_copy_client.cc:323] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:18:08.847836 14387 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet 37975f772fc648329a8acae36d33a345 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:18:08.848454 14387 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet 37975f772fc648329a8acae36d33a345 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-37975f772fc648329a8acae36d33a345
I20260709 13:18:08.860896 16281 tablet_copy_client.cc:323] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:18:08.866909 14387 tablet_copy_source_session.cc:215] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:08.880498 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet a4e025a69a5c42f3be03aeed0ac9a998 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:18:08.881366 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet a4e025a69a5c42f3be03aeed0ac9a998 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-a4e025a69a5c42f3be03aeed0ac9a998
I20260709 13:18:08.895985 14388 tablet_copy_source_session.cc:215] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:08.903858 16281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e025a69a5c42f3be03aeed0ac9a998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.906430 16279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37975f772fc648329a8acae36d33a345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.924643 14896 raft_consensus.cc:1217] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:18:08.932480 16242 raft_consensus.cc:993] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:18:08.932977 16242 raft_consensus.cc:1081] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:18:08.934051 16281 tablet_copy_client.cc:806] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:08.935669 16281 tablet_copy_client.cc:670] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:08.942108 14297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:18:08.942710 14297 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:08.943315 14297 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.965983 16279 tablet_copy_client.cc:806] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:08.996887 14896 raft_consensus.cc:1217] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:09.005122 16279 tablet_copy_client.cc:670] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:09.012164 16281 tablet_copy_client.cc:538] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:09.012715 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:09.027226 16281 tablet_bootstrap.cc:492] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:18:09.050863 14297 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:09.061896 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:09.062505 14222 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.063836 14297 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:09.064769 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:09.065318 14373 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:09.065611 14373 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:09.066356 14373 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:09.067348 14373 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.081459 14222 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:09.083472 14270 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:09.084553 16163 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:09.085049 16163 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:09.095777 14373 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:09.085904 16163 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:18:09.132879 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45559.3us
W20260709 13:18:09.141100 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 70738.4us
I20260709 13:18:09.131436 14125 catalog_manager.cc:5697] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 2 to 3, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 3 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.199062 16279 tablet_copy_client.cc:538] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:18:09.234382 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 82422.3us
W20260709 13:18:09.247519 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 89408.2us
I20260709 13:18:09.368518 16281 tablet_bootstrap.cc:492] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:18:09.372184 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 62993.1us
W20260709 13:18:09.376068 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47995.3us
W20260709 13:18:09.389964 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 58356.9us
I20260709 13:18:09.398293 16281 tablet_bootstrap.cc:492] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:18:09.399181 16281 ts_tablet_manager.cc:1403] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.372s	user 0.030s	sys 0.008s
W20260709 13:18:09.430275 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 70626.5us
I20260709 13:18:09.432010 14376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:18:09.432637 14376 raft_consensus.cc:606] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
W20260709 13:18:09.435599 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50873.6us
I20260709 13:18:09.437887 14222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f80782a117e14a308698329b8639179e"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:18:09.438470 14222 raft_consensus.cc:606] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:09.446401 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:09.448148 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:09.452351 16279 tablet_bootstrap.cc:492] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:18:09.475087 16281 raft_consensus.cc:359] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:09.476272 16281 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
W20260709 13:18:09.485072 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 53063.1us
W20260709 13:18:09.497906 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 67936.3us
I20260709 13:18:09.477135 16281 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:18:09.518651 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 47684.4us
I20260709 13:18:09.543751 16281 ts_tablet_manager.cc:1434] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.144s	user 0.008s	sys 0.000s
I20260709 13:18:09.578824 14374 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:09.580417 16307 raft_consensus.cc:1064] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:18:09.580776 16247 raft_consensus.cc:993] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:18:09.581310 16247 raft_consensus.cc:1081] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:18:09.582756 16307 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:09.599507 16163 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:09.617756 14302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f80782a117e14a308698329b8639179e"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:54360
I20260709 13:18:09.618583 14302 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:09.619011 14302 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.631111 14302 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:09.633625 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:09.634277 14229 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:09.634593 14229 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:09.645658 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-a4e025a69a5c42f3be03aeed0ac9a998 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:18:09.646191 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-a4e025a69a5c42f3be03aeed0ac9a998 on tablet a4e025a69a5c42f3be03aeed0ac9a998 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:18:09.646234 14229 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:09.647451 14229 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.647385 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:09.650799 14896 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.654359 14894 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Advancing to term 3
I20260709 13:18:09.661378 14896 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:09.672528 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:09.676621 14894 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 3 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:09.685961 14227 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:09.688452 14899 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:09.692109 16307 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:09.694917 14376 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:09.697886 16307 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:09.716638 16238 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:09.708881 16289 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:09.718075 14303 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:09.723290 14229 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
W20260709 13:18:09.728863 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.731205 14302 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:09.724215 16289 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:09.746850 16289 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:09.748083 16314 raft_consensus.cc:1064] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:18:09.725343 16163 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:18:09.730050 16247 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:18:09.770816 16314 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:10.023293 16313 raft_consensus.cc:993] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:18:10.023829 16313 raft_consensus.cc:1081] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
W20260709 13:18:10.349313 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 341941us
I20260709 13:18:10.454253 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:10.500324 16289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.001s	sys 0.016s
W20260709 13:18:10.528237 16289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.001s	sys 0.017s
I20260709 13:18:10.754695 14894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50016
I20260709 13:18:10.755523 14894 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.755970 14894 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.827752 14894 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:10.840435 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 72490.1us
I20260709 13:18:10.905375 14377 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:10.906844 14895 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:18:10.907274 16331 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 13:18:10.919471 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 100778us
I20260709 13:18:10.861351 16172 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:10.967585 16290 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:18:10.925892 16330 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:10.997035 16330 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:10.968746 16327 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 13:18:10.957108 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 670) took 1182 ms. Trace:
I20260709 13:18:11.004287 14893 rpcz_store.cc:276] 0709 13:18:09.767372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.770512 (+  3140us) service_pool.cc:224] Handling call
0709 13:18:09.771062 (+   550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.771594 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.790975 (+ 19381us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.871132 (+ 80157us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.157571 (+286439us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:10.169074 (+ 11503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.172301 (+  3227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.908249 (+735948us) raft_consensus.cc:1685] finished
0709 13:18:10.908268 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.949297 (+ 41029us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":789,"raft.queue_time_us":10017,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":4681,"thread_start_us":88507,"threads_started":1,"wal-append.queue_time_us":651147}
W20260709 13:18:11.000345 16326 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:18:10.949100 16333 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.000962 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:10.978412 16340 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:11.003059 16336 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:11.024296 16336 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:11.003402 16325 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 13:18:10.987247 16172 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:10.968398 16338 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:18:11.028861 16172 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.029670 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 1852) took 1288 ms. Trace:
I20260709 13:18:11.030138 16242 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.030200 14376 rpcz_store.cc:276] 0709 13:18:09.740840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.741857 (+  1017us) service_pool.cc:224] Handling call
0709 13:18:09.742364 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.777688 (+ 35324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.777737 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.779095 (+  1358us) log.cc:844] Serialized 572 byte log entry
0709 13:18:09.890908 (+111813us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:09.890954 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.891030 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.029417 (+1138387us) raft_consensus.cc:1685] finished
0709 13:18:11.029438 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.029577 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":111405,"threads_started":1,"wal-append.queue_time_us":914499}
I20260709 13:18:11.021899 16307 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:11.030967 16242 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:11.001876 16330 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.039026 14894 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:11.033723 16333 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:11.048195 16333 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:11.048254 16242 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:11.051496 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:11.054905 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:11.092913 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2038) took 1290 ms. Trace:
I20260709 13:18:11.093583 14302 rpcz_store.cc:276] 0709 13:18:09.782229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.782845 (+   616us) service_pool.cc:224] Handling call
0709 13:18:09.783392 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.783851 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.783895 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.785209 (+  1314us) log.cc:844] Serialized 572 byte log entry
0709 13:18:09.910440 (+125231us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:09.910491 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.910580 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.071842 (+1161262us) raft_consensus.cc:1685] finished
0709 13:18:11.071873 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.072063 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":124797,"threads_started":1,"wal-append.queue_time_us":865903}
I20260709 13:18:11.034380 16307 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.038458 16340 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:11.100090 16340 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:11.100119 16343 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.059127 16330 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.100874 16343 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.101212 16330 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:11.101816 16336 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:11.102825 16294 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.103570 16294 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.105356 16344 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.106063 16344 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.106604 16307 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.107558 16343 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.112793 16289 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.113603 16289 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.108531 16344 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.116227 16289 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.123108 16294 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:11.123971 16294 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:11.124598 16294 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.127120 16290 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.128262 16247 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.127976 16290 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:11.127240 16348 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.129032 16247 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.185743 14222 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:11.103919 16330 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:11.189296 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 156756us
W20260709 13:18:11.189802 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 152642us
I20260709 13:18:11.194973 16344 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:11.223682 16289 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:11.226296 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 381768us
I20260709 13:18:11.232323 16290 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:11.232918 16354 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:11.235224 16247 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.232972 16290 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:11.237756 16290 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.240098 16290 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:11.269109 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 47497us
I20260709 13:18:11.219079 16330 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.221590 16314 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.221818 16340 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:11.292390 16335 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.297124 16347 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.293120 16335 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:11.306695 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 78859.7us
I20260709 13:18:11.233507 16354 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:11.340458 16354 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:11.206241 16348 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.342929 16348 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.297808 16347 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.350029 16290 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:11.349867 16247 raft_consensus.cc:2955] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:11.352227 16346 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.350842 16290 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.358680 16269 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.229696 16344 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.352975 16346 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:11.387326 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 117162us
I20260709 13:18:11.388577 16361 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.299095 16330 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.267009 16289 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.367645 16294 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:11.393486 16242 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.396816 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:11.394377 16343 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:11.357347 16340 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:11.420846 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 43753.7us
I20260709 13:18:11.404856 16289 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.359274 16269 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.408154 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:11.408272 16297 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.437973 14220 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:11.459363 16363 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.460240 16363 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.309449 16314 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:11.464829 16342 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.493443 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:11.429440 16343 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:11.494974 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:11.390522 16361 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.415380 16242 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:11.496456 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67777.3us
W20260709 13:18:11.515774 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 285329us
I20260709 13:18:11.492936 16294 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.519209 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:11.519250 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:11.498956 16342 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.508808 16330 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.435251 16297 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:11.515461 16358 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:18:11.525502 14372 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:18:11.525709 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:11.663945 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:11.515957 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:11.545897 16364 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.691144 16297 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:11.690994 16364 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.661011 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:11.663774 16368 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.694391 16368 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:11.625805 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 109430us
I20260709 13:18:11.602018 16370 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.698108 16370 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:11.701234 16370 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:11.707964 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:11.711740 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:11.712617 14302 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:18:11.715952 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:11.716992 14302 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:18:11.697616 16368 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:11.571177 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:11.729868 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:11.571712 16346 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.754189 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:11.754879 16346 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.567734 16232 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:11.664201 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:11.517724 16347 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.523635 16348 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:11.640318 16345 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:11.683856 16344 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.677289 16269 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:11.776678 16361 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.788803 16364 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.661190 16363 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.660451 16302 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:11.894451 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 314641us
I20260709 13:18:11.825695 14220 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:11.751591 16290 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.846841 16297 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:11.921141 16297 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:11.661068 16340 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:11.854809 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 365488us
I20260709 13:18:11.858917 16303 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.660897 16335 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:11.853086 16289 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.755645 16346 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.885957 16314 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:11.886272 16242 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:11.887362 16247 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.002s
I20260709 13:18:11.934916 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:11.878882 14898 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:11.525686 16294 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.795300 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:11.837263 16348 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:11.779817 16232 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:12.317034 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.244679 16342 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:11.887615 16345 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:12.329844 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:12.062450 16330 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.319921 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:12.330727 14376 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:18:12.322151 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:12.331781 14371 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:12.332254 14371 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:12.333138 14371 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.172302 16373 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:11.872483 16368 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:12.319340 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.019s	sys 0.016s
I20260709 13:18:11.922737 16343 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:12.346776 14897 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:12.245643 16310 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:18:12.338783 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.019s	sys 0.016s
W20260709 13:18:12.353765 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 605658us
I20260709 13:18:12.340283 16358 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.338274 16315 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:12.347512 16330 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.363288 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:12.341265 16368 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.367427 16330 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:12.367978 16368 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:12.338666 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:12.349354 16346 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:12.337719 16289 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:12.350499 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.370268 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 1586) took 1078 ms. Trace:
I20260709 13:18:12.219839 16352 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:12.358006 16314 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:12.360494 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:12.363744 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.159317 16290 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:12.180251 16379 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:12.357286 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:12.370635 14229 rpcz_store.cc:276] 0709 13:18:11.292291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.294297 (+  2006us) service_pool.cc:224] Handling call
0709 13:18:12.350353 (+1056056us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:12.370200 (+ 19847us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52686720}
I20260709 13:18:12.250937 16375 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.335485 16354 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:12.179471 16372 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:12.062866 16303 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.336306 14895 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:18:12.389050 14297 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:12.423727 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:12.394222 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:12.390337 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.373354 16385 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:11.936791 16302 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:12.425594 14229 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 1.
I20260709 13:18:12.370294 16358 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:12.427750 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:12.479590 16354 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.481727 16368 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.482263 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.482355 16368 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:12.482975 14223 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:18:12.483502 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 1988) took 1139 ms. Trace:
I20260709 13:18:12.483888 14223 rpcz_store.cc:276] 0709 13:18:11.344167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.481958 (+1137791us) service_pool.cc:224] Handling call
0709 13:18:12.483436 (+  1478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.424467 16352 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.484548 16368 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:12.485178 16367 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.427277 16242 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:12.484959 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.334879 16373 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.487222 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:12.481798 14376 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:12.489235 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 403) took 1193 ms. Trace:
I20260709 13:18:12.452471 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:12.427872 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:12.391863 16343 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:12.374033 16315 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.492379 16335 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:12.503871 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1574) took 1484 ms. Trace:
I20260709 13:18:12.507551 14229 rpcz_store.cc:276] 0709 13:18:11.295556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.390082 (+1094526us) service_pool.cc:224] Handling call
0709 13:18:12.489177 (+ 99095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.507975 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:12.510653 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 82871.2us
I20260709 13:18:12.511307 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:12.512207 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:12.483532 16354 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:12.427040 16346 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.509171 14227 rpcz_store.cc:276] 0709 13:18:11.019776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.020607 (+   831us) service_pool.cc:224] Handling call
0709 13:18:11.021029 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.115576 (+ 94547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.115615 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.115676 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:11.115728 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.503579 (+1387851us) spinlock_profiling.cc:243] Waited 94.3 ms on lock 0x7b540033cf54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:12.503631 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.503805 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216801664}
I20260709 13:18:12.510120 14376 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:12.522418 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:12.423158 16290 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:12.530969 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:12.509676 16297 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:12.534263 16371 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:12.494304 16379 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.498167 16375 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.495528 16385 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.562353 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:12.536062 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:12.509927 16343 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:12.479796 16377 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.539064 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.526922 16346 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:12.548949 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:12.373772 16310 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.513489 16359 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:12.515491 16242 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.573443 16380 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:12.573678 16382 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.487944 16372 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.524703 16279 tablet_bootstrap.cc:492] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:12.529672 16335 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.570942 16390 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.571024 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.557621 16232 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:12.565977 16342 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:12.565426 16343 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.563375 16371 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:12.583505 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:12.591022 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.513924 16367 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:12.579298 16381 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.579312 16294 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:12.576926 16348 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:12.591903 14223 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:12.574213 16380 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.584734 16359 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:12.584988 16289 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:12.584167 16242 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:12.607501 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.589262 16303 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:12.589496 16232 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.593487 16371 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.612679 16386 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:12.614574 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.613262 16378 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:12.574285 16382 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:12.606398 16290 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:12.623945 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:12.632927 16373 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:12.633373 16385 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:12.651775 16372 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:12.624640 14300 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:12.622439 16279 tablet_bootstrap.cc:492] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:18:12.593063 16342 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:12.655656 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 124812us
I20260709 13:18:12.606812 16359 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:12.633622 16373 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:12.666267 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.608328 16302 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:12.678781 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.684113 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.685031 14223 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:12.688448 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 398) took 1394 ms. Trace:
I20260709 13:18:12.689117 14223 rpcz_store.cc:276] 0709 13:18:11.294296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.685960 (+1391664us) service_pool.cc:224] Handling call
0709 13:18:12.686362 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.687948 (+  1586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.687994 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.688055 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:12.688134 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.688217 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.688375 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.692709 14376 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:12.691321 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:12.673214 16359 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:12.696236 14370 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:12.622668 16232 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:12.696959 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.576779 16377 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:12.673616 16373 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:12.701443 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:12.653407 16378 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:12.712922 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:12.713874 14370 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 1.
I20260709 13:18:12.698578 16279 ts_tablet_manager.cc:1403] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 3.246s	user 0.047s	sys 0.048s
I20260709 13:18:12.705178 16393 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:12.718122 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:12.690778 16367 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:12.600167 16390 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.712270 16373 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.723605 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:12.723605 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:12.765247 14370 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:12.735847 14125 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36074 (request call id 211) took 1269 ms. Trace:
I20260709 13:18:12.763151 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:12.768987 16394 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:12.770744 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 399) took 1476 ms. Trace:
I20260709 13:18:12.772857 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1576) took 1673 ms. Trace:
I20260709 13:18:12.771346 14223 rpcz_store.cc:276] 0709 13:18:11.294615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.769651 (+1475036us) service_pool.cc:224] Handling call
0709 13:18:12.770037 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.770249 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.770287 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.770355 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:12.770423 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.770501 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.770667 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.773311 14221 rpcz_store.cc:276] 0709 13:18:11.022056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.024212 (+  2156us) service_pool.cc:224] Handling call
0709 13:18:11.024576 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.097439 (+ 72863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.097487 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.097546 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:11.097623 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.694773 (+1597150us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b5400051754. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:12.694844 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.695026 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166948224}
I20260709 13:18:12.787734 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 397) took 1493 ms. Trace:
I20260709 13:18:12.800216 14226 rpcz_store.cc:276] 0709 13:18:11.293986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.296868 (+  2882us) service_pool.cc:224] Handling call
0709 13:18:12.694902 (+1398034us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:12.787060 (+ 92158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.787261 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.787289 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.787334 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:12.787377 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.787438 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.787556 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47270784}
I20260709 13:18:12.703668 16315 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:12.788558 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:12.715488 16378 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.788694 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:13.007023 14300 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:12.737874 16304 raft_consensus.cc:1064] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
W20260709 13:18:12.722895 16389 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:18:12.783656 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:12.791292 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 400) took 1496 ms. Trace:
I20260709 13:18:12.767215 14125 rpcz_store.cc:276] 0709 13:18:11.466481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.504296 (+ 37815us) service_pool.cc:224] Handling call
0709 13:18:12.735679 (+1231383us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:18:13.011103 14896 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:18:12.654219 16381 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:12.726949 16302 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:12.793503 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 75498.8us
I20260709 13:18:13.011529 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:13.011015 14223 rpcz_store.cc:276] 0709 13:18:11.294871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.773645 (+1478774us) service_pool.cc:224] Handling call
0709 13:18:12.790697 (+ 17052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.790903 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.790933 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.790981 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:12.791054 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.791123 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.791235 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.009758 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 1987) took 1701 ms. Trace:
I20260709 13:18:13.019217 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 691) took 1090 ms. Trace:
I20260709 13:18:13.021009 14896 rpcz_store.cc:276] 0709 13:18:11.921458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.923090 (+  1632us) service_pool.cc:224] Handling call
0709 13:18:12.783489 (+860399us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:13.011717 (+228228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7150464}
I20260709 13:18:12.769680 16394 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.024305 16353 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:13.024854 16353 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:13.025288 16353 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.738471 16375 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:13.026031 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:12.785181 16279 raft_consensus.cc:359] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:13.019982 14226 rpcz_store.cc:276] 0709 13:18:11.308213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.801766 (+1493553us) service_pool.cc:224] Handling call
0709 13:18:13.009211 (+207445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.009378 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.009401 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.009453 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.009491 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.009547 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.009691 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.683485 16386 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:12.737731 16392 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:12.737573 16393 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.204674 14300 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:13.206019 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:13.206755 14300 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:13.207381 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 531) took 3401 ms. Trace:
I20260709 13:18:13.208025 14369 rpcz_store.cc:276] 0709 13:18:09.805530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.805679 (+   149us) service_pool.cc:224] Handling call
0709 13:18:11.409392 (+1603713us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67f8c 00007f8de9f67ef6 0000000000375939 00007f8df1fdb1e0 00007f8df20a40c4 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:11.409570 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.522030 (+112460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.522057 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.522092 (+    35us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:11.522130 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.206969 (+1684839us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001b9ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:13.207033 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.207179 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328578944}
I20260709 13:18:13.207919 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:13.213202 14300 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
W20260709 13:18:13.034145 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 330923us
I20260709 13:18:13.028784 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 1989) took 1587 ms. Trace:
I20260709 13:18:13.262444 14223 rpcz_store.cc:276] 0709 13:18:11.441040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.019803 (+1578763us) service_pool.cc:224] Handling call
0709 13:18:13.028166 (+  8363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.028378 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.028414 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.028469 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.028518 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.028587 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.028715 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.332998 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 405) took 1877 ms. Trace:
I20260709 13:18:13.333560 14223 rpcz_store.cc:276] 0709 13:18:11.455417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.263842 (+1808425us) service_pool.cc:224] Handling call
0709 13:18:13.332338 (+ 68496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.332563 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.332598 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.332665 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.332714 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.332784 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.332926 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.383909 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 406) took 1928 ms. Trace:
I20260709 13:18:13.384474 14223 rpcz_store.cc:276] 0709 13:18:11.455756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.344531 (+1888775us) service_pool.cc:224] Handling call
0709 13:18:13.383213 (+ 38682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.383465 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.383500 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.383552 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.383621 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.383690 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.383834 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.330790 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:13.390717 14369 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:13.081386 16382 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.082652 16390 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.473135 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:13.083518 16379 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:13.131383 16398 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:13.560683 14369 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 1.
I20260709 13:18:13.561589 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 1870) took 1030 ms. Trace:
I20260709 13:18:13.261994 16279 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:18:13.562235 14369 rpcz_store.cc:276] 0709 13:18:12.531629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.472770 (+941141us) service_pool.cc:224] Handling call
0709 13:18:13.561502 (+ 88732us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.562799 16279 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:13.339637 16342 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:13.031334 16302 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:13.567245 16279 ts_tablet_manager.cc:1434] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.846s	user 0.016s	sys 0.036s
W20260709 13:18:13.567684 16279 ts_tablet_manager.cc:1467] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Tablet startup took 852ms
I20260709 13:18:13.478889 16232 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.388176 16392 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:13.578004 16392 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.488540 16380 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:13.492177 16377 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.494467 16394 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:13.513542 16391 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
W20260709 13:18:13.514245 14867 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.051s
I20260709 13:18:13.507315 16308 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:13.580705 16308 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.585219 16386 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:13.601887 16308 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:13.609323 16343 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.007s	user 0.013s	sys 0.046s
I20260709 13:18:13.548921 16381 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.560942 16398 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.475522 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2045) took 1626 ms. Trace:
I20260709 13:18:13.631672 14300 rpcz_store.cc:276] 0709 13:18:11.848996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.388113 (+1539117us) service_pool.cc:224] Handling call
0709 13:18:13.474795 (+ 86682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.475062 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.475102 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.475159 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.475220 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.475293 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.475446 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.572830 16302 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:13.574316 16393 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:13.033129 16346 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:13.580056 14867 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.011s	sys 0.051s
I20260709 13:18:13.508932 16375 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:13.633759 16398 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:13.634109 14267 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 2.165s (SENT) [suppressed 9 similar messages]
W20260709 13:18:13.636866 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 710432us
I20260709 13:18:13.634711 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2046) took 1779 ms. Trace:
I20260709 13:18:13.640255 14300 rpcz_store.cc:276] 0709 13:18:11.855780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.633143 (+1777363us) service_pool.cc:224] Handling call
0709 13:18:13.633565 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.634266 (+   701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.634297 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.634353 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:13.634411 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.634493 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.634636 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:13.610256 16378 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.004s
I20260709 13:18:13.641494 16378 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:13.643036 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2047) took 1780 ms. Trace:
W20260709 13:18:13.612484 16359 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.896s	user 0.004s	sys 0.007s
I20260709 13:18:13.644183 16378 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:13.644618 16359 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:13.643667 14300 rpcz_store.cc:276] 0709 13:18:11.862234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.641420 (+1779186us) service_pool.cc:224] Handling call
0709 13:18:13.642248 (+   828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.642564 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.642604 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.642663 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:13.642731 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.642806 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.642950 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:13.548265 16371 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.921s	user 0.009s	sys 0.000s
I20260709 13:18:13.647801 16371 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:13.648617 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2077) took 1734 ms. Trace:
W20260709 13:18:13.568136 16279 ts_tablet_manager.cc:1469] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Trace:
0709 13:18:08.811787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.811930 (+   143us) service_pool.cc:224] Handling call
0709 13:18:08.812934 (+  1004us) ts_tablet_manager.cc:934] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
0709 13:18:08.905089 (+ 92155us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:08.944352 (+ 39263us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:08.944518 (+   166us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:08.964942 (+ 20424us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:08.965267 (+   325us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:08.965636 (+   369us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:08.965711 (+    75us) inbound_call.cc:177] Queueing success response
0709 13:18:09.451981 (+486270us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:18:12.721385 (+3269404us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:18:12.782259 (+ 60874us) tablet_replica.cc:261] Starting instrumentation
0709 13:18:12.783090 (+   831us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":242,"raft.queue_time_us":1695,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"tablet-copy.queue_time_us":120,"tablet-download-pool.queue_time_us":128,"tablet-download-pool.run_cpu_time_us":1390,"tablet-download-pool.run_wall_time_us":153575,"thread_start_us":30594,"threads_started":1}
I20260709 13:18:13.651906 16343 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:13.656556 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.095s	user 0.011s	sys 0.029s
W20260709 13:18:13.657155 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.012s	sys 0.029s
I20260709 13:18:13.658103 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:13.658710 14229 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 1.
I20260709 13:18:13.014642 16335 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:13.660893 16358 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.013433 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 401) took 1718 ms. Trace:
I20260709 13:18:13.661342 16346 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:13.662220 16346 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:13.663070 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 1868) took 1154 ms. Trace:
I20260709 13:18:13.663462 14376 rpcz_store.cc:276] 0709 13:18:12.509113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.535781 (+ 26668us) service_pool.cc:224] Handling call
0709 13:18:13.631080 (+1095299us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54002ecf54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:13.662984 (+ 31904us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296934656}
W20260709 13:18:13.541760 16373 consensus_meta.cc:287] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.751s	user 0.008s	sys 0.000s
I20260709 13:18:13.665134 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 1858) took 1488 ms. Trace:
I20260709 13:18:13.665241 16373 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:13.626853 16353 consensus_meta.cc:287] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.006s
I20260709 13:18:13.635655 16375 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:13.665778 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:13.685943 14295 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
W20260709 13:18:13.686555 14295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 239) took 1839 ms (client timeout 2240 ms). Trace:
W20260709 13:18:13.687021 14295 rpcz_store.cc:269] 0709 13:18:11.846717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.851434 (+  4717us) service_pool.cc:224] Handling call
0709 13:18:13.665650 (+1814216us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:13.686466 (+ 20816us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161730816}
I20260709 13:18:13.665531 14376 rpcz_store.cc:276] 0709 13:18:12.176919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.664267 (+1487348us) service_pool.cc:224] Handling call
0709 13:18:13.664596 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.664797 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.664824 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.664873 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:13.664921 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.664980 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.665086 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.687738 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:13.688573 16393 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:13.688727 14376 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:13.689368 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 1863) took 1355 ms. Trace:
I20260709 13:18:13.689692 14376 rpcz_store.cc:276] 0709 13:18:12.334009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.688240 (+1354231us) service_pool.cc:224] Handling call
0709 13:18:13.688550 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.689140 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.689318 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.690757 16359 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:13.691108 14376 raft_consensus.cc:2955] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:13.676093 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 547) took 1704 ms. Trace:
I20260709 13:18:13.676560 16375 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.694840 16343 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.677352 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 548) took 1633 ms. Trace:
I20260709 13:18:13.661571 14221 rpcz_store.cc:276] 0709 13:18:11.295112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.799995 (+1504883us) service_pool.cc:224] Handling call
0709 13:18:13.012759 (+212764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.013001 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.013042 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.013100 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.013158 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.013232 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.013364 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.695363 14375 rpcz_store.cc:276] 0709 13:18:12.044133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.044271 (+   138us) service_pool.cc:224] Handling call
0709 13:18:13.676443 (+1632172us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:13.676639 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.676857 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.676880 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.676923 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.676964 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.677030 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.677162 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8353664}
I20260709 13:18:13.696460 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:13.697140 14221 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:13.697491 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 550) took 1143 ms. Trace:
I20260709 13:18:13.682524 16371 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:13.671115 14223 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:13.698052 14375 rpcz_store.cc:276] 0709 13:18:12.553605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.696576 (+1142971us) service_pool.cc:224] Handling call
0709 13:18:13.696919 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.697114 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.697149 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.697195 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.697231 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.697292 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.697421 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:13.670863 14220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 402) took 2375 ms (client timeout 1888 ms). Trace:
I20260709 13:18:13.699869 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 1991) took 2209 ms. Trace:
W20260709 13:18:13.699834 14220 rpcz_store.cc:269] 0709 13:18:11.295332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.406223 (+110891us) service_pool.cc:224] Handling call
0709 13:18:13.670668 (+2264445us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b54002779d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:13.670790 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23040256}
I20260709 13:18:13.700321 14223 rpcz_store.cc:276] 0709 13:18:11.490084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.385597 (+1895513us) service_pool.cc:224] Handling call
0709 13:18:13.670841 (+285244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.698987 (+ 28146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.699658 (+   671us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002779d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:13.699815 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647763200}
I20260709 13:18:13.674736 14894 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:13.702827 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 625) took 2326 ms. Trace:
I20260709 13:18:13.703153 14894 rpcz_store.cc:276] 0709 13:18:11.376409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.377400 (+   991us) service_pool.cc:224] Handling call
0709 13:18:13.674274 (+2296874us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:13.674494 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.702542 (+ 28048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.702734 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16235392}
I20260709 13:18:13.704216 14371 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.704609 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1597) took 1783 ms. Trace:
I20260709 13:18:13.681901 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2040) took 1834 ms. Trace:
I20260709 13:18:13.705013 14223 rpcz_store.cc:276] 0709 13:18:11.921462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.701226 (+1779764us) service_pool.cc:224] Handling call
0709 13:18:13.701536 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.701718 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.701741 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.701779 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:13.704389 (+  2610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.704452 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.704556 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7424}
I20260709 13:18:13.678735 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:13.707871 14303 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:13.682941 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 545) took 1747 ms. Trace:
I20260709 13:18:13.649168 14300 rpcz_store.cc:276] 0709 13:18:11.913881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.647619 (+1733738us) service_pool.cc:224] Handling call
0709 13:18:13.648008 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.648224 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.648260 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.648313 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:13.648363 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.648430 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.648556 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:13.708417 14303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 238) took 1871 ms (client timeout 1868 ms). Trace:
I20260709 13:18:13.630247 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 689) took 1716 ms. Trace:
I20260709 13:18:13.697993 14369 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:13.709008 14303 rpcz_store.cc:269] 0709 13:18:11.836638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.837764 (+  1126us) service_pool.cc:224] Handling call
0709 13:18:13.666284 (+1828520us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:13.708353 (+ 42069us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2865408}
I20260709 13:18:13.709918 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:13.694507 14373 rpcz_store.cc:276] 0709 13:18:11.971667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.316858 (+345191us) service_pool.cc:224] Handling call
0709 13:18:12.729760 (+412902us) spinlock_profiling.cc:243] Waited 880 us on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:13.631203 (+901443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.631385 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.631411 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.631454 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.631504 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.631559 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.675931 (+ 44372us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54002ecf50. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:13.676031 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074467456}
I20260709 13:18:13.684996 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:13.714753 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2079) took 1782 ms. Trace:
I20260709 13:18:13.705928 14301 rpcz_store.cc:276] 0709 13:18:11.847393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.849423 (+  2030us) service_pool.cc:224] Handling call
0709 13:18:13.671536 (+1822113us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:13.671715 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.671885 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.671910 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.671947 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:13.681523 (+  9576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.681599 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.681720 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7121152}
I20260709 13:18:13.664386 16346 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.719332 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1592) took 2073 ms. Trace:
I20260709 13:18:13.725813 14221 rpcz_store.cc:276] 0709 13:18:11.646054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.697768 (+2051714us) service_pool.cc:224] Handling call
0709 13:18:13.718851 (+ 21083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.719024 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.719049 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.719088 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.719125 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.719173 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.719277 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.727995 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1600) took 1387 ms. Trace:
I20260709 13:18:13.728417 14221 rpcz_store.cc:276] 0709 13:18:12.341021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.726884 (+1385863us) service_pool.cc:224] Handling call
0709 13:18:13.727205 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.727413 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.727448 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.727675 (+   227us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:13.727727 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.727800 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.727930 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.723186 14295 rpcz_store.cc:276] 0709 13:18:11.932888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.713963 (+1781075us) service_pool.cc:224] Handling call
0709 13:18:13.714285 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.714443 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.714467 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.714506 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.714538 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.714599 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.714700 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.715364 14377 rpcz_store.cc:276] 0709 13:18:11.935749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.935905 (+   156us) service_pool.cc:224] Handling call
0709 13:18:13.682271 (+1746366us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:13.682452 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.682645 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.682671 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.682708 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.682744 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.682797 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.682891 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36806016}
I20260709 13:18:13.721515 14226 raft_consensus.cc:2376] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3. Re-sending same reply.
I20260709 13:18:13.743834 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1598) took 1700 ms. Trace:
I20260709 13:18:13.744266 14223 rpcz_store.cc:276] 0709 13:18:12.043508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.707252 (+1663744us) service_pool.cc:224] Handling call
0709 13:18:13.743376 (+ 36124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.743585 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.743604 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.743634 (+    30us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.743658 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.743697 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.743776 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.670202 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:13.745941 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:13.748117 16386 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.748667 16386 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.716540 16373 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.750257 16373 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:13.750526 16380 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:13.751075 16386 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:13.676991 16353 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.752082 16336 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:13.750777 16373 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.752626 16336 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.753283 16402 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:13.745824 16403 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:13.765158 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1595) took 1868 ms. Trace:
I20260709 13:18:13.765527 14220 rpcz_store.cc:276] 0709 13:18:11.896997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.701164 (+1804167us) service_pool.cc:224] Handling call
0709 13:18:13.701567 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.701760 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.701805 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.702317 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.732376 (+ 30059us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:13.732436 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.732621 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.764844 (+ 32223us) raft_consensus.cc:1685] finished
0709 13:18:13.764966 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.765107 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":29582,"threads_started":1,"wal-append.queue_time_us":46376}
I20260709 13:18:13.766780 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 408) took 1218 ms. Trace:
I20260709 13:18:13.767308 14221 rpcz_store.cc:276] 0709 13:18:12.548350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.729509 (+1181159us) service_pool.cc:224] Handling call
0709 13:18:13.766218 (+ 36709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.766436 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.766459 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.766494 (+    35us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.766545 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.766604 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.766709 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:13.752856 14224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 1588) took 2459 ms (client timeout 1677 ms). Trace:
I20260709 13:18:13.754902 14301 raft_consensus.cc:2955] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:13.770058 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 1869) took 1248 ms. Trace:
I20260709 13:18:13.771394 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2080) took 1834 ms. Trace:
I20260709 13:18:13.771862 16337 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:13.771827 14295 rpcz_store.cc:276] 0709 13:18:11.937302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.730005 (+1792703us) service_pool.cc:224] Handling call
0709 13:18:13.770925 (+ 40920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.771096 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.771125 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.771164 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.771201 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.771252 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.771343 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.772452 16337 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.772879 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:13.773646 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2054) took 1526 ms. Trace:
I20260709 13:18:13.774035 14295 rpcz_store.cc:276] 0709 13:18:12.247540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.772905 (+1525365us) service_pool.cc:224] Handling call
0709 13:18:13.773193 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.773351 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.773374 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.773411 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:13.773445 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.773492 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.773582 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.775627 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2056) took 1527 ms. Trace:
I20260709 13:18:13.775539 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:13.775980 16337 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.776568 16337 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.777154 16337 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.776163 14295 rpcz_store.cc:276] 0709 13:18:12.248174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.774893 (+1526719us) service_pool.cc:224] Handling call
0709 13:18:13.775183 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.775354 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.775374 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.775409 (+    35us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.775444 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.775489 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.775575 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.778716 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:13.779235 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2083) took 1407 ms. Trace:
I20260709 13:18:13.780836 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:13.771076 14376 rpcz_store.cc:276] 0709 13:18:12.521518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.690520 (+1169002us) service_pool.cc:224] Handling call
0709 13:18:13.690795 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.690998 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:13.764063 (+ 73065us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.769733 (+  5670us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.769804 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:13.769857 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.769918 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.770014 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1091,"thread_start_us":5335,"threads_started":1}
I20260709 13:18:13.779635 14295 rpcz_store.cc:276] 0709 13:18:12.371410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.778458 (+1407048us) service_pool.cc:224] Handling call
0709 13:18:13.778764 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.778934 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.778958 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.778997 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.779032 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.779084 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.779181 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.796070 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:13.797314 14223 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.780020 14894 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 3: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:13.797171 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:13.758334 16386 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:13.754956 16353 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:13.769466 14224 rpcz_store.cc:269] 0709 13:18:11.292910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.306697 (+ 13787us) service_pool.cc:224] Handling call
0709 13:18:13.669892 (+2363195us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:13.752769 (+ 82877us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55719808}
I20260709 13:18:13.800036 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:13.717203 14892 rpcz_store.cc:276] 0709 13:18:11.913459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.922738 (+  9279us) service_pool.cc:224] Handling call
0709 13:18:13.629133 (+1706395us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:13.629429 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.629703 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.629744 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.629826 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:13.629891 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.629976 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.630156 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27185920}
I20260709 13:18:13.758132 16341 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:13.805673 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:13.806108 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:13.805727 16341 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:13.807868 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:13.780172 16337 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.809113 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:13.802784 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2051) took 1586 ms. Trace:
I20260709 13:18:13.810074 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:13.781510 16346 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:13.811128 14371 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:13.821617 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 1857) took 1665 ms. Trace:
I20260709 13:18:13.824038 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:13.826915 14369 rpcz_store.cc:276] 0709 13:18:12.155769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.563364 (+1407595us) service_pool.cc:224] Handling call
0709 13:18:13.563741 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.718962 (+155221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.821362 (+102400us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540039b7d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:13.821540 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308289920}
I20260709 13:18:13.809931 14300 rpcz_store.cc:276] 0709 13:18:12.216339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.762377 (+1546038us) service_pool.cc:224] Handling call
0709 13:18:13.802368 (+ 39991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.802515 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.802530 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.802600 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:13.802624 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.802659 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.802741 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.827977 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:13.817917 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2043) took 1969 ms. Trace:
I20260709 13:18:13.825449 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:13.816838 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.810943 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:13.798776 16343 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:13.828608 14296 rpcz_store.cc:276] 0709 13:18:11.848288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.849552 (+  1264us) service_pool.cc:224] Handling call
0709 13:18:13.817163 (+1967611us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:13.817353 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.817539 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.817569 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.817611 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.817653 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.817723 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.817855 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23117184}
I20260709 13:18:13.799571 16393 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:13.840903 14371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 541) took 1913 ms (client timeout 1888 ms). Trace:
I20260709 13:18:13.906021 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:13.751124 16380 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.804092 16340 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:13.909832 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:13.831784 14225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 1585) took 2540 ms (client timeout 1691 ms). Trace:
I20260709 13:18:13.836184 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:13.907788 14226 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:13.905810 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:13.834825 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:13.917858 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2087) took 1332 ms. Trace:
I20260709 13:18:13.918217 14894 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:13.919772 14376 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:13.769090 16402 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:13.833770 14369 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:13.812031 16381 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:13.920827 14296 rpcz_store.cc:276] 0709 13:18:12.585463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.909485 (+1324022us) service_pool.cc:224] Handling call
0709 13:18:13.917021 (+  7536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.917492 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.917516 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.917565 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.917603 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.917656 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.917775 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.936873 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:13.920318 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2084) took 1547 ms. Trace:
W20260709 13:18:13.919202 14225 rpcz_store.cc:269] 0709 13:18:11.291910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.299861 (+  7951us) service_pool.cc:224] Handling call
0709 13:18:13.825280 (+2525419us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:13.831713 (+  6433us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48256896}
I20260709 13:18:13.909813 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:13.937672 14295 rpcz_store.cc:276] 0709 13:18:12.372585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.824250 (+1451665us) service_pool.cc:224] Handling call
0709 13:18:13.920008 (+ 95758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.920125 (+   117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.920139 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.920164 (+    25us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:13.920182 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.920213 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.920279 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.927953 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:13.812250 16232 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.811550 16407 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:13.938094 14896 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:13.938886 14369 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:13.927937 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:13.940901 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:13.941639 14369 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.833408 16382 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.908702 16351 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:13.770316 16403 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.829582 16401 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.812247 16341 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:13.908538 14371 rpcz_store.cc:269] 0709 13:18:11.913636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.914876 (+  1240us) service_pool.cc:224] Handling call
0709 13:18:13.704001 (+1789125us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b58001ba7d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8decfe80aa 00007f8ded06a447 00007f8ded082fe7 00007f8ded0847de 00007f8ded09027c 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c
0709 13:18:13.826957 (+122956us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056302976}
I20260709 13:18:13.922542 16374 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.940462 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:13.905387 16388 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:18:13.943369 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:13.905247 16337 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:13.940887 16232 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:13.949563 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2058) took 1158 ms. Trace:
I20260709 13:18:13.956282 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:13.956956 14296 rpcz_store.cc:276] 0709 13:18:12.791617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.943931 (+1152314us) service_pool.cc:224] Handling call
0709 13:18:13.949079 (+  5148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.949255 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.949280 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.949318 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.949354 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.949405 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.949500 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.954391 14373 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:13.810484 16386 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.818418 16392 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.958233 14375 raft_consensus.cc:2376] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3. Re-sending same reply.
I20260709 13:18:13.944177 16382 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:13.927649 16343 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:13.959918 16337 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:13.966506 16343 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.966609 16337 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:13.951030 16401 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:13.967376 16401 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.964392 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2041) took 1983 ms. Trace:
I20260709 13:18:13.964238 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:13.969611 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:13.960090 16232 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.922648 16393 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:13.988441 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1599) took 1647 ms. Trace:
I20260709 13:18:14.014209 14229 rpcz_store.cc:276] 0709 13:18:12.340668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.720174 (+1379506us) service_pool.cc:224] Handling call
0709 13:18:13.720646 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.720958 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.721822 (+   864us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.722865 (+  1043us) log.cc:844] Serialized 572 byte log entry
0709 13:18:13.766563 (+ 43698us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:13.766592 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.766645 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.988222 (+221577us) raft_consensus.cc:1685] finished
0709 13:18:13.988241 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.988379 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":43429,"threads_started":1,"wal-append.queue_time_us":182491}
I20260709 13:18:13.971553 16382 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.968402 14299 rpcz_store.cc:276] 0709 13:18:11.847695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.849194 (+  1499us) service_pool.cc:224] Handling call
0709 13:18:13.829998 (+1980804us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:13.830180 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.830366 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.830391 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.830430 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:13.830468 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.830518 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.830638 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1167093504}
I20260709 13:18:13.834259 16346 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.013090 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:13.957368 16374 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:14.021531 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 688) took 2240 ms. Trace:
W20260709 13:18:14.020498 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 192574us
I20260709 13:18:14.030120 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.019651 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:13.940418 16407 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.030736 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:13.963711 16392 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:14.033330 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.034037 14896 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:14.033667 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.029769 14900 rpcz_store.cc:276] 0709 13:18:11.781190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.781985 (+   795us) service_pool.cc:224] Handling call
0709 13:18:14.020838 (+2238853us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:14.021046 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.021228 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.021255 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.021294 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.021331 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.021380 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.021480 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43433856}
I20260709 13:18:14.037698 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:14.047154 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-37975f772fc648329a8acae36d33a345 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:18:14.023372 16374 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.047792 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-37975f772fc648329a8acae36d33a345 on tablet 37975f772fc648329a8acae36d33a345 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:18:14.048486 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:13.960355 16351 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.036087 16392 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.049819 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.050055 16409 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:14.054102 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:14.054313 16340 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:14.055305 16340 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:14.057260 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.057596 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2050) took 1904 ms. Trace:
I20260709 13:18:14.058081 14301 rpcz_store.cc:276] 0709 13:18:12.152845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.752901 (+1600056us) service_pool.cc:224] Handling call
0709 13:18:13.754604 (+  1703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.754798 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:14.031738 (+276940us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.053529 (+ 21791us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.053586 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:14.057333 (+  3747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.057421 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.057537 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":114,"thread_start_us":16744,"threads_started":1}
I20260709 13:18:14.021536 16403 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:14.061023 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.061708 14225 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:18:14.048175 16381 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:14.046478 16386 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:14.057965 16343 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:14.076510 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.073958 16381 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:14.056221 16340 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:14.079684 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.079803 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.065590 16346 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:14.076867 16343 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:14.093322 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.093422 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.094026 14296 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:14.080761 16381 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:14.080286 16402 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:14.101455 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:14.102280 14375 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:14.091174 14900 raft_consensus.cc:2955] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:14.099761 16407 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:14.093772 16343 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.114931 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.115489 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.115701 14225 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:14.112689 14369 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:14.107937 16340 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:14.121137 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.127782 14223 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:14.128726 16393 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:14.131675 16351 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:14.136296 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.136969 14374 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:14.137853 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.138489 14371 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:14.144625 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 543) took 2220 ms. Trace:
I20260709 13:18:14.148219 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.146844 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1583) took 2927 ms. Trace:
I20260709 13:18:14.149632 14222 rpcz_store.cc:276] 0709 13:18:11.219676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.220587 (+   911us) service_pool.cc:224] Handling call
0709 13:18:11.220847 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.394091 (+173244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.394128 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.394171 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:11.394212 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.146476 (+2752264us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400135bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:14.146545 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.146762 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397952384}
I20260709 13:18:14.158960 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 1856) took 2070 ms. Trace:
I20260709 13:18:14.145264 14372 rpcz_store.cc:276] 0709 13:18:11.924507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.924644 (+   137us) service_pool.cc:224] Handling call
0709 13:18:14.143619 (+2218975us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:14.143893 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.144147 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.144185 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.144249 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.144310 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.144394 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.144546 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12476288}
I20260709 13:18:14.159644 14378 rpcz_store.cc:276] 0709 13:18:12.088395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.504312 (+415917us) service_pool.cc:224] Handling call
0709 13:18:12.504672 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.567768 (+ 63096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.567818 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.567878 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:12.567939 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.158611 (+1590672us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b54002594d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:14.158697 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.158877 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144481024}
I20260709 13:18:14.186877 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1587) took 2859 ms. Trace:
I20260709 13:18:14.187402 14228 rpcz_store.cc:276] 0709 13:18:11.292626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.296567 (+  3941us) service_pool.cc:224] Handling call
0709 13:18:12.349151 (+1052584us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:12.349365 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.351266 (+  1901us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:12.358756 (+  7490us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.441858 (+ 83102us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.441942 (+    84us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:12.442010 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.151386 (+1709376us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b54002765d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:14.151439 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.151573 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":890,"prepare.queue_time_us":7390,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":56668,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"spinlock_wait_cycles":52108928,"thread_start_us":72832,"threads_started":2,"wal-append.queue_time_us":157167,"wal-append.run_cpu_time_us":3246,"wal-append.run_wall_time_us":1615991}
W20260709 13:18:14.219882 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.225132 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.229759 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:14.228477 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.239281 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.230156 14123 catalog_manager.cc:5697] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.240083 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:14.137622 16232 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:14.250613 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 106698us
I20260709 13:18:14.252727 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.239001 16346 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:14.250010 14344 connection.cc:256] RPC call timeout handler was delayed by -1.2960040620000655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 13:18:14.260154 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.261438 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.243003 16332 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:14.268684 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.262894 14344 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:14.261438 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.267731 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.268644 16401 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.279747 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.269061 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.270010 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.279778 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:14.238315 16341 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:18:14.250785 16356 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:14.285357 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.283907 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 236) took 2437 ms. Trace:
I20260709 13:18:14.289069 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.291165 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.257436 16346 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:14.287569 16299 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:14.288290 16334 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:14.243595 16306 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:14.341938 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2044) took 2392 ms. Trace:
I20260709 13:18:14.331945 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.292073 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:14.361403 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 240) took 2514 ms. Trace:
I20260709 13:18:14.314282 14298 rpcz_store.cc:276] 0709 13:18:11.789681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.790173 (+   492us) service_pool.cc:224] Handling call
0709 13:18:14.215701 (+2425528us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:14.215985 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.216236 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.216276 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.216367 (+    91us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.216425 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.216505 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.227217 (+ 10712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5698816}
I20260709 13:18:14.374248 14302 rpcz_store.cc:276] 0709 13:18:11.847098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.849362 (+  2264us) service_pool.cc:224] Handling call
0709 13:18:14.360695 (+2511333us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:14.360877 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.361048 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.361075 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.361114 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.361150 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.361231 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.361342 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4305152}
I20260709 13:18:14.374608 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.374894 16247 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:14.286016 16332 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:14.379175 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 87210.6us
W20260709 13:18:14.342303 16411 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
W20260709 13:18:14.343086 16412 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:18:14.337350 16346 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:14.394335 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.371100 14304 rpcz_store.cc:276] 0709 13:18:11.848621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.848933 (+   312us) service_pool.cc:224] Handling call
0709 13:18:11.879716 (+ 30783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.490221 (+610505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.490254 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.490293 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:12.490341 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.240601 (+1750260us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54001a0ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:14.240652 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.240783 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403538304}
I20260709 13:18:14.342226 16299 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:14.394409 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.406978 14375 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:14.378922 16339 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:14.332139 16356 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:14.413923 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.381699 16247 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:14.394912 16385 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:14.435146 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.435899 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.437268 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.342978 16334 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.438074 14302 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:14.418390 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:14.410647 16299 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.444978 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:14.445924 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 103846us
W20260709 13:18:14.446180 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 183352us
I20260709 13:18:14.446837 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:14.447427 14296 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:14.429603 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.451375 14342 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:14.441469 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:14.442324 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 682) took 2860 ms. Trace:
I20260709 13:18:14.443140 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.443336 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.452360 14899 rpcz_store.cc:276] 0709 13:18:11.582352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.582509 (+   157us) service_pool.cc:224] Handling call
0709 13:18:11.583196 (+   687us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.583653 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.583692 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.022224 (+2438532us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b4c00300240. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb358a20 00007f8deb369a29 00007f8deb32f644 00007f8deb356f2d 00007f8deb356b93 00007f8ded08718b 00007f8ded087cb5 00007f8ded089004 00007f8ded088729 00007f8ded08dd96 00007f8ded082adb
0709 13:18:14.023962 (+  1738us) log.cc:844] Serialized 572 byte log entry
0709 13:18:14.093153 (+ 69191us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:14.093201 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.093337 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.436463 (+343126us) raft_consensus.cc:1685] finished
0709 13:18:14.436491 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.442244 (+  5753us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45604224,"thread_start_us":28372,"threads_started":1,"wal-append.queue_time_us":175436}
I20260709 13:18:14.457655 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:14.432638 16247 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:14.460615 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:14.461247 16420 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:14.432466 16385 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:14.459707 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.469998 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:14.470352 16334 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:14.471822 16334 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:14.472354 16334 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:14.474983 16332 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:14.475596 16332 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:14.475944 16332 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:14.476342 16332 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.478726 14228 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:14.479406 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.486860 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:14.526687 16414 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:18:14.438035 16339 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.530124 16334 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:14.531857 16339 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:14.534941 16332 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.536454 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.537734 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.538784 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.542590 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:14.479058 16232 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:14.573704 14228 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:14.563724 14900 raft_consensus.cc:1217] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:14.538956 16356 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:14.538476 16332 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:14.579918 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:14.579948 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 128644us
I20260709 13:18:14.468152 16385 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:14.596695 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:14.600371 14296 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
W20260709 13:18:14.603854 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 133924us
I20260709 13:18:14.604802 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:18:14.607455 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 223143us
I20260709 13:18:14.611419 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:14.613561 14373 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.611068 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:14.609426 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:14.620332 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:14.632445 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.632691 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.633800 14373 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:14.636206 14374 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:14.602406 16421 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:14.637107 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.637897 14369 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 2: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:14.608963 16401 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:14.638417 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.613144 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.640508 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.640566 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.641810 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.641989 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.642879 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:14.644969 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.645283 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.649247 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:14.651110 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.641119 16311 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:14.637987 16425 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:14.654682 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.637733 16419 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:14.653862 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59427.8us
I20260709 13:18:14.647177 16339 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:14.647541 16401 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:14.663496 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 51346.5us
W20260709 13:18:14.661444 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52141.4us
I20260709 13:18:14.667457 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.668612 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.664883 14270 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:14.653463 16311 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:14.663560 14893 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 2: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:14.659296 16419 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:14.664021 16381 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.000s
I20260709 13:18:14.675830 14867 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:14.672492 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:14.677007 16403 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:14.659046 16425 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:14.662765 16339 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:14.663836 16401 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:14.689692 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 692) took 2767 ms. Trace:
I20260709 13:18:14.696689 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.679353 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.681246 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.694121 16351 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:14.696389 14901 rpcz_store.cc:276] 0709 13:18:11.921819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.922726 (+   907us) service_pool.cc:224] Handling call
0709 13:18:12.320002 (+397276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.528561 (+208559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.528602 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.528657 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:12.528709 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.689328 (+2160619us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540030c5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:14.689371 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.689506 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479100416}
I20260709 13:18:14.700127 16388 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:14.700487 16339 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.701403 14371 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:14.690984 16403 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:14.703482 16374 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.000s
I20260709 13:18:14.696700 16425 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:14.704411 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.705215 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:14.705991 16382 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.690s	user 0.005s	sys 0.005s
I20260709 13:18:14.706393 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.706836 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.706847 16381 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.708648 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.710129 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.710219 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.665954 16247 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:14.712919 16380 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:14.676672 16311 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:14.713730 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:14.739557 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.740388 14371 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 2: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:14.691671 16419 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:14.742183 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.742887 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.723034 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:14.745517 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.746490 14371 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:14.730934 16392 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.002s
I20260709 13:18:14.723357 16388 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:14.725298 16403 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:14.726330 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:14.714413 16401 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.730533 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.728889 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:14.733031 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:14.738289 14897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 690) took 2810 ms (client timeout 1854 ms). Trace:
W20260709 13:18:14.726312 16343 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 13:18:14.692414 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:14.723742 16421 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:14.726393 16351 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:18:14.758052 14897 rpcz_store.cc:269] 0709 13:18:11.921107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.922816 (+  1709us) service_pool.cc:224] Handling call
0709 13:18:14.731681 (+2808865us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b54006bcbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:14.731789 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35147136}
I20260709 13:18:14.725558 16304 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.767304 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.731027 16299 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:14.766172 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:14.735635 16374 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.771337 14301 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:14.771771 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79409.4us
I20260709 13:18:14.739658 16382 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.756412 16420 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:14.772853 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:14.756713 16388 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:14.764341 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:14.788725 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:14.790982 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 77326us
I20260709 13:18:14.770231 16351 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.794580 16436 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:14.794957 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2085) took 2372 ms. Trace:
I20260709 13:18:14.795360 14300 rpcz_store.cc:276] 0709 13:18:12.422200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.828305 (+1406105us) service_pool.cc:224] Handling call
0709 13:18:14.794290 (+965985us) spinlock_profiling.cc:243] Waited 6.56 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:14.794476 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.794647 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.794674 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.794713 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:14.794754 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.794806 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.794901 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15090432}
I20260709 13:18:14.773386 16380 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:14.799841 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 418) took 1001 ms. Trace:
I20260709 13:18:14.767652 16434 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:14.802459 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:14.771798 16310 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:14.755224 16392 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.803483 14220 rpcz_store.cc:276] 0709 13:18:13.798073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.798254 (+   181us) service_pool.cc:224] Handling call
0709 13:18:13.809761 (+ 11507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.945835 (+136074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.945866 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.945910 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:13.945948 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.799627 (+853679us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540033ed54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:14.799686 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.799789 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312414464}
I20260709 13:18:14.806476 16430 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:14.814878 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:14.807845 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.807054 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.815965 14900 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:14.769552 16343 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.792066 16347 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:14.820190 16357 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:14.798048 16373 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:14.787994 16420 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:14.831826 14223 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:14.775619 16385 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:14.824095 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.831140 16420 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.820938 16430 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:14.818841 16380 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:14.830649 16347 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:18:14.933599 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 118774us
I20260709 13:18:14.934222 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 624) took 1024 ms. Trace:
W20260709 13:18:14.935420 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 218190us
I20260709 13:18:14.935027 14894 rpcz_store.cc:276] 0709 13:18:13.910287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.933044 (+1022757us) service_pool.cc:224] Handling call
0709 13:18:14.933725 (+   681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.933922 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.933945 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.933987 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.934018 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.934066 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.934168 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.935907 14225 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:14.816919 16436 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:18:14.937511 14270 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:14.940726 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.840711 16352 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:14.904657 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.943650 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.933272 16347 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.962889 14373 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:18:14.936715 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.971017 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.973573 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:14.937587 16357 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:14.936826 16437 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:15.014739 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:15.018808 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.939116 16351 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:14.973683 16247 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.026846 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:14.908098 16421 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:15.059089 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 121983us
I20260709 13:18:15.030316 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:15.061002 14223 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.056573 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.062270 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.062855 14894 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:14.978164 14895 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:14.938117 16432 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
W20260709 13:18:15.067205 16435 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:18:15.069839 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:15.071115 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 406311us
I20260709 13:18:15.023504 16436 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.073719 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.077633 14193 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.079367 14193 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.062119 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:15.080138 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 143621us
I20260709 13:18:15.080968 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.082182 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.083091 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.083451 14377 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.084784 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 694) took 1178 ms. Trace:
I20260709 13:18:15.085316 16351 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:15.085223 14892 rpcz_store.cc:276] 0709 13:18:13.906873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.908561 (+  1688us) service_pool.cc:224] Handling call
0709 13:18:13.950387 (+ 41826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.017551 (+ 67164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.018743 (+  1192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.022844 (+  4101us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.028288 (+  5444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.084548 (+1056260us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54005212d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:15.084599 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.084723 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36149120}
I20260709 13:18:15.086095 16341 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.086810 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.087234 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:15.088317 16374 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:15.090587 16343 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:15.091166 16357 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.093343 16393 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:15.093851 16393 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:15.094614 16392 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:15.094523 16311 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.095718 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:15.096776 16311 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:15.098435 16345 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.104928 14270 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:15.106693 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:15.074895 16299 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.074668 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 620) took 1274 ms. Trace:
I20260709 13:18:15.114133 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:15.103904 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:15.116139 14864 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.111423 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.117267 14377 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 2: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:15.108285 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.109189 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.110083 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.112016 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:15.112383 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.112596 16442 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:15.113474 16300 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.113638 16385 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:15.114436 14895 rpcz_store.cc:276] 0709 13:18:13.798527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.799710 (+  1183us) service_pool.cc:224] Handling call
0709 13:18:14.932150 (+1132440us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67eee 0000000000375939 00007f8df1fdb1e0 00007f8df20a40c4 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:15.072440 (+140290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4938112}
I20260709 13:18:15.119655 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.120443 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.124349 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.124343 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.125859 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:15.126451 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.126593 14373 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:15.125468 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.130214 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.130446 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:15.122179 16346 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.000s
I20260709 13:18:15.068158 16380 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.103073 16373 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:15.107177 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.121852 16402 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.134976 14373 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:15.142141 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.132282 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:15.138494 14126 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37096 (request call id 351) took 3604 ms. Trace:
I20260709 13:18:15.158984 14126 rpcz_store.cc:276] 0709 13:18:11.511841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.511986 (+   145us) service_pool.cc:224] Handling call
0709 13:18:15.116285 (+3604299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1213830,"reported_tablets":1,"spinlock_wait_cycles":297728}
I20260709 13:18:15.151319 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:15.159530 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:15.129002 16310 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:15.147225 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.163386 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.164613 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:15.151467 16392 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.166421 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.148307 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:15.167171 14898 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:15.158558 16363 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:15.150851 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:15.167812 16363 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:15.168251 16363 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.157193 14192 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:15.129113 16352 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.131254 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.166460 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.147635 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:15.150399 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:15.168095 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.169050 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.128783 16437 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.171241 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:15.163589 16310 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:15.150463 16346 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:15.177094 16384 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.177256 16310 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.108958 16345 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:18:15.173647 16340 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.045s	user 0.024s	sys 0.029s
I20260709 13:18:15.175380 14892 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:15.155298 16381 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:15.158694 16440 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.178433 14223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:18:15.184440 14223 raft_consensus.cc:606] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Received request to transfer leadership to TS cebb34ac155340899a38c728707ddc0d
W20260709 13:18:15.182477 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51318.3us
I20260709 13:18:15.185818 14270 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.173439 16385 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.181777 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.175865 16332 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.191241 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.195149 16346 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.183072 16436 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.158174 16373 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.206947 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:15.207409 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:15.204198 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.173221 16339 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:15.214344 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:18:15.215664 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 44030.4us
I20260709 13:18:15.216585 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.217732 16311 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:15.218242 16311 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:15.218318 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:15.218844 16311 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.218390 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.233523 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:15.224618 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.203197 16437 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:15.235355 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 53657.5us
I20260709 13:18:15.230337 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.201071 16388 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:15.239923 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:15.242230 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48189.5us
I20260709 13:18:15.229774 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:15.209339 16345 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:15.246333 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.247982 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.248423 14270 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.249310 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:15.249614 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:15.211809 16381 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:15.221764 16382 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:15.271848 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.253876 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:15.192269 16418 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:18:15.237987 16314 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.240844 14898 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:15.241240 16440 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.241058 16352 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.282779 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:15.271914 16384 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.250627 16409 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.253315 16343 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.274358 16357 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:18:15.304978 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:15.271694 16386 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.253196 16428 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:15.224175 16425 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:15.253623 16432 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:15.308041 16446 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:18:15.293965 16392 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:15.294510 16442 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:15.315757 16413 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:15.315953 16382 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:15.308290 16300 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.315760 16374 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:15.320701 16445 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.297446 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.251765 16419 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:15.324977 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.339587 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.340647 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.341012 16425 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.277899 16381 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:15.343214 16381 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.343715 14226 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:15.343773 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.347159 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:15.348354 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:15.329645 14220 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:15.349444 16356 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.350179 16356 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.327355 16382 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:15.321244 16428 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:15.354240 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:15.341157 16443 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.320s	user 0.004s	sys 0.000s
I20260709 13:18:15.275460 16403 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:15.248342 16420 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.329243 16386 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.324184 16442 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:15.333658 16413 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:15.341550 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.352686 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:15.353924 16388 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.328869 16432 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:15.351702 16401 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.574s	user 0.002s	sys 0.009s
I20260709 13:18:15.330406 16392 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:15.358198 14370 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:15.336750 16374 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.387897 16336 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.395390 16382 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.397562 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:15.365674 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 114325us
I20260709 13:18:15.367522 14900 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:15.371783 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:15.408169 14229 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.372516 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:15.409998 14341 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.411685 16403 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.413945 16349 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:18:15.372383 16310 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.356022 16428 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.380647 16393 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:15.430111 16393 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:15.381079 16339 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:15.365779 16442 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.384804 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:15.418883 16413 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:15.420142 16392 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.380664 16420 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:15.424829 14229 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:15.428608 16432 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.434055 14222 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:15.388397 16401 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:15.442871 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:15.443327 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:15.457584 16450 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:15.458146 16450 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:15.458701 16450 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.437042 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.458079 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.460829 14893 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:18:15.463256 14222 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:15.465715 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:15.467099 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:15.468923 16439 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:15.469362 16439 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:15.438563 16311 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.474860 16356 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:15.475041 16449 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:15.481608 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:15.485342 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:15.495023 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:15.500101 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.510905 14377 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 2: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:15.471742 16413 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.508050 16356 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:15.513152 14229 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:15.470249 16439 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:15.508958 16334 raft_consensus.cc:3055] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:15.515079 16356 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:15.519255 16374 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:15.518829 16334 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:15.503722 16373 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:15.527887 14267 leader_election.cc:336] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.559s (SENT)
I20260709 13:18:15.535226 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:15.523686 16347 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.005s
I20260709 13:18:15.532110 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:15.542207 16311 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.519717 16349 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:18:15.530695 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:15.552723 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:15.521322 14898 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:15.528975 16419 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:15.561031 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 321196us
I20260709 13:18:15.556777 14900 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 3 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:15.565649 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.570644 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2002) took 1221 ms. Trace:
I20260709 13:18:15.571076 14225 rpcz_store.cc:276] 0709 13:18:14.348920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.349574 (+   654us) service_pool.cc:224] Handling call
0709 13:18:15.570413 (+1220839us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b5400276fd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:15.570582 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037580544}
I20260709 13:18:15.572177 14228 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.534760 16420 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:15.528672 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:15.574838 14344 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:15.594584 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.595504 14123 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37080 (request call id 328) took 3261 ms. Trace:
I20260709 13:18:15.596267 14897 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:15.596729 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:15.597429 14296 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.599052 14229 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.602011 14865 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.605543 14225 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.647886 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.649390 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:15.669327 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:15.671468 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:15.675384 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:15.676388 14221 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 2: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:15.700690 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:15.701126 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:15.700706 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.555428 16347 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.703907 14304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:18:15.704716 14304 raft_consensus.cc:606] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:15.633910 16339 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.648859 16439 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:15.673532 16402 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:15.646281 16310 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:15.669711 16385 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:15.713322 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 463735us
I20260709 13:18:15.720095 14221 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.720013 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:15.721930 14303 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:15.725054 14296 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:15.725955 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:15.726882 14229 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:15.700042 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 174386us
I20260709 13:18:15.729950 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:15.733026 14229 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.601567 16420 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:15.735051 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:15.702011 16437 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:15.743470 14227 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:15.708642 16349 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.711347 16402 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:15.718905 16429 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:15.735965 16401 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:15.752449 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 150554us
I20260709 13:18:15.753427 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:15.766215 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:15.751443 16453 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.794363 14374 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.768239 16311 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.800571 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:15.761301 16455 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.767799 16429 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:15.823580 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:15.825981 14298 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.865125 14867 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:15.780767 16454 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:15.862445 16363 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.694s	user 0.006s	sys 0.008s
W20260709 13:18:15.836843 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 58597.6us
I20260709 13:18:15.913491 14899 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:15.838749 16422 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:15.884831 16311 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:18:15.887048 16395 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:15.890945 16454 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:15.883296 16310 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:18:15.916023 16455 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:18:15.936774 16395 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:15.937759 16395 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.921123 16373 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:15.946424 16455 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:15.946950 16455 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:15.949292 16428 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.003s
I20260709 13:18:15.835037 16402 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:15.950139 16440 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.644s	user 0.002s	sys 0.010s
I20260709 13:18:15.950518 16402 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:15.950683 16440 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:15.956653 16450 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:15.928844 16451 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:18:15.930222 16429 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.973102 16420 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:15.973942 16428 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.893831 14867 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:15.977770 16345 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.725s	user 0.006s	sys 0.005s
I20260709 13:18:15.978231 16345 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:15.921759 16422 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.983979 16422 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:15.985085 16310 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:15.985602 16310 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:15.915597 16363 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:15.931881 16454 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:16.048257 16442 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 13:18:16.048857 16442 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:16.059437 16393 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.003s
I20260709 13:18:15.991788 16363 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:16.308734 16349 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.324510 16380 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.388175 16450 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:16.080292 16454 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.315379 16363 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.940310 16347 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:16.158433 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.145318 14227 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.410508 16363 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.210775 14298 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:16.325459 14223 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.324337 16385 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:16.182891 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 534900us
I20260709 13:18:16.282271 16235 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.215508 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 321736us
I20260709 13:18:16.414289 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:16.414427 16235 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:16.416235 14303 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.693s	user 0.006s	sys 0.015s
I20260709 13:18:16.394860 16428 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:16.416930 14303 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:16.171165 14295 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:16.418071 16385 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.418998 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:16.146170 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 415434us
I20260709 13:18:16.173012 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:16.420843 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:16.395673 16455 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.423668 16455 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:16.139281 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.136140 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.595896 14123 rpcz_store.cc:276] 0709 13:18:12.334517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.334677 (+   160us) service_pool.cc:224] Handling call
0709 13:18:15.595443 (+3260766us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:14.549877 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:14.614645 (+ 64768us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:14.614677 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:18:14.614694 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:14.615000 (+   306us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:14.615070 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:14.615102 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:14.615278 (+   176us) tablet.cc:701] Row locks acquired
0709 13:18:14.615294 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:18:14.615428 (+   134us) write_op.cc:270] Start()
0709 13:18:14.615528 (+   100us) write_op.cc:276] Timestamp: P: 1783603094615385 usec, L: 0
0709 13:18:14.615547 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:14.655653 (+ 40106us) log.cc:844] Serialized 539 byte log entry
0709 13:18:15.134784 (+479131us) op_driver.cc:464] REPLICATION: finished
0709 13:18:15.253369 (+118585us) write_op.cc:301] APPLY: starting
0709 13:18:15.275290 (+ 21921us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:15.292416 (+ 17126us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:15.302131 (+  9715us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:15.302469 (+   338us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:15.302753 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:15.302822 (+    69us) write_op.cc:312] APPLY: finished
0709 13:18:15.303106 (+   284us) log.cc:844] Serialized 23 byte log entry
0709 13:18:15.303370 (+   264us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:15.303474 (+   104us) write_op.cc:454] Released schema lock
0709 13:18:15.303526 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:15.304015 (+   489us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:15.304059 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":96721,"apply.run_cpu_time_us":2465,"apply.run_wall_time_us":56128,"num_ops":1,"prepare.queue_time_us":211652,"prepare.run_cpu_time_us":35304,"prepare.run_wall_time_us":313211,"raft.queue_time_us":19585,"raft.run_cpu_time_us":16846,"raft.run_wall_time_us":53506,"replication_time_us":519087,"thread_start_us":324148,"threads_started":4,"wal-append.queue_time_us":180461}]]}
I20260709 13:18:16.190711 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:16.180133 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:16.073491 16442 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:16.201804 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:16.135857 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:16.172194 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:16.432528 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:16.433283 16450 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:16.433892 16450 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:16.434226 16430 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:16.436304 14299 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.436372 16450 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:16.439397 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:16.443044 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:16.444051 14371 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:16.444489 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:16.444614 16454 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:16.446774 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:16.425621 14267 leader_election.cc:336] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.854s (SENT)
I20260709 13:18:16.452872 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 712) took 1281 ms. Trace:
I20260709 13:18:16.454028 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:16.458654 14225 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:18:16.458890 16457 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.689s	user 0.005s	sys 0.019s
I20260709 13:18:16.460041 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:16.459062 14125 catalog_manager.cc:5697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 3 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.464649 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:16.464808 14900 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:16.466202 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:16.466941 16439 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.455308 14893 rpcz_store.cc:276] 0709 13:18:15.165283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.469836 (+304553us) service_pool.cc:224] Handling call
0709 13:18:15.470257 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.472180 (+  1923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.482232 (+ 10052us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.532924 (+ 50692us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.922552 (+389628us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:15.922613 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.922712 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.411993 (+489281us) raft_consensus.cc:1685] finished
0709 13:18:16.412044 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.435173 (+ 23129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10083,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":11061,"thread_start_us":287297,"threads_started":1,"wal-append.queue_time_us":852162}
I20260709 13:18:16.469411 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:16.469831 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:16.470683 16442 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:16.472705 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 196499us
I20260709 13:18:16.456524 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.464838 16363 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:16.477934 14225 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.476495 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 652) took 1181 ms. Trace:
I20260709 13:18:16.480912 14300 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:16.479107 14900 rpcz_store.cc:276] 0709 13:18:15.293054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.563761 (+270707us) service_pool.cc:224] Handling call
0709 13:18:15.649432 (+ 85671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.464340 (+814908us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b5400883ea0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded003dc0 00007f8ded08e1c0 00007f8ded08f231 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c
0709 13:18:16.465555 (+  1215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.473944 (+  8389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58353408}
I20260709 13:18:16.481629 16235 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:16.482630 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:16.487988 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 62483.3us
I20260709 13:18:16.488615 16418 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:16.489141 16418 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:16.493415 16418 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:16.490257 16442 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:18:16.495669 16442 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:16.496371 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 429) took 1128 ms. Trace:
I20260709 13:18:16.497417 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:16.490545 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:16.498099 14222 rpcz_store.cc:276] 0709 13:18:15.368026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.372277 (+  4251us) service_pool.cc:224] Handling call
0709 13:18:16.495936 (+1123659us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b540026cad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:16.496140 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55902080}
I20260709 13:18:16.499687 16363 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:16.483363 16385 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:16.501621 14222 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.501765 16439 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.503633 14222 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:16.503773 16339 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.791s	user 0.003s	sys 0.018s
I20260709 13:18:16.504454 16339 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.505988 16430 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.506873 16430 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:16.507639 14378 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.512897 16429 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.514081 14220 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.514299 16380 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:16.506024 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.516983 14220 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.517258 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:16.499300 16442 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:16.517954 14900 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:16.522292 16356 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.003s	user 0.006s	sys 0.016s
I20260709 13:18:16.522477 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:16.523914 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 635) took 2403 ms. Trace:
I20260709 13:18:16.523187 16356 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.524446 16363 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.525094 14370 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:16.519078 16442 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.522351 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 431) took 1147 ms. Trace:
I20260709 13:18:16.527258 16363 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:16.475131 16454 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:18:16.527480 16442 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.527429 14228 rpcz_store.cc:276] 0709 13:18:15.374632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.375355 (+   723us) service_pool.cc:224] Handling call
0709 13:18:15.572010 (+196655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.572586 (+   576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.521943 (+949357us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400276fd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:16.522153 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451457408}
I20260709 13:18:16.529718 14220 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.531438 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:16.532462 14896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 701) took 1708 ms (client timeout 1627 ms). Trace:
W20260709 13:18:16.533051 14896 rpcz_store.cc:269] 0709 13:18:14.823989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.828330 (+  4341us) service_pool.cc:224] Handling call
0709 13:18:16.402215 (+1573885us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:16.532368 (+130153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2991488}
I20260709 13:18:16.524376 14899 rpcz_store.cc:276] 0709 13:18:14.120672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.560088 (+439416us) service_pool.cc:224] Handling call
0709 13:18:15.103256 (+543168us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:15.103431 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.914021 (+810590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.523381 (+609360us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54004bfad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:16.523684 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877870848}
W20260709 13:18:16.489909 14267 leader_election.cc:336] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 2.004s (SENT)
I20260709 13:18:16.538183 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.544090 16333 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:16.544704 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.544943 16333 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.547390 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 427) took 1180 ms. Trace:
I20260709 13:18:16.547492 16339 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:16.547870 14223 rpcz_store.cc:276] 0709 13:18:15.367461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.371111 (+  3650us) service_pool.cc:224] Handling call
0709 13:18:15.371403 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.413865 (+1042462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.547087 (+133222us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b540026d4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:16.547323 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192511360}
I20260709 13:18:16.550349 16333 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:16.515021 16380 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.553162 14297 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
W20260709 13:18:16.554395 14226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2004) took 2152 ms (client timeout 1888 ms). Trace:
I20260709 13:18:16.514827 16430 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:16.557204 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:16.539769 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 49957.8us
I20260709 13:18:16.475240 16349 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:16.567801 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:16.582337 14299 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:16.583333 16333 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:16.583688 16332 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:16.584038 16333 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:16.584573 16332 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:16.580293 14226 rpcz_store.cc:269] 0709 13:18:14.402078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.404319 (+  2241us) service_pool.cc:224] Handling call
0709 13:18:16.553967 (+2149648us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b540011fdd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:16.554168 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708654848}
I20260709 13:18:16.587273 14900 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:16.589808 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:16.590085 16333 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:16.591063 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:16.591807 14893 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.591934 14377 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:16.593046 16453 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.593276 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:16.593611 16453 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:16.594164 14899 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:16.595357 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:16.596482 14895 raft_consensus.cc:2393] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 2: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:16.597232 16314 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.595045 16453 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:16.597590 14898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 644) took 1426 ms (client timeout 1736 ms). Trace:
W20260709 13:18:16.599013 14898 rpcz_store.cc:269] 0709 13:18:15.170690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.192929 (+ 22239us) service_pool.cc:224] Handling call
0709 13:18:16.597254 (+1404325us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b540049fa54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:16.597418 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44250496}
I20260709 13:18:16.589074 16454 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:16.600672 16454 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.602311 16357 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:16.603694 16357 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.604040 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.604161 16357 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:16.597412 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:16.605034 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:16.605289 16357 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:16.606549 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.606923 14377 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:16.607614 16357 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.608103 14376 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:16.609251 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:16.610018 14378 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:16.610110 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:16.611047 14226 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:16.611367 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:16.612030 14376 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:16.612349 16332 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:16.613554 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:16.614459 14225 raft_consensus.cc:2393] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:16.615239 16310 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.616829 16310 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.610137 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:16.618407 14375 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:16.618575 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:16.603694 16380 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:16.620088 14369 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:16.620837 16269 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.621120 16349 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:16.621234 16269 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:16.622128 16427 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.622567 16427 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:16.624420 14369 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.623782 16427 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.625145 16427 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.626051 16453 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.626794 16430 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.627424 16430 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.630740 16380 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.630857 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.632084 16300 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:16.627956 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.633754 16341 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:16.633836 16380 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.634223 16341 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:16.634586 14227 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:16.634699 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2091) took 1092 ms. Trace:
I20260709 13:18:16.635751 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.635381 16341 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:16.636723 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:16.637499 14296 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 1.
I20260709 13:18:16.638382 16334 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.635181 14302 rpcz_store.cc:276] 0709 13:18:15.542188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.542680 (+   492us) service_pool.cc:224] Handling call
0709 13:18:15.542981 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.170885 (+627904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.170997 (+   112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.171090 (+    93us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:16.171194 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.634251 (+463057us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54003d95d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:16.634299 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.634503 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":170199,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":362,"spinlock_wait_cycles":1441201408}
I20260709 13:18:16.639658 16380 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.639797 16334 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.641155 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.641650 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.642916 16300 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.636339 16269 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.649161 16333 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.653604 16380 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.655082 16428 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:16.648021 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:16.643585 16430 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:16.669942 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 112908us
I20260709 13:18:16.648201 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:16.673377 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:16.674049 14900 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:16.674126 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:16.675809 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:16.676332 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:16.677579 14892 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:16.678006 14302 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.678170 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:16.678639 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:16.678983 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:16.679425 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:16.680130 14300 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:16.680317 16454 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:16.648510 16304 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:18:16.681105 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:16.681291 16341 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.681841 14898 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.684639 14304 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:18:16.685221 16418 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:16.690624 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 49238us
I20260709 13:18:16.663638 16269 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.697695 14301 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.706938 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:16.700292 16304 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.708364 16304 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:16.709409 16304 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.710687 16304 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.711899 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.713935 16419 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.714798 16419 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.698140 16428 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:16.716184 16428 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:16.697506 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:16.717310 16428 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.720882 16446 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:16.721570 16446 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.723492 16349 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:16.724080 16446 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:16.724802 16349 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:16.725952 16339 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.726336 16339 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:16.727469 16403 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:16.727578 16388 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:16.727384 16339 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:16.728560 16403 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:16.728767 16339 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.681280 16454 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:18:16.703547 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 72959.4us
W20260709 13:18:16.731422 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 239310us
I20260709 13:18:16.719627 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.729547 14896 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:16.740092 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.732313 16314 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:16.746934 14374 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:16.749157 16402 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:18:16.750005 16403 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:16.751228 16403 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.751658 16403 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:16.752907 16403 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.750319 16402 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:16.778251 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.779382 14193 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.776407 16454 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:16.775192 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 108376us
I20260709 13:18:16.796909 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:16.775303 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 55848.1us
W20260709 13:18:16.797876 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 53686.2us
I20260709 13:18:16.782230 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:16.775465 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 127614us
I20260709 13:18:16.738883 16442 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:16.804939 16374 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.807184 16403 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.810387 16357 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.810541 16446 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.754392 16419 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.778692 16424 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:16.817502 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.754334 16314 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:16.838037 16314 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:16.754323 16430 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.817808 16357 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:16.841535 16357 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.842451 16393 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.843117 16357 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.843379 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.845263 14342 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.821934 16371 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:16.845638 16420 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:16.827766 16446 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:16.846415 16371 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:16.846478 16300 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:16.815115 16339 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
W20260709 13:18:16.827513 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.847002 16446 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.828078 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:16.847929 16393 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.848292 16446 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.848378 16393 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:16.848598 16422 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:16.847954 16339 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:16.849144 16422 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:16.834232 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54948.2us
I20260709 13:18:16.836061 14899 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:16.802163 16356 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:16.837926 16395 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.826432 16424 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:16.846925 16371 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:16.849236 16339 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:16.852351 16371 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.852844 16339 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:16.853725 16371 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.848640 14341 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:16.854516 16339 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:16.850517 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.755416 16429 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:16.856432 16429 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:16.794621 16402 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:16.851265 16422 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.853626 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:16.824855 14894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 648) took 1583 ms (client timeout 1897 ms). Trace:
I20260709 13:18:16.850031 16419 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:16.861021 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.857547 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:16.865000 14894 rpcz_store.cc:269] 0709 13:18:15.241500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.343544 (+102044us) service_pool.cc:224] Handling call
0709 13:18:16.824461 (+1480917us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540066dad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:16.824658 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3385969536}
I20260709 13:18:16.861773 16429 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:16.871546 16429 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.862067 16424 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:16.874888 16424 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.876120 16269 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:16.878279 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:16.878633 16473 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.879349 16473 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:16.882045 16473 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:16.882519 14341 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.882788 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:16.883397 16349 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.776263 16380 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
W20260709 13:18:16.886099 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 48416.1us
I20260709 13:18:16.887576 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.888370 16454 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:16.888834 16454 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:16.851313 16393 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.868443 16334 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:16.868906 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:16.870878 16420 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:16.889914 16334 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:16.890094 16420 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:16.888854 16402 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:16.891175 16420 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.892344 16402 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.889307 16454 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.890949 16334 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.813908 16442 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:16.899916 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.902052 16432 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:18:16.903327 16427 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:18:16.903499 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.903765 16427 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:16.904830 16427 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.906399 16427 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.890159 16393 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:16.910424 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.912011 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.913331 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.916301 16247 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:16.916884 14192 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:16.918545 16429 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.889144 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.924536 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:16.924645 16419 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:16.932782 16247 raft_consensus.cc:993] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: : Instructing follower cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:18:16.932952 14374 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:16.936383 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:16.933243 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:16.930682 16363 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:18:16.887902 14898 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
W20260709 13:18:16.938843 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 93703.6us
I20260709 13:18:16.919104 16341 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.955514 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:16.882910 16422 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.967507 16428 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.966290 16247 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 13:18:16.968613 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 55367.3us
I20260709 13:18:16.968963 16299 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:16.969436 16299 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:16.933687 16374 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:16.970009 16374 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:16.970075 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.970973 16374 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:16.971596 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.972236 16383 raft_consensus.cc:1081] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Signalling peer cebb34ac155340899a38c728707ddc0d to start an election
I20260709 13:18:16.972579 16439 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:16.973026 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:16.973379 16439 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:16.973857 16403 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.975131 16300 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:16.975765 16300 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:16.978483 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.931792 16380 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:16.934846 16395 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:16.985452 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.930411 16473 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:16.999188 14220 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:16.978024 16299 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.006449 16475 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:17.006677 16474 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 13:18:17.007910 14224 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:17.008431 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:17.009121 14222 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
W20260709 13:18:17.009946 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 156469us
I20260709 13:18:17.014087 14229 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:17.015055 14220 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.018610 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:17.011473 16341 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:16.978199 16356 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:17.025075 16341 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.033274 14370 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:17.035025 16395 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:17.014685 16300 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.047962 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:17.052397 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.059686 14304 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 1.
I20260709 13:18:17.060700 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.062700 16371 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:17.063074 16341 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.063669 16341 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.063331 16371 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.063794 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:17.064206 16341 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.064561 16356 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.067749 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:17.069125 14193 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:17.068570 16428 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:17.072985 16428 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.074172 16371 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:17.075197 16428 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:17.076112 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:17.076896 14892 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 3 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:17.080507 16439 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:17.080967 16439 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.081318 16439 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.083304 14894 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:17.048660 16424 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:17.091513 16300 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.092532 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:17.093670 16476 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
W20260709 13:18:17.099620 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.102412 16475 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:17.115722 16339 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:17.116448 16339 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:17.117489 16339 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:17.136224 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 115495us
I20260709 13:18:17.076649 16314 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.120745 16454 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.139750 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:17.144187 14865 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:17.150839 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:17.154268 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.154672 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:17.156953 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:17.159626 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.160185 14300 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:17.143055 16341 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:17.142482 16356 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:17.161815 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:17.153713 16453 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.134635 16424 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.153569 16428 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:17.183502 16428 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:17.115671 16442 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.184176 16428 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.187076 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:17.187414 16442 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.188416 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:17.190063 16473 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.190524 16429 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:17.155997 16383 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:17.195574 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:17.200454 16439 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:17.179167 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 60124.9us
I20260709 13:18:17.180250 16454 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:17.167200 16420 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:17.207223 14267 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:17.169366 16475 raft_consensus.cc:2764] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:17.226408 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:17.227149 16419 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.227643 16439 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.227759 16419 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.230329 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:17.231209 14898 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:17.213222 16422 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:17.234372 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:17.234995 14225 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.213531 16420 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:17.236090 16420 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.253348 14229 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:17.237732 14894 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:17.239295 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:17.260593 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.261116 14220 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:17.241453 14342 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:17.265268 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.270244 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:17.270771 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.270790 14300 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:17.272102 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 336293us
W20260709 13:18:17.272749 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 65616.9us
I20260709 13:18:17.272156 14193 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:17.242935 16314 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:17.262766 16334 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.279124 14225 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
W20260709 13:18:17.279160 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 62335.6us
I20260709 13:18:17.272254 16439 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:17.281020 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:17.274711 16357 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:17.237636 16299 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.272385 16419 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:17.282371 16383 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:17.285173 16357 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:17.289681 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.290017 16357 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.290345 14299 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:17.291342 16299 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.291404 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:17.293995 14226 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:17.281993 16442 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:17.294777 16442 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.295053 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.295816 14302 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:17.296850 16442 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.298277 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:17.301304 14894 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
W20260709 13:18:17.301714 16477 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.234s	user 0.004s	sys 0.000s
I20260709 13:18:17.301915 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:17.303949 16299 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:17.304533 16299 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.304648 16357 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.305161 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:17.306543 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:17.306970 16422 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:17.307216 14892 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:17.307031 16357 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:17.307876 16422 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:17.309103 16422 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:17.310264 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 56267.4us
I20260709 13:18:17.310909 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.288890 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.285092 16491 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:17.313319 14295 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:17.304003 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:17.288374 14300 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:17.316044 16299 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.319238 16424 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:17.288443 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:17.323293 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:17.323642 16492 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:17.324095 16492 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:17.324271 16299 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:17.324466 16492 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.324733 16299 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.325137 16299 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.326097 14301 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:18:17.326661 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.284611 16429 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:18:17.331284 16471 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.156s	user 0.000s	sys 0.002s
I20260709 13:18:17.332208 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:17.332842 14299 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.334859 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.336130 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.336367 16374 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.337932 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.338528 14295 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:17.338891 14301 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:17.339219 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:17.339936 14226 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:17.341382 14303 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:17.282979 16454 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:18:17.347141 14375 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:18:17.348826 14341 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:17.350486 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73875.1us
I20260709 13:18:17.353466 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:17.347234 14125 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37072 (request call id 321) took 2801 ms. Trace:
I20260709 13:18:17.366384 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:17.366611 14899 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:17.368654 16429 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.369045 16429 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:17.368959 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:17.373170 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:17.374804 14299 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:17.379451 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:17.375658 14342 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:17.324115 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:17.382190 14894 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:17.405133 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:17.361210 16419 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:17.488867 16419 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.487291 16341 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:17.489362 16341 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.489769 16341 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.489485 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:17.389039 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50172.1us
W20260709 13:18:17.490851 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:17.487962 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 163907us
I20260709 13:18:17.386013 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:17.491609 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:17.491739 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 105824us
W20260709 13:18:17.492422 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 179000us
W20260709 13:18:17.492774 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 87774.1us
I20260709 13:18:17.389546 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:17.317261 16428 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.410328 16356 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:17.433251 16388 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:18:17.360409 16314 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:17.387420 16429 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.384368 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:17.499229 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:17.490690 16439 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:17.510128 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:17.409991 14892 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:17.388408 16424 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:17.493355 16419 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.432965 16402 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:17.515173 16383 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:17.528445 14193 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:17.530078 16430 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.497606 16446 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:17.433389 16442 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:17.540151 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:17.565999 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 55951.9us
W20260709 13:18:17.549607 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50444.8us
W20260709 13:18:17.566828 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 77431.8us
W20260709 13:18:17.502945 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.504386 16356 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:17.573493 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.519919 16424 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:17.577670 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:17.508929 16371 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:18:17.579097 14192 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:17.566884 16310 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:17.592223 16310 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:17.593171 16310 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.506325 16418 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:17.359458 14125 rpcz_store.cc:276] 0709 13:18:14.546251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.546387 (+   136us) service_pool.cc:224] Handling call
0709 13:18:17.347139 (+2800752us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:16.775833 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:16.776648 (+   815us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:16.776705 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:18:16.776728 (+    23us) tablet.cc:662] Decoding operations
0709 13:18:16.782378 (+  5650us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:16.782467 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:16.782499 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:16.782812 (+   313us) tablet.cc:701] Row locks acquired
0709 13:18:16.782871 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:18:16.783024 (+   153us) write_op.cc:270] Start()
0709 13:18:16.783186 (+   162us) write_op.cc:276] Timestamp: P: 1783603096782963 usec, L: 0
0709 13:18:16.783206 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:16.783861 (+   655us) log.cc:844] Serialized 603 byte log entry
0709 13:18:17.092353 (+308492us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:17.226490 (+134137us) op_driver.cc:464] REPLICATION: finished
0709 13:18:17.317619 (+ 91129us) write_op.cc:301] APPLY: starting
0709 13:18:17.317718 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:17.317850 (+   132us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:17.317890 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:17.318377 (+   487us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:17.318677 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:17.318727 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:17.319009 (+   282us) log.cc:844] Serialized 23 byte log entry
0709 13:18:17.319196 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:17.319285 (+    89us) write_op.cc:454] Released schema lock
0709 13:18:17.319351 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:17.319819 (+   468us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:17.319848 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":520554,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":90834,"apply.run_cpu_time_us":2157,"apply.run_wall_time_us":2163,"num_ops":1,"prepare.queue_time_us":278121,"prepare.run_cpu_time_us":4839,"prepare.run_wall_time_us":83886,"raft.queue_time_us":131072,"raft.run_cpu_time_us":4384,"raft.run_wall_time_us":47217,"replication_time_us":443118,"spinlock_wait_cycles":18697472,"thread_start_us":331867,"threads_started":4,"wal-append.queue_time_us":75561}]]}
I20260709 13:18:17.506119 16357 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:17.582057 16383 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:18:17.517410 16453 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:18:17.542421 16419 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.566421 16492 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.610239 14222 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:17.610911 16357 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:17.611284 16492 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.584321 16424 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.612315 16357 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.615739 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:17.566079 16446 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:17.618000 16446 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.590274 16311 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:18:17.505759 16314 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:17.602175 14899 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:17.517237 16393 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:18:17.580845 16356 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.554354 16402 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.601023 16418 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:18:17.629843 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49891us
W20260709 13:18:17.631950 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 52931.3us
I20260709 13:18:17.609637 16428 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:17.639257 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:17.645964 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:17.627820 16247 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:17.648209 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 155800us
I20260709 13:18:17.648993 16503 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:17.653847 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:17.619524 16442 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.638362 16418 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.658174 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:17.660411 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:17.666759 16505 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:17.667305 16505 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:17.668486 16505 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.670425 16505 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.671213 16388 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:17.671756 16388 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:17.661103 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 91850.2us
I20260709 13:18:17.664108 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:17.675396 14376 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:17.676702 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:17.681577 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:17.678136 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:17.665694 14373 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:17.689301 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:17.685184 16497 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:18:17.688398 16500 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:17.701300 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:17.712376 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 60474.9us
I20260709 13:18:17.713325 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:17.719486 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:17.719887 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:17.723060 14226 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:17.722823 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:17.727355 16403 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:17.734040 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:17.736217 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:17.738626 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:17.691885 14892 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
 from {username='slave'} at 127.0.0.1:50026
I20260709 13:18:17.739812 16371 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.740444 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:17.741081 14898 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:17.747990 16492 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:17.748449 16492 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:17.759781 14226 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.758673 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:17.717653 16424 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.751827 14895 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:17.779911 16504 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:17.780094 14892 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:17.780611 14892 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:17.782840 16419 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:17.784039 16442 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.718432 16314 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.785833 16299 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.788122 14224 raft_consensus.cc:2368] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3.
W20260709 13:18:17.794835 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 72029.2us
I20260709 13:18:17.749469 16492 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:17.797997 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.794220 16402 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.804386 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:17.776597 16446 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.806306 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:17.805852 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:17.804881 16442 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:17.816043 16442 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:17.816831 16424 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:17.818184 16442 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.819772 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:17.821183 14894 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:17.797765 16503 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:17.826218 14224 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:17.827209 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:17.810007 16388 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.972106 14299 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:17.978060 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 240297us
I20260709 13:18:18.028272 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.833779 14303 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:17.834187 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.833154 14300 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:17.944306 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.032019 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.032989 14225 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:17.832571 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.834930 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.832192 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:17.831729 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:18.035802 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:17.834514 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.034679 14296 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:18.038968 14295 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:18:18.039913 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.040619 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.042569 14298 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 2: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:18.045616 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:18.046259 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:17.841465 16374 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.002s
I20260709 13:18:17.836716 16341 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:17.837487 16299 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:17.831611 16418 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.054759 16341 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:18.058104 14226 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:18.059618 14227 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:17.825666 16402 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.067134 14304 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:17.813072 16492 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.938529 14895 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:18.081869 14302 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:18.082991 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:18.072582 16509 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.074824 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.075063 16439 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.075548 16503 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.038105 16247 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:17.927979 16454 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:18.121603 16454 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.121969 16247 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.124151 16454 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.044792 16314 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.124953 16314 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.125916 16304 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:18.126344 16304 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:18.127213 16304 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.083911 16420 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:18.128300 16314 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:18.128399 16304 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.932279 16371 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.080004 14224 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.086694 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:17.841329 16356 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.136344 16439 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.138286 16356 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:18.138741 16439 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:18.088291 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:17.832922 16446 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:18.091518 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.110267 16388 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.117588 14125 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:18.092126 14222 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:18.092559 14228 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:18.092811 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46627us
I20260709 13:18:18.093068 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.143504 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:18.095139 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 381868us
I20260709 13:18:18.144477 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:18.093849 16402 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.144724 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.145346 14297 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:18.095247 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.146291 14227 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:18.146198 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.146504 16402 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.093327 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:18.146845 14226 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:18.095523 16453 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.148031 16453 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.148861 14228 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:18.149889 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:18.150993 16453 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:18:18.095749 16393 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.151686 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:18.093619 16506 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.152480 14222 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:18.152593 16506 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.154285 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.154757 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:18.155192 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:18.155493 14226 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:18.156205 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.156672 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.157250 14226 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:18.158444 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.096658 14899 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:18.096876 14895 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:18.098574 16442 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.165735 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:18.064703 16429 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.104451 14302 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:18.105942 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 60476.4us
I20260709 13:18:18.174953 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:18.175575 14894 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.055498 16418 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:18.111335 16509 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.094571 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:18.176385 14304 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:18.095935 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:18.142516 14125 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 2 to 3, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 3 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:18.173938 14221 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:18.179764 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:18.182755 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:18.185115 14296 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:18.185470 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:18.185930 14373 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:18.186095 14304 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.188899 14370 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:18.189435 14125 catalog_manager.cc:5697] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.194110 14125 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 3 to 4, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 4 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.197386 14125 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:18.199847 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:18.200171 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:18.200404 14374 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:18.200493 14298 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.196209 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:18.199203 14125 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 2 to 3, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.201365 14373 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:18.194921 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.202108 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:18.204686 14222 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:18.156708 16300 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:18.206355 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 61966.2us
I20260709 13:18:18.207234 14342 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:18.208129 14304 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:18.211839 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:18.213650 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:18.215140 14370 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.217041 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:18.217883 14193 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:18.219376 14376 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:18.232474 14302 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:18.234855 14296 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:18.235858 14229 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:18.237625 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:18.218897 16512 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:18.239952 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88621.9us
I20260709 13:18:18.222405 16388 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:18.265475 16388 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:18.222247 16422 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.267496 14370 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:18.185504 16341 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:18:18.228713 16420 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.228061 16314 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.230826 16300 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:18.231377 16430 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.233283 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:18.289484 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:18.371631 14894 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:18.231235 16402 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:18.291360 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48763.4us
I20260709 13:18:18.287870 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:18.482766 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 197095us
I20260709 13:18:18.277627 16393 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.483747 14270 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:18.483963 16393 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.486129 16532 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.486485 16393 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:18.233973 16442 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:18.486786 16532 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.365660 16510 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.281s
I20260709 13:18:18.494647 16442 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.494753 16510 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:18.248512 16512 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.293709 16310 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:18.488256 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 252707us
I20260709 13:18:18.365862 16501 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:18.497013 16310 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.497437 16501 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:18.335613 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 130382us
I20260709 13:18:18.498735 14370 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:18.282671 16424 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.208s
I20260709 13:18:18.499432 14193 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:18.471256 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:18.286260 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:18.482667 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:18.502557 16424 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:18.503398 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:18.504146 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:18.495148 16442 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:18.505364 16442 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.505455 16418 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.507001 16418 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.510023 14893 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:18.512181 16334 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:18.487175 16430 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.514684 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:18.503409 16424 consensus_queue.cc:1243] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:18.516119 16424 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:18.516350 16430 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.517081 16430 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:18.365751 16514 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.342s
I20260709 13:18:18.517625 16430 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:18.365456 16386 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.518761 16430 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.519769 16418 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.496308 16512 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.489548 16341 consensus_queue.cc:1243] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:18.519475 16386 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:18.520569 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.521515 16334 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.513782 16442 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.522701 16514 raft_consensus.cc:3055] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:18.523346 14894 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:18.495680 16510 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:18.280047 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:18:18.635196 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 355212us
I20260709 13:18:18.523787 14344 leader_election.cc:400] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3.
I20260709 13:18:18.280347 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:18.527789 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.637934 14372 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.279964 16388 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.462435 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:18.538620 16473 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.338090 16519 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.267050 16454 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:18.369354 16439 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:18:18.463378 16516 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:18:18.477504 16420 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:18.531603 16501 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:18.660638 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:18.279032 16475 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.350s
I20260709 13:18:18.664422 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:18.665150 14378 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:18.631801 16428 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:18.647735 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:18.291080 14892 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.653611 14229 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:18.655186 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:18.675261 16304 consensus_meta.cc:287] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
I20260709 13:18:18.631163 16299 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.675879 16428 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.661448 14371 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:18.604453 14296 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:18.643599 16503 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.663691 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:18.633296 16514 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:18.663789 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:18.671192 16523 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:18:18.676237 14298 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:18.718020 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:18.662444 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 138829us
I20260709 13:18:18.722841 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:18.726842 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:18.740628 16356 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.666867 16300 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.742451 16424 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:18.701989 16503 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:18.743304 16503 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.743723 16428 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:18.709479 16395 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.744607 16424 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:18.745060 16395 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.705000 16501 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:18.746034 16501 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:18.746387 16501 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:18.746901 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:18.747164 16395 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.748373 16386 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.702454 14372 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:18.749313 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:18.677948 14901 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:18.653415 16439 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:18.651562 16506 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.704598 16418 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.660995 16420 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.631438 16314 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.762240 16356 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.766508 16356 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.767560 16314 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.705360 16380 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.768308 16380 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.768807 16356 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:18.770388 16380 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:18.772904 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 271170us
I20260709 13:18:18.662699 16509 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:18.637351 16334 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.644147 14898 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:18.676383 16299 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.742468 14297 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:18.751811 14303 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:18.710016 14304 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:18.705093 16532 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.757390 14300 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:18.749591 14298 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:18.658061 16383 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:18:18.659920 16454 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.773690 14193 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:18.778307 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 130624us
I20260709 13:18:18.801457 14302 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:18.806468 14229 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:18.809594 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.822214 14376 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:18.814182 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:18.776319 16424 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:18.793130 16247 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:18.828631 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54999.5us
I20260709 13:18:18.791800 16520 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.796250 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:18.818109 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:18.820592 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:18.830590 14298 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:18.811309 14227 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:18.824127 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:18.832669 14374 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:18.834059 14298 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:18:18.834398 14899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.000s	sys 0.018s
W20260709 13:18:18.834786 14899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.000s	sys 0.018s
I20260709 13:18:18.835592 14304 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:18.839635 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:18.840488 14229 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:18.812364 16304 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:18.844864 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 467639us
W20260709 13:18:18.835170 14375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.010s	sys 0.007s
W20260709 13:18:18.845527 14224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.000s	sys 0.026s
W20260709 13:18:18.845903 14375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.011s	sys 0.007s
I20260709 13:18:18.846371 14303 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:18.850076 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:18.783565 16418 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:18.838001 16492 consensus_meta.cc:287] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.741s	user 0.009s	sys 0.000s
W20260709 13:18:18.851403 14224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.000s	sys 0.026s
W20260709 13:18:18.836328 16374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.017s
I20260709 13:18:18.853144 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:18.854755 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:18.864596 14228 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:18.871138 16334 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:18.871795 16334 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:18.852092 16424 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:18.846829 16520 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:18.874481 16424 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:18.875448 16424 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.876027 16520 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:18.852833 16543 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:18.877249 16543 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.879431 16543 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:18.879798 16299 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:18.880070 16543 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.880532 16543 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:18.881201 16525 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.401s	user 0.004s	sys 0.000s
I20260709 13:18:18.851979 16314 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:18.856470 16506 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.884370 16314 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:18.884882 16314 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.885244 16418 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:18.861950 16374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.000s	sys 0.017s
I20260709 13:18:18.888742 16388 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.889935 14297 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:18.852088 16341 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:18.853211 16304 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.899509 16503 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.849323 16339 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.848632 16475 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:18.913390 16475 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.751461 16514 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.914719 16514 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:18.911983 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 58921.3us
I20260709 13:18:18.858645 16531 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.863938 16247 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:18.917379 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:18.893277 16341 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:18.916810 16523 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:18.918432 14865 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:18.905263 16388 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.901713 16503 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.935491 14865 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:18.916360 16442 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.922521 16492 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:18.849499 16439 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.923301 16531 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.930940 16541 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:18.934852 16454 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:18.938753 16383 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:18:18.944530 16386 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:18.961851 16533 raft_consensus.cc:2764] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:18:18.962152 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:18.970003 14376 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:18.966519 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:18.971508 14370 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:18.972404 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:18.973201 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:18.974036 16536 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:18:18.956775 16531 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.968401 16442 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.976950 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:18.977350 16442 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:18.979171 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:18.980379 16428 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:18.980861 16428 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.981297 16428 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:18.982146 16533 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:18.982679 16533 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.985407 16533 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.969247 16341 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.958750 16501 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.985913 16535 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:18:18.988536 16386 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:18.989050 16386 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.989401 16501 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:18.958546 16541 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:18.989972 16429 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.799s	user 0.005s	sys 0.006s
I20260709 13:18:18.990327 16247 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:18.968876 16543 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:18.998097 16475 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:18.987138 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:18.957505 14229 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:19.000959 16446 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.998454 16492 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.001849 16446 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.002492 16492 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:18:19.004276 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.004743 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:19.004923 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 68380.4us
I20260709 13:18:19.007232 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:19.008275 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:19.009313 14370 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:19.009742 14375 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 2: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:19.013329 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:19.013962 14370 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:19.014801 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:19.008867 16422 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:19.015784 16537 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.015604 16422 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.016295 16537 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:18.989411 16386 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.021647 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:18.999630 16541 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:19.024612 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 201239us
I20260709 13:18:19.023696 16503 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.029628 16503 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.029700 16428 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.009423 16395 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.034163 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:19.035094 14370 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.017139 16537 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.036513 16310 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:19.007238 16512 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.038702 16429 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:19.039217 16429 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.039884 14296 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:19.041038 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.031754 16428 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:18:19.041172 16429 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:19.041590 16521 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:19.041919 14301 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:19.043027 16512 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:19.045014 14300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2102) took 1204 ms (client timeout 1566 ms). Trace:
W20260709 13:18:19.045459 14300 rpcz_store.cc:269] 0709 13:18:17.840896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.086416 (+245520us) service_pool.cc:224] Handling call
0709 13:18:19.044868 (+958452us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54001a1154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:19.044961 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241406720}
I20260709 13:18:19.034488 16395 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.031754 16503 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:19.049772 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.052068 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.057891 14227 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:19.050640 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.054920 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.058990 14300 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:19.055717 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.057991 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.062914 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.063832 14299 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:19.064517 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.066282 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.066649 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.068486 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.069290 14304 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:19.024744 16509 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:19.074970 14193 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:19.078007 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:19.102087 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.083529 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.082772 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.084913 14220 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:19.053973 16395 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.087486 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.104915 14226 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:19.051242 16383 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.102007 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.088603 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:19.084573 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.104986 14221 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:19.103993 14296 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:19.107592 14300 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:19.109905 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:19.111256 14370 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:19.111255 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.111670 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:19.112547 14304 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:19.112732 14298 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:19.115453 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.116290 14296 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:19.112761 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:19.118589 14299 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:19.063365 16501 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:18:19.100978 16314 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:19.105340 16492 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.085541 16521 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:18:19.087622 16418 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:18:19.120853 16310 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.130134 14300 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:19.122749 16380 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:19.126516 16428 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.098582 16531 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.128293 16422 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:19.143735 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.149852 16540 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:19.150555 14297 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:19.152081 16531 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.155443 16473 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:19.161532 16442 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.164129 16304 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:19.164793 16371 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:18:19.165102 16519 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.003s
I20260709 13:18:19.111096 16383 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:19.167802 16528 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.451s	user 0.002s	sys 0.000s
I20260709 13:18:19.169282 14299 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:19.169001 16428 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:19.171530 16540 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:19.186128 16521 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:19.186658 16512 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.142787 16380 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:19.141427 16310 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.195393 16371 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:19.195713 16473 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:19.167375 16520 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:19.203584 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2108) took 1028 ms. Trace:
I20260709 13:18:19.202191 16371 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.204859 16371 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.204030 14295 rpcz_store.cc:276] 0709 13:18:18.174926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.190176 (+ 15250us) service_pool.cc:224] Handling call
0709 13:18:18.214152 (+ 23976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.214397 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.214421 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.239669 (+ 25248us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.326344 (+ 86675us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:18.326413 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.326513 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.167138 (+840625us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:19.202132 (+ 34994us) raft_consensus.cc:1685] finished
0709 13:18:19.202153 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.203488 (+  1335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76678016,"thread_start_us":30059,"threads_started":1,"wal-append.queue_time_us":377061}
I20260709 13:18:19.196693 16519 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.185767 16395 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.200948 16380 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.202975 16512 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.209328 16520 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.202697 16310 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:19.213179 16554 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:18:19.165776 16420 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.228116 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:19.231120 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:19.228833 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:19.230777 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:19.200728 16521 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.233284 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:19.232093 14375 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:19.238754 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:19.244939 14375 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:19.246762 14374 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:19.249286 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:19.259690 14372 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:19.261904 16492 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.262349 16492 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.262693 16492 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.263629 16454 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.269070 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:19.274875 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:19.275602 14372 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.279286 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:19.286659 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:19.287428 14894 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:19.286100 14375 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:19.286084 14372 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:19.268601 16247 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.265653 16519 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:19.290143 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:19.264667 14895 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:19.275857 16512 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.229385 16473 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.295668 16247 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.312765 14893 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:19.313006 16247 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.314687 16520 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:19.316862 16473 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.293913 16519 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.239512 16428 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.297159 16422 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:19.274644 16454 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.283987 16503 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:19.333199 14303 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:19.342666 14376 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:19.347247 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.331889 16519 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.269156 16540 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.348910 16503 consensus_queue.cc:1243] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:19.349076 16383 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:19.331297 16386 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.372337 16454 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.376075 16492 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.378294 16492 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.418671 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:19.418107 16557 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:18:19.419333 14901 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.405987 16395 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.428747 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:19.431985 14901 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:19.432354 16420 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:19.411021 16386 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.436266 14299 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
W20260709 13:18:19.462998 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 198925us
I20260709 13:18:19.423131 16521 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:19.460764 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 168206us
I20260709 13:18:19.465972 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:19.492281 16422 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:19.492972 16422 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.493412 16422 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.500592 16509 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:19.502980 16422 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.507036 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:19.507787 14299 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.479137 14892 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:19.447435 16541 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.512844 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50026 (request call id 661) took 1866 ms. Trace:
I20260709 13:18:19.477164 16542 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:19.514294 16542 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.513295 14892 rpcz_store.cc:276] 0709 13:18:17.654555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.663611 (+  9056us) service_pool.cc:224] Handling call
0709 13:18:19.467513 (+1803902us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b5400775e54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded083a3d 00007f8df2053cd0 00007f8deb5d8254 00007f8deb5d81e2 00007f8deb5d8111 00007f8deb5d808c 00007f8deb5d7342 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:19.512738 (+ 45225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92189440}
I20260709 13:18:19.529448 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:19.530543 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:19.533183 14375 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:19.530985 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:19.531248 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:19.533893 14372 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.534507 14374 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:19.533476 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:19.517212 16548 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:19.539214 14299 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:19.536247 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:19.531575 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.533247 14376 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.536221 14226 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:19.539912 14897 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 3 LEARNER]: Advancing to term 4
I20260709 13:18:19.541028 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.541841 14223 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:19.546814 14372 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:19.548167 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.548276 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.514650 16541 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.552822 14220 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:19.562440 14220 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:19.550457 16544 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.007s
I20260709 13:18:19.563146 16422 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:19.576536 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 301378us
I20260709 13:18:19.580969 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:19.582583 14222 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.587801 16510 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.593227 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2052) took 1444 ms. Trace:
W20260709 13:18:19.594264 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.593828 14228 rpcz_store.cc:276] 0709 13:18:18.148895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.150723 (+  1828us) service_pool.cc:224] Handling call
0709 13:18:18.151010 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.864969 (+713959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.592851 (+727882us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540026cfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:19.593153 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636417920}
I20260709 13:18:19.632889 14299 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:19.631214 16569 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:19.637564 16569 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.637970 16510 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.639997 16569 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:19.648032 16526 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.894s	user 0.000s	sys 0.002s
I20260709 13:18:19.647998 16446 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:19.652848 14376 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:19.655690 14892 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:19.628110 16395 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:19.655532 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:19.656616 16395 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:19.658648 16530 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.988s	user 0.004s	sys 0.003s
I20260709 13:18:19.659476 16247 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.660435 16395 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.651644 16439 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.649686 16310 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.665072 16310 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:19.665944 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.665740 16380 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.666887 14898 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:19.666957 16304 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:19.667708 16304 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:19.672739 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.673424 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:19.674391 14897 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 4 LEARNER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:19.674543 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:19.661515 16247 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:19.657328 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:19.679435 14221 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.680583 14222 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:19.688112 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.697902 16551 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.698515 16551 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.699082 16551 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.655364 16542 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:19.689947 16247 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:19.702788 16247 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.669780 16304 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.705163 16247 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.707446 16371 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:19.708006 16371 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.710745 16371 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:19.711565 16371 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:19.712054 16371 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.712217 16519 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.691320 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:19.737874 14223 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:19.715662 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.739926 14226 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:19.717232 14229 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:19.712946 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:19.716355 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:19.745144 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.745396 14223 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:19.747517 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:19.749601 14224 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:19.750512 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 59296.2us
I20260709 13:18:19.752734 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:19.753332 14297 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.754362 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.758181 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.758777 14299 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:19.762028 14342 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:19.764200 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:19.769915 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:19.772137 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:19.773753 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:19.689852 16507 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:19.829365 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55698.6us
W20260709 13:18:19.829594 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 116747us
I20260709 13:18:19.833096 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:19.836803 14304 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:19.830760 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:19.838280 14301 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.845033 14297 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
W20260709 13:18:19.779747 16527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.291s	user 0.000s	sys 0.030s
I20260709 13:18:19.742586 16304 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:19.778896 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:19.848330 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:19.850302 14193 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:19.850594 14302 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:19.848778 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 70854.9us
I20260709 13:18:19.850683 14227 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:19.874468 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 341714us
I20260709 13:18:19.777313 16573 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.877872 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:19.883428 14221 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:19.878346 14224 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:19.767412 16424 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:19.777884 16422 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:19.778010 14220 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.885712 14227 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:19.846719 16446 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:19.887604 14299 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
W20260709 13:18:19.851779 16527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.361s	user 0.007s	sys 0.041s
I20260709 13:18:19.851774 16492 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.849699 16383 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.848501 16380 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.775159 16501 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:18:19.905356 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.828881 16542 consensus_queue.cc:1059] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:18:19.832512 16299 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:18:19.847615 16570 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.876890 16533 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.911391 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:19.924952 14896 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.767621 16509 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 13:18:19.833256 16510 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:18:19.915951 14302 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
W20260709 13:18:19.904003 16580 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:18:19.897362 16422 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.887642 16541 raft_consensus.cc:2764] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:18:19.923997 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 159884us
I20260709 13:18:19.972190 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:19.949579 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.974748 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:19.975456 14221 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:19.975504 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.976187 14227 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:19.977959 14270 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:19.961284 16581 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:19.956498 16386 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.943055 16439 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:19.956135 16570 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:19.897511 16428 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:19.905537 16514 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:19.959882 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:19.990408 14224 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.912268 16492 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:19.899654 16573 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.970435 16422 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:19.988731 16386 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.989460 16439 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.995062 16573 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:19.995746 16439 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:19.911583 16446 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.854039 16304 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:19.896395 16424 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.961187 16578 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.955322 16503 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:18:20.001889 14896 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:19.986984 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:19.961741 16247 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:18:19.958086 16533 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:19.993734 16386 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.017067 16424 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:20.041970 16418 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:20.042990 16304 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:20.043457 16418 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:20.043949 16418 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:20.045264 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:20.045671 16501 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:20.046074 16501 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:20.046787 16511 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:20.047039 16501 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.047376 16511 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.048262 16501 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.049403 16511 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:20.051144 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:20.052129 16576 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:20.052299 16558 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:20.052677 16576 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:20.052877 16558 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:20.044740 16418 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.058092 16576 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.058708 16570 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.002264 16428 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.038341 16371 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:20.061072 16519 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:20.076577 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 226325us
I20260709 13:18:20.081094 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:18:20.085848 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 208040us
I20260709 13:18:20.137233 14224 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:20.154979 16341 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.155085 16428 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:20.148437 16558 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.157521 16533 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:20.161439 16547 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:20.162341 16446 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:20.117846 16521 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:20.164297 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:20.171766 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:20.192209 14296 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:20.074115 16422 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:18:20.177297 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 96264.6us
I20260709 13:18:20.182127 14900 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:20.076170 16492 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.190479 16547 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:20.163830 16551 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.191529 16521 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.181852 16503 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.261241 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:20.196442 14301 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:20.241317 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:20.242251 14221 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:20.269541 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:20.270520 14296 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:20.272107 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:20.273244 14299 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:20.275416 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:20.276363 14297 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:20.265595 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:20.267596 14867 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:20.279457 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 428392us
I20260709 13:18:20.280066 14299 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:20.281416 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:20.282128 14299 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 3: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:20.283504 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:20.284860 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:20.286250 14298 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:20.286990 14865 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:20.288887 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:20.289471 14298 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:20.292376 14299 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:20.251355 16501 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:20.262923 16503 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.263824 16507 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:18:20.309773 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 337629us
I20260709 13:18:20.319244 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:20.286170 16304 raft_consensus.cc:2764] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:20.285542 16520 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.324106 16540 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:20.330596 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:20.296007 16533 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:20.329108 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48420.8us
I20260709 13:18:20.337451 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:20.329360 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61864.7us
I20260709 13:18:20.329952 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:20.326380 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:20.340284 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:20.331362 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:20.340512 14867 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:20.340847 14896 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.341009 14299 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:20.308815 16428 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:20.318846 16503 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.349696 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:20.320694 16505 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:20.295740 16339 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:18:20.285738 16586 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:18:20.329623 16520 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.361105 16607 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:20.332701 16432 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:20.330890 16540 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:20.362969 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:20.363529 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:20.362972 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:20.364490 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:20.338941 16567 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:20.366947 14301 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:20.371104 14896 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:20.373086 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:20.373288 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 395403us
W20260709 13:18:20.373982 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.319154 16501 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.395614 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:20.397863 14900 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:20.395779 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:20.401568 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:20.408916 14378 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:20.338878 16542 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:18:20.411213 14369 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:20.363991 16520 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.347498 16371 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:18:20.395406 16420 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:20.381313 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:20.367064 16334 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:20.367789 16453 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.417685 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:20.377179 16374 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.422184 14375 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.428159 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:20.365976 16505 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.421366 16356 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.420492 16567 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.381276 16310 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:20.428524 16420 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:20.380800 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:20.415360 16507 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.364902 16607 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.505125 14374 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:20.555720 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:20.465185 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:20.443913 14369 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:20.560317 14375 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
W20260709 13:18:20.562453 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 231042us
I20260709 13:18:20.563323 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:20.565105 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 224662us
I20260709 13:18:20.565958 16420 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:20.567706 16576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.046s	sys 0.054s
W20260709 13:18:20.568162 16576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.046s	sys 0.055s
I20260709 13:18:20.568794 16576 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:20.572305 16356 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.573165 16576 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:20.574136 14378 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:20.574656 16356 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:20.581458 16576 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.587687 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:20.588946 16597 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:20.588948 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 239310us
I20260709 13:18:20.589663 16597 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:20.591250 16597 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.446139 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:20.519289 16427 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:20.599383 16609 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.599601 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 218844us
I20260709 13:18:20.600167 16609 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.600886 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:20.602964 16609 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:20.441946 16374 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.604583 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:20.437991 16453 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.609234 16453 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:20.609844 14901 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.610214 16589 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:20.610706 16589 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.611080 16589 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:20.613224 16247 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:20.618629 14220 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.618531 16547 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.619056 16589 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.620077 16547 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.620488 16428 raft_consensus.cc:697] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:20.621560 16428 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:20.624993 14267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.008s	sys 0.018s
W20260709 13:18:20.625365 14267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.008s	sys 0.018s
W20260709 13:18:20.625609 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 680538us
I20260709 13:18:20.626768 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:20.627610 16609 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:20.628158 16383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.000s	sys 0.028s
W20260709 13:18:20.628505 16383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.000s	sys 0.028s
I20260709 13:18:20.628777 16383 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:20.629669 16383 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.632274 14220 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:18:20.632889 16393 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:18:20.633580 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 476) took 1081 ms. Trace:
I20260709 13:18:20.634083 14220 rpcz_store.cc:276] 0709 13:18:19.551822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.552351 (+   529us) service_pool.cc:224] Handling call
0709 13:18:19.552686 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.708633 (+155947us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4c00199100. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb358a20 00007f8deb369a29 00007f8deb32f644 00007f8deb356f2d 00007f8deb356b93 00007f8ded08718b 00007f8ded087cb5 00007f8ded082f30 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416
0709 13:18:20.157578 (+448945us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b1800264600. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0c7646 00007f8ded00158e 00007f8ded082f9e 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4
0709 13:18:20.286957 (+129379us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b58001586d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8decfe80aa 00007f8ded06a447 00007f8ded082fe7 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4
0709 13:18:20.618466 (+331509us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b58003ed5d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8decfe80aa 00007f8ded06a447 00007f8ded082fe7 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4
0709 13:18:20.632705 (+ 14239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.633500 (+   795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352796928}
I20260709 13:18:20.499086 16505 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:20.507342 16578 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:20.639992 14373 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 3: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:18:20.640173 16424 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 13:18:20.483320 16422 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:20.640547 16424 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.565932 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:20.642858 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77019.6us
I20260709 13:18:20.644591 14193 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:20.627995 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:20.634106 16533 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:20.646507 14267 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:20.645119 14901 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:20.649097 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:20.654099 14378 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:20.672021 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:20.598246 16427 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:20.529084 16595 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:18:20.695027 14371 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:18:20.683036 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.696800 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:20.697655 14220 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.435856 16334 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.702850 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:20.705521 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:20.709239 14295 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:20.659514 16582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.011s	sys 0.007s
I20260709 13:18:20.605571 16374 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:20.693288 16422 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:20.496579 16551 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:20.497203 16596 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.546839 16501 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:20.531576 16521 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:20.506057 16566 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:20.729809 14369 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:20.733399 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:20.677088 16570 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:18:20.695205 16512 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:18:20.740710 16520 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.742134 16612 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:20.743389 16589 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:20.685760 16609 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:20.810307 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:20.744325 16533 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.746258 16539 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.748464 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 70402.5us
I20260709 13:18:20.678421 16299 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:18:20.689812 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:20.753695 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:20.756511 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:20.674232 16564 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:20.664018 16542 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:20.678242 16439 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:20.719491 16582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.011s	sys 0.007s
I20260709 13:18:20.682551 16618 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:20.800232 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 71761.4us
W20260709 13:18:20.742173 16341 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.003s
I20260709 13:18:20.684784 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:20.802291 16521 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:20.850255 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 165608us
I20260709 13:18:20.803982 14220 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:20.765985 16596 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.808907 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:20.857275 14222 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:20.688649 16430 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:20.767369 16386 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.001s
I20260709 13:18:20.863904 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:20.864346 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:20.864616 14896 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 1.
I20260709 13:18:20.674793 16567 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.821522 14341 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:20.764380 16424 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:20.769726 16453 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:20.836301 14376 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:20.844869 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:20.712389 16578 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.853339 16380 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:20.878602 16380 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.766423 16422 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.856217 16432 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:20.866645 16386 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.867784 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:20.868243 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.802018 16566 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.889045 14374 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 2: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:20.886088 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:20.860677 16596 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.873101 14369 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:20.860154 16430 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.856495 16558 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:20.858517 16573 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.818116 16503 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.873679 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:20.859172 16599 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:20.896533 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:20.849610 16576 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:18:20.901223 14373 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 1.
I20260709 13:18:20.847826 16542 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:20.899533 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 87583.9us
W20260709 13:18:20.885272 14267 connection.cc:256] RPC call timeout handler was delayed by -1.0389173600001413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
I20260709 13:18:20.849419 16593 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:18:20.885766 16439 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.910722 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:20.911521 14369 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:20.909101 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:20.905208 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:20.912743 14228 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:20.900846 16430 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.861449 16521 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.889173 16432 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.925686 14224 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:20.844242 16539 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:20.930038 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:20.880613 16453 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.911168 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:20.903589 16599 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:20.906312 16573 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:20.882603 16578 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.280181 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:20.905669 16586 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:21.284117 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 354070us
I20260709 13:18:21.013140 16609 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:21.284772 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.285550 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 364713us
W20260709 13:18:21.286692 14295 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
I20260709 13:18:20.943114 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:21.295902 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:21.296877 14375 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:21.257323 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:21.074287 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:21.294380 14295 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:21.287937 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:21.289149 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:21.299338 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:21.300463 14375 raft_consensus.cc:2368] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5.
I20260709 13:18:21.301529 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:20.927250 16607 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:21.306981 14372 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:21.313557 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:20.920475 16594 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:21.321406 14375 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:21.324438 14375 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:21.326452 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:21.320264 16586 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:21.360159 16632 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:18:21.360752 16386 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:20.922386 16439 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:21.331449 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:21.331854 14373 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:21.373075 14373 pending_rounds.cc:85] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 1
W20260709 13:18:21.374133 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 82294.4us
I20260709 13:18:21.266242 16520 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:21.194550 16570 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:21.294356 16597 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.974109 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:21.293596 16446 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:21.334444 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:21.335193 16356 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.335193 16339 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.359961 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:21.313877 16509 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.294147 16589 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:21.291070 16599 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.293068 16334 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:20.906155 16558 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.279774 16540 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.337612 14372 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:18:21.380123 14221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.033s	sys 0.048s
I20260709 13:18:21.387676 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:21.289227 16380 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:21.369599 16632 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:21.332319 14892 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
W20260709 13:18:21.398752 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.397126 16594 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.385010 14373 pending_rounds.cc:107] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:18:21.426337 14221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.033s	sys 0.049s
I20260709 13:18:21.434567 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:21.437635 16521 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:21.440541 16624 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.449s	user 0.000s	sys 0.001s
I20260709 13:18:21.467173 16623 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.467321 16578 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:21.405258 16617 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.441203 16566 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:21.441941 16542 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:21.422119 16422 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:21.306495 16609 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.408717 16304 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.454200 16558 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:21.405174 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:21.399359 16446 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:21.462265 14373 raft_consensus.cc:2889] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:21.462792 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2074) took 1089 ms. Trace:
I20260709 13:18:21.404616 16439 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:21.409277 16569 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:21.463485 16632 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:21.466961 14893 raft_consensus.cc:2410] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:21.486441 14295 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:21.488447 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.488291 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:21.465241 16540 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:21.400063 16597 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.406482 16509 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.416311 16339 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.415997 16356 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:21.443377 16539 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:21.401233 16570 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:21.470758 16628 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.506s	user 0.000s	sys 0.001s
I20260709 13:18:21.486672 16393 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:21.467789 16623 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.425872 16589 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.468142 16594 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.497622 16609 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:21.593142 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:21.680580 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 87604.3us
I20260709 13:18:21.681372 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:21.652369 16566 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:21.652818 16393 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:21.653689 16623 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:21.654054 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:21.651960 14221 rpcz_store.cc:276] 0709 13:18:20.372950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.374441 (+  1491us) service_pool.cc:224] Handling call
0709 13:18:20.414623 (+ 40182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.414832 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:20.428826 (+ 13994us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.622516 (+193690us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b18003cf1c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a 00007f8ded096a2a
0709 13:18:21.462406 (+839890us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.462467 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:21.462525 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.462595 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.462732 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13855,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":3125,"raft.queue_time_us":49499,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":10711296,"thread_start_us":839555,"threads_started":2,"wal-append.queue_time_us":304378}
I20260709 13:18:21.654621 14220 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:21.512032 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 193168us
I20260709 13:18:21.654822 14375 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:21.655717 14297 raft_consensus.cc:2410] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:18:21.506593 16420 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.940s	user 0.009s	sys 0.003s
I20260709 13:18:21.656032 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:21.493995 16304 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.682503 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:21.656752 16509 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:21.623786 16637 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:18:21.657148 16597 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:21.658092 16339 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:21.658360 16356 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:21.703763 14267 leader_election.cc:400] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5.
I20260709 13:18:21.654983 14895 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:21.659649 16570 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:21.660367 16569 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.561935 16432 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:21.571537 14867 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 2.039s (SENT) [suppressed 41 similar messages]
I20260709 13:18:21.664497 16632 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:21.665931 16446 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:21.498435 16453 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:21.718339 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:21.499934 16633 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.430s	user 0.000s	sys 0.001s
W20260709 13:18:21.623663 16430 consensus_meta.cc:287] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.001s
I20260709 13:18:21.719542 16430 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:21.506139 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:21.499382 16586 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.717314 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:21.699265 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:21.701092 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:21.702135 14304 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:21.544238 16593 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.709004 16645 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:21.722774 14296 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:21.701709 16566 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.678164 16418 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.682906 16439 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:21.701514 16596 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.797s	user 0.012s	sys 0.000s
I20260709 13:18:21.717249 16646 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:21.717767 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:21.490808 16617 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.792160 14895 raft_consensus.cc:2368] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4.
I20260709 13:18:21.697113 16422 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.698069 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:21.794837 14297 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.796633 16422 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.697296 16420 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:21.750180 14227 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:21.800763 16569 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:21.723435 16632 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:21.771632 16339 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.768662 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:21.748124 16640 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.378s	user 0.007s	sys 0.000s
I20260709 13:18:21.780041 16589 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:21.765208 16393 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:21.783564 16558 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:21.711546 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:21.784093 16304 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:21.770956 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 199455us
I20260709 13:18:21.787550 16418 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:21.770988 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 53750.3us
I20260709 13:18:21.789778 16646 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.793828 14900 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:21.810164 14297 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
W20260709 13:18:21.827337 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 115856us
I20260709 13:18:21.705991 16609 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:18:21.832116 16645 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:21.792640 16596 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.784606 16593 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.870173 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:21.961236 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.991878 14901 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:21.856257 16646 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.856595 16304 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:21.830911 16339 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:21.830307 14893 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:21.745419 16599 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:21.997726 16642 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:21.974074 16645 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:22.042280 16632 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.063020 16632 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.110066 16509 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:22.111251 16632 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:22.202464 16617 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:22.111047 16509 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.259307 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:22.144658 16596 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:22.250803 16593 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:22.246594 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 371836us
I20260709 13:18:22.007145 16304 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.064352 16547 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.071676 16645 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:22.216594 16393 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.264300 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 394267us
I20260709 13:18:22.264247 16589 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:18:22.279165 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:22.261737 14895 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:22.265292 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2077) took 1532 ms. Trace:
I20260709 13:18:22.280794 14224 rpcz_store.cc:276] 0709 13:18:20.732793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.732938 (+   145us) service_pool.cc:224] Handling call
0709 13:18:20.736762 (+  3824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.284758 (+547996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.265035 (+980277us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400149bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:22.265230 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433797376}
I20260709 13:18:22.282863 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:22.266455 16547 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.290347 16642 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.267740 16645 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.292294 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:22.292613 16645 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.293396 16356 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:22.293634 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:22.294046 16356 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.294394 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.294934 14298 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:22.295434 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:22.295845 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.296505 14298 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:22.273169 16632 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:18:22.273201 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:22.287119 16649 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.620s	user 0.003s	sys 0.008s
I20260709 13:18:22.299358 14304 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:22.288551 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 1952) took 1881 ms. Trace:
I20260709 13:18:22.300067 16632 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:22.287621 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 1951) took 1884 ms. Trace:
W20260709 13:18:22.257206 16446 consensus_meta.cc:287] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.000s
I20260709 13:18:22.273222 16393 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.301373 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.269508 16599 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:22.301970 14295 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:22.285679 16501 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.295954 14297 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.297294 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:22.311671 14298 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.312144 16430 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:22.288497 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:22.301059 16446 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.265647 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:22.290266 14894 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:18:22.274916 16646 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.300330 14377 rpcz_store.cc:276] 0709 13:18:20.407154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.407808 (+   654us) service_pool.cc:224] Handling call
0709 13:18:20.422947 (+ 15139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.752841 (+329894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.752883 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.752941 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:20.752993 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.288355 (+1535362us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54003c32d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:22.288398 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.288502 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666412416}
I20260709 13:18:22.305157 14865 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:22.300263 16570 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:18:22.306740 16642 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:22.307376 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.319500 14300 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:22.307734 16393 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:22.300622 14371 rpcz_store.cc:276] 0709 13:18:20.403278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.404800 (+  1522us) service_pool.cc:224] Handling call
0709 13:18:20.419872 (+ 15072us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.695506 (+275634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.287345 (+1591839us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b5400170cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:22.287536 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":632190336}
I20260709 13:18:22.309548 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 685) took 1497 ms. Trace:
W20260709 13:18:22.271756 14892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 739) took 1415 ms (client timeout 1676 ms). Trace:
I20260709 13:18:22.314368 14899 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:22.325980 14897 rpcz_store.cc:276] 0709 13:18:20.812460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.812612 (+   152us) service_pool.cc:224] Handling call
0709 13:18:20.840138 (+ 27526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.853825 (+ 13687us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:20.853852 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.860545 (+  6693us) log.cc:844] Serialized 26 byte log entry
0709 13:18:21.283212 (+422667us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:21.283300 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.283397 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.747497 (+464100us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:22.309162 (+561665us) raft_consensus.cc:1685] finished
0709 13:18:22.309193 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.309468 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13155,"raft.queue_time_us":15637,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6296,"spinlock_wait_cycles":6519680,"thread_start_us":403019,"threads_started":1,"wal-append.queue_time_us":490244}
I20260709 13:18:22.318400 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:22.323757 14297 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:22.324744 14298 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:22.290027 16304 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:22.331796 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:22.328395 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.370015 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:22.371697 14296 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:22.375910 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:22.377873 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.390532 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:22.392046 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:22.393326 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:22.394459 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:22.320786 16454 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.302712 16566 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:22.366825 16386 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.318590 16632 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:22.401473 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.318301 16501 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.396309 16304 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.375187 16642 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.398994 16617 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.398965 16558 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:22.320143 16599 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:22.343135 16339 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:22.346988 16609 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:22.400748 16386 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.454836 14371 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:22.400980 16454 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:22.380532 16439 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.423113 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.399334 16569 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:22.374450 16395 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:18:22.366525 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:22.457882 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:22.328265 14892 rpcz_store.cc:269] 0709 13:18:20.856548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.860080 (+  3532us) service_pool.cc:224] Handling call
0709 13:18:22.270928 (+1410848us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400500fd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:22.271676 (+   748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992845184}
I20260709 13:18:22.421942 16427 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:22.458887 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.467072 14377 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:22.426710 16617 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:22.469679 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 170802us
I20260709 13:18:22.460422 16386 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.472078 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:22.460672 16454 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.461400 16596 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:22.426326 16642 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.462478 16558 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:22.463389 16304 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.461850 16569 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:22.427994 16599 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.481240 16501 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:22.481340 16446 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:22.481858 14376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 1943) took 2119 ms (client timeout 1689 ms). Trace:
I20260709 13:18:22.483214 16642 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:22.502656 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:22.475809 16632 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.483702 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1673) took 2104 ms. Trace:
I20260709 13:18:22.503800 14225 rpcz_store.cc:276] 0709 13:18:20.379425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.379550 (+   125us) service_pool.cc:224] Handling call
0709 13:18:20.410367 (+ 30817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.913238 (+502871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.913281 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.913333 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:20.913377 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.483468 (+1570091us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b540026ded4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:22.483513 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.483626 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156015360}
I20260709 13:18:22.505216 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.505983 14225 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:22.506695 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.507236 14225 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:22.507345 16599 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:22.498066 16596 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:22.508031 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:22.508693 16596 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.509116 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.483250 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2078) took 1733 ms. Trace:
I20260709 13:18:22.473752 16617 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.509938 14227 rpcz_store.cc:276] 0709 13:18:20.749718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.749883 (+   165us) service_pool.cc:224] Handling call
0709 13:18:20.750212 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.798109 (+1047897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.482963 (+684854us) spinlock_profiling.cc:243] Waited 1e+03 ms on lock 0x7b540026cfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:22.483151 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2298919680}
I20260709 13:18:22.511143 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.511750 14227 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:22.484678 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:22.513602 16646 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:22.486888 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.514575 14226 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:22.516671 16573 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:22.487361 14374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 629) took 1949 ms (client timeout 1904 ms). Trace:
I20260709 13:18:22.479096 16569 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:22.518108 14374 rpcz_store.cc:269] 0709 13:18:20.538259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.555421 (+ 17162us) service_pool.cc:224] Handling call
0709 13:18:22.487184 (+1931763us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540028c654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:22.487295 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764451072}
I20260709 13:18:22.520105 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:22.491119 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.521631 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:22.522491 16593 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.522229 16558 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.522934 16593 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:22.523407 16593 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.491868 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.523739 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:22.524268 14221 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:22.475908 16566 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:22.530090 16566 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:22.531004 16566 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.532176 16420 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:22.495400 16567 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:22.463809 16609 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.471824 16439 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:22.534762 16439 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.535854 16393 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:22.536275 16393 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:22.536588 16609 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:22.537328 16439 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:22.486199 14222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 481) took 2799 ms (client timeout 2039 ms). Trace:
I20260709 13:18:22.527246 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:22.528043 14226 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:18:22.542062 14222 rpcz_store.cc:269] 0709 13:18:19.687011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.687325 (+   314us) service_pool.cc:224] Handling call
0709 13:18:22.486035 (+2798710us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540026d4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:22.486130 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683019520}
I20260709 13:18:22.509719 14225 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:22.533972 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 682) took 1823 ms. Trace:
I20260709 13:18:22.537045 16393 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.502885 16642 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.500257 14376 rpcz_store.cc:269] 0709 13:18:20.362620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.362727 (+   107us) service_pool.cc:224] Handling call
0709 13:18:22.481618 (+2118891us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b540039b7d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:22.481756 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074533120}
I20260709 13:18:22.540518 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:22.494313 16509 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:22.544708 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:22.543126 14901 rpcz_store.cc:276] 0709 13:18:20.711052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.711249 (+   197us) service_pool.cc:224] Handling call
0709 13:18:20.711599 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.992625 (+1281026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.533724 (+541099us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540030c5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:22.533914 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2943696256}
I20260709 13:18:22.548451 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:22.546988 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.552311 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:22.555562 14376 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:22.558459 14376 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:22.571009 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 111111us
I20260709 13:18:22.572615 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:22.572774 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.575120 14374 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:22.559528 16386 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.547019 16427 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:22.576131 16427 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:22.576649 16427 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.583917 14193 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:22.587416 14296 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:22.611502 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:22.612190 14300 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.561156 16505 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.614842 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.629145 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.546361 16614 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:18:22.568861 16589 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.644148 14303 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:22.645331 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.625597 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:22.555735 16642 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:22.563937 16573 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:22.640473 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.650897 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.651265 14375 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:22.641507 14296 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:22.642000 14225 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:22.647053 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.637040 14295 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 3: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:22.615341 16393 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.651997 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.665207 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.665472 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.666913 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.653182 14303 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:22.647716 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.667701 14370 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:22.615922 16603 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.668251 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.660586 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.662111 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:22.582240 16430 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:18:22.679477 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.680095 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.667086 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:22.649477 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 273650us
I20260709 13:18:22.680665 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.662078 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:22.569482 16501 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:18:22.669344 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.685511 14377 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:22.669934 14303 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:18:22.687539 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.653877 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.674307 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.689057 14372 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:22.568730 16569 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.641243 16612 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.681573 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:22.735617 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 54214.4us
I20260709 13:18:22.735898 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:22.736588 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:22.682406 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:22.737609 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54182.3us
I20260709 13:18:22.680671 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:22.682448 14226 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:22.640009 16645 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:22.650767 16395 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.688337 14303 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:22.746001 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:22.746447 14303 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.738497 14376 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:22.711650 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.728539 14300 raft_consensus.cc:2410] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:22.734273 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.748121 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:22.748315 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.735656 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.748591 14225 raft_consensus.cc:2410] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:22.750366 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.739187 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:22.656200 16658 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:22.750450 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64729.7us
W20260709 13:18:22.757779 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 75450.5us
I20260709 13:18:22.748997 14304 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:22.758637 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:22.753751 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.759440 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:22.759582 14295 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:22.760113 14304 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:22.753750 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.755085 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.761840 14300 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:22.765043 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.765733 14223 raft_consensus.cc:1813] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Handling vote request from an unknown peer bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:22.766448 14223 raft_consensus.cc:2410] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:18:22.766372 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.767153 14304 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:22.768760 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:22.769606 14227 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:22.734979 16612 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:22.750968 16439 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.749004 16609 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.679090 16573 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.779136 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.650115 16589 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.783835 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.821148 14303 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:22.765828 16304 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.840157 14300 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:22.778769 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:22.834282 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 439873us
I20260709 13:18:22.771929 14295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:18:22.835554 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.756457 16420 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:18:22.839984 14301 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:22.775417 16509 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:22.842016 14303 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:22.847259 14301 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:22.783535 16612 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.850476 14295 raft_consensus.cc:606] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:22.782650 16386 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:22.765297 16645 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.855198 14295 raft_consensus.cc:614] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:22.857913 14301 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:22.864641 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.772696 16653 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:22.868630 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.871201 14227 raft_consensus.cc:2410] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:18:22.843587 16304 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:22.849376 16667 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:18:22.768873 16564 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:18:22.844759 14865 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:22.907846 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 63198.3us
I20260709 13:18:22.910588 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:22.927719 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.928194 16569 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:22.929450 16669 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:18:22.931628 16657 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:18:22.943149 16663 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:22.943997 16663 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.945449 16569 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.946012 16569 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.947633 16663 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:22.948113 16569 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:22.948871 16662 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.949342 16662 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:22.949717 16662 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.956077 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.958135 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.958979 14223 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:22.959360 16662 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:22.960855 16642 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:22.962809 16589 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:22.836315 16632 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:18:22.983741 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2080) took 2229 ms. Trace:
I20260709 13:18:22.985000 14296 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
W20260709 13:18:22.984001 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 212614us
I20260709 13:18:22.986332 14193 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:22.991618 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:22.992439 14302 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.984190 14229 rpcz_store.cc:276] 0709 13:18:20.754600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.755242 (+   642us) service_pool.cc:224] Handling call
0709 13:18:20.755595 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.943558 (+187963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.943604 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.943662 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:20.943707 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.983459 (+2039752us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540026bbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:22.983512 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.983677 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431827328}
W20260709 13:18:23.011569 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 455019us
I20260709 13:18:23.012884 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:23.013916 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:23.023308 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:22.897387 16304 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.094651 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:23.102509 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:23.103742 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 89872.5us
I20260709 13:18:23.133309 14301 raft_consensus.cc:2376] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3. Re-sending same reply.
I20260709 13:18:23.134383 14223 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:23.134436 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:23.104768 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 93244.8us
I20260709 13:18:22.964506 16386 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:22.962759 16662 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:22.873930 16512 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.162s
I20260709 13:18:23.192819 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:23.195215 14303 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:18:23.135815 16511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.005s	sys 0.026s
I20260709 13:18:23.011271 16642 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:23.181336 16609 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.102605 16430 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:23.211982 16662 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:23.217689 14302 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:23.221830 16642 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.222434 16567 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:23.222875 16567 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:23.223311 16567 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:23.224381 16642 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:23.227322 16454 consensus_meta.cc:287] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.000s
I20260709 13:18:23.227439 16662 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.228152 16680 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:23.228019 16454 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.228638 16680 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:23.229015 16680 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.229211 16418 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:23.231302 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:22.988906 16596 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.209s
W20260709 13:18:23.243698 16665 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:23.231498 16454 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:23.161227 16573 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:23.198827 16658 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:23.250742 16658 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:23.253260 16654 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:23.203353 16511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.005s	sys 0.026s
W20260709 13:18:23.259181 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 484591us
I20260709 13:18:23.194052 16386 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:23.087837 16617 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.262821 14220 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:23.271837 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:23.216188 16430 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:23.229705 16662 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:23.257887 16512 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:23.277453 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 141227us
I20260709 13:18:23.283346 14341 leader_election.cc:400] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4.
I20260709 13:18:23.283746 14341 leader_election.cc:403] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:23.283664 16512 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:23.286721 16512 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:23.288646 16512 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:23.289505 16427 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 13:18:23.290485 16645 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:23.296762 16511 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4.
I20260709 13:18:23.293754 16418 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:23.298084 16418 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:23.281670 16430 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.298874 16418 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:23.299836 16418 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.291553 16304 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.303447 16304 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:23.304864 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:23.305501 14229 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:23.292066 16617 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:23.292757 16503 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:23.266464 16386 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.309378 16567 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:23.310257 16427 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.310604 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:23.311825 16593 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.788s	user 0.006s	sys 0.003s
I20260709 13:18:23.316627 16386 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.324470 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:23.247007 16609 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.329195 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:23.324381 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 190016us
I20260709 13:18:23.332844 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.332934 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.334591 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:23.335189 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.328836 16593 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.336218 16683 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:23.336812 16567 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:23.347883 14896 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:23.348110 14901 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:23.348403 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:23.351277 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:23.367741 14229 raft_consensus.cc:2376] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3. Re-sending same reply.
I20260709 13:18:23.368497 16689 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:23.352329 14224 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:23.348711 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:23.369164 16689 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.370674 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:23.371965 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:23.372936 16689 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:23.348964 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:23.375154 14299 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:23.350282 14900 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:23.349171 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:23.349768 14297 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:18:23.363699 14298 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:23.379180 14297 pending_rounds.cc:85] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 3
I20260709 13:18:23.379492 14297 pending_rounds.cc:107] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:18:23.368388 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:23.369339 16420 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:23.348306 14897 raft_consensus.cc:1813] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Handling vote request from an unknown peer bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:23.384547 14897 raft_consensus.cc:2410] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:18:23.379778 14297 raft_consensus.cc:2889] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:23.386665 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:23.389413 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:23.391647 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:23.392360 14229 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.362775 16653 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:23.412422 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:23.415244 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:23.415392 14897 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:23.427924 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 59618.3us
I20260709 13:18:23.394662 16567 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:23.416654 16653 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:23.340524 16564 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:18:23.430488 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.383911 16420 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.433386 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:23.434820 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.396196 16542 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:18:23.439973 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:23.442770 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:23.454412 16395 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:23.394536 16615 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:23.463203 14901 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:23.464190 14896 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 4 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:23.469584 14300 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:23.432904 16569 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:23.432293 16427 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:23.504319 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.406997 16658 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:18:23.501974 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.502918 14376 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:23.515735 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:23.502835 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.440249 16653 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:23.473302 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:23.469553 14229 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
W20260709 13:18:23.506747 16635 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 2.135s	user 0.017s	sys 0.025s
I20260709 13:18:23.527558 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1701) took 1150 ms. Trace:
I20260709 13:18:23.458737 16420 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.527962 14371 rpcz_store.cc:276] 0709 13:18:22.377039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.377175 (+   136us) service_pool.cc:224] Handling call
0709 13:18:23.527372 (+1150197us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b54001b9754. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:23.527482 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120807808}
I20260709 13:18:23.470418 16304 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:23.538000 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.507198 16570 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:23.508951 16386 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:23.509035 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.473145 16395 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.509773 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:23.510244 16509 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:23.510423 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:23.699777 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.003s	sys 0.016s
W20260709 13:18:23.700198 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.003s	sys 0.016s
I20260709 13:18:23.700260 14374 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:23.510999 16569 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:23.700739 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 687882us
I20260709 13:18:23.701509 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:23.701674 16569 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.703047 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 1965) took 1055 ms. Trace:
I20260709 13:18:23.704018 14374 rpcz_store.cc:276] 0709 13:18:22.647677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.648120 (+   443us) service_pool.cc:224] Handling call
0709 13:18:23.528490 (+880370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.700650 (+172160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.702069 (+  1419us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54001b9754. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:23.702859 (+   790us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54001b9750. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:23.702987 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2418043008}
I20260709 13:18:23.511449 16505 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:23.705818 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2089) took 1034 ms. Trace:
I20260709 13:18:23.705711 16505 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.706229 14224 rpcz_store.cc:276] 0709 13:18:22.671378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.671511 (+   133us) service_pool.cc:224] Handling call
0709 13:18:22.671813 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.369492 (+697679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.705543 (+336051us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400341554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:23.705725 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564617088}
I20260709 13:18:23.708115 16505 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:23.511991 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:23.708889 14369 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.709774 16509 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.521023 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.710743 14378 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 3: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:23.521071 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.524906 14901 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:23.526755 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.526919 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:23.527009 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.440908 16614 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:23.470602 16642 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:23.500360 16615 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.510169 16609 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:23.553114 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.720595 14371 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:23.556046 16680 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.457216 16676 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:18:23.558076 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.559770 14867 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:23.560305 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:23.590775 16547 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:23.643494 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.594672 16593 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:23.561802 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49283.4us
I20260709 13:18:23.527951 16507 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:23.636983 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:23.737758 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 100855us
W20260709 13:18:23.602900 16668 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.674s	user 0.003s	sys 0.003s
I20260709 13:18:23.530614 16511 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:18:23.649574 14126 catalog_manager.cc:5697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 3, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 3 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:23.720688 16615 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.598649 14270 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:23.792788 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 194213us
I20260709 13:18:23.792945 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 496) took 1305 ms. Trace:
W20260709 13:18:23.594849 16612 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.000s
W20260709 13:18:23.580127 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50881.1us
I20260709 13:18:23.802986 14900 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:23.540302 16570 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:23.809043 14222 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:23.538765 16632 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:23.639295 16594 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:23.551103 16304 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:23.640170 16393 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.960s	user 0.007s	sys 0.004s
I20260709 13:18:23.641876 16430 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:23.600732 16697 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.087s	user 0.003s	sys 0.000s
W20260709 13:18:23.654752 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.694651 16670 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.735s	user 0.004s	sys 0.000s
I20260709 13:18:23.793314 14228 rpcz_store.cc:276] 0709 13:18:22.487327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.492314 (+  4987us) service_pool.cc:224] Handling call
0709 13:18:22.492619 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.492949 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.492977 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:22.493427 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:18:22.575457 (+ 82030us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:23.738793 (+1163336us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b1800337fc0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf
0709 13:18:23.758696 (+ 19903us) log.cc:844] Serialized 14 byte log entry
0709 13:18:23.759018 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.759129 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.759187 (+    58us) raft_consensus.cc:1685] finished
0709 13:18:23.792738 (+ 33551us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.792889 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":367511,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":1654,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":4078,"spinlock_wait_cycles":54377344,"thread_start_us":162949,"threads_started":2,"wal-append.queue_time_us":159017}
I20260709 13:18:23.696296 16422 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:23.697031 14864 connection.cc:256] RPC call timeout handler was delayed by -1.9289934689998063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:18:23.845856 14864 connection.cc:256] RPC call timeout handler was delayed by -1.7306687350001084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 13:18:23.846347 14864 connection.cc:256] RPC call timeout handler was delayed by -1.2549976000000242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 13:18:23.846695 14864 connection.cc:256] RPC call timeout handler was delayed by -1.0057443749999493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260709 13:18:23.834568 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:23.847555 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:23.697454 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.709969 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:18:23.848780 16653 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.497305 16683 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:23.715440 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.722846 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:23.722831 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:23.852401 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 129664us
I20260709 13:18:23.728973 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:23.729697 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.730374 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:23.730966 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.733522 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.736828 14896 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:23.753517 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.855554 14377 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
W20260709 13:18:23.739218 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 179488us
I20260709 13:18:23.763661 16680 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:23.765208 16694 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:23.770354 16420 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.758605 16588 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:23.772970 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:23.773099 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2182) took 1138 ms. Trace:
W20260709 13:18:23.866578 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 93689.7us
I20260709 13:18:23.736868 16505 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:18:23.774062 16591 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:23.774734 16501 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:23.719868 16509 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.773691 16623 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
W20260709 13:18:23.781288 16701 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:18:23.761565 16593 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:23.910070 16593 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:23.910689 16593 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.781315 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:23.915037 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:23.782593 16395 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.916076 16566 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:23.916543 16566 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:23.916976 16566 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.918110 16395 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:23.918553 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:23.738592 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:23.723676 16614 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.787984 14126 catalog_manager.cc:5697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:23.919958 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 181448us
I20260709 13:18:23.921020 16614 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:23.920902 14267 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:23.789327 16339 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:23.790549 16654 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:23.657589 14125 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37096 (request call id 352) took 5952 ms. Trace:
I20260709 13:18:23.808184 14224 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:23.538146 16601 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:18:23.811626 14369 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:23.738407 16418 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.737850 16542 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:18:23.737411 16507 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:23.695703 16356 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:23.812726 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:23.945911 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 133310us
I20260709 13:18:23.835382 14223 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:23.844728 16599 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:23.847421 16702 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:23.529232 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:23.949268 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 420073us
I20260709 13:18:23.850610 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:23.852437 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 129734us
I20260709 13:18:23.953802 14344 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:23.726222 16564 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:23.853765 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:23.924767 16551 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:23.863582 14225 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:23.867501 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:23.724290 16642 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.870620 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.876726 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.812351 16645 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:23.964784 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:23.866505 14304 rpcz_store.cc:276] 0709 13:18:22.635116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.771937 (+136821us) service_pool.cc:224] Handling call
0709 13:18:22.772195 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.844954 (+ 72759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.844994 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.845044 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:22.845077 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.772851 (+927774us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b54000fdcd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:23.772904 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.773039 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166897920}
I20260709 13:18:23.814112 16632 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:23.880626 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:23.967293 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 86778.2us
I20260709 13:18:23.967753 14295 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:23.968863 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:23.858130 16607 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:23.859465 16393 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:23.858377 16596 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:23.954514 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:23.896404 16304 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:23.882477 16512 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:18:23.893900 16589 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.808585 16658 raft_consensus.cc:2955] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:23.899428 16689 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:23.882320 16422 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:23.859747 16683 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.812318 16612 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.922349 16588 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:23.902277 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.906755 16653 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:23.907548 16420 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:23.908403 16693 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:23.920449 14126 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 3 to 4, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 4 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:23.913182 16615 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.078747 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:23.974825 16695 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:23.926291 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:23.921655 16594 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.909420 16430 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:23.858752 14370 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:23.928400 16662 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:23.921953 16339 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:23.928601 16654 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:23.924535 14125 rpcz_store.cc:276] 0709 13:18:17.703706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.707627 (+  3921us) service_pool.cc:224] Handling call
0709 13:18:23.625887 (+5918260us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:18.485054 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:18.485622 (+   568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:18.485657 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:18.485674 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:18.486499 (+   825us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:18.486592 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:18.486622 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:18.487315 (+   693us) tablet.cc:701] Row locks acquired
0709 13:18:18.487335 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:18:18.487478 (+   143us) write_op.cc:270] Start()
0709 13:18:18.487602 (+   124us) write_op.cc:276] Timestamp: P: 1783603098487430 usec, L: 0
0709 13:18:18.487626 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:18.488308 (+   682us) log.cc:844] Serialized 2475 byte log entry
0709 13:18:19.639574 (+1151266us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8de9f820ac 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b
0709 13:18:20.124355 (+484781us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18002bf000. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f522 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:18:20.578956 (+454601us) op_driver.cc:464] REPLICATION: finished
0709 13:18:21.217248 (+638292us) write_op.cc:301] APPLY: starting
0709 13:18:21.264732 (+ 47484us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:21.329546 (+ 64814us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:21.332597 (+  3051us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:21.501038 (+168441us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:21.501386 (+   348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:18:21.501454 (+    68us) write_op.cc:312] APPLY: finished
0709 13:18:21.501861 (+   407us) log.cc:844] Serialized 53 byte log entry
0709 13:18:21.502091 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:21.502240 (+   149us) write_op.cc:454] Released schema lock
0709 13:18:21.502308 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:21.502909 (+   601us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:21.502957 (+    48us) write_op.cc:454] Released schema lock
0709 13:18:22.263599 (+760642us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b18002bf000. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f522 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
Metrics: {"mutex_wait_us":1616,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":409992,"apply.run_cpu_time_us":13659,"apply.run_wall_time_us":433412,"num_ops":6,"prepare.queue_time_us":264412,"prepare.run_cpu_time_us":52151,"prepare.run_wall_time_us":1427713,"raft.queue_time_us":577628,"raft.run_cpu_time_us":37263,"raft.run_wall_time_us":263671,"replication_time_us":2091128,"spinlock_wait_cycles":143653504,"thread_start_us":2699294,"threads_started":4,"wal-append.queue_time_us":1432582,"wal-append.run_cpu_time_us":20942,"wal-append.run_wall_time_us":2586071}]]}
I20260709 13:18:24.099473 14375 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:23.878400 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.860251 16558 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:23.970727 14864 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:23.978204 16614 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
W20260709 13:18:23.973675 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 120026us
W20260709 13:18:23.973717 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 106293us
I20260709 13:18:23.946760 16567 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:24.104585 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:23.976492 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:24.106629 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 130198us
I20260709 13:18:23.976967 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:23.979369 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:23.946290 16680 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:18:23.966351 16663 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:24.095767 16686 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:24.105391 14373 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:24.119556 14370 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:24.120147 14373 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:24.026404 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:24.026612 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 108134us
I20260709 13:18:23.902369 14377 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:23.948043 16418 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:23.980325 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86671.2us
I20260709 13:18:24.127161 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:24.127487 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:24.127926 14371 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:23.960177 16551 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:18:24.131105 16706 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:18:24.131289 16551 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:23.980783 16427 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:24.099682 16430 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:24.132489 16427 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:24.132721 16430 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:24.133039 16427 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.133680 16430 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.135046 16430 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.093488 16570 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.136427 16570 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.136600 16566 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.068596 16712 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:24.138098 16712 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.139008 16615 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:24.113665 16567 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:24.139737 16339 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.140247 16712 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:24.027145 14895 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:24.140126 16567 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.140965 16339 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.141249 16567 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.141530 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:24.142341 16708 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:18:23.787310 16609 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:24.142942 16609 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.143134 14895 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:24.143362 16609 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.965327 16645 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.144143 16645 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.059811 16589 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:24.033751 14898 raft_consensus.cc:2955] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:24.147370 16589 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:23.960567 16599 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.151829 16599 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:24.079819 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:23.975003 16501 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.153909 16501 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:23.974779 16623 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.154698 16612 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:24.001727 16304 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:23.965397 16692 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:18:24.085963 14897 raft_consensus.cc:2410] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:24.027148 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:24.066828 16422 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:23.975955 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:24.118637 16695 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.109951 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:23.979233 16596 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.105440 14342 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:24.188395 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 83060.7us
I20260709 13:18:24.113862 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:24.114670 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 144035us
I20260709 13:18:24.190188 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:24.190505 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:24.123449 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:24.124465 14298 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:24.191617 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:24.192644 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:24.193460 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:24.125995 14295 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:24.201239 14220 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:24.126336 16586 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:18:24.129812 16558 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:24.130903 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:24.202524 16586 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:24.125463 16663 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:24.202912 16586 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:24.203073 16663 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.203828 16586 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.205044 16586 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.150151 16588 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:24.084991 14378 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:24.027928 16393 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.206991 16645 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.209074 16645 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:24.211833 16663 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:24.213369 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.158989 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 232730us
I20260709 13:18:24.108759 14894 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.028031 16507 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.185633 14374 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.214494 16507 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.215096 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:24.209662 16645 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:24.215935 14371 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:18:24.216229 16645 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:24.189340 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:24.218240 16601 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.218501 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:24.220647 14894 raft_consensus.cc:2410] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:24.223577 14303 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:18:24.224537 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.223739 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:24.222473 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.227294 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.223229 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:24.230664 14374 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:24.098017 16632 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:24.334198 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 210810us
I20260709 13:18:24.335440 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:24.284708 16601 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:24.339010 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:24.340982 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:24.222579 16509 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.224041 16599 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.225694 16615 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:24.217092 16645 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.160629 16304 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:24.229238 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:24.324539 14298 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:24.324558 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:24.325016 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:24.360554 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:24.361259 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:24.327827 14296 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:24.328025 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:24.346761 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:24.321969 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:24.364687 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 133589us
I20260709 13:18:24.365763 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:24.366026 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.228081 16609 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.340312 16589 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:24.303376 16614 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:24.367898 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:24.373019 14267 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:24.371001 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:24.376555 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:24.379746 16719 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.380528 16719 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.337030 16663 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:24.403018 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:24.394249 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:24.345597 16693 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:24.407158 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:24.327119 16676 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:24.410247 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:24.410957 14296 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.418010 14295 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:24.358966 16712 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:24.363663 16304 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.406035 14303 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:24.357693 16642 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:24.382571 14895 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.378216 16589 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.378906 16615 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:24.403395 16558 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:24.424011 16593 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 13:18:24.432173 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:24.409853 16693 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.363130 16599 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.415124 16676 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:24.424751 16712 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:24.462545 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:24.433274 16642 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.467653 16693 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.352851 16422 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.353396 16601 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.430094 16589 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.499725 14298 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:24.474110 16712 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.471411 16695 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:24.471210 16676 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:24.493893 16566 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:24.524950 14296 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:24.510661 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 647) took 1007 ms. Trace:
I20260709 13:18:24.478967 16710 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:24.478320 16713 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:24.465490 14342 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:24.531774 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 66392.2us
I20260709 13:18:24.528581 14375 rpcz_store.cc:276] 0709 13:18:23.502765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.520678 (+ 17913us) service_pool.cc:224] Handling call
0709 13:18:24.510391 (+989713us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54002ecf54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:24.510581 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887698816}
I20260709 13:18:24.532356 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:24.532689 14899 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:24.515630 14226 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:24.475720 16709 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.454752 16593 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.475210 16418 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:24.538455 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:24.546471 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:24.547367 14296 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:24.540226 16713 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:24.552088 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:24.552623 14226 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.537904 16501 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.537600 16695 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.558095 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:24.550750 16418 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:24.559800 16687 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.551216 16710 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:24.553432 16713 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.538324 16427 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.550673 16720 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:24.533377 16558 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.608843 16601 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:24.612519 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:24.556665 16718 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:18:24.614233 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:24.614888 16718 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:24.521204 16615 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:24.587906 16509 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:24.615293 16718 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:24.593231 16722 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.603884 16418 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:24.550781 16709 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.636073 16721 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:24.656755 14300 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:24.658368 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:24.662061 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:24.669987 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 442999us
I20260709 13:18:24.672928 16747 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:24.674775 16726 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:24.679526 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:24.680577 16746 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.684850 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:24.639849 14892 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:24.648056 16567 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260709 13:18:24.692013 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:24.693161 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 338316us
I20260709 13:18:24.695313 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:24.626041 16720 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.651535 16722 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.702162 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.669613 16740 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.684024 16717 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:24.706300 16731 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:18:24.712539 14226 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:24.686204 16609 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:24.688992 16721 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:24.714227 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 341322us
I20260709 13:18:24.719672 14267 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:24.713147 14193 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:24.713997 16725 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:18:24.729843 16716 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:24.702394 16570 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:18:24.694811 16718 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.690191 16710 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.688496 16747 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:18:24.687067 16723 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:24.714099 16727 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.746387 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:24.759397 14895 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
W20260709 13:18:24.760308 16662 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.001s
I20260709 13:18:24.725914 16721 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.761905 14342 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:24.762655 14226 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:18:24.784884 14226 pending_rounds.cc:85] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 5
I20260709 13:18:24.785210 14226 pending_rounds.cc:107] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:18:24.785504 14226 raft_consensus.cc:2889] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.750821 16739 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:24.688937 16418 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.732206 16709 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:24.760816 16427 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:24.745002 16593 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:24.781747 16609 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:24.796276 16430 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.661s	user 0.005s	sys 0.004s
I20260709 13:18:24.804442 16740 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:18:24.805886 16718 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.761206 16566 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:24.799758 14898 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.000s
I20260709 13:18:24.790238 16662 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.825989 16589 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.805583 16567 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:24.792413 16594 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.000s
W20260709 13:18:24.836506 16507 consensus_meta.cc:287] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.622s	user 0.001s	sys 0.009s
W20260709 13:18:24.838863 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.815596 16566 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:24.850371 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 479440us
I20260709 13:18:24.807022 16739 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.750707 16723 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:24.855160 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 126398us
I20260709 13:18:24.858273 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:24.720326 16722 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:24.859949 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:24.864950 14298 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 3: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:24.847465 16567 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:24.868541 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.857589 16739 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:24.860072 16566 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.854883 16594 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.875572 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1710) took 1146 ms. Trace:
I20260709 13:18:24.864030 16430 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:24.763060 16716 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:24.855383 16304 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:24.890914 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.876055 14374 rpcz_store.cc:276] 0709 13:18:23.729648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.730166 (+   518us) service_pool.cc:224] Handling call
0709 13:18:24.875400 (+1145234us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54003340d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:24.875513 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762686848}
I20260709 13:18:24.884996 14298 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:24.867182 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:24.865701 14302 raft_consensus.cc:2955] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:24.864323 16743 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.164s
W20260709 13:18:24.942349 14897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 713) took 1513 ms (client timeout 1749 ms). Trace:
W20260709 13:18:24.942909 14897 rpcz_store.cc:269] 0709 13:18:23.429303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.434532 (+  5229us) service_pool.cc:224] Handling call
0709 13:18:23.508929 (+ 74397us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67eee 0000000000375939 00007f8df1fdb1e0 00007f8df20a40c4 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:24.942096 (+1433167us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54005014d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:24.942282 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239217920}
I20260709 13:18:24.935215 16662 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.936005 16505 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:24.941902 16723 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:24.949447 14304 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:24.970417 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1709) took 1241 ms. Trace:
W20260709 13:18:24.878211 16654 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.002s
I20260709 13:18:24.971046 14378 rpcz_store.cc:276] 0709 13:18:23.729308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.729462 (+   154us) service_pool.cc:224] Handling call
0709 13:18:24.970161 (+1240699us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54000b9854. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:24.970334 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531737984}
W20260709 13:18:24.954958 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 87908.1us
I20260709 13:18:24.978452 14299 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:24.954741 16505 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:24.979022 16430 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:24.907963 16720 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:24.873107 16567 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.958941 16662 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:25.020663 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 301053us
I20260709 13:18:25.023162 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:25.005054 16722 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:25.025847 16720 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:25.026343 16720 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.026714 16720 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:24.984611 16654 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:25.003104 16430 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:25.019807 16547 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.041410 16723 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:25.042049 16723 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:25.025120 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:25.047744 16739 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:25.032516 16505 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:25.074460 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 87305.7us
I20260709 13:18:25.084700 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:25.034186 16722 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:25.034970 16430 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.107412 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:25.114790 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:25.116480 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:25.118762 16662 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:25.063475 16718 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:25.063089 16570 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.109298 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:25.086493 16603 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:18:25.128288 16739 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:25.044269 16547 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:25.108145 16723 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:25.175333 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:25.181082 14298 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:25.111617 16505 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:25.259842 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.119453 16662 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:25.112015 16511 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:25.284626 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 175438us
W20260709 13:18:25.304987 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.305226 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:25.120399 16722 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:25.110005 16709 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.173s
I20260709 13:18:25.132500 16570 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:25.283385 16304 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:25.299536 16749 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:25.293025 16511 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:25.349274 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2213) took 1006 ms. Trace:
I20260709 13:18:25.349892 14304 rpcz_store.cc:276] 0709 13:18:24.342599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.408278 (+ 65679us) service_pool.cc:224] Handling call
0709 13:18:24.428397 (+ 20119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.966445 (+538048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.349015 (+382570us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b540020b554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:25.349215 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1197774080}
W20260709 13:18:25.132797 16663 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.005s	sys 0.047s
W20260709 13:18:25.355461 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 62002.9us
I20260709 13:18:25.356848 16658 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:25.410609 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:25.400243 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:25.349123 16734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.030s	sys 0.058s
W20260709 13:18:25.418131 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.439291 14303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.011s	sys 0.028s
W20260709 13:18:25.367410 16645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.009s	sys 0.030s
W20260709 13:18:25.439692 14303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.011s	sys 0.028s
I20260709 13:18:25.443187 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 764) took 1215 ms. Trace:
W20260709 13:18:25.439472 14297 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.019s	sys 0.014s
W20260709 13:18:25.441700 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.299324 16683 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:25.346001 16749 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:25.446259 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.446630 14297 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.019s	sys 0.015s
W20260709 13:18:25.437381 16712 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.910s	user 0.013s	sys 0.000s
I20260709 13:18:25.559442 16547 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:25.805469 16430 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.671s	user 0.012s	sys 0.000s
W20260709 13:18:25.896205 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.414439 16692 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
W20260709 13:18:25.484301 14226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.014s	sys 0.035s
W20260709 13:18:25.922987 14226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.018s	sys 0.060s
I20260709 13:18:25.491132 16654 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:25.445727 14900 rpcz_store.cc:276] 0709 13:18:24.227319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.227434 (+   115us) service_pool.cc:224] Handling call
0709 13:18:25.410350 (+1182916us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:25.443113 (+ 32763us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4435840}
I20260709 13:18:25.544792 16511 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:25.564327 16676 consensus_meta.cc:287] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.030s	user 0.005s	sys 0.005s
W20260709 13:18:25.550412 16693 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.024s	user 0.013s	sys 0.000s
I20260709 13:18:25.447312 16694 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:25.558921 16570 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:25.647935 16503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.016s	sys 0.025s
W20260709 13:18:25.940295 16503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.022s	sys 0.038s
I20260709 13:18:25.565526 16722 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:25.942058 16632 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:25.925132 16430 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:25.944319 16430 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:25.443964 16645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.009s	sys 0.030s
I20260709 13:18:25.945415 14296 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:25.850611 16696 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:25.810192 14864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.030s	sys 0.028s
W20260709 13:18:25.954991 14864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.032s	sys 0.029s
W20260709 13:18:25.461968 16710 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.002s	sys 0.035s
W20260709 13:18:25.549461 16720 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.522s	user 0.003s	sys 0.006s
I20260709 13:18:25.550711 16752 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:25.490906 14897 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:25.550678 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:25.958788 14302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.026s	sys 0.049s
W20260709 13:18:25.960263 14302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.026s	sys 0.049s
I20260709 13:18:25.960505 14220 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:25.955783 14298 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.017s	sys 0.019s
W20260709 13:18:25.552947 16728 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.011s	user 0.004s	sys 0.008s
W20260709 13:18:25.961246 14298 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.018s	sys 0.019s
I20260709 13:18:25.961591 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2185) took 1101 ms. Trace:
I20260709 13:18:25.962015 14302 rpcz_store.cc:276] 0709 13:18:24.860220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.860587 (+   367us) service_pool.cc:224] Handling call
0709 13:18:24.860973 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.861217 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:24.992579 (+131362us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.961041 (+968462us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.961237 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.961285 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:25.961330 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.961407 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.961536 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":633,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":199,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":148,"spinlock_wait_cycles":33024,"thread_start_us":967390,"threads_started":1}
I20260709 13:18:25.963186 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 529) took 1773 ms. Trace:
I20260709 13:18:25.925894 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:25.639029 14194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.014s	sys 0.024s
I20260709 13:18:25.739533 16749 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:25.569737 16713 consensus_meta.cc:287] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.950s	user 0.003s	sys 0.007s
W20260709 13:18:25.438721 16734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.030s	sys 0.058s
W20260709 13:18:25.409946 16663 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.006s	sys 0.050s
W20260709 13:18:25.560611 16721 consensus_meta.cc:287] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.753s	user 0.004s	sys 0.007s
I20260709 13:18:25.300904 16566 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:25.555508 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 1976) took 1451 ms. Trace:
I20260709 13:18:25.556777 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:25.979306 14371 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
W20260709 13:18:25.979941 14371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1718) took 1753 ms (client timeout 1620 ms). Trace:
I20260709 13:18:25.977876 14369 rpcz_store.cc:276] 0709 13:18:24.104447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.106070 (+  1623us) service_pool.cc:224] Handling call
0709 13:18:24.971760 (+865690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.972021 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.972059 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.972115 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:24.972174 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.972251 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.555259 (+583008us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54000b9850. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:25.555427 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989895424}
W20260709 13:18:25.980448 14371 rpcz_store.cc:269] 0709 13:18:24.226429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.226585 (+   156us) service_pool.cc:224] Handling call
0709 13:18:25.556569 (+1329984us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:25.979848 (+423279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4072832}
W20260709 13:18:25.552845 16567 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.523s	user 0.002s	sys 0.006s
W20260709 13:18:25.894419 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.76621e+06us
I20260709 13:18:25.922780 16712 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:25.932121 14192 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:25.936259 16693 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:25.549978 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 524) took 1361 ms. Trace:
I20260709 13:18:25.984143 14224 rpcz_store.cc:276] 0709 13:18:24.188358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.191261 (+  2903us) service_pool.cc:224] Handling call
0709 13:18:25.549272 (+1358011us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:25.549472 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.549656 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.549679 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.549718 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:25.549757 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.549826 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.549923 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39270656}
I20260709 13:18:25.964453 16748 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:25.963757 14227 rpcz_store.cc:276] 0709 13:18:24.189756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.197303 (+  7547us) service_pool.cc:224] Handling call
0709 13:18:24.197728 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.332104 (+134376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.332136 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.332595 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:18:24.422013 (+ 89418us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:24.525051 (+103038us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.525463 (+   412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.525533 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.552402 (+1026869us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:25.962823 (+410421us) raft_consensus.cc:1685] finished
0709 13:18:25.962959 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.963113 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134052,"prepare.queue_time_us":177318,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":146919,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":12402,"spinlock_wait_cycles":10193152,"thread_start_us":133573,"threads_started":2,"wal-append.queue_time_us":156421}
I20260709 13:18:25.548715 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 522) took 1361 ms. Trace:
I20260709 13:18:25.988528 14223 rpcz_store.cc:276] 0709 13:18:24.187672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.189867 (+  2195us) service_pool.cc:224] Handling call
0709 13:18:25.548004 (+1358137us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:25.548219 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.548403 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.548426 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.548464 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:25.548490 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.548540 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.548654 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39460096}
W20260709 13:18:25.966277 14220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 1698) took 1635 ms (client timeout 1941 ms). Trace:
W20260709 13:18:25.989905 14220 rpcz_store.cc:269] 0709 13:18:24.330719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.330920 (+   201us) service_pool.cc:224] Handling call
0709 13:18:25.550541 (+1219621us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:25.966187 (+415646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29254016}
I20260709 13:18:25.926345 16680 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.926764 16730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.005s	sys 0.022s
W20260709 13:18:25.969460 14194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.016s	sys 0.032s
W20260709 13:18:25.959925 16710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.014s	sys 0.047s
I20260709 13:18:25.997252 14225 raft_consensus.cc:2368] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4.
I20260709 13:18:25.982815 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:25.998646 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:25.908705 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.986768 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 54789.9us
I20260709 13:18:26.000303 14192 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:25.937826 16676 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.009373 16676 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:26.000303 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.001219 16547 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.013295 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:26.003047 16693 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.003255 16694 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.978030 16713 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.004956 16712 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:25.968948 16696 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:25.986435 16692 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:25.985615 16567 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:25.966068 16720 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:25.952572 14267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.008s	sys 0.022s
I20260709 13:18:26.001724 16505 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.969219 16752 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:25.997149 16730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.005s	sys 0.025s
W20260709 13:18:26.026122 16418 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.098s	user 0.037s	sys 0.079s
I20260709 13:18:26.010077 16654 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:25.979979 16721 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:26.010764 16615 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:26.044952 14267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.009s	sys 0.022s
I20260709 13:18:26.023233 16430 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:26.058301 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 941835us
I20260709 13:18:26.059010 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:26.029263 14898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.171s	user 0.044s	sys 0.070s
I20260709 13:18:26.035835 16570 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.055702 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:26.039122 16683 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.026415 16547 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.060058 14220 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:26.066532 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:26.073262 14901 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:26.066587 14897 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.069659 14900 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:26.060103 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:26.055728 16418 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.037s	sys 0.079s
I20260709 13:18:26.031751 16694 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:26.087638 16418 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:26.088340 16567 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:26.088160 16418 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.089015 16694 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.060492 16654 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.090569 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2201) took 1859 ms. Trace:
I20260709 13:18:26.091149 16720 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.090946 14295 rpcz_store.cc:276] 0709 13:18:24.230782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.246932 (+ 16150us) service_pool.cc:224] Handling call
0709 13:18:24.326972 (+ 80040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.425088 (+ 98116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.090339 (+1665251us) spinlock_profiling.cc:243] Waited 90.7 ms on lock 0x7b54003ee4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:26.090507 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208606080}
I20260709 13:18:26.091801 16654 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.093279 16547 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.095038 16716 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.095368 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 541) took 1268 ms. Trace:
I20260709 13:18:26.095773 14226 rpcz_store.cc:276] 0709 13:18:24.826499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.826726 (+   227us) service_pool.cc:224] Handling call
0709 13:18:24.827074 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.827411 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.827439 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.828021 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.923490 (+1095469us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:25.923568 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.923650 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.095162 (+171512us) raft_consensus.cc:1685] finished
0709 13:18:26.095182 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.095307 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10478,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":5397,"thread_start_us":1095089,"threads_started":1,"wal-append.queue_time_us":1223529}
W20260709 13:18:26.062479 14898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.045s	sys 0.071s
I20260709 13:18:26.097611 14222 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:26.098167 16751 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.100016 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:26.056277 14300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.012s	sys 0.014s
I20260709 13:18:26.053572 16693 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:26.077772 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:26.106213 14300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.012s	sys 0.014s
W20260709 13:18:26.108440 14301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.107s	user 0.010s	sys 0.015s
I20260709 13:18:26.066630 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:26.063506 16645 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:26.053259 16505 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.116977 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:26.082083 16722 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.086035 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:26.120741 16730 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:26.121066 16721 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.010819 16680 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:26.109125 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:26.110888 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:26.121276 16730 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.134886 16386 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:26.111878 14301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.010s	sys 0.015s
I20260709 13:18:26.112589 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:26.142704 14901 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.144663 16730 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.134758 16418 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.146291 16505 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.113144 16642 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:26.114235 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:26.152503 14369 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:26.115702 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:26.114749 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:26.082655 16615 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.118775 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2186) took 1258 ms. Trace:
I20260709 13:18:26.119436 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:26.128994 14295 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:26.156402 14300 rpcz_store.cc:276] 0709 13:18:24.860494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.861505 (+  1011us) service_pool.cc:224] Handling call
0709 13:18:24.861754 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.861979 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:25.317191 (+455212us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.118194 (+801003us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.118256 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:26.118477 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.118561 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.118708 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":878080,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":15404,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8463,"thread_start_us":1244029,"threads_started":2}
I20260709 13:18:26.158649 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:26.159379 14300 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:26.160535 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:26.161128 14300 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.163184 14899 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:26.129439 14897 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
W20260709 13:18:26.112488 16689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.786s	user 0.018s	sys 0.065s
W20260709 13:18:26.170326 16689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.847s	user 0.018s	sys 0.065s
W20260709 13:18:26.072660 14303 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.009s	sys 0.008s
I20260709 13:18:26.149976 14374 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:26.171722 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:26.173125 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:26.175050 14303 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.010s	sys 0.008s
I20260709 13:18:26.116817 16693 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.113817 16751 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.162330 16696 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.181699 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 361) took 1500 ms. Trace:
I20260709 13:18:26.174822 16752 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.176633 16730 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:26.191319 14303 rpcz_store.cc:276] 0709 13:18:24.681286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.681425 (+   139us) service_pool.cc:224] Handling call
0709 13:18:24.681687 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.708424 (+ 26737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.708457 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.719966 (+ 11509us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.444154 (+724188us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:26.179468 (+735314us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.179818 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.179988 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.180045 (+    57us) raft_consensus.cc:1685] finished
0709 13:18:26.180063 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.181625 (+  1562us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6670,"prepare.queue_time_us":306566,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":75278,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":21845,"thread_start_us":1352655,"threads_started":3,"wal-append.queue_time_us":1061111}
I20260709 13:18:26.178721 16570 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:26.200714 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:26.173512 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:26.204387 14267 connection.cc:256] RPC call timeout handler was delayed by -1.6483313249998446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
I20260709 13:18:26.205384 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:26.364393 14369 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:26.364761 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2193) took 1330 ms. Trace:
W20260709 13:18:26.364902 14225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 539) took 1670 ms (client timeout 1819 ms). Trace:
I20260709 13:18:26.180981 16718 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.172273 16615 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:26.365226 14304 rpcz_store.cc:276] 0709 13:18:25.034640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.559478 (+524838us) service_pool.cc:224] Handling call
0709 13:18:25.894835 (+335357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.895394 (+   559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.895439 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.913268 (+ 17829us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.291567 (+378299us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:26.291623 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.291722 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.363890 (+ 72168us) raft_consensus.cc:1685] finished
0709 13:18:26.363912 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.364688 (+   776us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11102,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":13544,"thread_start_us":335006,"threads_started":1,"wal-append.queue_time_us":425264}
I20260709 13:18:26.178260 16393 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:18:26.208024 16730 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.240314 16713 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.369705 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:26.240207 16722 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:26.283072 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 324600us
W20260709 13:18:26.284106 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 166073us
I20260709 13:18:26.294493 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 363) took 1468 ms. Trace:
I20260709 13:18:26.296479 16693 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.303296 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:26.304423 14300 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:26.371716 14297 rpcz_store.cc:276] 0709 13:18:24.826068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.826236 (+   168us) service_pool.cc:224] Handling call
0709 13:18:24.843441 (+ 17205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.843705 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:25.908118 (+1064413us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.294048 (+385930us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.294127 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:26.294185 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.294264 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.294420 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":830273,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":13080,"raft.queue_time_us":11528,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":118,"thread_start_us":1423698,"threads_started":2,"wal-append.queue_time_us":422408}
I20260709 13:18:26.373471 14372 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.304806 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:26.200290 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 349994us
I20260709 13:18:26.373998 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:26.374178 14377 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:26.375339 14193 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:26.376806 14227 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:26.307128 14341 connection.cc:256] RPC call timeout handler was delayed by -1.0935721109999577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 13:18:26.306354 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2191) took 1414 ms. Trace:
I20260709 13:18:26.307673 16749 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.306697 16680 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.384045 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:26.369618 16730 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:26.310261 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 311721us
I20260709 13:18:26.209692 16715 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:26.391285 16715 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.389899 16784 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.393980 14229 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:26.394099 16715 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.329173 16542 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:26.395112 16542 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.335390 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2189) took 1467 ms. Trace:
W20260709 13:18:26.336205 16762 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.004s
I20260709 13:18:26.397655 14301 rpcz_store.cc:276] 0709 13:18:24.867461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.947744 (+ 80283us) service_pool.cc:224] Handling call
0709 13:18:24.948138 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.948486 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.948518 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.967071 (+ 18553us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.177743 (+1210672us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:26.177804 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.177889 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.334996 (+157107us) raft_consensus.cc:1685] finished
0709 13:18:26.335060 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.335297 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4181,"raft.queue_time_us":610,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":1175375,"threads_started":1,"wal-append.queue_time_us":1345675}
I20260709 13:18:26.179344 16758 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:26.346544 16618 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:26.337091 16570 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:26.399956 16758 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:26.400699 16570 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.400816 16758 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.393726 16749 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.401288 16730 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:26.403484 16596 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:26.348135 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:26.349386 16719 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.354607 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2216) took 1807 ms. Trace:
I20260709 13:18:26.404644 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:26.346632 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 703) took 2415 ms. Trace:
I20260709 13:18:26.207470 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:26.365353 14225 rpcz_store.cc:269] 0709 13:18:24.694756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.694970 (+   214us) service_pool.cc:224] Handling call
0709 13:18:26.364712 (+1669742us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002760d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:26.364845 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2985908480}
I20260709 13:18:26.409619 14375 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
W20260709 13:18:26.369210 14267 connection.cc:256] RPC call timeout handler was delayed by -1.210471489999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 13:18:26.370363 14901 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:26.372413 14304 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:26.411108 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:26.378149 14298 rpcz_store.cc:276] 0709 13:18:24.892298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.288534 (+396236us) service_pool.cc:224] Handling call
0709 13:18:25.294538 (+  6004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.294756 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:25.961616 (+666860us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.305560 (+343944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.305685 (+   125us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:26.305820 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.305964 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.306222 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":445556,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":181,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":1009510,"threads_started":2,"wal-append.queue_time_us":370545}
I20260709 13:18:26.379467 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.411975 14224 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:26.380511 16551 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.412091 16785 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:18:26.413190 16744 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.929s	user 0.015s	sys 0.016s
I20260709 13:18:26.383301 14373 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:26.414372 14373 pending_rounds.cc:85] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 2
I20260709 13:18:26.414707 14373 pending_rounds.cc:107] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:26.414983 14373 raft_consensus.cc:2889] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:26.382470 16713 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:26.416455 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:26.384778 14370 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:26.418361 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:26.309043 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 178704us
I20260709 13:18:26.419025 14370 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.419190 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.385936 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.420789 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:26.421494 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:26.422973 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:26.423724 14227 raft_consensus.cc:2393] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:26.424160 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:26.423982 16505 consensus_queue.cc:1059] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:26.424820 14375 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:26.425658 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:26.425806 16505 raft_consensus.cc:3055] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:26.426175 14375 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.426312 16505 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:26.427502 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:26.386209 14372 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:26.387130 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:26.372578 16503 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:26.389474 14369 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:26.434414 14225 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:26.435449 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:26.390292 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.390239 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.436403 14226 raft_consensus.cc:2410] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:26.393635 16784 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:26.404155 14303 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:26.406663 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:26.437026 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.337162 14378 raft_consensus.cc:2393] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:26.408046 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.404624 14296 rpcz_store.cc:276] 0709 13:18:24.546872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.548025 (+  1153us) service_pool.cc:224] Handling call
0709 13:18:24.548293 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.945769 (+1397476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.354309 (+408540us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000dbbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:26.354534 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3212642176}
W20260709 13:18:26.378589 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.438256 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.431994 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:26.433084 14372 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:26.417943 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:26.441238 14227 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:26.347466 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:26.435595 14369 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:26.443318 14369 raft_consensus.cc:2955] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:26.434417 16632 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:26.373211 16722 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:26.408995 16787 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.434580 16503 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:26.433667 16542 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.427456 16505 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:26.415521 16615 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:26.431025 16596 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.401845 16758 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.449371 16623 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:26.460711 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:26.449002 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:26.461640 14867 leader_election.cc:400] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4.
I20260709 13:18:26.461892 14373 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.462066 14867 leader_election.cc:403] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:26.450598 16632 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:26.449540 14221 raft_consensus.cc:2368] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6.
I20260709 13:18:26.437088 14301 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:26.466393 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.452942 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.455910 16730 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.591820 16692 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:26.451903 16511 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:26.641973 16692 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.455402 16596 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.592308 14378 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:18:26.644093 14376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1714) took 2911 ms (client timeout 2151 ms). Trace:
W20260709 13:18:26.644508 14376 rpcz_store.cc:269] 0709 13:18:23.732233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.878086 (+145853us) service_pool.cc:224] Handling call
0709 13:18:26.643891 (+2765805us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54000618d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:26.644026 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273144192}
I20260709 13:18:26.456053 14370 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:26.451040 14297 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:26.461659 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.648286 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:26.479768 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 61888.9us
I20260709 13:18:26.651834 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:26.652969 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.654548 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:26.671921 14341 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:26.655535 14226 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:26.673805 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.674680 14221 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:26.675978 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.677446 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.680310 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.649446 14224 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:26.682608 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.685025 14221 raft_consensus.cc:2410] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:26.684886 14378 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:18:26.686290 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:26.686688 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.687414 14227 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:26.687530 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:26.688409 14864 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.714s (SENT) [suppressed 11 similar messages]
W20260709 13:18:26.691520 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 266148us
I20260709 13:18:26.552626 14375 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:26.500823 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:26.692970 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.617609 16564 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.698966 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:26.698057 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:26.700301 14301 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.454483 16505 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:26.624207 16694 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.452468 16784 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:26.589237 16418 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:26.450379 16713 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:26.570245 16788 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4.
I20260709 13:18:26.671834 16721 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:26.452304 16722 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.597105 16393 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:26.695549 16683 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:26.701825 16564 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.712328 16547 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.723932 16719 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:26.724468 16694 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:26.589747 16642 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.136s
I20260709 13:18:26.452666 16787 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.495287 16503 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:26.720041 16752 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.721194 16615 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:26.775090 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.742069 16418 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:26.761394 16719 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.739418 16784 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:26.777051 16609 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:26.743317 16721 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.785962 16609 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:26.780519 16752 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.790717 16713 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:26.790820 16609 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.791960 16752 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.792320 16609 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:26.792745 16599 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:26.794216 16794 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.116s	user 0.002s	sys 0.003s
I20260709 13:18:26.794834 16418 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.783167 16692 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.798499 16589 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.800551 16716 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:26.801111 16716 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:26.768194 16547 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.782610 16719 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.805588 16716 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:26.752373 16393 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.826081 16547 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.828066 16799 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:26.827382 16716 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:26.746850 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59401.2us
I20260709 13:18:26.988412 16558 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.990924 16694 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.992063 16564 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.992646 16795 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.829833 16787 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:26.994124 16566 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:26.956135 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.993721 16795 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.939405 14301 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:26.841704 16799 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:26.999181 16799 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:26.988657 16596 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:26.918392 14226 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:18:26.948859 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.842689 16632 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:27.007404 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:26.872121 16721 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:26.409227 14898 rpcz_store.cc:276] 0709 13:18:23.931249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.938266 (+  7017us) service_pool.cc:224] Handling call
0709 13:18:23.972576 (+ 34310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.002431 (+ 29855us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:24.839942 (+837511us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.346001 (+1506059us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.346221 (+   220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.346292 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:26.346347 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.346439 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.346571 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":229294,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":888,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":172,"thread_start_us":1489548,"threads_started":2,"wal-append.queue_time_us":1367411}
I20260709 13:18:26.912340 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:26.913555 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:27.019207 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.021625 16558 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.022465 14224 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:27.027158 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:27.028659 14901 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:27.031916 16795 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.032691 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:27.038956 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 340073us
I20260709 13:18:27.040259 14224 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:27.037398 14898 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:27.050608 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:27.051250 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:27.046926 14901 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:27.045325 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 358) took 2659 ms. Trace:
I20260709 13:18:26.874472 16719 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:27.122910 14301 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:27.047928 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:27.127300 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 548) took 1057 ms. Trace:
I20260709 13:18:27.076524 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:27.127774 14229 rpcz_store.cc:276] 0709 13:18:26.070259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.071814 (+  1555us) service_pool.cc:224] Handling call
0709 13:18:26.072150 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.394395 (+322245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.126749 (+732354us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540026d4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:27.127096 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739707776}
W20260709 13:18:27.130520 14222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 527) took 2941 ms (client timeout 1804 ms). Trace:
I20260709 13:18:27.121675 16719 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:27.131034 14222 rpcz_store.cc:269] 0709 13:18:24.189240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.192436 (+  3196us) service_pool.cc:224] Handling call
0709 13:18:27.130149 (+2937713us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54002a21d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:27.130324 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4379652352}
I20260709 13:18:27.070539 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:27.132364 14894 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:27.051554 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 762) took 2830 ms. Trace:
I20260709 13:18:27.134568 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1723) took 1017 ms. Trace:
W20260709 13:18:27.076004 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 575100us
I20260709 13:18:27.135885 14374 rpcz_store.cc:276] 0709 13:18:26.116629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.116765 (+   136us) service_pool.cc:224] Handling call
0709 13:18:27.134102 (+1017337us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b540025a8d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:27.134312 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73966848}
I20260709 13:18:27.117998 14224 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:27.047521 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:27.141530 14377 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
W20260709 13:18:27.142251 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 444198us
I20260709 13:18:27.145661 14193 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:27.146915 16730 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:27.147456 16730 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.147507 14193 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:27.147908 16730 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.077045 16558 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:27.154304 14229 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: [3.5-4.6]
I20260709 13:18:27.147547 16588 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:18:27.157177 16588 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:27.076963 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.157691 16588 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:27.158694 14296 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:27.159530 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:27.159324 16588 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.160418 14295 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:27.136418 14892 rpcz_store.cc:276] 0709 13:18:24.220690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.220839 (+   149us) service_pool.cc:224] Handling call
0709 13:18:24.221187 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.696635 (+475448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.050912 (+2354277us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54004c0ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:27.051324 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933001984}
I20260709 13:18:27.116393 14299 rpcz_store.cc:276] 0709 13:18:24.386310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.405718 (+ 19408us) service_pool.cc:224] Handling call
0709 13:18:24.406218 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.982577 (+576359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.044745 (+2062168us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54000fd2d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:27.045090 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315464448}
W20260709 13:18:27.162045 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.161132 16588 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.163090 16730 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:27.163988 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.165078 14304 raft_consensus.cc:2410] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:27.068219 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:27.179492 14373 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.009s
I20260709 13:18:27.180110 14373 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:27.182011 16785 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.870266 16751 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.065181 16718 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:27.182664 16785 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.201006 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2198) took 1075 ms. Trace:
I20260709 13:18:27.204200 16799 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:27.208117 16618 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:27.166013 16730 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:27.219082 14295 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:27.220103 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:27.220768 16808 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.215111 14302 rpcz_store.cc:276] 0709 13:18:26.125642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.125758 (+   116us) service_pool.cc:224] Handling call
0709 13:18:26.126088 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.137930 (+ 11842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.137957 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.138002 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:26.138030 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.200465 (+1062435us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54000dcfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:27.200537 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.200778 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26759936}
I20260709 13:18:27.214243 14270 leader_election.cc:400] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6.
I20260709 13:18:27.225332 14270 leader_election.cc:403] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:27.225999 16618 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:27.226256 16511 consensus_meta.cc:287] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.015s
I20260709 13:18:27.186574 16719 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:27.227707 16719 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.231207 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:27.222787 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:27.243564 16542 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:27.243830 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.244823 14298 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:27.246256 16746 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:27.248030 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:27.248975 16748 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.249284 16418 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:27.250023 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 78921.8us
I20260709 13:18:27.249917 16748 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.250622 16680 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:27.251019 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:27.250356 16418 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:27.251768 16418 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.252153 16418 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.252386 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:27.252972 16748 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.253307 16632 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:27.253835 16632 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.254101 16717 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:27.254226 16632 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.254683 16717 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:27.255314 16717 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:27.254587 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.257242 14300 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:27.258381 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.259389 14300 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:27.260548 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:27.260810 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 86345.5us
I20260709 13:18:27.262315 14304 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.262742 14302 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.263984 16393 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.264701 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.265272 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.262317 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:27.240154 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.240382 16511 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.264020 14304 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:27.266598 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.267617 14303 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:27.277345 14300 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.283370 16719 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.283478 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:27.284039 16718 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.286705 16718 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.287529 16503 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.280615 16511 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.288910 16808 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.293056 16512 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:27.251384 16680 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:27.295760 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 98247.2us
I20260709 13:18:27.315901 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.316869 14304 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:27.316920 16680 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:27.319630 14344 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:27.321894 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:27.305024 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:27.331070 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.291450 16746 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:27.330652 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:27.335285 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.336305 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.338616 16788 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:27.339645 16511 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.332695 16719 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6.
I20260709 13:18:27.334237 16784 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:27.385012 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.420794 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 169408us
I20260709 13:18:27.422072 16551 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:27.422837 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 160698us
I20260709 13:18:27.423144 16511 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:27.424193 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.424603 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:27.424911 16614 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:27.425964 16588 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:27.578603 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.746240 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.436817 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 77451.8us
I20260709 13:18:27.426596 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:27.426656 16614 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:27.745641 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1726) took 1539 ms. Trace:
I20260709 13:18:27.758103 14303 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.760293 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.745172 16785 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:27.435315 16814 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:18:27.765504 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.767104 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:27.768064 16719 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:27.768338 16743 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:27.768486 16512 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:27.769075 16743 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.769640 16512 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.449730 14301 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:27.784829 16751 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:27.785750 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 335747us
I20260709 13:18:27.788623 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.789160 16512 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.789429 14297 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:27.784931 14267 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:27.526638 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:27.438153 16755 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.634s	user 0.000s	sys 0.013s
I20260709 13:18:27.508515 16788 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:27.454675 16808 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.795445 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.634994 16542 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:27.802240 14299 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:27.772765 16614 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:27.756903 14371 rpcz_store.cc:276] 0709 13:18:26.206073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.206193 (+   120us) service_pool.cc:224] Handling call
0709 13:18:26.206450 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.245418 (+1038968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.245485 (+    67us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.245556 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:27.245613 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.745129 (+499516us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003985d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:27.745174 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.745406 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13672,"raft.queue_time_us":14487,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":164,"spinlock_wait_cycles":2356715776}
I20260709 13:18:27.660578 16418 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:27.645773 16717 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.525061 16558 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.277s
I20260709 13:18:27.432406 16618 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.525442 16787 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.279s
I20260709 13:18:27.798602 16788 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:27.814412 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 398623us
I20260709 13:18:27.433746 16784 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.805066 16542 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.817539 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:27.816470 16719 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:27.808373 16785 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:27.815416 16799 consensus_meta.cc:287] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.004s
I20260709 13:18:27.423156 16551 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.816829 16718 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:27.830071 14301 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.820895 16788 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:27.831516 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 412474us
I20260709 13:18:27.836077 16743 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.826454 16719 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:27.837986 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 411550us
I20260709 13:18:27.840787 14220 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:27.835057 16718 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.842708 16719 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:27.852486 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 67724.9us
I20260709 13:18:27.849102 16596 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.853286 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:27.853521 16596 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.855795 16596 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:27.850222 16718 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.859864 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:27.862085 16798 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:27.863127 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 1980) took 1483 ms. Trace:
I20260709 13:18:27.863263 16798 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:27.863859 16798 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.863627 14377 rpcz_store.cc:276] 0709 13:18:26.379734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.386885 (+  7151us) service_pool.cc:224] Handling call
0709 13:18:27.862889 (+1476004us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54000b9354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:27.863042 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599382400}
I20260709 13:18:27.864426 16798 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:27.866837 16632 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.612s	user 0.015s	sys 0.000s
I20260709 13:18:27.866999 16743 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:27.867309 16632 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:27.868357 16693 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:27.868785 16693 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:27.869889 16693 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.871366 16689 raft_consensus.cc:3055] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:27.871615 16693 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:27.875278 16503 consensus_meta.cc:287] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.587s	user 0.003s	sys 0.011s
I20260709 13:18:27.874853 16689 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:27.874197 16632 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:27.885538 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:27.891319 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:27.895663 14895 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 1 LEARNER]: Advancing to term 4
I20260709 13:18:27.895798 16689 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.897289 16393 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:27.897749 16393 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:27.898373 16739 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:27.898859 16739 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:27.898787 16393 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.898236 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:27.901968 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:27.903005 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:27.910809 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:27.900434 16393 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.843443 16614 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.915125 14896 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:27.897298 16689 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:27.920441 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:27.903424 16785 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:18:27.900396 16676 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 13:18:27.928301 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 645486us
I20260709 13:18:27.911845 16717 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.933318 16776 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:27.936885 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:27.940465 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.900102 16739 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.901990 16719 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:27.928876 16418 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:27.948372 16511 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:27.944214 16785 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:18:27.948292 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:27.949113 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:27.950654 16739 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.955699 16614 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:27.955873 14895 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 4 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:27.934538 16808 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:27.966454 16511 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.969039 14226 raft_consensus.cc:2410] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:27.969058 16753 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:27.972285 14224 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.969771 16799 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.969928 14341 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:27.982936 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:27.984122 16418 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.981768 16753 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:27.992094 14220 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:18:27.988225 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:27.985262 16511 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:27.947041 16776 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:27.992607 14220 pending_rounds.cc:85] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 5
I20260709 13:18:28.016844 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:27.978190 16808 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:28.035090 14296 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:27.980268 16784 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:28.018100 14220 pending_rounds.cc:107] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:28.051930 14297 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:28.054044 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:28.059299 16819 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:28.059808 16819 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:28.060293 16819 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:28.061874 14225 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:28.044634 16743 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:18:28.063166 16612 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:28.063453 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 177289us
I20260709 13:18:28.063935 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:28.064713 14223 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:28.065946 16505 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:28.066797 16505 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:28.074399 16815 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:18:28.076741 16776 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:27.992229 16785 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.082152 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:28.082248 16785 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.082516 16393 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:28.084471 16785 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:28.085112 16785 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:28.085259 16393 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:28.085738 16393 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:28.081636 14299 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:28.089342 14193 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:28.057539 14220 raft_consensus.cc:2889] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:28.099684 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:28.101368 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:28.103042 16658 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:28.104096 16743 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:28.104552 16743 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:28.103785 14123 catalog_manager.cc:5697] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 2, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:18:28.104948 16743 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:28.106201 14228 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:18:28.109126 14224 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:28.110250 16393 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:28.112063 16393 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:28.115327 16596 raft_consensus.cc:3055] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:28.116003 16596 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:28.123546 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 270335us
I20260709 13:18:28.126842 14299 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:28.085691 16785 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.128814 16820 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:28.129647 14225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 1713) took 1669 ms (client timeout 1809 ms). Trace:
I20260709 13:18:28.129698 16820 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.131587 16788 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.131196 16785 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:28.133872 16719 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:28.134045 16503 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:28.134619 16719 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:28.134969 16719 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.135298 16719 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:28.135648 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 141048us
I20260709 13:18:28.135813 16820 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:28.133891 16730 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 13:18:28.140363 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 149011us
I20260709 13:18:28.136472 16743 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.006212 16418 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:28.140123 16753 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.033317 16799 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:28.137518 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:28.088240 16618 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:28.150264 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 207434us
I20260709 13:18:28.144811 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:28.125876 16658 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:28.189673 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:28.189242 16746 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:28.191035 16746 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.191396 16746 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:28.193590 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.193919 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.194146 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.194347 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.197324 14371 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:28.087814 16808 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.197885 16511 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:28.198570 16511 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:28.198863 16808 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.199610 16511 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:28.202165 14374 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
W20260709 13:18:28.147115 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.149344 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.140954 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 291019us
I20260709 13:18:28.154011 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:28.210655 14373 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:28.141989 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:28.177910 16798 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.133709 16788 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:28.183359 16799 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:28.184183 16418 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:28.186411 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:28.116974 16551 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:28.202318 16743 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:28.204295 16710 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:28.205289 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:28.157986 16718 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:28.205862 14126 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36074 (request call id 212) took 9837 ms. Trace:
I20260709 13:18:28.206030 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:28.143000 14225 rpcz_store.cc:269] 0709 13:18:26.460273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.460400 (+   127us) service_pool.cc:224] Handling call
0709 13:18:28.129427 (+1669027us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400082354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:28.129558 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3312097664}
I20260709 13:18:28.213394 14377 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:28.169776 14301 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:28.209116 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:28.261122 14223 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:28.230723 14864 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.655s (SENT)
W20260709 13:18:28.242496 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 182951us
I20260709 13:18:28.244712 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:28.262249 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:28.205312 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.259111 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:28.257243 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.257642 14300 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:28.271101 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.261873 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:28.276925 14299 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:28.260262 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:28.261826 14193 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:28.257273 16753 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:28.285720 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 307224us
W20260709 13:18:28.288035 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51306.8us
I20260709 13:18:28.294500 14296 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:28.282802 14298 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:28.297490 16825 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:28.263055 16820 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:28.298812 14370 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
W20260709 13:18:28.299084 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 112784us
I20260709 13:18:28.234865 16821 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:18:28.306171 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.285398 16743 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:28.315797 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.313653 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:28.321429 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.322078 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.333209 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:28.329977 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:28.328164 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 97538.1us
I20260709 13:18:28.335139 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.332715 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:28.326907 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:28.339088 16551 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:28.339514 16551 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.339836 16551 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:28.340340 16542 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.002s
I20260709 13:18:28.340862 16542 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.259979 14126 rpcz_store.cc:276] 0709 13:18:18.367896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.368221 (+   325us) service_pool.cc:224] Handling call
0709 13:18:18.963152 (+594931us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b54002c0010. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f68640 00007f8df2e3fb76 00007f8df2f49c3e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc 00007f8df1409392 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:28.205575 (+9242423us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:24.428553 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:24.434555 (+  6002us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:24.434588 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:18:24.434604 (+    16us) tablet.cc:662] Decoding operations
0709 13:18:24.435216 (+   612us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:24.435283 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:24.435310 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:24.435624 (+   314us) tablet.cc:701] Row locks acquired
0709 13:18:24.435646 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:18:24.435800 (+   154us) write_op.cc:270] Start()
0709 13:18:24.435941 (+   141us) write_op.cc:276] Timestamp: P: 1783603104435735 usec, L: 0
0709 13:18:24.435967 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:18:24.513636 (+ 77669us) log.cc:844] Serialized 1311 byte log entry
0709 13:18:25.811444 (+1297808us) op_driver.cc:464] REPLICATION: finished
0709 13:18:26.327533 (+516089us) write_op.cc:301] APPLY: starting
0709 13:18:26.327614 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:26.327778 (+   164us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:26.327903 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:26.328366 (+   463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:26.328555 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:18:26.328598 (+    43us) write_op.cc:312] APPLY: finished
0709 13:18:26.328846 (+   248us) log.cc:844] Serialized 35 byte log entry
0709 13:18:26.329629 (+   783us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:26.329732 (+   103us) write_op.cc:454] Released schema lock
0709 13:18:26.329770 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:26.330196 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:26.330222 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1131886,"reported_tablets":10,"spinlock_wait_cycles":43983616,"child_traces":[["op",{"apply.queue_time_us":475284,"apply.run_cpu_time_us":2070,"apply.run_wall_time_us":2665,"num_ops":3,"prepare.queue_time_us":251993,"prepare.run_cpu_time_us":48748,"prepare.run_wall_time_us":224575,"raft.queue_time_us":976396,"raft.run_cpu_time_us":23079,"raft.run_wall_time_us":523167,"replication_time_us":1348039,"spinlock_wait_cycles":14592,"thread_start_us":1823658,"threads_started":4,"wal-append.queue_time_us":179950,"wal-append.run_cpu_time_us":103909,"wal-append.run_wall_time_us":2630722}]]}
I20260709 13:18:28.313023 16825 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:28.366577 14228 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:28.325433 16743 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:28.324877 16614 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.324633 16822 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.379294 14370 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:28.381743 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:28.387578 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.384083 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50998.4us
I20260709 13:18:28.387159 14227 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
W20260709 13:18:28.397866 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.376559 16558 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:28.378346 16799 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:28.382534 16817 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:28.399699 14342 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:28.383270 16798 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:28.382076 16758 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:28.439677 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 60047.8us
I20260709 13:18:28.443871 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.444607 16785 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:28.444801 14373 raft_consensus.cc:2368] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4.
I20260709 13:18:28.446059 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:28.433739 16832 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:18:28.446641 14899 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:28.443993 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54476.1us
I20260709 13:18:28.458312 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.437985 16817 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:28.440022 16503 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:28.463762 14370 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:28.398386 16614 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.467413 14371 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:28.470467 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 96075us
I20260709 13:18:28.483471 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:28.485492 14295 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.487805 14373 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:28.468477 16817 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:28.439093 16822 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:28.492498 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.469349 16838 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.501250 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:28.497638 14223 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:28.504792 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:28.509119 14370 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:28.510375 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.511197 14377 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 2: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:28.481359 16718 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:28.472355 16785 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:18:28.472980 16821 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:18:28.525063 16505 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:28.507467 16838 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:28.543977 16838 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:28.528004 14864 leader_election.cc:336] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.714s (SENT)
I20260709 13:18:28.550442 14864 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:28.551203 16614 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:28.551934 16614 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:28.553323 16788 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:28.501750 16596 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.553880 16788 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:28.554875 16834 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:18:28.491314 16511 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:18:28.605345 14300 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:28.617585 14371 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:28.589682 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:28.561306 16505 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:28.559229 16551 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:28.631564 16505 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:28.632738 16551 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:28.633502 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:28.634177 14377 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
W20260709 13:18:28.558480 16831 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:18:28.636488 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 135307us
W20260709 13:18:28.636070 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 303399us
I20260709 13:18:28.562955 16718 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.483850 16743 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:28.585733 16799 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:28.707248 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 199842us
I20260709 13:18:28.478920 16825 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:28.664959 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.628335 16503 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.711023 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:28.725754 14295 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:28.555138 16788 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:28.952943 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.731482 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.926283 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.958226 14373 raft_consensus.cc:2368] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5.
I20260709 13:18:28.730556 14298 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:28.928907 14375 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:28.922793 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:28.959311 14267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.023s	sys 0.134s
W20260709 13:18:28.957716 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.959976 14223 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:28.788918 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:28.961127 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:28.786777 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.948323 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.788565 14227 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:28.756503 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.959854 14267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.023s	sys 0.134s
W20260709 13:18:28.963752 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.963682 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 633739us
W20260709 13:18:28.964996 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.919679 14864 leader_election.cc:336] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.957s (SENT)
I20260709 13:18:28.963094 14374 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 13:18:28.968230 14899 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.000s
I20260709 13:18:28.968715 14899 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:28.926971 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.971112 14369 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:28.919601 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:28.967327 14374 pending_rounds.cc:85] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 6
I20260709 13:18:28.973958 14374 pending_rounds.cc:107] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:28.974356 14374 raft_consensus.cc:2889] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:28.973384 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:28.954421 16393 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.002s
I20260709 13:18:28.929522 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:28.980181 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.724064 16799 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:18:28.785286 16719 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.001s
W20260709 13:18:28.774989 16839 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:28.921523 16551 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:18:28.936414 16746 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.002s
W20260709 13:18:28.939723 16820 consensus_meta.cc:287] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
W20260709 13:18:28.930635 16819 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.870s	user 0.012s	sys 0.000s
W20260709 13:18:28.884227 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 54698.1us
I20260709 13:18:28.996426 16821 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:28.980896 14371 raft_consensus.cc:2376] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5. Re-sending same reply.
I20260709 13:18:29.012077 16821 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.012761 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.013417 14371 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.763533 16784 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.014199 16784 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.017290 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.018272 14896 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:29.017875 16746 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.018478 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:28.979746 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.019752 14892 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:29.020256 16746 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.020665 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:29.021130 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:29.021301 14297 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.022490 14371 raft_consensus.cc:2410] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:29.022346 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:29.022781 16753 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.000s
I20260709 13:18:29.023015 14227 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:29.023371 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.023496 14226 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:28.927637 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.024381 14376 raft_consensus.cc:2376] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4. Re-sending same reply.
I20260709 13:18:29.024761 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.025345 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:28.760876 14893 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:28.782152 14895 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:29.026185 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:28.979740 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:28.789247 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:28.790514 16822 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:28.985618 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:29.027267 16799 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.027550 14225 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:28.983330 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.033435 14373 raft_consensus.cc:2368] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4.
I20260709 13:18:28.729123 16841 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:28.970080 16689 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:28.988061 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:28.989112 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:28.991117 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.032677 14376 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:28.988721 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.989678 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:28.986902 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:28.993127 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:28.997716 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.040741 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:29.041417 14370 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:28.994417 16551 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.002550 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:29.044440 14228 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:28.724267 16718 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.010385 16820 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:29.011036 16819 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:28.769637 16836 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:18:29.025581 14371 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 2: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:18:29.027943 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 108352us
I20260709 13:18:29.079027 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.080091 14373 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:28.934497 16542 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:28.986300 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.027258 14300 raft_consensus.cc:2410] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:29.027407 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.035895 14297 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:28.992157 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:29.041514 14295 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:28.992028 16503 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:29.041949 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52368.9us
I20260709 13:18:29.081221 16851 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:29.040185 14369 raft_consensus.cc:2376] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4. Re-sending same reply.
W20260709 13:18:29.090319 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.038955 14375 raft_consensus.cc:2376] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3. Re-sending same reply.
I20260709 13:18:28.985560 16418 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.759006 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.093932 14301 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:29.045666 16746 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:29.097899 14372 raft_consensus.cc:2410] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:29.099431 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:29.055447 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.100570 14298 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:28.994138 16719 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.103529 16719 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.104875 16820 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:29.105365 16820 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:29.105778 16820 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:29.110146 16746 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:29.111034 16551 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:29.113550 16386 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:18:29.114190 16596 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.116873 16386 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:29.119937 16718 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:29.121673 16819 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:29.124244 16503 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.126024 16821 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:29.126906 16851 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.129367 16851 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:29.130086 16784 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:29.130903 16817 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.003s
I20260709 13:18:29.111754 16746 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.131433 16817 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.081930 16845 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:29.134639 16418 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.137293 16418 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:29.040680 16689 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.075779 14370 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:29.028476 16618 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:29.077886 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:29.081981 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:29.146771 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 68994.5us
I20260709 13:18:29.084523 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.147768 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:29.083132 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:28.729543 16632 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:29.117449 16386 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:29.091332 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 104504us
W20260709 13:18:29.082870 14864 leader_election.cc:336] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.972s (SENT)
I20260709 13:18:29.096045 14304 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:18:29.144345 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45030us
I20260709 13:18:29.084410 14378 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:29.146986 14376 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:29.089594 16787 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.154661 14226 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:29.155503 14221 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:29.155797 14297 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:29.168781 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.169595 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:29.157447 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.166059 14222 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:29.178503 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.179714 14304 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:29.145920 16799 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.145107 16817 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.187803 14295 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:29.150162 16689 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.196930 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:29.228824 14228 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.154060 16848 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:29.232177 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.154884 16542 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:29.158605 16503 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:29.202759 14867 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:29.249235 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46582.7us
I20260709 13:18:29.211477 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.226263 14225 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:29.134719 16845 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.235237 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.260445 14297 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:29.224232 16841 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:29.245416 14901 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:29.198129 16819 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.159591 16851 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:18:29.172422 16632 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:29.263624 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 185068us
I20260709 13:18:29.231961 16848 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.265455 16386 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.210901 16730 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:18:29.210708 16693 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:18:29.211877 16758 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:18:29.192144 16787 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:29.288199 14864 leader_election.cc:336] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.057s (SENT)
I20260709 13:18:29.289049 14864 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:29.263294 16846 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:29.285998 16848 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.299718 16841 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.301896 16632 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:29.302832 16596 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:29.304036 16596 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.304558 16596 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.314688 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:29.315116 16845 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.315706 16845 raft_consensus.cc:2764] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:29.318532 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.319389 14377 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:29.319535 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.320348 14370 raft_consensus.cc:2376] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5. Re-sending same reply.
I20260709 13:18:29.320717 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.321388 14372 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
W20260709 13:18:29.321549 16858 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:29.321746 14304 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:29.326170 14864 leader_election.cc:336] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.101s (SENT)
I20260709 13:18:29.291213 16393 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:18:29.330457 14372 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:29.332928 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.334800 14300 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 3: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:29.305341 16846 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:29.342067 14864 leader_election.cc:336] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.125s (SENT)
I20260709 13:18:29.334344 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:29.287662 16819 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.350571 14297 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:29.356711 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.364234 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:29.364722 14376 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:29.364915 14220 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
W20260709 13:18:29.367609 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.368188 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:29.370301 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:29.334350 16386 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.369160 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:29.375250 14372 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:29.346798 16846 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.380015 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:29.330611 16730 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:18:29.382412 14225 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:29.383708 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:29.334621 16820 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.372907 16418 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:29.386628 14376 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:29.378422 16632 raft_consensus.cc:1064] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:18:29.389405 16776 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:29.390239 16418 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.393321 16819 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.378520 16503 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:18:29.393543 16787 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:29.395565 16596 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.408205 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:29.386224 16821 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:29.397670 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.408877 14226 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:29.409162 14370 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:29.408879 16821 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.397894 14223 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:29.410106 16821 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.398795 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.398933 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.411003 14375 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:29.380955 16808 raft_consensus.cc:2764] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:29.412631 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.398175 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.399590 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.414316 14377 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:29.399727 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.415151 14371 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.396950 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.416734 14376 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:29.405537 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.374351 16855 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:18:29.408442 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:29.418676 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.404453 14304 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:29.419377 14224 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:29.417826 14374 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.408986 16844 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:29.423257 16862 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:29.426033 14296 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:29.428537 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.429229 14299 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:29.380265 16542 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:29.430351 16542 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.430721 16846 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.404615 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:29.433982 14220 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:29.414170 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.435105 14370 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.407814 16418 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:29.422708 16808 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:29.423425 16844 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:29.438297 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 440959us
I20260709 13:18:29.438686 16844 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.439967 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:29.440723 16776 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:29.441196 16785 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:29.442047 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.439908 16844 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.441608 16785 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:29.444558 16785 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:29.445351 16614 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.445880 16614 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.446480 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:29.447328 16819 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.447794 16819 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.424381 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.448030 16788 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:29.452061 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.452730 14298 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:29.453876 16819 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:29.454156 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:29.454468 16819 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:29.454771 14304 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.458290 16846 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.453500 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.462179 14298 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:29.448052 16614 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.463492 16785 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.463416 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:29.467499 14370 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:29.479876 14304 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:29.468649 14374 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:29.424237 16820 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:29.474295 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:29.402390 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.480827 14371 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
W20260709 13:18:29.482578 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.483249 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.484649 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:29.484910 16418 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:29.485251 14222 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.485553 16418 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.486101 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.487632 16418 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:29.490098 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.490589 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.490125 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.490868 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.491214 14893 raft_consensus.cc:1813] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Handling vote request from an unknown peer bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:29.491366 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.491781 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.492535 14895 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:29.494037 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:29.494871 14229 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:29.491355 14374 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.496701 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.497545 14376 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:29.498311 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.499827 16819 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:29.500888 16819 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.501974 16860 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:29.502614 16860 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:29.502619 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 160599us
I20260709 13:18:29.504905 16860 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:29.422770 16848 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.506026 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:29.507416 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:29.507622 16848 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.505671 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.508498 14295 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:29.508855 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:29.510562 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 107719us
I20260709 13:18:29.502898 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.513326 14373 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:29.507519 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:29.516917 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53557.3us
W20260709 13:18:29.518697 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 76893.6us
I20260709 13:18:29.519795 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:29.521212 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:29.523602 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:29.529456 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:29.535451 16784 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:29.536058 14370 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:29.533429 14901 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:29.540772 14342 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:29.571462 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.491780 14893 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:29.572166 14376 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.572723 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.571599 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.572786 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:29.575045 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 58795.9us
I20260709 13:18:29.574473 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:29.579321 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.535827 16784 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.582348 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.583647 14372 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:29.516510 16808 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:29.583918 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.530390 16511 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:29.536429 16614 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:29.533980 16848 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:29.593981 16846 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:29.533386 16822 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:29.606669 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.573312 16418 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:29.609927 16863 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:18:29.617200 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.577291 16551 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:29.634871 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.609431 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:29.635958 14224 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.608510 16614 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.612623 14222 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:29.609663 16848 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.577206 16855 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:29.629226 14894 raft_consensus.cc:2410] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:29.619062 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.650039 14372 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:29.650983 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.651507 14372 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.647464 16614 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.654027 16855 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:29.654462 14377 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.655040 16855 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.629606 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.658114 14378 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:29.658206 16851 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.617847 14228 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:29.586228 16784 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.658742 16851 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.661069 16851 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.617619 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:29.630692 14375 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:29.620297 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.662030 14370 raft_consensus.cc:2410] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:29.598379 16808 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 13:18:29.667527 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.668305 14224 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
W20260709 13:18:29.669356 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 77603.8us
I20260709 13:18:29.669881 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:29.612344 14374 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
W20260709 13:18:29.614008 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80468.2us
I20260709 13:18:29.707849 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:29.661993 14371 raft_consensus.cc:2410] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:18:29.628540 16822 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:29.709651 16822 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:29.710311 16569 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:29.710968 16569 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:29.674928 14377 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:29.674305 14372 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:29.722841 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.724227 16825 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.725060 16825 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.727993 16825 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:29.729825 14123 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37080 (request call id 329) took 11483 ms (client timeout 15000 ms). Trace:
I20260709 13:18:29.731459 16822 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.430922 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:29.675638 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:29.687217 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:29.689976 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 155318us
I20260709 13:18:29.634464 16846 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:29.668612 16848 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:29.702845 14376 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:29.702864 16847 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:29.756047 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 213204us
W20260709 13:18:29.749747 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 74210.1us
I20260709 13:18:29.750686 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:29.756880 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:29.760139 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:29.760782 14303 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:29.759218 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:29.761241 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2236) took 1037 ms. Trace:
I20260709 13:18:29.762951 14373 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:29.698946 16820 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:29.698422 16676 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
W20260709 13:18:29.754910 14267 connection.cc:256] RPC call timeout handler was delayed by -1.8292713870000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 13:18:29.767695 14267 connection.cc:256] RPC call timeout handler was delayed by -1.596171386999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 13:18:29.767994 14267 connection.cc:256] RPC call timeout handler was delayed by -1.5052713869999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:18:29.768235 14267 connection.cc:256] RPC call timeout handler was delayed by -1.4746713869999439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
I20260709 13:18:29.765466 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.761548 14303 rpcz_store.cc:276] 0709 13:18:28.724114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.724239 (+   125us) service_pool.cc:224] Handling call
0709 13:18:29.759989 (+1035750us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:29.761189 (+  1200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52067712}
W20260709 13:18:29.766933 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59231.5us
I20260709 13:18:29.769332 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:29.770334 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:29.768464 14267 connection.cc:256] RPC call timeout handler was delayed by -1.3837713870000243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 13:18:29.771543 14267 connection.cc:256] RPC call timeout handler was delayed by -1.307271387000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 13:18:29.777397 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.778268 14373 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:29.778465 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 399) took 1056 ms. Trace:
I20260709 13:18:29.756485 16788 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.778872 14301 rpcz_store.cc:276] 0709 13:18:28.722269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.722674 (+   405us) service_pool.cc:224] Handling call
0709 13:18:28.722958 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.094524 (+371566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.778231 (+683707us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b540022d8d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:29.778407 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852560768}
I20260709 13:18:29.770982 14229 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:29.758490 16825 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:29.756304 16847 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:29.756801 16841 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:29.769481 16689 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 13:18:29.761967 16418 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:29.700806 16821 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.766360 16758 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.798722 16874 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:29.806316 16874 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.806082 16758 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.806730 16874 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.808454 16758 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:29.809063 16758 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:29.730486 14123 rpcz_store.cc:269] 0709 13:18:18.246257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.270024 (+ 23767us) service_pool.cc:224] Handling call
0709 13:18:20.278597 (+2008573us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400152054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff6090 00007f8ded094f3a 00007f8df2e4b1cc 00007f8df2f4937e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc 00007f8df1409392 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:29.729713 (+9451116us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:28.384813 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:28.557974 (+173161us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:28.558033 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:18:28.558053 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:28.558509 (+   456us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:28.558594 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:28.558632 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:28.559003 (+   371us) tablet.cc:701] Row locks acquired
0709 13:18:28.559058 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:18:28.559269 (+   211us) write_op.cc:270] Start()
0709 13:18:28.559442 (+   173us) write_op.cc:276] Timestamp: P: 1783603108559187 usec, L: 0
0709 13:18:28.559482 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:18:28.560315 (+   833us) log.cc:844] Serialized 544 byte log entry
0709 13:18:29.285155 (+724840us) op_driver.cc:464] REPLICATION: finished
0709 13:18:29.409903 (+124748us) write_op.cc:301] APPLY: starting
0709 13:18:29.410005 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:29.410128 (+   123us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:29.410266 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:29.410554 (+   288us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:29.410896 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:29.410944 (+    48us) write_op.cc:312] APPLY: finished
0709 13:18:29.411258 (+   314us) log.cc:844] Serialized 23 byte log entry
0709 13:18:29.411472 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:29.411553 (+    81us) write_op.cc:454] Released schema lock
0709 13:18:29.411609 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:29.412051 (+   442us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:29.412095 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":136802,"reported_tablets":5,"spinlock_wait_cycles":2926312832,"child_traces":[["op",{"apply.queue_time_us":116656,"apply.run_cpu_time_us":2110,"apply.run_wall_time_us":2115,"num_ops":1,"prepare.queue_time_us":221862,"prepare.run_cpu_time_us":6408,"prepare.run_wall_time_us":250214,"raft.queue_time_us":454521,"raft.run_cpu_time_us":26369,"raft.run_wall_time_us":116025,"replication_time_us":703076,"thread_start_us":626005,"threads_started":4,"wal-append.queue_time_us":171731}]]}
I20260709 13:18:29.767092 16785 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:29.769631 16386 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:18:29.811265 16785 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.811746 16785 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.812252 16386 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:29.812685 16386 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:29.795114 14867 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:29.799718 14270 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:29.800156 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:29.810164 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.828933 14369 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:18:29.829878 14192 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.529s (SENT)
I20260709 13:18:29.712208 16569 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.784143 16820 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:29.852614 16841 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.795799 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.798993 16825 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:29.853500 16821 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:29.854954 14372 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:29.854772 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.791831 16788 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.794837 16846 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.813490 16386 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.858016 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:30.397154 14229 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:29.857239 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.398393 16841 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:30.398886 14898 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:30.399093 16569 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.399871 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:29.961827 16822 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:30.266788 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.402376 16386 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:29.856631 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:29.941040 16718 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:30.026942 16596 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.273207 16855 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.404206 16596 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.404717 16855 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:30.405974 14374 raft_consensus.cc:2376] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4. Re-sending same reply.
I20260709 13:18:30.406687 16596 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:30.406936 16855 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:29.815385 16689 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.951901 16799 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:30.407485 16614 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.753s	user 0.016s	sys 0.006s
I20260709 13:18:29.941380 16418 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.952056 16817 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:30.127769 16784 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:29.815770 16746 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.609s
W20260709 13:18:30.069243 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 239409us
I20260709 13:18:30.409516 16788 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:30.119702 16874 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:29.836042 16758 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:30.118628 16847 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:29.865722 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66073.1us
I20260709 13:18:30.467911 16689 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:30.274099 16717 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.032691 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 245730us
I20260709 13:18:30.488656 16717 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:30.078043 16870 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:18:30.474324 16614 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:30.079336 16849 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:30.489516 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.491077 16717 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:30.395186 16877 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.278s	user 0.000s	sys 0.000s
I20260709 13:18:29.856182 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:30.449613 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.449671 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.503710 14901 raft_consensus.cc:2368] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4.
I20260709 13:18:29.799993 16787 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:30.464493 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.273836 16730 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.419484 16820 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:30.502842 14378 raft_consensus.cc:2376] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6. Re-sending same reply.
I20260709 13:18:30.482839 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.483053 16847 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.483771 14375 raft_consensus.cc:2368] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4.
I20260709 13:18:30.485031 16784 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:30.487928 16874 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:30.473568 16855 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:30.511631 16758 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:30.511940 16855 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.462610 16791 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:30.502748 14376 raft_consensus.cc:2376] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5. Re-sending same reply.
I20260709 13:18:30.503557 14372 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:30.470477 16799 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:30.466277 14864 leader_election.cc:336] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.819s (SENT)
W20260709 13:18:30.523658 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57455.4us
W20260709 13:18:30.524278 14864 leader_election.cc:336] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.929s (SENT)
I20260709 13:18:30.524672 16799 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:30.504597 14893 raft_consensus.cc:2410] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:30.505354 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.506896 16730 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.526463 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.526695 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.478531 16883 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.527709 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.528380 16883 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.529197 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.529778 14898 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:30.530872 16885 raft_consensus.cc:3055] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:30.531239 16883 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:30.531719 16785 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.720s	user 0.012s	sys 0.004s
I20260709 13:18:30.531925 16743 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:30.532047 16841 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:30.532444 16743 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:30.532977 16841 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:30.533334 16743 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:30.534265 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 51528.1us
I20260709 13:18:30.535459 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.535944 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.536531 14374 raft_consensus.cc:2376] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6. Re-sending same reply.
I20260709 13:18:30.536646 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:30.537070 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.505954 16614 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:30.468227 16632 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.538465 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1745) took 1126 ms. Trace:
I20260709 13:18:30.538829 14369 rpcz_store.cc:276] 0709 13:18:29.412241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.412362 (+   121us) service_pool.cc:224] Handling call
0709 13:18:30.538290 (+1125928us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54003c3cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:30.538408 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955488000}
I20260709 13:18:30.540033 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:30.541153 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:30.504482 14370 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:30.544551 16784 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:30.545233 16784 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:30.545313 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.502432 16718 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:30.512789 16758 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.546154 14370 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:30.546749 16855 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:30.546914 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.547780 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:30.548046 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.548715 14370 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:30.549315 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 1998) took 1059 ms. Trace:
I20260709 13:18:30.558853 14371 rpcz_store.cc:276] 0709 13:18:29.489679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.489842 (+   163us) service_pool.cc:224] Handling call
0709 13:18:30.549116 (+1059274us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54002599d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:30.549260 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393210240}
I20260709 13:18:30.560148 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.560667 14371 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:30.561375 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:30.515183 16569 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.557570 16512 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:30.562480 16512 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:30.515226 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.563316 14376 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:30.563220 16512 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:30.564241 16512 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.564280 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.565101 14376 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:30.566846 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:30.567615 14377 raft_consensus.cc:2368] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4.
I20260709 13:18:30.568497 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.569151 14377 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:30.557557 14373 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:18:30.570362 14373 pending_rounds.cc:85] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 2
I20260709 13:18:30.570644 14373 pending_rounds.cc:107] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:30.570921 14373 raft_consensus.cc:2889] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.571193 14896 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:30.572393 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.573761 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:30.574790 14371 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.518064 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 411) took 1013 ms. Trace:
I20260709 13:18:30.517992 16791 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.522473 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:30.476073 16418 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:30.524616 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:30.474601 16817 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.527771 16730 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:30.531296 16885 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:30.542091 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:30.608637 14378 raft_consensus.cc:2376] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6. Re-sending same reply.
W20260709 13:18:30.609018 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 132772us
I20260709 13:18:30.543921 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:30.544320 14303 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:30.610102 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:30.537469 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:30.610915 14374 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.611110 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:30.609647 14192 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.605s (SENT)
I20260709 13:18:30.549382 16596 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.550154 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:30.549518 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.611747 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.612219 14299 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:30.612408 14370 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:30.550176 14369 raft_consensus.cc:2368] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5.
I20260709 13:18:30.610128 14899 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:30.551946 16848 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.791s	user 0.007s	sys 0.004s
I20260709 13:18:30.401809 16825 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:30.554513 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.619716 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.557201 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.505053 16787 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.532159 16785 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.515018 16822 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:30.578771 14372 raft_consensus.cc:2376] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5. Re-sending same reply.
I20260709 13:18:30.578224 14302 rpcz_store.cc:276] 0709 13:18:29.504622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.533655 (+ 29033us) service_pool.cc:224] Handling call
0709 13:18:29.580440 (+ 46785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.580795 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.580821 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.610272 (+ 29451us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.778845 (+168573us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:29.778885 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.778947 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.517859 (+738912us) raft_consensus.cc:1685] finished
0709 13:18:30.517877 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.518007 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":19473,"thread_start_us":120701,"threads_started":1,"wal-append.queue_time_us":310060}
I20260709 13:18:30.602696 14296 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:30.621518 16787 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.631803 16892 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:30.632417 16892 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.607271 16817 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.621596 16596 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.636334 16596 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:30.639461 16785 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:30.642951 16892 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:30.643401 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 86320.3us
I20260709 13:18:30.644733 14373 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:30.647692 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:30.649858 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:30.604336 14371 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
W20260709 13:18:30.604867 14866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.001s	sys 0.005s
I20260709 13:18:30.611734 14377 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:30.614810 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:30.658579 14866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.002s	sys 0.005s
W20260709 13:18:30.605559 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 77705.4us
I20260709 13:18:30.618597 14378 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:30.618922 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:30.660012 14229 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:30.622244 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 98013.1us
W20260709 13:18:30.608199 14897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.001s	sys 0.005s
W20260709 13:18:30.661567 14897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.002s	sys 0.005s
I20260709 13:18:30.657140 14374 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:30.662683 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.624903 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:30.624291 14899 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:30.664788 14227 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:30.669135 14899 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 6. Ops: []
I20260709 13:18:30.562063 16569 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.670392 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:30.672619 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:30.621431 16874 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:30.628068 16730 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:30.674088 14897 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 4 LEARNER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:30.669015 16784 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:30.626149 16808 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.682124 14303 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:30.674723 14302 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:30.685554 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:30.684932 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.688035 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:30.701601 14301 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.690637 16743 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.694306 16785 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.695942 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.684981 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:30.699393 16758 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:30.669174 16717 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:30.664592 16746 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.621420 16848 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:30.729620 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 777) took 1231 ms. Trace:
I20260709 13:18:30.728700 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:30.731047 14303 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.680742 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.733683 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.735025 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:30.730041 14894 rpcz_store.cc:276] 0709 13:18:29.485718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.485849 (+   131us) service_pool.cc:224] Handling call
0709 13:18:30.707965 (+1222116us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54002495d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:30.716651 (+  8686us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326996352}
W20260709 13:18:30.736260 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 126648us
I20260709 13:18:30.736635 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:30.737208 14295 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.667359 16847 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:18:30.683131 16393 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:30.739010 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 68701us
I20260709 13:18:30.743000 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:30.740084 14900 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 13:18:30.744130 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.744140 14900 pending_rounds.cc:85] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 4
I20260709 13:18:30.744899 14900 pending_rounds.cc:107] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:30.745128 14900 raft_consensus.cc:2889] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.746695 16891 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:30.664216 16840 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 13:18:30.746246 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50378.9us
I20260709 13:18:30.749095 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.751977 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.717021 16717 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.757513 14301 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:30.758028 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.708256 16808 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:30.743047 16799 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.716073 16785 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:30.747179 16891 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.772464 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:30.773448 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.764071 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:30.751200 16883 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:30.768093 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:30.769459 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:30.759914 16717 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.770530 14865 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:30.786405 14301 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:30.778610 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:30.779403 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.779318 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.733058 16746 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.752583 16820 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:30.758978 16718 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:30.795899 14295 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:30.794531 14303 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:30.805152 16840 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:30.809870 16895 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:18:30.811393 16808 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:30.812192 14897 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:30.886077 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:30.760315 16893 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:18:30.814019 16896 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:18:30.891086 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.818581 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 733) took 1064 ms. Trace:
I20260709 13:18:30.818936 16569 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:30.820842 16785 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:30.826414 16418 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:30.827776 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 739) took 1021 ms. Trace:
I20260709 13:18:30.894203 16893 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:30.894134 14900 rpcz_store.cc:276] 0709 13:18:29.806439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.810702 (+  4263us) service_pool.cc:224] Handling call
0709 13:18:30.715766 (+905064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.750407 (+ 34641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.827544 (+ 77137us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54002495d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:30.827708 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2063121664}
I20260709 13:18:30.895697 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.896277 14900 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:30.831067 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.897904 14893 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:30.898080 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:30.898748 14225 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:30.889271 16820 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:30.857937 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:30.901233 16883 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:30.728924 16885 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.901558 14895 rpcz_store.cc:276] 0709 13:18:29.753855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.755927 (+  2072us) service_pool.cc:224] Handling call
0709 13:18:30.817578 (+1061651us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:30.817844 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.818081 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.818114 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:30.818163 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:30.818205 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.818283 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.818451 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6131456}
I20260709 13:18:30.904106 14895 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:30.781179 16860 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:30.884330 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 110947us
I20260709 13:18:30.887218 14226 raft_consensus.cc:2410] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:30.787572 16821 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:30.778584 16891 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.790148 16889 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:30.809373 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:30.894697 16893 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:30.899370 14893 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:30.754014 16393 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.933049 16746 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:30.842077 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 97881us
I20260709 13:18:30.796329 16881 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:18:30.935290 16881 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:30.933488 16393 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:30.906497 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:30.941100 16893 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.942585 16893 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.906052 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.917876 14267 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.946519 16718 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:30.946583 16784 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:30.947070 16784 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.947149 14895 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 4 LEARNER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:30.947438 16784 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.916399 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:30.950103 14227 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:30.949967 16846 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:30.925578 16889 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.951267 16889 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.953840 16718 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:30.954785 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.955569 14220 raft_consensus.cc:2410] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:30.959760 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.960551 14893 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:30.960438 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.962122 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.778309 16822 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:18:30.966797 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.962707 14377 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:30.964730 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:30.961725 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:30.969487 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:30.969762 14373 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.961153 16717 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:30.971596 14229 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:30.971750 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.973435 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:30.974022 14893 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:30.917140 16860 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.905289 16883 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:30.976504 14378 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:18:30.977927 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.925606 16821 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.956972 16817 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:30.982558 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.984928 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:30.966485 16718 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:30.984083 14377 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:30.981331 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:30.993266 14373 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:30.980415 16860 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:30.999428 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 220876us
I20260709 13:18:31.014066 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:30.986541 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:31.002792 16808 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:31.015231 16817 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:30.988617 16418 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:31.016005 16418 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.016400 16418 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.976071 16787 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.019454 14896 raft_consensus.cc:2368] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4.
I20260709 13:18:30.994138 16799 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.007886 16883 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.011742 14892 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:31.021262 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 736) took 1263 ms. Trace:
I20260709 13:18:31.021617 14892 rpcz_store.cc:276] 0709 13:18:29.765991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.766932 (+   941us) service_pool.cc:224] Handling call
0709 13:18:29.786225 (+ 19293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.011563 (+1225338us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b540079a520. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded003dc0 00007f8ded08e1c0 00007f8ded08f231 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c
0709 13:18:31.021000 (+  9437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.021203 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47794432}
I20260709 13:18:30.982826 16821 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.024776 16891 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.022920 16787 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:31.027467 16791 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:31.000484 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:31.030565 16817 raft_consensus.cc:2764] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:18:31.031114 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:31.031540 14374 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:31.031925 16817 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.032320 16817 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:31.032670 16817 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.033677 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2022) took 1178 ms. Trace:
I20260709 13:18:31.034066 14375 rpcz_store.cc:276] 0709 13:18:29.854849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.856392 (+  1543us) service_pool.cc:224] Handling call
0709 13:18:31.033498 (+1177106us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b54000b9354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:31.033622 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184270208}
I20260709 13:18:31.036015 16717 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:31.046164 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:31.047766 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.048116 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:31.048971 14296 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:31.051026 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:31.064177 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:31.065014 14297 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.065306 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.066323 14296 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:31.067145 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:31.078651 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.081707 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.079767 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.087229 14296 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:31.097469 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.097746 14300 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:31.098040 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:31.098408 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 64633.1us
I20260709 13:18:31.102924 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:31.104467 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:31.045154 16889 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.106801 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.105572 14302 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:31.109923 14298 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:31.078683 16808 raft_consensus.cc:697] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:31.082711 16822 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:31.025586 16784 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:31.117158 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:31.125557 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 367618us
I20260709 13:18:31.134747 14297 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:31.112550 16718 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:31.153964 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:31.107600 16717 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:31.173530 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:31.159298 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 54935.8us
I20260709 13:18:31.174391 14229 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:31.079634 16817 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:31.175590 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:31.175753 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:31.175848 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:31.179054 14224 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.178912 14229 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.181480 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:31.182473 14377 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:31.184504 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.116107 16910 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:31.125198 16743 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.193884 14229 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:31.174768 16874 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.158790 16825 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:31.211329 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:31.172873 16893 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:31.175041 16718 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:31.176735 16393 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:31.217167 14296 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:31.247673 14226 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:31.185232 16821 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.185139 16512 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.250372 16820 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.251466 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:31.285105 14228 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:31.252028 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:31.178861 16846 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:31.254876 14224 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:31.217630 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:18:31.259400 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.215039 16743 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.260106 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:31.181282 16730 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:18:31.218205 16874 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.294278 16874 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.294530 16784 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:31.290212 16820 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.183446 16717 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.192335 16847 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:18:31.271736 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.259291 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:31.277314 16718 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:31.309116 16911 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:18:31.309271 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 127864us
I20260709 13:18:31.310024 16847 raft_consensus.cc:2764] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:18:31.310150 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:31.312325 16846 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:31.299223 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:31.315042 14226 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.315622 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:31.315781 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 98253.7us
I20260709 13:18:31.316437 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:31.207870 16910 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.299258 14372 raft_consensus.cc:2368] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5.
I20260709 13:18:31.316286 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:31.319856 14267 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:31.323475 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:31.298667 16875 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.446s	user 0.008s	sys 0.012s
I20260709 13:18:31.336233 14220 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.338723 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:31.339401 14224 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.313511 16846 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.341092 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:31.343456 14303 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:31.345978 14227 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:31.298674 16820 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:31.277483 14125 catalog_manager.cc:5697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 4, now has a pending config: VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129), VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131), VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 4 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:31.353549 14222 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:31.350986 14229 raft_consensus.cc:2410] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:31.273530 16825 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:31.355741 14867 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:31.360065 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:31.361690 14228 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:31.359166 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 308183us
I20260709 13:18:31.286861 16860 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.366365 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:31.343204 16848 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:31.288940 16512 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:31.359357 16907 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:18:31.344643 16883 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:31.375541 14867 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:31.320176 16393 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.286587 16808 consensus_queue.cc:237] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:31.369248 16746 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:31.394380 14901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 736) took 1639 ms (client timeout 1523 ms). Trace:
I20260709 13:18:31.395533 14228 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:31.398921 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 746) took 1590 ms. Trace:
I20260709 13:18:31.378244 14224 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:31.375320 14125 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 4, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 4 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:31.349385 16913 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.385010 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:31.399477 14896 rpcz_store.cc:276] 0709 13:18:29.808442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.572120 (+763678us) service_pool.cc:224] Handling call
0709 13:18:31.398665 (+826545us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b5400883bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:31.398844 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026466560}
I20260709 13:18:31.387727 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:31.421432 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:31.401691 14125 catalog_manager.cc:5697] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 3 to 4, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 4 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:31.394917 14901 rpcz_store.cc:269] 0709 13:18:29.755128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.755243 (+   115us) service_pool.cc:224] Handling call
0709 13:18:31.389999 (+1634756us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54005abc54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:31.394308 (+  4309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662267264}
I20260709 13:18:31.402990 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:31.388860 16596 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:31.404023 16883 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:31.406613 16860 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:31.410791 16917 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:31.419566 14222 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.356616 16891 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:31.377537 16927 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.377626 16840 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.413213 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:31.438328 16909 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.439073 16785 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:31.439548 16785 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:31.440707 16825 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:31.423470 14125 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 4, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 4 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:31.441843 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:31.442638 14295 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:31.417688 14226 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:31.440375 16785 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.378528 16614 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:18:31.453390 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 105662us
I20260709 13:18:31.389122 16889 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:31.441843 14125 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 3, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:31.457312 14222 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:31.394865 16848 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:31.457039 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:31.459183 14125 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 4, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 4 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:31.444731 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:31.460341 16614 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:31.461522 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:31.425932 16632 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.425606 16913 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:31.466922 16825 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:31.468130 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:31.443455 16817 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:31.474829 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:31.472718 14125 catalog_manager.cc:5697] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 3, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 3 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:18:31.460394 16785 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.509195 14125 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 2, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 2 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:31.495456 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:31.502898 14224 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:31.456202 16787 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:31.513013 14125 catalog_manager.cc:5697] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:31.477402 16889 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:31.465572 16921 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:31.500839 16822 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:31.495098 16821 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:31.495579 16512 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:31.471158 16841 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:18:31.496047 16743 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:31.522411 14125 catalog_manager.cc:5697] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: config changed from index 2 to 3, term changed from 1 to 3, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129), cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.478248 16904 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:31.472371 16614 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:31.524479 16787 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:31.507862 16913 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.515405 16717 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:31.515027 16891 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:31.513958 16909 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:31.557567 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.559253 16393 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:31.560696 16418 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.003s
I20260709 13:18:31.562888 14220 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:31.562446 14125 catalog_manager.cc:5697] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 3, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 3 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:31.531251 16825 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:31.551047 16903 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.280s	user 0.003s	sys 0.000s
I20260709 13:18:31.548720 16921 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:31.550446 16889 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:31.577513 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 82114us
I20260709 13:18:31.578449 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:31.565047 16512 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:31.551190 16632 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:18:31.587221 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:31.498297 16883 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.584227 16512 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:31.581138 16910 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:31.530442 16905 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:18:31.584846 16393 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:31.585105 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 77251.6us
I20260709 13:18:31.595219 14192 leader_election.cc:400] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4.
I20260709 13:18:31.553259 16904 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.585649 16891 raft_consensus.cc:697] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:31.597014 14192 leader_election.cc:403] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:31.596254 16912 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.598093 16393 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:31.594144 16632 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:31.615674 16393 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.615696 16632 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:31.619115 16632 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:31.620815 16632 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.618955 16913 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.628993 16913 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:31.634370 14222 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:31.634392 14221 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:31.598920 16825 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:31.596949 16909 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:31.639801 16909 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:31.592921 16512 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:31.603549 16874 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.577894 16418 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:31.605410 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 702) took 1122 ms. Trace:
I20260709 13:18:31.593750 16614 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:31.607911 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.607848 16921 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:31.635337 16889 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.640810 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.640301 16909 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.595973 16787 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.675627 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.676448 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.697666 14300 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:18:31.690567 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.692752 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:31.698344 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.698376 14296 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.675395 14369 rpcz_store.cc:276] 0709 13:18:30.482512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.627975 (+145463us) service_pool.cc:224] Handling call
0709 13:18:30.666969 (+ 38994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.684319 (+ 17350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.684364 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.716427 (+ 32063us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.978318 (+261891us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:30.984524 (+  6206us) log.cc:844] Serialized 14 byte log entry
0709 13:18:30.993971 (+  9447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.994379 (+   408us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.500797 (+506418us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:31.605127 (+104330us) raft_consensus.cc:1685] finished
0709 13:18:31.605226 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.605358 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14887,"prepare.queue_time_us":8073,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":18954,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":33208,"spinlock_wait_cycles":12666752,"thread_start_us":231171,"threads_started":1,"wal-append.queue_time_us":421668}
W20260709 13:18:31.707239 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 115000us
I20260709 13:18:31.674455 16596 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.710418 14378 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:31.711449 14300 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:31.728876 14192 leader_election.cc:400] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5.
I20260709 13:18:31.729271 14192 leader_election.cc:403] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:31.614033 16891 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:31.733044 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 413254us
I20260709 13:18:31.738690 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:31.706703 16936 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4.
I20260709 13:18:31.698792 16718 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.746026 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:31.751770 14267 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:31.748565 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49081us
I20260709 13:18:31.721943 16596 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.755407 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:31.756526 16940 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:31.758325 16743 raft_consensus.cc:2764] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:18:31.758818 16512 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.762200 14297 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:31.750676 16717 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5.
I20260709 13:18:31.776818 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:31.778435 16893 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:31.779000 16596 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:31.754119 16632 raft_consensus.cc:2764] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:18:31.786103 16418 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:31.788070 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:31.789352 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:31.791654 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.793133 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:31.793885 16746 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.803507 16746 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.803843 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:31.804550 14897 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:31.805505 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:31.787436 16940 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:31.806186 14901 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.791839 16847 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:31.798884 16893 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:31.801764 16905 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:31.834537 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.839048 14300 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:31.840953 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:31.806022 16922 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:31.806353 16927 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:31.797338 16860 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:18:31.841593 14302 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.835629 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:31.808036 16940 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:31.849364 16922 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:31.850837 16512 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:31.851382 16718 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:31.805764 16746 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:31.842114 16874 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:31.854353 16954 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.870625 16954 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:31.856683 16909 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:31.871505 16946 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:18:31.873205 16954 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:31.873983 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:31.864481 14300 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:31.809348 16913 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:18:31.867116 16885 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:31.840286 16905 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.806071 16939 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:31.864895 14296 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:31.873490 16893 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:31.863818 16940 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:31.838095 16632 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:18:31.901753 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 102221us
I20260709 13:18:31.902675 14192 leader_election.cc:400] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4.
I20260709 13:18:31.903048 14192 leader_election.cc:403] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:31.904918 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:31.868655 16912 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.898314 16905 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.912709 16393 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:31.914121 16945 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:18:31.914568 14192 leader_election.cc:336] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.220s (SENT)
I20260709 13:18:31.915055 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:31.915872 16954 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:31.918337 16820 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:31.918819 16784 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.918365 14270 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:31.923372 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 560186us
I20260709 13:18:31.929374 14302 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:31.925421 14222 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:31.927170 14229 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:18:31.923213 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 589552us
I20260709 13:18:31.908303 16939 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:31.908859 16909 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:32.045841 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 115794us
I20260709 13:18:32.018930 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1755) took 1058 ms. Trace:
I20260709 13:18:31.908985 16912 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.912022 16512 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4.
W20260709 13:18:31.994828 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.911816 16847 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.934960 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.048024 14372 rpcz_store.cc:276] 0709 13:18:30.960011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.966489 (+  6478us) service_pool.cc:224] Handling call
0709 13:18:32.018674 (+1052185us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400060ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:32.018851 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762623232}
I20260709 13:18:31.921929 14901 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:32.066425 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:32.068140 14341 leader_election.cc:400] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4.
I20260709 13:18:32.069177 14341 leader_election.cc:403] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:32.070909 16915 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.051136 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:32.080880 14220 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.082032 16915 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4.
W20260709 13:18:32.083173 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.090312 16418 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.090899 16418 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.093400 16418 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:32.094290 16418 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.094165 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:32.094913 14229 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:32.094779 16418 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.096828 16418 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:32.098232 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.098997 14369 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:32.099793 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:32.100039 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.100572 14377 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.101121 16915 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:32.101537 16915 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.101915 16915 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.936878 16925 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.108014 16925 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:32.109193 16949 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:18:32.109993 16820 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:31.936614 16393 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:32.111886 16948 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:18:32.112439 16921 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.050268 16939 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.113054 16921 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:31.986932 16922 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.110627 16820 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:32.121160 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:32.115854 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2034) took 2171 ms. Trace:
I20260709 13:18:32.122073 14223 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:32.116346 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:32.123256 14229 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:31.932224 16927 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:31.937086 16930 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.128158 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.116801 14377 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:32.125931 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.129691 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.130859 14373 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:32.128983 14369 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:32.131474 14220 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:32.122049 14376 rpcz_store.cc:276] 0709 13:18:29.944797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.578928 (+634131us) service_pool.cc:224] Handling call
0709 13:18:30.611069 (+ 32141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.619256 (+  8187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.619287 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.627529 (+  8242us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.094799 (+467270us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:31.116047 (+ 21248us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.904902 (+788855us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b18003f5d40. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:18:32.045830 (+140928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.045912 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.045959 (+    47us) raft_consensus.cc:1685] finished
0709 13:18:32.115654 (+ 69695us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.115792 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20443,"prepare.queue_time_us":20989,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":7352,"raft.queue_time_us":830458,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":37363,"spinlock_wait_cycles":14007680,"thread_start_us":518246,"threads_started":2,"wal-append.queue_time_us":549247}
I20260709 13:18:32.053131 16912 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.132891 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:32.135550 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.056955 16551 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.134938 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.136230 14374 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:32.012387 16822 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:18:32.141741 14267 leader_election.cc:400] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5.
I20260709 13:18:32.142154 14267 leader_election.cc:403] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:32.148252 14373 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:32.139914 16799 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.155365 16893 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.062250 16847 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.136344 16927 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:32.153569 16808 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:32.202670 16855 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:32.206256 16808 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.206727 16808 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:32.206455 16855 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.143225 16551 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:32.210210 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.209653 16855 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:32.211702 16847 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:32.212518 16551 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:32.142149 16393 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:32.212908 16927 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.213337 16393 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.215647 16393 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:32.195514 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:32.217555 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:32.218264 14226 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:32.218919 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:32.219753 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:32.220505 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:32.220865 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:32.220992 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:32.237865 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 788) took 1262 ms. Trace:
I20260709 13:18:32.245311 14901 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:32.245416 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:32.239931 14893 rpcz_store.cc:276] 0709 13:18:30.975040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.979180 (+  4140us) service_pool.cc:224] Handling call
0709 13:18:31.640995 (+661815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.641245 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.641285 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.702950 (+ 61665us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.808882 (+105932us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:31.808934 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.809013 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.057840 (+248827us) raft_consensus.cc:1685] finished
0709 13:18:32.057857 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.217206 (+159349us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54005f28d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:32.237769 (+ 20563us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521336064,"thread_start_us":78686,"threads_started":1,"wal-append.queue_time_us":182306}
I20260709 13:18:32.280069 14342 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:32.168932 16785 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.187279 16956 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.281721 14896 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.286630 14897 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:32.287714 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.288079 14372 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:32.288554 14375 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:32.169474 16921 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:32.290303 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:32.291501 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:32.290930 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:32.337049 16925 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:32.337273 14892 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:32.337718 16925 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:32.135568 16930 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.338511 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:32.339854 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:32.339998 16930 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:32.327688 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.345009 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.345800 14302 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:32.201293 16957 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.362063 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.362803 14304 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:32.328634 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:32.356137 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 214529us
I20260709 13:18:32.374675 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:32.290817 16855 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:32.280719 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:32.375533 14901 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:32.204636 16932 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.199s
I20260709 13:18:32.290198 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:32.167400 16915 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.379231 14896 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:32.166707 16931 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.320s
I20260709 13:18:32.332322 16822 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:32.291239 16551 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:32.194307 16820 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.387880 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.392208 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:32.394104 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.391424 14295 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:18:32.402362 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 181420us
I20260709 13:18:32.405313 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:32.406388 14894 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:32.293083 16799 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.334371 16905 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.394289 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:32.408679 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:32.409305 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:32.310671 16785 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:32.317636 16940 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.292519 16959 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.159s
I20260709 13:18:32.394058 16822 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:32.417954 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:32.426493 14375 raft_consensus.cc:2376] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6. Re-sending same reply.
I20260709 13:18:32.427042 14226 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:32.310853 16956 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.417302 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.409132 16847 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:32.408324 16904 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:32.410498 16393 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:32.445478 14301 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:32.408104 16596 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.420775 16932 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:32.370450 16957 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.440266 14374 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.191883 16717 raft_consensus.cc:2955] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:32.394884 16883 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:18:32.450315 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 170328us
I20260709 13:18:32.425592 16860 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.464978 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:32.465931 16958 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:32.466274 14342 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:32.469717 16931 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:32.471057 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:32.471021 16931 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:32.473402 16821 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:32.473765 16821 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:32.474556 16821 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.475783 16821 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.468636 14895 raft_consensus.cc:2955] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:32.445353 16393 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.477945 16393 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:32.479110 14341 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.697s (SENT) [suppressed 35 similar messages]
I20260709 13:18:32.480679 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.426189 16885 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:32.481961 16885 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:32.482968 16910 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:32.482869 16885 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.483426 16910 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:32.483635 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:32.447211 16618 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:18:32.441895 16847 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:32.457653 16939 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.460301 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.454504 16596 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.463287 16957 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:32.465411 16860 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.481498 14373 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 2: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:32.428913 16822 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.494313 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:32.495398 14377 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:32.499102 14304 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:32.508675 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:32.509519 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.509653 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:32.510447 14373 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.483965 16785 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:32.514632 14192 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:32.514699 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:32.517256 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.513235 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.518114 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.519573 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.519794 14296 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:32.520411 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.520823 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.521824 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:32.522420 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.482991 16956 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:32.484254 16910 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.498015 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:32.500208 16971 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:32.493515 16847 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.623121 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:32.523372 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.501099 16930 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:32.495324 16840 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.523022 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.529846 14369 raft_consensus.cc:2393] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:18:32.596815 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.725196 14373 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:32.725442 14300 raft_consensus.cc:2410] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:32.529497 14374 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:32.623872 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:32.500176 16799 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:32.499675 16939 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:32.536783 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:32.634218 14192 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.566s (SENT)
I20260709 13:18:32.712361 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.520937 14303 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
W20260709 13:18:32.580817 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.731870 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.734174 14374 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:32.515688 16551 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:32.730854 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.578737 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.732314 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:32.733266 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 99107.6us
I20260709 13:18:32.622875 16618 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.522608 16953 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:32.654758 16676 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.654371 16932 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:32.740998 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.578393 16791 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.741816 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.514887 16632 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:32.750653 14374 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:32.750864 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:32.751497 14221 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.724670 16930 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:32.710531 16971 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:32.524753 16730 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:32.751829 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.759654 14374 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:32.753064 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.753710 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 603) took 1579 ms. Trace:
I20260709 13:18:32.755439 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:32.756857 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.757696 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.726369 14892 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:32.505961 16931 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.239s
W20260709 13:18:32.802695 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.808346 14225 rpcz_store.cc:276] 0709 13:18:31.174270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.175138 (+   868us) service_pool.cc:224] Handling call
0709 13:18:31.190606 (+ 15468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.432807 (+242201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.432837 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.432880 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:31.432920 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.753410 (+1320490us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540019afd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:32.753474 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.753630 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556512640}
W20260709 13:18:32.810482 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 55126.8us
I20260709 13:18:32.816941 14374 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:32.819931 14374 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:32.822788 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:32.802444 16957 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.824862 16957 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.825191 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:32.826427 14892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:18:32.827234 14892 raft_consensus.cc:606] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:32.828423 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:32.829185 16912 consensus_meta.cc:287] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.000s
I20260709 13:18:32.830066 14369 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:32.830946 16860 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:32.831575 16910 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:32.832442 14377 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:32.744555 16618 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.833640 14377 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:32.842378 14221 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:32.739800 16840 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.761371 16915 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:32.854839 14377 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:32.761813 16551 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.759341 16930 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:32.834717 16959 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.834515 16956 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:32.829625 16912 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.806407 16730 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.801923 16791 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.853091 16905 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:32.878804 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 399518us
I20260709 13:18:32.756844 16932 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.824220 16632 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:32.875417 14228 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:32.756533 16676 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.873656 14374 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:32.886873 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:32.848109 16860 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:18:32.875025 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:32.905989 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.924090 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:32.855371 16939 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:32.874652 16927 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:32.875183 16730 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.879182 16618 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:32.922487 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:32.874356 16959 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.879369 16848 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 13:18:32.959770 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.872087 16551 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.925838 14374 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:32.894524 16785 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.946961 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:32.973419 14192 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:32.927435 16905 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:32.965083 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:32.891567 16956 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:18:32.935326 14892 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:32.948627 16978 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:18:32.929214 16904 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.983659 16905 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:32.986232 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:32.975975 14300 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:32.986483 16840 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:32.951104 16791 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:32.986981 16551 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:32.922856 16632 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:32.953110 16614 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:32.988674 16808 consensus_meta.cc:287] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.781s	user 0.006s	sys 0.005s
I20260709 13:18:32.953764 16959 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:32.879771 16971 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:32.978596 16393 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.500s	user 0.004s	sys 0.006s
I20260709 13:18:32.966403 16897 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:32.947788 16927 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:32.978482 16785 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.002496 16904 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.086083 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:33.092171 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:33.093474 14900 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:33.097651 14900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:18:33.006338 16822 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.102310 14372 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:33.103183 16822 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:33.021375 16840 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.104918 16840 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:33.105321 16840 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.110567 16904 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:33.122727 16847 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.125221 16847 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:33.098351 14900 raft_consensus.cc:606] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:33.070421 16980 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:33.058653 16393 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.128973 16393 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:33.081151 16730 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.011862 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:32.952682 16676 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:33.024971 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.029762 16808 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:33.134680 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 122927us
I20260709 13:18:33.135432 14374 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:33.136338 16808 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:33.136500 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:33.075485 16632 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:33.078238 16912 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:33.068845 16957 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:33.138669 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.133812 16927 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:33.079850 16932 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:33.139010 16632 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.140872 16632 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:33.092124 16717 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.634s	user 0.005s	sys 0.002s
I20260709 13:18:33.142062 16676 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:33.141501 16632 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:33.144187 16730 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:33.144430 16910 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:33.149317 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:33.152236 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:33.089201 16893 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.850s	user 0.005s	sys 0.005s
I20260709 13:18:33.153857 16897 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:33.154038 16847 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:33.009492 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:33.085533 16821 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.001s
I20260709 13:18:33.162603 14901 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.153379 16393 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.174424 14896 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:33.153600 16785 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:33.179973 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:33.182930 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.185844 14373 raft_consensus.cc:2410] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:33.151337 16840 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.162883 16992 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.171589 16893 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5.
I20260709 13:18:33.204562 14901 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:33.206873 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:33.208542 14224 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:33.161999 16676 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.213687 16676 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:33.216081 16897 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.222213 14899 raft_consensus.cc:2410] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:33.222054 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1757) took 2249 ms. Trace:
I20260709 13:18:33.225059 14378 rpcz_store.cc:276] 0709 13:18:30.972915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.981112 (+  8197us) service_pool.cc:224] Handling call
0709 13:18:33.221831 (+2240719us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54000618d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:33.221968 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1651515776}
I20260709 13:18:33.229379 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:33.230265 14378 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.241425 14220 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:33.242383 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.198354 16393 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.245965 16840 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:33.198210 16847 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.255720 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:33.259090 14220 raft_consensus.cc:2410] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:18:33.261258 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 157151us
I20260709 13:18:33.242148 14892 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:33.270803 14298 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:33.258039 16881 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:33.277596 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:33.225997 16992 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:18:33.279352 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:33.282143 14224 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.287626 16596 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:33.294236 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.295311 14371 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:33.295819 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 722) took 1153 ms. Trace:
I20260709 13:18:33.296214 14371 rpcz_store.cc:276] 0709 13:18:32.142558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.142725 (+   167us) service_pool.cc:224] Handling call
0709 13:18:33.294046 (+1151321us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:33.295747 (+  1701us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156077312}
I20260709 13:18:33.306169 16992 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:33.266317 16930 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.308806 14377 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:33.309906 16930 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:33.279211 16881 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.315035 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:33.313565 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:33.317159 14221 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:33.319535 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:33.320197 14374 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.297581 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:33.321669 14371 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.327101 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:33.327849 14378 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:33.328775 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:33.329559 16920 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:33.330147 16920 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:33.330262 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 441) took 1469 ms. Trace:
I20260709 13:18:33.330842 14301 rpcz_store.cc:276] 0709 13:18:31.860333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.860457 (+   124us) service_pool.cc:224] Handling call
0709 13:18:31.860761 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.445960 (+585199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.329932 (+883972us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54003af554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:33.330167 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344264960}
I20260709 13:18:33.329133 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.332950 14378 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:33.335314 14224 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:33.333137 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:33.337713 14344 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:33.338881 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:33.340042 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:33.341269 16990 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.342195 16785 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.346104 16881 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:33.349043 16393 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:33.350256 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:33.355981 16847 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:33.356083 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:33.359791 14220 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:33.360180 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:33.331104 16920 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.363224 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:33.363631 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:33.362088 14371 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
W20260709 13:18:33.366575 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68556.2us
I20260709 13:18:33.367865 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.368492 14371 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:33.369359 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.370126 14371 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:33.371085 14267 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:33.371897 16893 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.372359 16893 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:33.372774 16893 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.372921 16785 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:33.373502 16785 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.373937 16785 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.372176 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:33.375393 14896 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.375932 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 743) took 1157 ms. Trace:
I20260709 13:18:33.376307 14899 rpcz_store.cc:276] 0709 13:18:32.218599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.218708 (+   109us) service_pool.cc:224] Handling call
0709 13:18:33.375751 (+1157043us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54007468d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:33.375880 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305183616}
I20260709 13:18:33.377981 16932 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:33.378685 16932 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.380751 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:33.380945 16932 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:33.366180 16930 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:33.382001 16930 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:33.371999 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:33.382884 16930 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.384717 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:33.385820 16990 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:33.387372 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:33.388252 14222 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:33.388532 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:33.388880 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1740) took 1366 ms. Trace:
I20260709 13:18:33.389464 16940 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:33.390141 16940 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:33.390506 16931 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:33.391086 16931 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.391557 16931 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:33.392017 14224 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:33.393676 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1764) took 1189 ms. Trace:
I20260709 13:18:33.394058 14373 rpcz_store.cc:276] 0709 13:18:32.204000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.731997 (+527997us) service_pool.cc:224] Handling call
0709 13:18:33.393512 (+661515us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540004c4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:33.393625 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031251328}
I20260709 13:18:33.395148 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:33.396132 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.397972 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:33.399246 14192 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:33.400100 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:33.400938 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:33.402190 16918 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.403828 16820 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:33.404383 16820 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.405928 16912 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.406524 16820 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:33.406435 16912 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.407043 16820 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:33.407488 16820 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.372002 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2043) took 1092 ms. Trace:
I20260709 13:18:33.408931 14377 rpcz_store.cc:276] 0709 13:18:32.279787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.857898 (+578111us) service_pool.cc:224] Handling call
0709 13:18:32.860807 (+  2909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.309361 (+448554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.371774 (+ 62413us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b5400258fd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:33.371948 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029616384}
W20260709 13:18:33.409399 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.408337 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:33.391319 14220 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:33.381495 14301 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:33.389266 14222 rpcz_store.cc:276] 0709 13:18:32.022494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.387656 (+1365162us) service_pool.cc:224] Handling call
0709 13:18:33.387975 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.388640 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.388830 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.413605 14224 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:33.416975 14226 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:33.422637 14229 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:33.428467 14374 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:33.431861 14377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:18:33.432420 16912 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:33.433147 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:33.433743 14300 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.434023 16897 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:33.434688 16897 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:33.435734 16897 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.437968 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1766) took 1233 ms. Trace:
I20260709 13:18:33.391398 16940 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:18:33.438545 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:33.439260 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 446) took 1069 ms. Trace:
I20260709 13:18:33.439455 14892 raft_consensus.cc:2410] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:33.439795 16784 raft_consensus.cc:2764] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:33.439687 14304 rpcz_store.cc:276] 0709 13:18:32.370015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.370545 (+   530us) service_pool.cc:224] Handling call
0709 13:18:32.377368 (+  6823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.508884 (+131516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.439040 (+930156us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54001559d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:33.439203 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279513344}
I20260709 13:18:33.440706 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:33.441249 14304 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:33.441725 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.390604 16393 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.442374 14295 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 1.
I20260709 13:18:33.442618 16910 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:33.442395 16393 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.443189 16910 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:33.443864 14297 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:33.444060 16910 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.444737 16393 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:33.445326 16393 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.445277 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.446165 16840 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.446681 16840 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.448803 16840 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:33.449869 14370 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:33.450435 16820 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:33.450554 14228 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:33.438370 14372 rpcz_store.cc:276] 0709 13:18:32.204535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.393851 (+189316us) service_pool.cc:224] Handling call
0709 13:18:33.437771 (+1043920us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54000609d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:33.437913 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625749248}
I20260709 13:18:33.451260 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:33.450479 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 721) took 1309 ms. Trace:
I20260709 13:18:33.452021 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.446791 16992 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:18:33.453282 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:33.468279 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:33.362046 16717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53822 (request call id 89) took 15232 ms. Trace:
I20260709 13:18:33.449862 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:33.472656 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.472769 14220 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.454409 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.368505 16847 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.474251 14378 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:33.371516 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.458762 14300 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:33.459606 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:33.465238 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 94221.1us
I20260709 13:18:33.452293 14370 rpcz_store.cc:276] 0709 13:18:32.141141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.141592 (+   451us) service_pool.cc:224] Handling call
0709 13:18:33.449340 (+1307748us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:33.449528 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.450259 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.450430 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158641920}
I20260709 13:18:33.468266 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.453581 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:33.432514 14377 raft_consensus.cc:606] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:33.477993 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:33.478212 14377 raft_consensus.cc:614] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:33.478796 14341 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.480573 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:33.482072 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.471196 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:33.471419 14896 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:33.452726 14372 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:33.484529 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.484767 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.472127 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:33.475803 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.415023 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:33.483538 14224 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:33.486693 14899 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:33.485778 14371 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:33.370779 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:33.475867 14900 raft_consensus.cc:2368] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5.
I20260709 13:18:33.490048 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:33.490437 14378 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:33.490638 14295 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:33.491289 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1773) took 1083 ms. Trace:
I20260709 13:18:33.491724 14378 rpcz_store.cc:276] 0709 13:18:32.408143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.489704 (+1081561us) service_pool.cc:224] Handling call
0709 13:18:33.490136 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.490961 (+   825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.491221 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.492599 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.493224 14378 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:33.492664 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:33.490222 14372 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:33.495675 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1774) took 1050 ms. Trace:
I20260709 13:18:33.495954 14372 rpcz_store.cc:276] 0709 13:18:32.445653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.489617 (+1043964us) service_pool.cc:224] Handling call
0709 13:18:33.489921 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.495452 (+  5531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.495626 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.461683 16393 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:33.502269 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 131554us
I20260709 13:18:33.503623 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.503155 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:33.497862 14222 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:33.499138 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.499140 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.494352 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.512491 14341 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.504287 14296 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:33.513708 14297 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 7 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:33.506117 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.505191 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:33.514380 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:33.511478 14224 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:33.508633 14220 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:33.439515 16889 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:18:33.515110 14222 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:33.515942 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:33.528692 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.498126 16990 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:33.497493 16953 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.537940 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.502357 16918 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.530454 14896 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:33.531268 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:33.532214 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:33.497537 16840 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.534502 14222 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:33.529588 14297 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:33.504173 16892 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:18:33.539060 14300 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:33.601326 14894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 755) took 2934 ms (client timeout 2233 ms). Trace:
I20260709 13:18:33.600598 16920 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:33.601738 14894 rpcz_store.cc:269] 0709 13:18:30.666883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.856655 (+189772us) service_pool.cc:224] Handling call
0709 13:18:33.601127 (+2744472us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400440554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:33.601233 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3457171840}
I20260709 13:18:33.602296 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.603116 14371 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:33.603029 14296 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:33.555930 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.604813 16820 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:33.605888 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50046.5us
I20260709 13:18:33.606622 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:33.607591 16820 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:33.608355 16820 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:33.608629 14375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2044) took 1278 ms (client timeout 1566 ms). Trace:
W20260709 13:18:33.609138 14375 rpcz_store.cc:269] 0709 13:18:32.330279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.373495 (+ 43216us) service_pool.cc:224] Handling call
0709 13:18:33.608432 (+1234937us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b54003340d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:33.608565 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73584896}
I20260709 13:18:33.609225 16820 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.511579 16822 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:33.610950 16822 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:33.611869 16822 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.613288 14369 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:33.597919 16825 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:18:33.509920 16393 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.618642 14371 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: [4.4-5.5]
W20260709 13:18:33.620738 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81570.7us
W20260709 13:18:33.623806 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.624648 14297 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:33.581573 14295 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:33.502084 16632 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:33.626976 14267 leader_election.cc:400] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5.
I20260709 13:18:33.627327 14267 leader_election.cc:403] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:33.502516 16957 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.629117 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.497189 16847 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.622262 14270 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:33.518499 16551 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.526153 16959 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.530313 16992 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:33.511337 16596 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:18:33.630890 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:33.657618 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:33.670015 14227 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:33.635753 16991 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:33.670806 14267 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:33.658367 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.658634 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:33.660683 14300 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:33.559127 16808 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:33.559389 16953 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:33.522735 16676 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:18:33.625717 16973 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:18:33.667250 14371 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:33.623564 16990 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:33.668459 16881 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:33.672294 14296 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:33.660266 16825 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.619901 16787 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:18:33.674749 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.692556 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:33.631779 16932 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5.
I20260709 13:18:33.677943 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:33.703783 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 191359us
I20260709 13:18:33.704876 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.709829 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.677067 16718 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:33.733227 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 234149us
W20260709 13:18:33.733325 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 55479.1us
I20260709 13:18:33.659842 16892 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:18:33.673576 16991 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:33.747110 14376 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:33.748780 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:33.749015 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 719) took 1613 ms. Trace:
I20260709 13:18:33.749342 14376 rpcz_store.cc:276] 0709 13:18:32.135195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.139577 (+  4382us) service_pool.cc:224] Handling call
0709 13:18:33.746707 (+1607130us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:33.746927 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.748772 (+  1845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.748964 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164084480}
I20260709 13:18:33.749925 14193 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:33.686733 16959 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.694360 16927 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.681504 16953 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.687556 16983 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:33.678578 16923 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.732048 16860 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.752635 16718 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:33.754757 16991 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:33.756083 16992 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:33.756585 16840 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.757215 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:33.758857 16905 raft_consensus.cc:2955] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index 2 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:33.688599 16808 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:33.681155 16904 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.752596 16889 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:33.736022 16921 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.778167 16918 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:33.820501 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 315355us
I20260709 13:18:33.747884 16632 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.751475 16915 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:33.795795 14376 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:33.735898 16940 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:18:33.735724 16848 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:18:33.751824 16912 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:18:33.795156 16923 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:33.889212 14222 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:33.766129 16932 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:18:33.805266 16992 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.933041 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:18:33.835301 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 169825us
I20260709 13:18:33.771193 16785 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:33.808741 16846 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:33.472538 16717 rpcz_store.cc:276] 0709 13:18:18.045912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.046043 (+   131us) service_pool.cc:224] Handling call
0709 13:18:18.135365 (+ 89322us) log.cc:844] Serialized 508 byte log entry
0709 13:18:33.274119 (+15138754us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129651,"raft.queue_time_us":130223,"raft.run_cpu_time_us":10206,"raft.run_wall_time_us":145698,"thread_start_us":643246,"threads_started":2,"wal-append.queue_time_us":61946,"wal-append.run_cpu_time_us":1792,"wal-append.run_wall_time_us":1002432}
I20260709 13:18:33.934216 14376 pending_rounds.cc:85] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 2
I20260709 13:18:34.042418 14376 pending_rounds.cc:107] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:34.042694 14376 raft_consensus.cc:2889] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:33.770102 16959 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.834887 16889 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:33.882179 17002 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:18:33.953308 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 287824us
I20260709 13:18:34.044162 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:33.887501 16973 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:33.887260 16991 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.939440 16923 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.886884 16799 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:33.938956 17005 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.950855 16632 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:33.947499 16957 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:33.952950 16992 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:34.069772 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 330029us
I20260709 13:18:34.039983 16846 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:34.041282 16912 consensus_queue.cc:1243] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:34.053818 16973 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:34.065886 16840 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.092919 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 335744us
I20260709 13:18:33.889513 16918 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.100183 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:34.113983 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:34.118558 14376 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
W20260709 13:18:34.116528 16922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.393s	user 0.007s	sys 0.031s
I20260709 13:18:34.132982 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:34.085461 16847 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.137308 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:34.141384 14376 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:34.092048 16932 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:34.129768 16893 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.756s	user 0.008s	sys 0.002s
I20260709 13:18:34.077577 17005 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:34.151749 17008 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:34.128472 16889 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.089071 16957 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.154664 16785 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:34.085764 16808 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:34.156522 16957 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.125087 16840 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.074347 16799 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.159106 16840 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.159493 16799 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.159781 16932 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.161013 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:34.134163 16912 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:34.153642 17005 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:33.882969 16990 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.162622 14375 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:18:34.140668 16922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.433s	user 0.007s	sys 0.031s
W20260709 13:18:34.193392 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 149282us
I20260709 13:18:34.177095 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:34.194339 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:34.196651 14295 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:34.147238 16930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.008s	sys 0.017s
I20260709 13:18:34.204564 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:34.206981 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:34.207808 14375 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:34.222893 14896 raft_consensus.cc:2955] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:34.161772 16932 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.168081 16847 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:34.228776 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:34.201313 16999 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.435s	user 0.000s	sys 0.001s
I20260709 13:18:34.192083 16820 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:34.168678 17005 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:18:34.259351 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:18:34.259740 17013 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:18:34.260416 17007 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:18:34.200697 16930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.008s	sys 0.017s
I20260709 13:18:34.173307 16983 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:34.266510 17025 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:34.266611 14375 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:18:34.269204 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 53795.8us
I20260709 13:18:34.269996 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:34.273772 16931 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.882s	user 0.007s	sys 0.005s
I20260709 13:18:34.272354 16991 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:34.162329 16874 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:18:34.162737 16912 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.222599 17019 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:34.177119 16840 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:34.307260 14114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48132.3us
I20260709 13:18:34.311870 14376 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
W20260709 13:18:34.272105 17015 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:34.174185 16893 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:34.316265 16983 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.353691 14302 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:34.274976 17006 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:18:34.317235 17025 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.317698 17005 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:34.320477 16923 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.324604 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2059) took 1402 ms. Trace:
I20260709 13:18:34.325947 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2280) took 1806 ms. Trace:
I20260709 13:18:34.327486 16959 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:34.163023 16918 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:34.332918 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.332289 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:34.350991 17022 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.374810 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 334815us
I20260709 13:18:34.375360 17022 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:34.355921 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.376315 14864 connection.cc:256] RPC call timeout handler was delayed by -1.4153026899998622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 13:18:34.376662 14864 connection.cc:256] RPC call timeout handler was delayed by -1.4140319319999435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:18:34.377060 14864 connection.cc:256] RPC call timeout handler was delayed by -1.2835319319999599s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:18:34.300410 16847 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:34.378109 17022 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:34.378265 16847 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.380686 17030 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.357327 17025 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.381341 17030 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:34.381937 17030 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.387189 16787 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:34.360358 14378 rpcz_store.cc:276] 0709 13:18:32.922216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.495824 (+573608us) service_pool.cc:224] Handling call
0709 13:18:33.496210 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:33.501622 (+  5412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.501651 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:33.512287 (+ 10636us) log.cc:844] Serialized 52 byte log entry
0709 13:18:33.808800 (+296513us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:34.175223 (+366423us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.177375 (+  2152us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.177607 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.177691 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.324358 (+146667us) raft_consensus.cc:1685] finished
0709 13:18:34.324375 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.324540 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4930,"raft.queue_time_us":25651,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":45024,"thread_start_us":558302,"threads_started":2,"wal-append.queue_time_us":539257}
I20260709 13:18:34.348183 17019 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.362423 14299 rpcz_store.cc:276] 0709 13:18:32.519176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.531663 (+ 12487us) service_pool.cc:224] Handling call
0709 13:18:33.220451 (+688788us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:33.220669 (+   218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.221107 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:33.265212 (+ 44105us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.475636 (+210424us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.497711 (+ 22075us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.497929 (+   218us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:33.498185 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.518583 (+ 20398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.518692 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.325687 (+806995us) raft_consensus.cc:1685] finished
0709 13:18:34.325708 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.325878 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33658,"prepare.queue_time_us":164984,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":23149,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":20387,"spinlock_wait_cycles":10658560,"thread_start_us":241780,"threads_started":2,"wal-append.queue_time_us":400282}
I20260709 13:18:34.357546 17005 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:34.200650 16846 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.307513 16820 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.420949 16820 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.348970 16931 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.421687 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2295) took 1022 ms. Trace:
I20260709 13:18:34.422163 14302 rpcz_store.cc:276] 0709 13:18:33.399741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.409595 (+  9854us) service_pool.cc:224] Handling call
0709 13:18:33.409870 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.354142 (+944272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.421405 (+ 67263us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b54000db1d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:34.421617 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170145536}
I20260709 13:18:34.423348 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:34.424320 14373 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:34.424207 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:34.405439 17024 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:18:34.205696 16973 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.407116 17027 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.398315 17019 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:34.407944 16746 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.416273 16892 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:34.418980 16923 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:34.406602 17009 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:18:34.440526 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:34.441210 14229 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:34.442394 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:34.443746 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:34.446539 14374 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:34.429070 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:34.447161 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:34.347959 17012 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:18:34.436502 14224 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:34.447986 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:34.432973 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2039) took 2212 ms. Trace:
I20260709 13:18:34.447997 14374 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:18:34.448778 14369 rpcz_store.cc:276] 0709 13:18:32.220526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.831591 (+611065us) service_pool.cc:224] Handling call
0709 13:18:33.612882 (+781291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.613754 (+   872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.432715 (+818961us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54003340d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:34.432902 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796144512}
W20260709 13:18:34.454238 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 78531.1us
I20260709 13:18:34.470325 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:34.470582 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:34.471032 14894 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:34.405638 16730 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:34.424626 16893 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:34.476764 14344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.004s	sys 0.025s
I20260709 13:18:34.472864 14299 raft_consensus.cc:2955] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:34.431710 16846 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.419028 16912 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.471282 14224 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:34.481467 14225 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:34.485487 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:34.411087 17025 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.489097 17025 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:34.493350 16920 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.493978 16920 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.494072 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:34.495712 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:34.496436 14225 raft_consensus.cc:2376] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4. Re-sending same reply.
W20260709 13:18:34.501605 14344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.004s	sys 0.026s
I20260709 13:18:34.507956 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:34.496037 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:34.547607 14224 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:34.440349 16892 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:34.548594 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:34.474431 16730 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:34.551707 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66425.5us
I20260709 13:18:34.552591 14867 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:34.539031 16918 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.554289 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:34.554348 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 58397.2us
I20260709 13:18:34.555107 14901 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:34.555577 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 795) took 1187 ms. Trace:
I20260709 13:18:34.440618 17022 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.555909 14901 rpcz_store.cc:276] 0709 13:18:33.368012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.368136 (+   124us) service_pool.cc:224] Handling call
0709 13:18:34.554151 (+1186015us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:34.555524 (+  1373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3477888}
I20260709 13:18:34.556466 14894 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:34.476914 16923 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:34.542788 16825 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.806s	user 0.008s	sys 0.003s
I20260709 13:18:34.497913 16973 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.559978 14901 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:34.468788 16992 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.566146 14223 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:34.543996 17006 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:34.544387 16893 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:34.582923 16991 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:34.583258 17032 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:18:34.570010 16918 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:34.560257 16953 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.008s
I20260709 13:18:34.547026 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:34.574149 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2065) took 1297 ms. Trace:
I20260709 13:18:34.544178 16912 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:34.470221 16746 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.588209 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:34.591574 16393 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.958s	user 0.008s	sys 0.003s
I20260709 13:18:34.558588 16822 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:34.554404 17025 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:34.591197 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:34.591270 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:34.591552 14864 connection.cc:256] RPC call timeout handler was delayed by -1.1070393339998645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 13:18:34.566687 16825 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:34.595942 16393 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:34.480588 17005 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.562511 16847 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:18:34.593851 14372 rpcz_store.cc:276] 0709 13:18:33.277125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.496420 (+219295us) service_pool.cc:224] Handling call
0709 13:18:33.496744 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:33.502654 (+  5910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.502685 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:33.513275 (+ 10590us) log.cc:844] Serialized 598 byte log entry
0709 13:18:33.888039 (+374764us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:34.291750 (+403711us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.292705 (+   955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.292806 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.573649 (+280843us) raft_consensus.cc:1685] finished
0709 13:18:34.573673 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.574089 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16885,"prepare.queue_time_us":531924,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":336,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5975,"spinlock_wait_cycles":22484864,"thread_start_us":494954,"threads_started":2,"wal-append.queue_time_us":637206}
W20260709 13:18:34.598508 16921 consensus_meta.cc:287] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.711s	user 0.010s	sys 0.000s
I20260709 13:18:34.590957 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:34.593389 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:34.592036 16717 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:34.600538 17032 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:34.583140 17026 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.601358 16931 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.470958 17027 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.567966 16930 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.573347 16820 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.570729 17022 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.590082 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:34.572754 16939 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:34.583212 16893 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.590935 17006 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:34.638679 17012 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:18:34.694449 14225 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:34.662281 14896 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:34.637303 16393 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:34.635803 14899 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:34.635380 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:34.594244 16910 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:34.568819 16923 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.598672 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:34.587460 16918 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.695993 14221 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.702006 14897 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:18:34.702540 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 254940us
W20260709 13:18:34.685734 17009 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:34.627120 16730 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:34.680197 16512 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:34.722517 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:34.719950 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 111593us
I20260709 13:18:34.722940 14220 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:34.606554 16912 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:34.696406 16930 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:34.595705 16953 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:34.730055 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.700409 16847 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.696653 17032 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:34.667469 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 760) took 1299 ms. Trace:
I20260709 13:18:34.700191 16910 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.651362 17025 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:18:34.732372 17039 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.735605 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:18:34.736366 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.736515 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:34.748374 14225 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:34.737017 14221 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:34.714025 16921 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:34.625996 16822 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.727595 17005 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.750576 14221 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:34.727119 16512 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:34.752177 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.734192 16930 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.700059 16820 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.756049 17050 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:34.740828 16847 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:34.756788 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:34.770771 14225 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:34.744261 16730 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.757799 16676 raft_consensus.cc:993] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: : Instructing follower a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:18:34.751377 17048 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:18:34.626603 16892 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.780421 14221 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:34.780421 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 170530us
I20260709 13:18:34.753767 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:34.718060 16939 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.744292 16910 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.757455 17022 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.700412 17026 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:34.701670 16717 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:34.766841 16905 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:34.805859 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:34.768342 16956 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.792248 17041 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:34.793207 17019 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.794816 16889 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.796334 16923 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.798219 16512 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:34.801148 14225 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:34.771996 17050 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:34.804044 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.736248 14895 rpcz_store.cc:276] 0709 13:18:33.356578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.361372 (+  4794us) service_pool.cc:224] Handling call
0709 13:18:34.544939 (+1183567us) spinlock_profiling.cc:243] Waited 980 us on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67eee 0000000000375939 00007f8df1fdb1e0 00007f8df20a40c4 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:34.655730 (+110791us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254208}
I20260709 13:18:34.808204 16892 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:34.807755 16905 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.802187 16992 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.807421 17022 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:18:34.764041 17039 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.813030 17041 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:34.849212 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 67468.1us
I20260709 13:18:34.820041 16918 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.816988 17033 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:34.807638 16921 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:18:34.868497 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:34.809757 16927 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:18:34.829483 17034 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.858022 17041 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.825122 17050 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.849543 16905 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.860600 16512 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.815061 16956 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.848189 17027 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.847031 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:34.883911 17054 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:34.910090 16912 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:34.910219 17054 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:34.910830 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:34.911243 17054 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.912359 16822 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.912644 17054 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.866109 17057 raft_consensus.cc:1081] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Signalling peer a9b2cf49ceed478480fb0f27ccf55d81 to start an election
I20260709 13:18:34.855240 17053 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:18:34.893374 14900 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:34.884501 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1785) took 1405 ms. Trace:
I20260709 13:18:34.931392 14371 rpcz_store.cc:276] 0709 13:18:33.478913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.630069 (+151156us) service_pool.cc:224] Handling call
0709 13:18:33.630365 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.680433 (+ 50068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.884257 (+1203824us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5400334d54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:34.884443 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82474752}
I20260709 13:18:34.885842 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:34.902379 17019 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:34.858386 17028 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:18:34.905966 17056 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:34.869318 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 68595.8us
I20260709 13:18:34.915298 14864 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:34.874185 17033 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:34.950258 17049 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.960140 17049 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.962095 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:34.882596 16893 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.937916 14371 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: [4.4-5.5]
I20260709 13:18:34.935438 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:34.969401 14374 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
W20260709 13:18:34.971226 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 56010.4us
I20260709 13:18:34.972515 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:34.870512 16918 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.990624 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:34.940460 17006 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:34.984856 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:35.001713 14377 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:34.998833 14375 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:34.869928 17032 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:35.011655 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:35.016587 16956 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:34.997612 17056 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:34.988225 16846 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:35.014467 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:35.000746 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:34.967957 16953 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:35.004987 14378 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:35.017922 16964 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:18:35.024618 16931 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.040023 16931 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:34.878568 17034 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:35.042313 16931 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:35.043020 17034 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:35.042943 16717 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:35.033560 16846 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.043959 16939 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:35.045579 17049 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:35.046470 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.993209 16893 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.031044 17056 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:35.004971 16973 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:35.010419 16847 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:35.037659 17048 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:34.993993 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:35.044193 16846 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:35.059608 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 143235us
I20260709 13:18:35.046048 16982 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:34.999868 17019 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:18:35.033864 16956 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:35.034674 16551 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.061205 17053 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:35.062638 16893 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:35.050271 16820 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:35.068418 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 54059.9us
I20260709 13:18:35.077347 14374 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:35.060609 17056 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.078516 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:35.082163 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:35.038964 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:35.082835 14374 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:35.084082 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:35.084412 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45539us
I20260709 13:18:35.086969 14374 raft_consensus.cc:2955] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:35.027721 17033 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:35.093595 17012 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:35.096391 17041 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:35.098096 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:35.098927 14376 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:35.066627 17048 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:35.109855 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:35.111902 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:35.070295 17059 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:18:35.113070 14375 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:35.127722 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:35.131649 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:35.123917 16860 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:35.134414 17041 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:35.089552 16551 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:35.137179 16551 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:35.144903 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:35.116901 17048 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:35.154220 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:35.154721 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:35.156870 14375 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.163221 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:35.163983 14896 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:35.133700 16860 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:35.079775 16956 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:35.168965 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:35.131182 17039 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:35.177241 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:35.178767 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.178038 16551 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:35.114833 16820 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:18:35.184789 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:35.187592 14376 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.124668 16939 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:18:35.159264 16940 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.191452 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 635) took 1769 ms. Trace:
I20260709 13:18:35.185345 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:35.185429 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:35.132833 17034 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:18:35.195515 14227 rpcz_store.cc:276] 0709 13:18:33.422007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.423411 (+  1404us) service_pool.cc:224] Handling call
0709 13:18:33.423770 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.670404 (+246634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.187834 (+1517430us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540026d4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:35.191374 (+  3540us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565523328}
I20260709 13:18:35.201012 14374 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:35.180754 16860 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:35.213035 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:35.207319 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:35.213729 14896 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:35.214249 14374 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:35.215862 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:35.217624 14375 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:35.224740 14375 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:35.190575 17065 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:35.171792 17050 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:35.213099 17034 consensus_queue.cc:1243] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:35.236617 14376 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:35.189042 16930 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:35.224965 16822 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.192229 16551 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:35.252004 14222 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:35.202945 16940 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:35.229724 17065 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:35.257834 14298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2269) took 2731 ms (client timeout 1664 ms). Trace:
I20260709 13:18:35.262655 16551 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:35.268832 14298 rpcz_store.cc:269] 0709 13:18:32.514368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.514470 (+   102us) service_pool.cc:224] Handling call
0709 13:18:35.245589 (+2731119us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54001f7f54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:35.245709 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598607616}
I20260709 13:18:35.241773 16847 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.272562 17065 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.260344 16822 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:35.297362 16893 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:35.310662 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 1.8973e+06us
I20260709 13:18:35.299378 17053 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.315958 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:35.316596 14297 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.321338 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:35.321888 14300 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:35.326815 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:35.325399 17053 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:35.359901 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:35.360832 14300 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:35.356993 14304 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:18:35.367403 16889 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.000s
I20260709 13:18:35.368486 14897 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:18:35.369127 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2049) took 2927 ms. Trace:
I20260709 13:18:35.370303 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:35.296015 16847 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:35.373142 16847 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:35.374015 16847 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:35.374346 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.375247 17030 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.993s	user 0.014s	sys 0.000s
W20260709 13:18:35.376428 14373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1778) took 2021 ms (client timeout 2223 ms). Trace:
I20260709 13:18:35.303381 16905 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:35.376848 14373 rpcz_store.cc:269] 0709 13:18:33.354841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.395910 (+ 41069us) service_pool.cc:224] Handling call
0709 13:18:35.376216 (+1980306us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003c37d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:35.376360 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2362983168}
I20260709 13:18:35.385885 14227 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:35.389961 14227 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:18:35.369566 14370 rpcz_store.cc:276] 0709 13:18:32.442292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.493888 (+1051596us) service_pool.cc:224] Handling call
0709 13:18:33.494567 (+   679us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:33.668386 (+173819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.668417 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:33.674080 (+  5663us) log.cc:844] Serialized 534 byte log entry
0709 13:18:34.913662 (+1239582us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b1800050b00. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:18:34.996017 (+ 82355us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:34.996057 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.368788 (+372731us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400349ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:35.368840 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.368888 (+    48us) raft_consensus.cc:1685] finished
0709 13:18:35.368901 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.369060 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6495,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":11350,"spinlock_wait_cycles":393089664,"thread_start_us":82156,"threads_started":1,"wal-append.queue_time_us":1350612}
I20260709 13:18:35.393610 14370 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:35.391395 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:35.402271 14342 connection.cc:256] RPC call timeout handler was delayed by -1.3018268900002568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
I20260709 13:18:35.402655 14300 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:35.406934 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:35.407196 14221 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:35.407729 14304 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:35.416199 14299 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:35.375728 17030 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:35.416643 14299 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:35.471410 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:35.468654 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.836405 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.487464 14297 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
W20260709 13:18:35.596731 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.845515 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.827755 14299 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:35.420426 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:35.852597 14342 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:35.877259 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 48563.9us
I20260709 13:18:35.386454 16990 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:35.879081 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:35.880533 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:35.552165 14300 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:35.863128 14297 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:35.891542 14299 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:35.807070 17069 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.506s	user 0.000s	sys 0.002s
I20260709 13:18:35.963642 17030 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:35.395130 16847 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:35.964686 16846 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.892s	user 0.011s	sys 0.000s
I20260709 13:18:35.575517 17050 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:35.615612 16930 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:35.958830 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:35.499001 16910 consensus_meta.cc:287] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.695s	user 0.005s	sys 0.005s
W20260709 13:18:35.848078 17067 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.552s	user 0.001s	sys 0.001s
W20260709 13:18:35.569213 17005 consensus_meta.cc:287] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.802s	user 0.007s	sys 0.004s
I20260709 13:18:36.006733 14299 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:18:36.051486 14299 pending_rounds.cc:85] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 3
I20260709 13:18:36.051789 14299 pending_rounds.cc:107] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:18:36.052086 14299 raft_consensus.cc:2889] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.970669 14304 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:36.053658 14304 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:35.700781 16940 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:36.057026 14372 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:18:35.974373 14225 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
W20260709 13:18:36.004683 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.986549 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:35.797551 17048 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.629s	user 0.015s	sys 0.000s
W20260709 13:18:35.847823 17075 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.477s	user 0.002s	sys 0.000s
W20260709 13:18:35.966833 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 87837.3us
W20260709 13:18:35.971127 17077 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.609s	user 0.001s	sys 0.000s
I20260709 13:18:35.413444 16551 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:35.407780 16956 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:35.982430 14302 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:35.806229 17053 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:35.793942 17078 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.412282 16931 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.057509 14372 pending_rounds.cc:85] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 6
I20260709 13:18:36.175848 14372 pending_rounds.cc:107] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:36.176262 14372 raft_consensus.cc:2889] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:35.716078 17073 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.409s	user 0.001s	sys 0.000s
I20260709 13:18:35.993917 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1755) took 1530 ms. Trace:
I20260709 13:18:36.177713 14222 rpcz_store.cc:276] 0709 13:18:34.463133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.761154 (+298021us) service_pool.cc:224] Handling call
0709 13:18:34.761558 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.256615 (+495057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.993613 (+736998us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b540033e354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:35.993847 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127194496}
I20260709 13:18:35.841828 16959 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:35.992364 17054 consensus_meta.cc:287] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.079s	user 0.004s	sys 0.008s
W20260709 13:18:35.981334 17042 log.cc:927] Time spent T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.293s	user 0.003s	sys 0.009s
I20260709 13:18:36.054760 14304 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:35.966997 16847 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:36.089838 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.087689 14300 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:35.977662 16883 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.173702 16551 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.050858 16910 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.316497 16883 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.101302 17048 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.319054 16883 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:36.002168 17010 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.652s	user 0.004s	sys 0.002s
W20260709 13:18:35.985036 16860 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.760s	user 0.004s	sys 0.005s
I20260709 13:18:36.323575 16860 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:35.987787 16730 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.204s	user 0.010s	sys 0.001s
I20260709 13:18:36.101869 17005 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:35.990695 16718 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:35.965129 16846 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:35.997222 16905 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:35.966423 16930 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.977813 17030 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:36.108072 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2084) took 1025 ms. Trace:
I20260709 13:18:36.350286 14376 rpcz_store.cc:276] 0709 13:18:35.082927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.237330 (+154403us) service_pool.cc:224] Handling call
0709 13:18:35.237629 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.240081 (+  2452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.240109 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.240549 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.276742 (+ 36193us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:35.276767 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.276814 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.107837 (+831023us) raft_consensus.cc:1685] finished
0709 13:18:36.107857 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.108010 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13388,"thread_start_us":35908,"threads_started":1,"wal-append.queue_time_us":68776}
I20260709 13:18:36.109602 14302 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:35.996757 16822 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:36.281545 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.191617 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 101220us
I20260709 13:18:36.308522 14304 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.314210 14299 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:36.309062 16891 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.319496 17048 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:36.320755 14227 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:36.174254 17046 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.309474 17056 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.212s	user 0.017s	sys 0.000s
I20260709 13:18:36.325299 14301 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:36.011511 16990 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.326257 14893 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:36.327322 16956 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.327405 16551 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:36.319847 17065 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.014s	user 0.011s	sys 0.000s
I20260709 13:18:36.332759 16910 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.333289 16959 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.334064 17032 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.336140 16918 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.180421 16931 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.384459 16718 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.280824 16596 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.354266 14302 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:36.380761 17026 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:36.338327 16940 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:36.397838 16551 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:36.421581 16596 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.181156 17078 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.381270 14896 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:36.398682 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 450) took 2885 ms. Trace:
I20260709 13:18:36.347142 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:36.374377 17030 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.409735 16918 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.412573 14302 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.391327 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:36.355662 17054 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:18:36.381052 16930 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:36.410957 16959 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.428032 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2182) took 2575 ms. Trace:
W20260709 13:18:36.428824 14370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.013s	sys 0.029s
I20260709 13:18:36.374194 16822 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:36.388154 17046 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.388389 17056 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.431216 14303 rpcz_store.cc:276] 0709 13:18:33.513277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.514100 (+   823us) service_pool.cc:224] Handling call
0709 13:18:33.514432 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.524045 (+  9613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.524078 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.561491 (+ 37413us) log.cc:844] Serialized 26 byte log entry
0709 13:18:34.083364 (+521873us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:34.083419 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.083516 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.496416 (+1412900us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:36.384262 (+887846us) raft_consensus.cc:1685] finished
0709 13:18:36.384289 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.398604 (+ 14315us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9208,"raft.queue_time_us":13163,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":26183,"spinlock_wait_cycles":11044736,"thread_start_us":391058,"threads_started":1,"wal-append.queue_time_us":704956}
I20260709 13:18:36.405362 17048 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:36.381183 14304 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:18:36.452497 14304 pending_rounds.cc:85] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 4
I20260709 13:18:36.452824 14304 pending_rounds.cc:107] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:36.453219 14304 raft_consensus.cc:2889] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.454239 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2302) took 1041 ms. Trace:
I20260709 13:18:36.454670 14304 rpcz_store.cc:276] 0709 13:18:35.413273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.870704 (+457431us) service_pool.cc:224] Handling call
0709 13:18:35.970541 (+ 99837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.453878 (+483337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.454163 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:36.395402 16956 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:36.437813 14370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.014s	sys 0.029s
I20260709 13:18:36.436385 14228 rpcz_store.cc:276] 0709 13:18:33.848881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.849360 (+   479us) service_pool.cc:224] Handling call
0709 13:18:33.849904 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.204942 (+355038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.204972 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:34.260170 (+ 55198us) log.cc:844] Serialized 26 byte log entry
0709 13:18:34.498004 (+237834us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:34.498049 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.498111 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.980662 (+1482551us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:36.414433 (+433771us) raft_consensus.cc:1685] finished
0709 13:18:36.414460 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.424028 (+  9568us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39548,"raft.queue_time_us":100471,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":91070,"spinlock_wait_cycles":18718592,"thread_start_us":552049,"threads_started":2,"wal-append.queue_time_us":342053}
I20260709 13:18:36.439141 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 771) took 1361 ms. Trace:
I20260709 13:18:36.458933 14901 rpcz_store.cc:276] 0709 13:18:35.077410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.382537 (+1305127us) service_pool.cc:224] Handling call
0709 13:18:36.439067 (+ 56530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:36.381980 16891 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.421545 16860 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.407514 16787 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:36.429363 16551 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:36.466583 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:36.468407 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:36.469244 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 770) took 1392 ms. Trace:
I20260709 13:18:36.469321 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:36.469601 14901 rpcz_store.cc:276] 0709 13:18:35.077097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.468166 (+1391069us) service_pool.cc:224] Handling call
0709 13:18:36.469181 (+  1015us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:36.470234 14304 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.470526 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:36.424625 16940 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.424664 17065 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:36.467330 16904 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:18:36.489883 14302 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:36.491855 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:36.438246 16918 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:36.501644 14300 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:36.494472 17030 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:36.494952 16596 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:36.496444 16931 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.497210 16846 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:36.497373 16891 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:36.468502 16825 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.538295 14300 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
W20260709 13:18:36.526774 16848 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:18:36.503861 14297 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:36.448484 16930 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:36.508368 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:36.518431 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2307) took 2092 ms. Trace:
I20260709 13:18:36.450309 16822 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.483300 16860 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:36.502627 14341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.001s	sys 0.013s
W20260709 13:18:36.548866 14341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.001s	sys 0.013s
W20260709 13:18:36.550051 14221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.004s	sys 0.010s
W20260709 13:18:36.550565 14221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.004s	sys 0.010s
I20260709 13:18:36.551151 14304 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:36.545965 14302 rpcz_store.cc:276] 0709 13:18:34.426026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.471999 (+ 45973us) service_pool.cc:224] Handling call
0709 13:18:34.472373 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.982323 (+1509950us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b54001034a0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded003dc0 00007f8ded08e1c0 00007f8ded08f231 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c
0709 13:18:36.516454 (+534131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.518358 (+  1904us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9063168}
W20260709 13:18:36.552961 14194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.006s	sys 0.008s
I20260709 13:18:36.560338 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:36.560352 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:36.561956 14302 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:36.563650 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:36.547974 16983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.007s	sys 0.047s
W20260709 13:18:36.560595 14194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.007s	sys 0.008s
W20260709 13:18:36.549770 14268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.004s	sys 0.011s
I20260709 13:18:36.565560 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:36.572626 14268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.005s	sys 0.011s
W20260709 13:18:36.573424 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.574716 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:36.575536 14302 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:18:36.576361 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.552034 16973 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:36.572949 14304 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:36.579509 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:36.581007 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:36.582384 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:36.583068 14374 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.598043 17046 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:36.598522 16940 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.599663 16959 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.600136 16940 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.571024 16990 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.600713 16940 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:36.561138 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 793) took 3197 ms. Trace:
I20260709 13:18:36.602492 16918 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:36.580770 17026 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.602008 14898 rpcz_store.cc:276] 0709 13:18:33.361838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.362344 (+   506us) service_pool.cc:224] Handling call
0709 13:18:34.950379 (+1588035us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:34.950601 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.959767 (+  9166us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:35.066426 (+106659us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.511511 (+1445085us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b180032f440. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287
0709 13:18:36.542713 (+ 31202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.543717 (+  1004us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:36.547629 (+  3912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.552271 (+  4642us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.559190 (+  6919us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24017,"prepare.queue_time_us":103008,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":41,"raft.queue_time_us":33689,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":5224064,"thread_start_us":308849,"threads_started":3,"wal-append.queue_time_us":199767}
I20260709 13:18:36.603974 17026 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.553608 16860 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.606191 14303 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
W20260709 13:18:36.606593 14864 leader_election.cc:336] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.510s (SENT)
I20260709 13:18:36.607053 14864 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:36.570192 17054 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:36.571705 16983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.007s	sys 0.047s
I20260709 13:18:36.630426 14222 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:36.544082 16825 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.643139 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:36.578226 16846 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:36.650370 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.629488 17030 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:36.661520 17093 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.662268 17093 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.664691 17093 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.665316 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 653) took 1169 ms. Trace:
I20260709 13:18:36.666383 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 735) took 1441 ms. Trace:
W20260709 13:18:36.668545 14270 connection.cc:256] RPC call timeout handler was delayed by -1.6426420349998807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 13:18:36.649505 14374 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:36.670517 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:36.671176 14222 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:36.671500 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.671116 14377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.000s	sys 0.017s
I20260709 13:18:36.666795 14370 rpcz_store.cc:276] 0709 13:18:35.225007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.411053 (+186046us) service_pool.cc:224] Handling call
0709 13:18:35.411476 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.458003 (+1046527us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:36.458032 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.467891 (+  9859us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.666045 (+198154us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:36.666087 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.666164 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.666203 (+    39us) raft_consensus.cc:1685] finished
0709 13:18:36.666214 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.666331 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3127,"raft.queue_time_us":191957,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":1196300,"threads_started":2,"wal-append.queue_time_us":177071}
W20260709 13:18:36.672742 14377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.000s	sys 0.018s
I20260709 13:18:36.673369 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:36.672037 14267 connection.cc:256] RPC call timeout handler was delayed by -1.3179388569999446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
I20260709 13:18:36.673969 14370 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:36.666180 14221 rpcz_store.cc:276] 0709 13:18:35.496131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.966585 (+470454us) service_pool.cc:224] Handling call
0709 13:18:35.967174 (+   589us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:35.967688 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.967720 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:35.968914 (+  1194us) log.cc:844] Serialized 624 byte log entry
0709 13:18:36.550945 (+582031us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:36.550988 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.551061 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.665087 (+114026us) raft_consensus.cc:1685] finished
0709 13:18:36.665118 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.665260 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33850,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":581583,"threads_started":1,"wal-append.queue_time_us":688077}
W20260709 13:18:36.675190 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.675685 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.676103 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.666996 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 304135us
I20260709 13:18:36.670220 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:36.679780 14374 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:36.639997 16883 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:36.687461 14299 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:36.640668 14228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:57812
I20260709 13:18:36.690347 14228 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:36.690717 14228 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.692178 14222 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:36.640267 17046 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.693050 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:36.694845 14295 raft_consensus.cc:2410] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:36.681980 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:36.699270 14374 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:36.703054 16825 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.704021 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 813) took 1632 ms. Trace:
I20260709 13:18:36.706280 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.708011 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:36.650573 16846 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.650738 17054 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:36.652832 16956 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:36.722826 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:36.726269 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.710821 14228 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.718709 14270 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:36.668921 17030 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.670496 17048 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:36.741046 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 45450.3us
I20260709 13:18:36.705163 17051 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:36.734097 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:36.715879 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:36.744897 14370 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:36.746186 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:36.747583 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:36.748119 14370 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:36.749773 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 739) took 1483 ms. Trace:
I20260709 13:18:36.750201 14370 rpcz_store.cc:276] 0709 13:18:35.266020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.749001 (+1482981us) service_pool.cc:224] Handling call
0709 13:18:36.749273 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.749456 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.749478 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.749518 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:36.749555 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.749621 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.749715 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:36.743245 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:36.752460 14370 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:18:36.753250 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 740) took 1455 ms. Trace:
I20260709 13:18:36.753535 14370 rpcz_store.cc:276] 0709 13:18:35.297427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.751764 (+1454337us) service_pool.cc:224] Handling call
0709 13:18:36.752144 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:36.752936 (+   792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.753191 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:36.684860 17078 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.707365 16921 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.774243 14270 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:36.696570 17092 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:36.780496 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:36.801182 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:36.802028 17085 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:36.802054 16918 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:36.802753 17085 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:36.803530 16931 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:36.803710 16918 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:36.803807 17085 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:36.805261 17103 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:36.819665 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:36.782035 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.773522 17095 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.714309 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 812) took 1644 ms. Trace:
I20260709 13:18:36.710029 16718 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:36.810722 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 68995us
I20260709 13:18:36.815274 17087 raft_consensus.cc:2764] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:18:36.732594 16920 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.740201 17093 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.841068 17093 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:36.843485 17093 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:36.813908 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 349032us
W20260709 13:18:36.846527 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72362.9us
I20260709 13:18:36.704439 14892 rpcz_store.cc:276] 0709 13:18:35.071784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.073324 (+  1540us) service_pool.cc:224] Handling call
0709 13:18:35.125726 (+ 52402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.169350 (+ 43624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.169407 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.212159 (+ 42752us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.318138 (+1105979us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18003c35e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:18:36.678028 (+359890us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:36.693821 (+ 15793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.703648 (+  9827us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.703703 (+    55us) raft_consensus.cc:1685] finished
0709 13:18:36.703728 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.703957 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12463,"raft.queue_time_us":71192,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":16732,"spinlock_wait_cycles":27818368,"thread_start_us":335179,"threads_started":1,"wal-append.queue_time_us":1422978}
I20260709 13:18:36.749013 16991 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:36.846791 16718 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:36.821743 16883 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:36.847528 16991 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.757135 17056 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:36.719878 16846 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:36.774838 17051 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.718518 17046 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.808017 16956 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:36.822569 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 99824.3us
W20260709 13:18:36.863518 14899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 807) took 2279 ms (client timeout 2081 ms). Trace:
W20260709 13:18:36.864266 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.806560 14228 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.808192 17065 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.823167 14222 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:36.797946 16596 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:18:36.871914 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.872632 14222 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:36.757916 17048 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.741144 17030 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.850165 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:36.798288 16825 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.808434 16921 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:36.820611 17026 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.862727 17104 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:36.863940 14899 rpcz_store.cc:269] 0709 13:18:34.583771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.587944 (+  4173us) service_pool.cc:224] Handling call
0709 13:18:36.863289 (+2275345us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b540049fa54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:36.863448 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89382656}
W20260709 13:18:36.870139 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50562.5us
I20260709 13:18:36.878360 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:36.878942 16718 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:36.879097 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.881420 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:36.881810 14222 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:36.882714 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.811407 17092 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.882397 16991 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:36.885320 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.885982 14222 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 2.
I20260709 13:18:36.892992 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:36.858901 16883 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:36.893751 14222 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:36.911417 14270 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:36.914500 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1793) took 1979 ms. Trace:
I20260709 13:18:36.914966 14372 rpcz_store.cc:276] 0709 13:18:34.934631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.934781 (+   150us) service_pool.cc:224] Handling call
0709 13:18:34.935179 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.177108 (+1241929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.914221 (+737113us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540025a8d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:36.914435 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2579106688}
I20260709 13:18:36.916183 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:36.916800 14372 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.919032 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 811) took 1850 ms. Trace:
I20260709 13:18:36.919217 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:36.919467 14893 rpcz_store.cc:276] 0709 13:18:35.068409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.068597 (+   188us) service_pool.cc:224] Handling call
0709 13:18:35.068918 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.380836 (+1311918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.918799 (+537963us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400440554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:36.918972 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2877599488}
I20260709 13:18:36.921375 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:36.921988 17104 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:36.922164 16971 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:36.922757 17104 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:36.923182 17104 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.923569 17104 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:36.920766 14900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 774) took 2497 ms (client timeout 1605 ms). Trace:
W20260709 13:18:36.926193 14900 rpcz_store.cc:269] 0709 13:18:34.422957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.423064 (+   107us) service_pool.cc:224] Handling call
0709 13:18:36.920599 (+2497535us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54007e7054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:36.920700 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079287168}
I20260709 13:18:36.931118 16551 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:36.932224 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1752) took 2494 ms. Trace:
I20260709 13:18:36.883890 17087 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:36.935243 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:36.935999 14303 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:36.936832 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:36.938823 16930 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:36.939035 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.939646 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.940213 14229 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:36.940627 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:36.940984 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.943544 14123 catalog_manager.cc:5697] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 2 to 5, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 5 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.872699 16956 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.932629 14223 rpcz_store.cc:276] 0709 13:18:34.462118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.569701 (+107583us) service_pool.cc:224] Handling call
0709 13:18:34.594484 (+ 24783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.940243 (+345759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.940294 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:34.970936 (+ 30642us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.200688 (+229752us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:35.200732 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.931853 (+1731121us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540011fdd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:36.931900 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.931944 (+    44us) raft_consensus.cc:1685] finished
0709 13:18:36.931955 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.932164 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53351,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":11775,"spinlock_wait_cycles":514062080,"thread_start_us":288575,"threads_started":2,"wal-append.queue_time_us":232767}
I20260709 13:18:36.946769 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:36.950608 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:36.950634 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:36.952674 14893 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:36.953502 14222 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:36.876190 16822 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:36.954644 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:36.955936 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.964892 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53600.6us
W20260709 13:18:36.967706 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.967104 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:36.973384 14372 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:36.860055 17093 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:18:36.975994 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:36.976991 14372 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:36.981191 14222 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:36.837224 17095 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:36.982470 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:36.983296 14303 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:36.985157 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:36.986001 14893 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.986622 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.987382 14228 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:36.988305 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:36.988693 14223 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:18:36.988947 14899 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:36.991479 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:36.980155 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:36.993162 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:36.882668 16787 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
W20260709 13:18:36.966275 17032 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.010s
I20260709 13:18:36.835050 17054 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:36.997268 14220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2185) took 2446 ms (client timeout 2142 ms). Trace:
I20260709 13:18:36.954457 16956 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.952982 17022 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.000865 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:37.000509 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:37.049633 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:37.051048 14228 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:36.982201 17053 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.975200 16860 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:37.080173 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:37.081025 14228 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:37.094141 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:37.095358 14303 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:37.051112 14897 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:37.052645 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:37.097429 14229 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
W20260709 13:18:37.002147 14220 rpcz_store.cc:269] 0709 13:18:34.551067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.568585 (+ 17518us) service_pool.cc:224] Handling call
0709 13:18:36.997040 (+2428455us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b540033de54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:36.997179 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62460800}
I20260709 13:18:37.101337 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:37.102711 14303 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:37.111900 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 162080us
W20260709 13:18:37.106611 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 126561us
I20260709 13:18:37.113307 14303 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:37.114502 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:36.995151 16983 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:37.104578 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:36.982705 17101 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:37.117090 14303 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 9 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:37.001152 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:37.122041 14864 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:36.988884 17063 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 13:18:37.123229 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:37.123490 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:37.124303 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:37.117977 16983 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:36.988528 16825 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 13:18:37.132692 16991 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:37.134029 14892 raft_consensus.cc:1813] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Handling vote request from an unknown peer bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:37.141943 16991 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.142114 17012 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:37.142423 17112 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.142742 17012 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:37.143132 17112 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:37.144030 17012 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.134323 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:37.100090 16881 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.156131 17109 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:37.142434 14892 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:37.142452 16991 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.141686 16983 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.167454 16881 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.139971 16883 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.163233 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.171948 14372 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
W20260709 13:18:37.181641 17105 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:18:37.089993 17022 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:37.183411 14303 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:37.323432 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 466) took 1101 ms. Trace:
I20260709 13:18:37.324086 14303 rpcz_store.cc:276] 0709 13:18:36.221825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.158303 (+936478us) service_pool.cc:224] Handling call
0709 13:18:37.183242 (+ 24939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.322456 (+139214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.323107 (+   651us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:37.320313 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 206661us
W20260709 13:18:37.321139 14225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.001s	sys 0.001s
I20260709 13:18:37.329208 14220 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:18:37.330220 14225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.002s	sys 0.001s
I20260709 13:18:37.183458 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:37.214064 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 58804.1us
I20260709 13:18:37.224329 16956 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:37.364668 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.268184 16991 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.220458 17022 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.265969 17046 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.226276 17048 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:37.089365 17053 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:37.383126 17053 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.149662 17056 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.165594 17079 raft_consensus.cc:2955] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:37.162220 17082 raft_consensus.cc:2764] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:37.229413 17092 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:37.268613 17095 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:37.173338 17098 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:37.279245 17104 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.394083 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:37.396456 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:36.834744 14895 rpcz_store.cc:276] 0709 13:18:35.070368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.070531 (+   163us) service_pool.cc:224] Handling call
0709 13:18:35.073969 (+  3438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.569434 (+495465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.602776 (+ 33342us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.849329 (+246553us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.641044 (+791715us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:36.651689 (+ 10645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.667310 (+ 15621us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.671518 (+  4208us) raft_consensus.cc:1685] finished
0709 13:18:36.678928 (+  7410us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.708993 (+ 30065us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16698,"raft.queue_time_us":101007,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":9712,"thread_start_us":784372,"threads_started":2,"wal-append.queue_time_us":650727}
W20260709 13:18:37.349807 14867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.000s	sys 0.002s
W20260709 13:18:37.399048 14867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.001s	sys 0.002s
I20260709 13:18:37.401691 17092 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.402282 17092 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:37.402715 17092 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.405824 14893 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:37.351580 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.212884 17112 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:37.355214 17123 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:18:37.410318 14372 raft_consensus.cc:2410] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:37.410743 16956 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:37.356382 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 738) took 2116 ms. Trace:
I20260709 13:18:37.363015 16904 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:18:37.413444 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 679364us
I20260709 13:18:37.386933 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:37.415150 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 471) took 1185 ms. Trace:
I20260709 13:18:37.412467 14374 rpcz_store.cc:276] 0709 13:18:35.239822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.730293 (+1490471us) service_pool.cc:224] Handling call
0709 13:18:36.730641 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.730866 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.730904 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.744711 (+ 13807us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.952182 (+207471us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:36.952233 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.952317 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.353916 (+401599us) raft_consensus.cc:1685] finished
0709 13:18:37.353967 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.355954 (+  1987us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":135820,"threads_started":1,"wal-append.queue_time_us":313208}
I20260709 13:18:37.415882 14296 rpcz_store.cc:276] 0709 13:18:36.223255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.380066 (+1156811us) service_pool.cc:224] Handling call
0709 13:18:37.380796 (+   730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.381468 (+   672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.381515 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:37.381596 (+    81us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:37.381645 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.381738 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.408238 (+ 26500us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:37.418058 17048 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:37.419394 17048 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:37.422148 17056 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.412914 14372 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:18:37.429311 17056 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.441133 17120 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:37.441852 17120 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.435015 17048 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:37.442305 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45967us
I20260709 13:18:37.422884 17104 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:37.432526 17056 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.445266 14302 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:37.450609 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2304) took 1567 ms. Trace:
I20260709 13:18:37.451160 14301 rpcz_store.cc:276] 0709 13:18:35.880085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.880239 (+   154us) service_pool.cc:224] Handling call
0709 13:18:37.443718 (+1563479us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540020b554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:37.447591 (+  3873us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842066176}
I20260709 13:18:37.437307 17112 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.453764 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2312) took 1229 ms. Trace:
I20260709 13:18:37.442301 17120 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.455024 17022 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:37.470896 17022 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:37.458979 14897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 773) took 2367 ms (client timeout 2748 ms). Trace:
W20260709 13:18:37.457592 14896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 769) took 2380 ms (client timeout 2731 ms). Trace:
I20260709 13:18:37.462528 14301 rpcz_store.cc:276] 0709 13:18:36.223866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.452385 (+1228519us) service_pool.cc:224] Handling call
0709 13:18:37.452884 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.453313 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.453341 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:37.453418 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:37.453480 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.453541 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.453684 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:37.460954 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2085) took 2372 ms. Trace:
W20260709 13:18:37.474931 14897 rpcz_store.cc:269] 0709 13:18:35.091460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.370019 (+278559us) service_pool.cc:224] Handling call
0709 13:18:37.458610 (+2088591us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54005f64d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:37.458776 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3863863680}
W20260709 13:18:37.476230 14896 rpcz_store.cc:269] 0709 13:18:35.076814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.214800 (+137986us) service_pool.cc:224] Handling call
0709 13:18:37.457067 (+2242267us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54004a06d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:37.457350 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2678444416}
I20260709 13:18:37.484058 14270 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:37.456465 16991 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.473727 17022 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:37.505249 16822 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:37.505952 16822 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.506472 16822 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.506762 16784 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:37.507758 16784 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.511619 16931 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:37.457226 17112 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:37.460148 16983 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:37.525635 17063 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:37.526227 16718 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:37.526624 17063 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:37.527757 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 717584us
W20260709 13:18:37.528987 17030 consensus_meta.cc:287] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.629s	user 0.019s	sys 0.004s
I20260709 13:18:37.529461 17030 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.530365 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:37.534129 17125 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:37.534555 16904 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:37.534983 17125 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:18:37.549999 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 106113us
I20260709 13:18:37.551077 14270 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:37.552850 14270 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:37.553949 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 377189us
I20260709 13:18:37.521207 17104 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:37.555096 16971 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.632s	user 0.004s	sys 0.016s
I20260709 13:18:37.555771 17104 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.556245 17104 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:37.556454 17051 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.556630 17104 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.558279 16860 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.559370 17035 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.560045 17035 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.562199 16921 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.562404 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2082) took 2479 ms. Trace:
I20260709 13:18:37.566895 17030 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:37.567057 14901 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:37.571105 16983 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.570849 16931 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.574394 16921 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:37.582230 17065 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:37.582748 17065 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:37.583913 17065 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:37.586135 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 57351.7us
I20260709 13:18:37.587456 16930 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:37.588063 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:37.585529 17065 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.592464 17131 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:37.593653 17131 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.555140 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:37.594337 16983 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:37.597469 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 649) took 2187 ms. Trace:
I20260709 13:18:37.601267 14227 rpcz_store.cc:276] 0709 13:18:35.409530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.409830 (+   300us) service_pool.cc:224] Handling call
0709 13:18:35.410311 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.382048 (+971737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.596952 (+1214904us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b540026d9d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:37.597277 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093154048}
I20260709 13:18:37.482602 14377 rpcz_store.cc:276] 0709 13:18:35.088143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.378720 (+290577us) service_pool.cc:224] Handling call
0709 13:18:35.412746 (+ 34026us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:35.843884 (+431138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.843933 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:35.881656 (+ 37723us) log.cc:844] Serialized 52 byte log entry
0709 13:18:36.673593 (+791937us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:36.738267 (+ 64674us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.797804 (+ 59537us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.455394 (+657590us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b1800143b00. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:18:37.460231 (+  4837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.460377 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.460533 (+   156us) raft_consensus.cc:1685] finished
0709 13:18:37.460552 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.460767 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42327,"prepare.queue_time_us":193499,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":252619,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":2589,"spinlock_wait_cycles":10068224,"thread_start_us":1158955,"threads_started":3,"wal-append.queue_time_us":683249}
W20260709 13:18:37.604223 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49244.6us
I20260709 13:18:37.604554 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 465) took 1383 ms. Trace:
I20260709 13:18:37.605255 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:37.597410 17131 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:37.605087 14304 rpcz_store.cc:276] 0709 13:18:36.221505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.807094 (+585589us) service_pool.cc:224] Handling call
0709 13:18:36.807503 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.953364 (+145861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.953391 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.953430 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:36.953466 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.604118 (+650652us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54000fcdd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:37.604178 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.604379 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335000320}
I20260709 13:18:37.609925 14378 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:37.562762 14375 rpcz_store.cc:276] 0709 13:18:35.082434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.225617 (+143183us) service_pool.cc:224] Handling call
0709 13:18:35.239488 (+ 13871us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:35.268549 (+ 29061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.268591 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:35.276530 (+  7939us) log.cc:844] Serialized 78 byte log entry
0709 13:18:36.918265 (+1641735us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b1800212ec0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:18:37.162400 (+244135us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:37.207015 (+ 44615us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.561666 (+354651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.561819 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.561878 (+    59us) raft_consensus.cc:1685] finished
0709 13:18:37.561978 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.562229 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267666,"prepare.queue_time_us":49511,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":25712,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":18404,"spinlock_wait_cycles":3318528,"thread_start_us":271070,"threads_started":2,"wal-append.queue_time_us":1928036}
W20260709 13:18:37.604315 16846 consensus_meta.cc:287] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.009s
I20260709 13:18:37.632603 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:37.639276 17050 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:37.639734 17050 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.640105 17050 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.640712 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:37.644062 17092 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:37.649422 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.635239 17112 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.634445 17125 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:37.658852 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:37.667889 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48281.3us
I20260709 13:18:37.668473 16983 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:37.669023 16983 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.669507 16983 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.669617 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:37.679770 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.679911 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:37.673959 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.636914 16846 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:37.696403 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 108480us
I20260709 13:18:37.697333 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:37.696455 14374 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 2.
I20260709 13:18:37.696609 14377 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:37.670385 17092 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.662573 17053 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:37.708776 17101 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:37.708938 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.681130 14370 raft_consensus.cc:2955] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:37.657020 17082 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:18:37.711468 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:37.723145 14304 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 3: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:37.724087 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:37.725173 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:37.713305 16940 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.725986 14378 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.726998 14374 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:37.727125 17050 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.728075 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:37.729175 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.708783 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.709503 14193 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:37.730072 14377 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:37.731112 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:37.731710 14377 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.734189 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:37.734872 14220 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:37.736222 14374 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:37.736495 14225 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:37.737447 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.741024 14374 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:37.720333 16718 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:37.721155 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51733.1us
I20260709 13:18:37.721347 16846 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.729212 17050 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:37.737895 14221 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:37.738382 17053 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.738739 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:37.719521 17063 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:37.670202 17115 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:37.740741 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:37.744043 17112 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:37.754969 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:37.750159 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:37.745589 16718 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.764525 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.752015 17112 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.705615 17125 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:37.749085 17053 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:37.767656 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:37.749366 17101 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:37.769659 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:37.785909 16889 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:37.786526 16889 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.786339 16983 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.788954 16983 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:37.789103 17035 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.789888 14220 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:37.786949 16889 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.790951 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:37.768000 17112 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:37.757496 17115 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:37.769997 17053 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.796747 17092 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:18:37.801199 17101 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:37.802450 17125 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:37.803236 14371 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:37.804543 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:37.806064 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:37.810043 14225 raft_consensus.cc:2393] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:37.811305 17116 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:37.811757 17116 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:37.812129 17116 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.818648 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:37.831127 14378 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:37.834582 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:37.867810 16973 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:37.868790 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.853351 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:37.885907 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 476) took 1261 ms. Trace:
W20260709 13:18:37.887861 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 69300.6us
I20260709 13:18:37.903034 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.906904 14377 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:37.908735 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 736) took 2682 ms. Trace:
I20260709 13:18:37.909268 14373 rpcz_store.cc:276] 0709 13:18:35.225744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.835377 (+609633us) service_pool.cc:224] Handling call
0709 13:18:35.965907 (+130530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.966245 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.966280 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:37.607611 (+1641331us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b2c00117c78. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb985a11 00007f8deb995372 00007f8ded0c7a01 00007f8ded08c43a 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2
0709 13:18:37.609676 (+  2065us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.692403 (+ 82727us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:37.742214 (+ 49811us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.763664 (+ 21450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.783878 (+ 20214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.903043 (+119165us) raft_consensus.cc:1685] finished
0709 13:18:37.908387 (+  5344us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.908546 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41162,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4242,"raft.queue_time_us":162481,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3403,"spinlock_wait_cycles":91149056,"thread_start_us":82258,"threads_started":1,"wal-append.queue_time_us":174435}
I20260709 13:18:37.916335 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:37.919761 17093 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.919620 16822 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.921165 17063 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:37.921936 17129 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.252s	user 0.000s	sys 0.002s
I20260709 13:18:37.922674 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 460) took 1737 ms. Trace:
I20260709 13:18:37.919996 14304 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.923725 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2311) took 1700 ms. Trace:
I20260709 13:18:37.919787 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:37.928432 14344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 1.757s (SENT) [suppressed 9 similar messages]
I20260709 13:18:37.923085 14302 rpcz_store.cc:276] 0709 13:18:36.185005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.624101 (+439096us) service_pool.cc:224] Handling call
0709 13:18:37.444695 (+820594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.447292 (+  2597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.922347 (+475055us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b540020b550. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:37.922564 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1884528000}
I20260709 13:18:37.918730 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:37.906625 16973 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:37.924125 14296 rpcz_store.cc:276] 0709 13:18:36.223582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.417111 (+1193529us) service_pool.cc:224] Handling call
0709 13:18:37.417738 (+   627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.429985 (+ 12247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.430034 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:37.430931 (+   897us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.445770 (+ 14839us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:37.445853 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.445918 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.923499 (+477581us) raft_consensus.cc:1685] finished
0709 13:18:37.923523 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.923666 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4003,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":13252,"thread_start_us":14161,"threads_started":1,"wal-append.queue_time_us":92916}
I20260709 13:18:38.032536 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:38.034054 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 214213us
I20260709 13:18:38.039314 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.040053 14371 raft_consensus.cc:1813] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Handling vote request from an unknown peer bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:38.040099 16784 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:38.040638 14371 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:38.040987 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.041556 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.042511 16973 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:37.927138 16614 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:38.034125 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.034700 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:38.035620 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.036604 14225 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:37.927322 17115 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.046062 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.035105 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:38.060525 14229 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:37.886588 14301 rpcz_store.cc:276] 0709 13:18:36.607258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.525506 (+918248us) service_pool.cc:224] Handling call
0709 13:18:37.564669 (+ 39163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.600554 (+ 35885us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:37.693944 (+ 93390us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.860810 (+166866us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:37.860874 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:37.868765 (+  7891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.868846 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.868978 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1561,"prepare.queue_time_us":26018,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":12451,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"thread_start_us":213866,"threads_started":2}
W20260709 13:18:38.063187 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 145389us
W20260709 13:18:38.061534 14300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 470) took 1838 ms (client timeout 1674 ms). Trace:
I20260709 13:18:38.056321 14221 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:38.065682 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2305) took 2122 ms. Trace:
W20260709 13:18:38.070407 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 655553us
I20260709 13:18:38.070691 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.067865 14220 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:38.071609 14867 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:38.066243 14297 rpcz_store.cc:276] 0709 13:18:35.943161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.959493 (+ 16332us) service_pool.cc:224] Handling call
0709 13:18:35.959781 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.545134 (+585353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.052613 (+1507479us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54001f7f54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:38.065455 (+ 12842us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250833664}
W20260709 13:18:38.063828 14300 rpcz_store.cc:269] 0709 13:18:36.222980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.314991 (+ 92011us) service_pool.cc:224] Handling call
0709 13:18:38.054811 (+1739820us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b54001a09d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:38.061283 (+  6472us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162125184}
I20260709 13:18:38.044494 16889 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.074548 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.075034 17032 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:38.072989 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.073779 14270 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:38.081132 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:38.074534 16676 raft_consensus.cc:3055] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:38.083809 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.083843 16676 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:38.085421 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.086572 14221 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:38.086542 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.086555 16676 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.087929 14300 raft_consensus.cc:2410] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:38.084900 17063 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.088680 16676 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.088999 17063 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.089279 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.078086 16746 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:38.089707 17063 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.090546 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.091535 14296 raft_consensus.cc:2368] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6.
I20260709 13:18:38.093339 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2314) took 1195 ms. Trace:
I20260709 13:18:38.090545 14297 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:38.095795 14296 rpcz_store.cc:276] 0709 13:18:36.898273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.092290 (+1194017us) service_pool.cc:224] Handling call
0709 13:18:38.092683 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.092936 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.092965 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.093049 (+    84us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:38.093096 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.093152 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.093278 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:38.048355 16614 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:38.073896 17120 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.005s
I20260709 13:18:38.084973 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:38.088992 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.100641 14374 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.100965 14302 raft_consensus.cc:2410] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:38.105891 14301 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
W20260709 13:18:38.103767 14901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 816) took 2989 ms (client timeout 3257 ms). Trace:
I20260709 13:18:38.102444 14270 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:38.113864 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:38.110180 14901 rpcz_store.cc:269] 0709 13:18:35.113994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.470308 (+1356314us) service_pool.cc:224] Handling call
0709 13:18:38.103531 (+1633223us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54005212d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:38.103700 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2512712448}
I20260709 13:18:38.107878 16746 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.118553 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.102717 16848 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:38.136991 14301 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:38.132773 14225 raft_consensus.cc:2368] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6.
I20260709 13:18:38.095239 16718 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.122503 16991 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:38.151487 16991 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:38.154219 17128 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.517s	user 0.010s	sys 0.000s
I20260709 13:18:38.155895 14378 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:38.158324 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.159018 14900 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:38.159432 14378 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [4.6-6.7]
W20260709 13:18:38.160300 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65572.3us
I20260709 13:18:38.104290 17116 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.106843 17112 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.134753 16846 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.136129 16848 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:38.102000 17120 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:38.169425 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 100685us
I20260709 13:18:38.173013 14864 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:38.149892 16822 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:38.169672 17032 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:18:38.171167 17079 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:18:38.180724 14342 leader_election.cc:400] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6.
I20260709 13:18:38.181936 17093 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:38.182286 16718 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:38.182548 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.185377 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 464) took 1950 ms. Trace:
I20260709 13:18:38.185948 16846 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.186324 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.186717 16848 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.142468 16746 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.174865 16614 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.190586 16921 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.194361 16881 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:18:38.196565 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.198148 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.198385 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.199720 14374 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:38.178411 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.177539 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.200129 16889 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:38.200268 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:38.201535 14222 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:38.202342 14224 raft_consensus.cc:2368] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5.
I20260709 13:18:38.203611 17112 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:38.203723 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 106798us
I20260709 13:18:38.204363 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.208859 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.216928 17087 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:38.228394 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:38.177214 17104 consensus_meta.cc:287] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.620s	user 0.005s	sys 0.021s
I20260709 13:18:38.258692 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.261885 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.338248 16614 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.270639 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.338918 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.339674 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.270153 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:38.340404 14372 raft_consensus.cc:2410] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:18:38.340646 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 70678us
I20260709 13:18:38.340996 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:38.271041 14304 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:38.275098 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:38.342473 17080 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.968s	user 0.006s	sys 0.003s
I20260709 13:18:38.342669 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:38.343380 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.343644 14304 raft_consensus.cc:2368] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6.
I20260709 13:18:38.344067 14378 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:38.344723 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.345093 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:38.284765 14342 leader_election.cc:403] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:38.287492 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.290140 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:38.169319 17135 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:18:38.299497 14301 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:38.303335 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.286765 17093 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:38.287460 14299 rpcz_store.cc:276] 0709 13:18:36.221195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.689170 (+467975us) service_pool.cc:224] Handling call
0709 13:18:36.689438 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.707303 (+ 17865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.707336 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.707835 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.422325 (+714490us) spinlock_profiling.cc:243] Waited 982 us on lock 0x7b1800358780. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:18:37.514353 (+ 92028us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:37.518923 (+  4570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.525409 (+  6486us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.049855 (+524446us) spinlock_profiling.cc:243] Waited 9.44 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:38.162700 (+112845us) raft_consensus.cc:1685] finished
0709 13:18:38.162721 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.171465 (+  8744us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6143,"raft.queue_time_us":28737,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":41770,"spinlock_wait_cycles":23961728,"thread_start_us":25133,"threads_started":1,"wal-append.queue_time_us":800106}
I20260709 13:18:38.315168 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:38.317914 14227 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:38.317929 14270 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:38.345654 14378 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.353237 17035 raft_consensus.cc:3055] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:38.353772 17035 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:38.354734 17035 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.355468 17065 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.355944 17065 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:38.346333 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 165810us
I20260709 13:18:38.356451 17092 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:38.317382 16676 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:38.320910 14892 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:38.318795 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.322259 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:38.326001 14895 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:38.322358 17116 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:38.329879 16921 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:38.331926 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.332319 17081 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.333958 16825 raft_consensus.cc:3055] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:38.317003 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:38.336311 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.315075 17087 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:38.337252 17104 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.339720 14377 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
W20260709 13:18:38.350335 17136 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.708s	user 0.004s	sys 0.000s
I20260709 13:18:38.344099 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 644) took 2964 ms. Trace:
I20260709 13:18:38.353041 16983 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:38.293437 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 430627us
I20260709 13:18:38.320623 16746 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:38.329150 16991 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:38.357755 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.358038 16676 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.403184 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:38.348184 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.347920 16931 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:38.381134 16825 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:38.350131 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.350808 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.359126 14222 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:38.351557 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 737) took 3123 ms. Trace:
I20260709 13:18:38.359622 14229 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.152105 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:38.382718 14370 raft_consensus.cc:2368] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6.
I20260709 13:18:38.359321 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:38.347057 14225 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:38.349620 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.351763 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:38.347851 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.351926 14193 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:38.349958 14900 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:38.409540 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:38.361704 14295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2309) took 3934 ms (client timeout 3356 ms). Trace:
I20260709 13:18:38.341355 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.356294 17065 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.361295 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.417047 14227 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:38.395627 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.346179 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.358551 17092 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.350142 17093 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.398403 14221 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:38.360816 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.347280 14897 raft_consensus.cc:2368] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4.
I20260709 13:18:38.404943 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.405189 14893 raft_consensus.cc:2410] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:18:38.420130 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 68293.9us
I20260709 13:18:38.349033 14375 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:38.356267 17035 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.348721 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.359306 16822 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:18:38.412513 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.429821 14222 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:38.412909 14374 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
W20260709 13:18:38.410322 14295 rpcz_store.cc:269] 0709 13:18:34.426649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.427641 (+   992us) service_pool.cc:224] Handling call
0709 13:18:38.361216 (+3933575us) spinlock_profiling.cc:243] Waited 2.25 s on lock 0x7b5400154854. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:38.361453 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5167343488}
I20260709 13:18:38.346406 16718 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:38.436793 16718 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.437204 16718 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.347733 17135 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6.
I20260709 13:18:38.439388 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.440240 14220 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:38.441335 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:38.429001 14895 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 2.
I20260709 13:18:38.442104 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.442942 14295 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:38.443009 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.443802 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.444324 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:38.444854 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:38.393239 14226 rpcz_store.cc:276] 0709 13:18:35.379669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.379813 (+   144us) service_pool.cc:224] Handling call
0709 13:18:35.380148 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.380521 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.380554 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.384109 (+  3555us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.442650 (+ 58541us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:35.442699 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.442782 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.218908 (+2776126us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:38.343620 (+124712us) raft_consensus.cc:1685] finished
0709 13:18:38.343656 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.343925 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2836,"raft.queue_time_us":85,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":14227200,"thread_start_us":58107,"threads_started":1,"wal-append.queue_time_us":897655}
I20260709 13:18:38.405287 16676 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.446147 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.446736 17120 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:38.447798 17104 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:38.407028 16931 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:38.449182 16921 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:38.449344 16931 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.450145 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 468) took 2227 ms. Trace:
I20260709 13:18:38.450764 16931 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.450968 16991 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:38.452178 16991 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:38.452536 16991 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:38.431665 14298 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:38.453938 14298 pending_rounds.cc:85] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 2
I20260709 13:18:38.454164 14298 pending_rounds.cc:107] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:38.454213 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:38.454447 14298 raft_consensus.cc:2889] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:38.456054 16822 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:38.456064 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2292) took 3141 ms. Trace:
I20260709 13:18:38.456516 16822 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:38.456611 14298 rpcz_store.cc:276] 0709 13:18:35.314369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.314530 (+   161us) service_pool.cc:224] Handling call
0709 13:18:38.361885 (+3047355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.454933 (+ 93048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.455857 (+   924us) spinlock_profiling.cc:243] Waited 3.05 s on lock 0x7b5400154850. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:38.456007 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7007153920}
I20260709 13:18:38.458063 17092 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.458526 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:38.453413 16991 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.432188 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.431798 16551 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:38.433800 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.434522 16825 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:38.436388 17053 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.005s
I20260709 13:18:38.462375 14298 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.462286 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.462961 16825 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.464090 14225 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:38.464876 17053 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:38.444967 14895 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.446887 14227 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:38.431768 14894 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
W20260709 13:18:38.426918 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 67712.9us
I20260709 13:18:38.466068 14304 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:38.466106 14223 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:38.475708 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.407645 14376 rpcz_store.cc:276] 0709 13:18:35.228539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.352744 (+1124205us) service_pool.cc:224] Handling call
0709 13:18:36.353273 (+   529us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:36.457309 (+104036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.457341 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:36.483075 (+ 25734us) log.cc:844] Serialized 78 byte log entry
0709 13:18:36.676036 (+192961us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:36.703446 (+ 27410us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b18003faf00. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:18:37.087338 (+383892us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.635208 (+547870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.351093 (+715885us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400259ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:38.351139 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.351232 (+    93us) raft_consensus.cc:1685] finished
0709 13:18:38.351243 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.351379 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":436240,"prepare.queue_time_us":147054,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":9934,"raft.queue_time_us":493398,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":295,"spinlock_wait_cycles":260235008,"thread_start_us":548466,"threads_started":3,"wal-append.queue_time_us":152383}
I20260709 13:18:38.476979 14295 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:38.483067 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 140663us
I20260709 13:18:38.493927 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:38.495265 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.426327 16983 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:38.503587 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:38.505179 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.450557 14303 rpcz_store.cc:276] 0709 13:18:36.222420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.325539 (+1103119us) service_pool.cc:224] Handling call
0709 13:18:37.333054 (+  7515us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:37.334032 (+   978us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:37.334074 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:37.335078 (+  1004us) log.cc:844] Serialized 52 byte log entry
0709 13:18:37.519585 (+184507us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:37.519627 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.520856 (+  1229us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.349376 (+828520us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:38.449853 (+100477us) raft_consensus.cc:1685] finished
0709 13:18:38.449874 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.450082 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14225,"raft.run_cpu_time_us":509,"raft.run_wall_time_us":509,"spinlock_wait_cycles":15180544,"thread_start_us":183923,"threads_started":1,"wal-append.queue_time_us":228825}
I20260709 13:18:38.512022 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.512814 14301 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:38.460309 17092 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:38.514356 14301 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:38.517158 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:38.515655 14378 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:38.518601 14193 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:38.519548 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 52625.1us
I20260709 13:18:38.520516 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:38.521013 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:38.521780 14894 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:38.521988 17058 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:38.522610 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:38.522701 17058 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:38.523264 14894 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.524037 17058 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.511101 16956 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:18:38.525987 17125 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:38.526827 16956 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:38.464880 17087 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:38.527256 16956 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:38.528160 16956 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:38.529381 16956 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.530850 17065 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:38.533049 17065 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:38.533106 14125 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37072 (request call id 322) took 10378 ms. Trace:
I20260709 13:18:38.465734 17063 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:38.498270 16551 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:38.535372 17063 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:38.510896 16921 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:18:38.536887 14123 catalog_manager.cc:5697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 2, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 2 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:38.540199 17053 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:38.539904 14123 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 4 to 5, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 5 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.541185 14299 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:38.508796 16983 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.541652 17135 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:38.542327 16983 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.542973 14299 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:38.501161 14892 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:38.519663 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.523129 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:38.545178 14901 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:38.550215 14304 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.549232 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:38.558738 14297 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:38.565853 14303 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:38.565920 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:38.506799 16846 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:38.572120 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:38.528182 17087 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.577730 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.578634 14900 raft_consensus.cc:2410] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:38.586740 16991 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.588876 14892 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:38.535265 16551 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:38.603165 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1791) took 3695 ms. Trace:
I20260709 13:18:38.603395 14896 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:38.603637 14369 rpcz_store.cc:276] 0709 13:18:34.908081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.939444 (+ 31363us) service_pool.cc:224] Handling call
0709 13:18:34.939870 (+   426us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:34.958129 (+ 18259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.958176 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:34.958937 (+   761us) log.cc:844] Serialized 52 byte log entry
0709 13:18:37.927735 (+2968798us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b18003b70a0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:18:38.331889 (+404154us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:38.331950 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.332641 (+   691us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.602697 (+270056us) raft_consensus.cc:1685] finished
0709 13:18:38.602712 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.602996 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":31520,"spinlock_wait_cycles":2422144,"thread_start_us":253416,"threads_started":1,"wal-append.queue_time_us":3619002}
I20260709 13:18:38.604746 14896 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:38.457548 16822 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:38.607108 14267 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:38.602890 17109 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:18:38.465538 14225 raft_consensus.cc:2955] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:38.609225 14298 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:38.609997 14900 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:38.613379 14295 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:38.623265 14894 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:38.624629 16973 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:38.625504 14123 catalog_manager.cc:5697] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 3, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.558475 17120 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:38.629377 17120 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:38.630054 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 61257.4us
I20260709 13:18:38.630380 17120 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.632771 17101 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:38.638687 14229 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:38.628144 14123 catalog_manager.cc:5697] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:18:38.650290 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.651682 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:38.652463 14376 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:38.653362 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:38.653550 17109 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:38.653921 17109 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:38.654316 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:38.639937 16973 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:38.659605 14295 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:18:38.659309 16973 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.660099 14295 pending_rounds.cc:85] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 5
I20260709 13:18:38.660480 14295 pending_rounds.cc:107] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:18:38.660770 14295 raft_consensus.cc:2889] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:38.593487 16931 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:18:38.540220 17081 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:18:38.668771 17081 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:38.669255 17081 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:38.670434 17081 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.671962 17081 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.674397 16822 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:38.678627 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 155593us
I20260709 13:18:38.680163 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:38.680384 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 119948us
I20260709 13:18:38.681874 17026 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.683357 17035 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:38.689038 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 495018us
I20260709 13:18:38.692860 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:38.698704 14304 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:38.697865 14303 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:38.533520 14125 rpcz_store.cc:276] 0709 13:18:28.154798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.156945 (+  2147us) service_pool.cc:224] Handling call
0709 13:18:38.532880 (+10375935us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:31.719817 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:31.720371 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:31.720404 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:18:31.720421 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:31.721506 (+  1085us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:31.721664 (+   158us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:31.721694 (+    30us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:18:31.749610 (+ 27916us) tablet.cc:701] Row locks acquired
0709 13:18:31.749638 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:18:31.749852 (+   214us) write_op.cc:270] Start()
0709 13:18:31.749966 (+   114us) write_op.cc:276] Timestamp: P: 1783603111749774 usec, L: 0
0709 13:18:31.749990 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:31.752321 (+  2331us) log.cc:844] Serialized 4735 byte log entry
0709 13:18:32.041920 (+289599us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b18002bf240. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:18:32.391148 (+349228us) op_driver.cc:464] REPLICATION: finished
0709 13:18:32.745014 (+353866us) write_op.cc:301] APPLY: starting
0709 13:18:32.748894 (+  3880us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:32.857312 (+108418us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:32.858924 (+  1612us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:33.076758 (+217834us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:33.077065 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:18:33.077124 (+    59us) write_op.cc:312] APPLY: finished
0709 13:18:33.077506 (+   382us) log.cc:844] Serialized 83 byte log entry
0709 13:18:33.077699 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.077860 (+   161us) write_op.cc:454] Released schema lock
0709 13:18:33.077908 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:33.078329 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.078361 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21135,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":329245,"apply.run_cpu_time_us":8513,"apply.run_wall_time_us":339085,"num_ops":11,"prepare.queue_time_us":108890,"prepare.run_cpu_time_us":30159,"prepare.run_wall_time_us":118169,"raft.queue_time_us":233955,"raft.run_cpu_time_us":22380,"raft.run_wall_time_us":269490,"replication_time_us":627893,"spinlock_wait_cycles":6305152,"thread_start_us":359891,"threads_started":4,"wal-append.queue_time_us":91964,"wal-append.run_cpu_time_us":11502,"wal-append.run_wall_time_us":2041857}]]}
W20260709 13:18:38.715322 17115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.026s	sys 0.023s
I20260709 13:18:38.641625 16676 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.622371 17093 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:38.640874 16848 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:38.723223 17115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.027s	sys 0.023s
I20260709 13:18:38.747684 14193 leader_election.cc:400] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6.
I20260709 13:18:38.751791 14193 leader_election.cc:403] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:18:38.723129 14898 raft_consensus.cc:2410] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:38.750597 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:38.708048 17087 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.749810 14371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.010s	sys 0.027s
I20260709 13:18:38.755939 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:38.760454 14371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.011s	sys 0.027s
I20260709 13:18:38.762287 14899 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:38.722040 17116 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:38.768311 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46605.2us
I20260709 13:18:38.769465 14224 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:38.773149 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.793076 14193 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:38.819917 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:38.818672 14192 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:38.714833 16931 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:18:38.763105 17125 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6.
I20260709 13:18:38.833420 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.847146 14894 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:18:38.838043 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 665078us
I20260709 13:18:38.726956 16746 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
W20260709 13:18:38.859542 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.862001 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.025s	sys 0.064s
W20260709 13:18:38.862519 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.025s	sys 0.064s
W20260709 13:18:38.832710 17079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.027s	sys 0.050s
I20260709 13:18:38.894100 14900 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:38.793846 17116 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:38.767855 17053 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
W20260709 13:18:38.897019 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 357114us
W20260709 13:18:38.896588 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 104235us
I20260709 13:18:38.891371 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:38.848670 17115 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.907575 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:38.907675 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:38.926654 14372 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:38.927961 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 162765us
W20260709 13:18:38.928680 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 160860us
I20260709 13:18:38.896600 16825 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:38.854480 17087 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.945120 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:38.891779 16718 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:38.986404 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:38.910475 14895 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:38.895329 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:38.991789 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 96559.9us
I20260709 13:18:38.992564 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:38.995052 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:38.996157 14377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.008s	sys 0.014s
W20260709 13:18:38.996539 14377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.008s	sys 0.014s
I20260709 13:18:38.992940 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:38.999372 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.003475 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:38.979498 16551 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:39.006148 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:38.982865 16931 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.017424 14302 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.015s	sys 0.027s
W20260709 13:18:39.025631 14302 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.016s	sys 0.027s
I20260709 13:18:38.950527 16956 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:18:39.038460 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:39.039114 14221 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:18:38.998780 17164 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.038026 14223 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.018721 16825 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:39.018584 17065 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:39.035445 17048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.008s	sys 0.037s
I20260709 13:18:39.035923 17093 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:39.028151 17112 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:39.082980 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:39.054177 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 59269.5us
I20260709 13:18:39.082399 14303 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:39.026568 17115 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.137657 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:39.139338 14221 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.141896 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:39.142489 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:39.143091 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.053597 17166 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.091847 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:39.142076 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 247691us
W20260709 13:18:39.086567 17048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.009s	sys 0.038s
I20260709 13:18:39.050573 16921 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.079283 17065 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:39.118716 17149 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
I20260709 13:18:39.160071 14901 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:18:39.133730 17177 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
W20260709 13:18:39.174299 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 165346us
I20260709 13:18:39.004515 17116 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:39.247129 17093 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.247872 17093 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:39.119764 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:39.252413 14375 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.254208 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:39.255180 14376 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 3: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:39.196148 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:39.262521 17048 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:39.054317 17125 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:18:39.120174 17112 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:39.172822 17159 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:18:39.203002 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:39.263586 17112 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.263936 14900 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:39.264990 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2318) took 1630 ms. Trace:
I20260709 13:18:39.265539 14300 rpcz_store.cc:276] 0709 13:18:37.636041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.107956 (+471915us) service_pool.cc:224] Handling call
0709 13:18:38.117942 (+  9986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.198774 (+ 80832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.198808 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.199290 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.511225 (+311935us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:38.511269 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.512681 (+  1412us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.264709 (+752028us) raft_consensus.cc:1685] finished
0709 13:18:39.264741 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.264916 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33441,"raft.queue_time_us":34642,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":79,"thread_start_us":311551,"threads_started":1,"wal-append.queue_time_us":694381}
I20260709 13:18:39.271109 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:39.273468 17093 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:39.274966 17093 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:39.227909 14374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.009s
W20260709 13:18:39.278100 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 130150us
W20260709 13:18:39.278647 14374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.000s	sys 0.009s
W20260709 13:18:39.262645 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 90837.6us
I20260709 13:18:39.226256 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:39.283566 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:39.197078 17065 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:39.087603 16931 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:39.211922 16676 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:39.309597 14375 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:39.325443 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:18:39.338136 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 112044us
I20260709 13:18:39.297022 14892 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:39.367013 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 83589.6us
W20260709 13:18:39.355044 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.368106 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:39.368794 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 63891us
I20260709 13:18:39.372759 14867 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:39.296017 17093 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:39.374039 17174 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:18:39.379454 17198 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:39.381336 17198 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:39.338457 16551 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:18:39.382778 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 118123us
I20260709 13:18:39.384923 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 673) took 1187 ms. Trace:
I20260709 13:18:39.279878 16921 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:39.407627 14223 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
W20260709 13:18:39.410760 14341 leader_election.cc:336] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.605s (SENT)
I20260709 13:18:39.394532 14226 rpcz_store.cc:276] 0709 13:18:38.255739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.445644 (+189905us) service_pool.cc:224] Handling call
0709 13:18:38.446022 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.492177 (+ 46155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.492221 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.518895 (+ 26674us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.588501 (+ 69606us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b180020b960. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:18:38.679632 (+ 91131us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180020b960. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8df0f6058f 00007f8de9f9f571 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd
0709 13:18:38.935984 (+256352us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:38.936032 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.936106 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.384633 (+448527us) raft_consensus.cc:1685] finished
0709 13:18:39.384663 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.384861 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24870,"raft.queue_time_us":49960,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":8967,"spinlock_wait_cycles":99092608,"thread_start_us":347298,"threads_started":1,"wal-append.queue_time_us":559968}
I20260709 13:18:39.411290 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:39.544410 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:39.374298 17156 log.cc:927] Time spent T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.427s	user 0.000s	sys 0.002s
I20260709 13:18:39.544873 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:39.546131 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:39.546414 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2312) took 1954 ms. Trace:
W20260709 13:18:39.547487 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 136796us
I20260709 13:18:39.547168 14296 rpcz_store.cc:276] 0709 13:18:37.592256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.096595 (+504339us) service_pool.cc:224] Handling call
0709 13:18:38.113712 (+ 17117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.180492 (+ 66780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.180533 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.181095 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.549959 (+368864us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:38.549994 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.550077 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.546110 (+996033us) raft_consensus.cc:1685] finished
0709 13:18:39.546145 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.546338 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25272,"raft.queue_time_us":29923,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"thread_start_us":368418,"threads_started":1,"wal-append.queue_time_us":666635}
W20260709 13:18:39.549463 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.517181 17204 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.128s	user 0.001s	sys 0.007s
I20260709 13:18:39.551826 14220 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:39.553198 14220 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:39.554350 14220 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:39.516444 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:39.338229 17162 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.546558 17197 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.546721 14226 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.528173 16931 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:39.558395 16931 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.559024 16931 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:39.383257 17125 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:39.384462 16551 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:39.383522 17158 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
W20260709 13:18:39.387882 17160 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.308s	user 0.000s	sys 0.000s
I20260709 13:18:39.564700 14226 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:39.570012 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1777) took 1207 ms. Trace:
W20260709 13:18:39.610880 14302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.003s	sys 0.021s
W20260709 13:18:39.632328 14302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.005s	sys 0.023s
I20260709 13:18:39.400740 16614 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:39.567927 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 222988us
W20260709 13:18:39.580435 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 212425us
W20260709 13:18:39.577917 14301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.009s	sys 0.015s
I20260709 13:18:39.381757 17198 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:39.636876 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:39.385334 16956 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:39.288218 17166 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:39.577907 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 306858us
I20260709 13:18:39.666940 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:39.664969 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:39.383567 17186 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:39.566816 17161 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:39.387037 17006 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.581s
I20260709 13:18:39.676167 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:39.567749 17173 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:18:39.701941 17176 log.cc:927] Time spent T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
W20260709 13:18:39.569486 16991 consensus_meta.cc:287] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.982s	user 0.008s	sys 0.003s
I20260709 13:18:39.367403 16784 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.216s
W20260709 13:18:39.680070 14301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.012s	sys 0.018s
W20260709 13:18:39.668026 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 585458us
I20260709 13:18:39.680943 14369 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:39.633673 14228 rpcz_store.cc:276] 0709 13:18:38.362332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.509067 (+146735us) service_pool.cc:224] Handling call
0709 13:18:38.551934 (+ 42867us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.683470 (+131536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.683513 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.684174 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.927815 (+243641us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:38.927851 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.927922 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.569700 (+641778us) raft_consensus.cc:1685] finished
0709 13:18:39.569720 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.569917 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107644,"raft.queue_time_us":130068,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":6189,"thread_start_us":243106,"threads_started":1,"wal-append.queue_time_us":639033}
I20260709 13:18:39.665489 14223 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:39.567396 17125 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:39.562539 16931 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:39.629657 16676 raft_consensus.cc:2764] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:18:39.655992 17092 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.024s	sys 0.005s
W20260709 13:18:39.567621 17168 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
I20260709 13:18:39.411875 17093 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:39.671360 16746 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.793978 16746 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:39.795012 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1820) took 2070 ms. Trace:
I20260709 13:18:39.672758 17197 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:39.366853 16825 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:39.720752 14221 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.001s
I20260709 13:18:39.581852 17087 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:39.755523 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:39.798923 14221 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
W20260709 13:18:39.800436 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 93971.6us
I20260709 13:18:39.675432 16614 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:18:39.783268 17092 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.024s	sys 0.006s
W20260709 13:18:39.799659 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48775.2us
W20260709 13:18:39.821244 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 100846us
I20260709 13:18:39.824302 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1775) took 1462 ms. Trace:
I20260709 13:18:39.823886 17198 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:39.825258 17184 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 13:18:39.827371 16822 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.152s	user 0.011s	sys 0.001s
W20260709 13:18:39.828544 17207 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:18:39.857028 17197 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:39.865545 17092 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.763571 17186 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:39.868117 17186 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:39.870609 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 778) took 1522 ms. Trace:
I20260709 13:18:39.871059 14892 rpcz_store.cc:276] 0709 13:18:38.348530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.592643 (+244113us) service_pool.cc:224] Handling call
0709 13:18:38.592968 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.399387 (+806419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.870270 (+470883us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54008674d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:39.870505 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461627136}
W20260709 13:18:39.872622 17081 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.200s	user 0.010s	sys 0.002s
W20260709 13:18:39.875372 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.876042 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.832665 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 677) took 1536 ms. Trace:
I20260709 13:18:39.795552 14371 rpcz_store.cc:276] 0709 13:18:37.724431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.105055 (+380624us) service_pool.cc:224] Handling call
0709 13:18:38.113230 (+  8175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.161806 (+ 48576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.161855 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.162447 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.761025 (+598578us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:38.793582 (+ 32557us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.079915 (+286333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.080042 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.794758 (+714716us) raft_consensus.cc:1685] finished
0709 13:18:39.794779 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.794935 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23367,"prepare.queue_time_us":31564,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":265768,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":5268,"thread_start_us":855758,"threads_started":2,"wal-append.queue_time_us":827520}
W20260709 13:18:39.834560 17171 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:18:39.838990 14899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 789) took 1495 ms (client timeout 1982 ms). Trace:
I20260709 13:18:39.844246 16848 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:39.974179 16848 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:39.854763 14897 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:39.846506 16614 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:39.862289 14194 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.208.190:37027, user_credentials={real_user=slave}} blocked reactor thread for 218990us
I20260709 13:18:39.863380 16746 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:39.893925 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:39.977461 14270 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:39.894663 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:39.822432 17087 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.897604 17120 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:39.862690 17125 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:39.984997 17125 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.985322 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:39.993245 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:39.902825 16718 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:39.901714 14304 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 3: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:39.910809 17092 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:39.911514 17170 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.082s	user 0.004s	sys 0.001s
W20260709 13:18:39.917066 17165 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:18:39.919466 17051 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:39.922698 16921 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:39.926959 17166 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:39.928949 17093 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:39.931315 16983 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.388s	user 0.012s	sys 0.000s
W20260709 13:18:39.933884 17112 consensus_meta.cc:287] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.000s
W20260709 13:18:39.934806 17035 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.251s	user 0.011s	sys 0.002s
I20260709 13:18:39.942217 17198 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:39.948180 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 192755us
I20260709 13:18:39.847635 14222 rpcz_store.cc:276] 0709 13:18:38.361738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.476618 (+114880us) service_pool.cc:224] Handling call
0709 13:18:38.508228 (+ 31610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.545892 (+ 37664us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:38.545934 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.565012 (+ 19078us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.002752 (+437740us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:39.002826 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.002949 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.824072 (+821123us) raft_consensus.cc:1685] finished
0709 13:18:39.824092 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.824238 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114487,"raft.queue_time_us":40208,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":5496,"thread_start_us":416308,"threads_started":1,"wal-append.queue_time_us":824623}
I20260709 13:18:39.887101 14224 rpcz_store.cc:276] 0709 13:18:38.296190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.471633 (+175443us) service_pool.cc:224] Handling call
0709 13:18:38.481973 (+ 10340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.794487 (+312514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.832366 (+1037879us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540026c5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:39.832587 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660458368}
I20260709 13:18:39.956631 17209 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.955878 17194 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:40.043463 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:39.954181 17162 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:18:39.956627 17032 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.962972 14899 rpcz_store.cc:269] 0709 13:18:38.343923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.377338 (+ 33415us) service_pool.cc:224] Handling call
0709 13:18:39.838773 (+1461435us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540049fa54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:39.838924 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783377664}
I20260709 13:18:39.964571 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:39.962289 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:40.046502 14295 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:39.964836 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:39.965623 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:39.967195 14303 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:39.967156 17164 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.967639 14298 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:39.973302 14898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 793) took 1628 ms (client timeout 1587 ms). Trace:
W20260709 13:18:39.974315 17182 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
W20260709 13:18:39.853140 14372 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.873s	user 0.005s	sys 0.004s
I20260709 13:18:40.065204 14372 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:40.031515 16991 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.983269 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 89459.4us
I20260709 13:18:39.988287 17120 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:39.990585 17193 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
I20260709 13:18:39.990983 17087 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:39.991787 17197 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:39.899137 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1831) took 1249 ms. Trace:
I20260709 13:18:39.997233 14270 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:18:39.999058 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 104531us
W20260709 13:18:39.999701 14897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 784) took 1596 ms (client timeout 1872 ms). Trace:
I20260709 13:18:40.000313 16746 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:39.973553 17065 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.000s
I20260709 13:18:40.096050 17065 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:39.996660 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 140495us
I20260709 13:18:40.048352 17115 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.006166 17053 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.019026 17101 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.386s	user 0.009s	sys 0.006s
I20260709 13:18:40.062897 14299 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:39.982548 17188 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.995522 16848 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:40.014469 17051 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:39.955372 17109 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:40.091429 14897 rpcz_store.cc:269] 0709 13:18:38.405045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.453942 (+ 48897us) service_pool.cc:224] Handling call
0709 13:18:39.999507 (+1545565us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003dac54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:39.999641 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2976641792}
I20260709 13:18:40.091960 14374 rpcz_store.cc:276] 0709 13:18:38.649803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.655336 (+  5533us) service_pool.cc:224] Handling call
0709 13:18:38.655644 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.656019 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.656044 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.656534 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.279078 (+622544us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:39.279132 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.279205 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.898888 (+619683us) raft_consensus.cc:1685] finished
0709 13:18:39.898914 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.899070 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11695,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"thread_start_us":584451,"threads_started":1,"wal-append.queue_time_us":1240526}
I20260709 13:18:40.129923 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2327) took 2409 ms. Trace:
I20260709 13:18:40.001752 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 675) took 1716 ms. Trace:
I20260709 13:18:40.098276 14297 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:40.034682 16921 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:40.101022 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.101919 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58582.3us
I20260709 13:18:40.095124 17058 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:40.102584 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1829) took 1449 ms. Trace:
I20260709 13:18:40.043601 17035 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.071213 17166 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.130367 16746 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:40.140825 14302 rpcz_store.cc:276] 0709 13:18:37.720265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.195095 (+474830us) service_pool.cc:224] Handling call
0709 13:18:38.195555 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.404880 (+209325us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:39.033722 (+628842us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.003993 (+970271us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.040825 (+ 36832us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.041259 (+   434us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:40.041313 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.068323 (+ 27010us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400154ad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:40.068385 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.100419 (+ 32034us) raft_consensus.cc:1685] finished
0709 13:18:40.129674 (+ 29255us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.129858 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":726753,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":222504,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":36318,"spinlock_wait_cycles":460806912,"thread_start_us":1479674,"threads_started":3,"wal-append.queue_time_us":846297}
I20260709 13:18:40.043913 17112 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:40.131264 17162 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:18:40.130926 17116 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:18:40.130167 16889 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:40.043082 17092 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:18:40.129719 17188 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.044238 16983 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.089819 16991 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.065398 17032 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.062496 17194 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.066677 17164 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.048617 17209 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:40.589102 17125 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.003s
I20260709 13:18:40.573797 17135 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.510977 17213 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:18:40.166159 17189 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.606328 17112 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:40.606896 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:40.363878 17161 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.002s
I20260709 13:18:40.608244 17161 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.608860 17163 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.609469 17163 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.610301 14298 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:40.611685 17163 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:40.612377 16889 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.372462 17058 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.613652 14893 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:40.613852 16746 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.614538 17194 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:40.169391 17101 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:40.615270 16889 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:40.615664 17058 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:40.419123 17206 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:40.455451 14267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.018s	sys 0.015s
I20260709 13:18:40.138837 17115 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:40.634414 14228 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:40.367906 17120 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:40.519256 14229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.344s	user 0.011s	sys 0.025s
I20260709 13:18:40.168134 16551 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.617408 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:40.099634 17006 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.252367 17165 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:18:40.617919 17032 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:40.141251 17053 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:40.618970 14222 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:40.240299 14295 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:40.364500 17051 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.619242 16991 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:40.603574 14268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.007s	sys 0.024s
W20260709 13:18:40.645753 14268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.008s	sys 0.024s
I20260709 13:18:40.204298 14372 rpcz_store.cc:276] 0709 13:18:38.649264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.653073 (+  3809us) service_pool.cc:224] Handling call
0709 13:18:40.098990 (+1445917us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54002ec554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:40.099096 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626975104}
I20260709 13:18:40.138319 17196 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:40.063270 14898 rpcz_store.cc:269] 0709 13:18:38.345283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.348365 (+  3082us) service_pool.cc:224] Handling call
0709 13:18:39.973033 (+1624668us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b5400883bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:39.973214 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592434048}
I20260709 13:18:40.612563 17166 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.620298 14227 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:18:40.606338 17189 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.605638 17135 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.621428 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:40.611857 16983 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:40.536505 16822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.014s	sys 0.030s
W20260709 13:18:40.287897 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.452265 14301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.008s	sys 0.024s
W20260709 13:18:40.670212 14301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.009s	sys 0.030s
I20260709 13:18:40.670755 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 477) took 2347 ms. Trace:
W20260709 13:18:40.594657 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 597448us
W20260709 13:18:40.600387 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.629963 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2331) took 1927 ms. Trace:
I20260709 13:18:40.608625 14302 raft_consensus.cc:2955] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:40.604027 14299 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:18:40.631693 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 1.26164e+06us
I20260709 13:18:40.632314 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2106) took 2321 ms. Trace:
I20260709 13:18:40.670984 14301 rpcz_store.cc:276] 0709 13:18:38.323124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.573069 (+249945us) service_pool.cc:224] Handling call
0709 13:18:38.620316 (+ 47247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.695994 (+ 75678us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:38.990286 (+294292us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.987924 (+997638us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4800241ed8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
0709 13:18:40.670487 (+682563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.670528 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:40.670561 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.670623 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.670708 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9596,"prepare.queue_time_us":627599,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":144434,"raft.run_cpu_time_us":2958,"raft.run_wall_time_us":109936,"spinlock_wait_cycles":6984064,"thread_start_us":1920505,"threads_started":3,"wal-append.queue_time_us":876974}
I20260709 13:18:40.674280 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:40.674448 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2107) took 2341 ms. Trace:
I20260709 13:18:40.673094 14377 rpcz_store.cc:276] 0709 13:18:38.310817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.390359 (+ 79542us) service_pool.cc:224] Handling call
0709 13:18:38.402460 (+ 12101us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.419666 (+ 17206us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:38.419704 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.455443 (+ 35739us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.004848 (+549405us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:39.004898 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.004967 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.910330 (+905363us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:40.594551 (+684221us) raft_consensus.cc:1685] finished
0709 13:18:40.594579 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.632256 (+ 37677us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9707,"raft.queue_time_us":12271,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6252,"spinlock_wait_cycles":57915136,"thread_start_us":541049,"threads_started":1,"wal-append.queue_time_us":1373372}
I20260709 13:18:40.673713 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:40.677134 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.677225 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:40.677075 14299 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:40.680481 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:40.652645 17051 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:40.633565 14267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.018s	sys 0.017s
I20260709 13:18:40.634791 14228 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:40.635165 14229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.460s	user 0.012s	sys 0.025s
W20260709 13:18:40.505395 16825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.018s	sys 0.067s
I20260709 13:18:40.635756 14224 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:40.468822 16973 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.017s	sys 0.018s
I20260709 13:18:40.202236 17199 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:40.362042 16846 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:40.205348 17109 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:40.252390 16921 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:40.641409 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 547198us
I20260709 13:18:40.626811 16848 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:40.643147 17104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.005s	sys 0.018s
I20260709 13:18:40.364462 16614 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.640795 17206 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:40.668718 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:40.672477 14270 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:40.672209 14297 rpcz_store.cc:276] 0709 13:18:38.702879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.837185 (+1134306us) service_pool.cc:224] Handling call
0709 13:18:39.837615 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.165444 (+327829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.629604 (+464160us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400154854. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:40.629884 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598896000}
I20260709 13:18:40.681087 14301 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:40.140983 14225 rpcz_store.cc:276] 0709 13:18:38.285558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.464857 (+179299us) service_pool.cc:224] Handling call
0709 13:18:38.465134 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.465389 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:38.752125 (+286736us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.352178 (+600053us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.971464 (+619286us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b18000fa120. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:18:40.000820 (+ 29356us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b18000fa120. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:18:40.001239 (+   419us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.001406 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.001451 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:40.001503 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.001577 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.001696 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":674460,"prepare.queue_time_us":68219,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":105,"raft.queue_time_us":1030994,"raft.run_cpu_time_us":507,"raft.run_wall_time_us":98672,"spinlock_wait_cycles":123535360,"thread_start_us":453398,"threads_started":2,"wal-append.queue_time_us":524105}
I20260709 13:18:40.682897 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:40.674909 14370 rpcz_store.cc:276] 0709 13:18:38.332623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.467526 (+134903us) service_pool.cc:224] Handling call
0709 13:18:38.497500 (+ 29974us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:38.525851 (+ 28351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.525883 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:38.526475 (+   592us) log.cc:844] Serialized 52 byte log entry
0709 13:18:38.900828 (+374353us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:38.940120 (+ 39292us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.946333 (+  6213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.946432 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.916358 (+969926us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:40.668225 (+751867us) raft_consensus.cc:1685] finished
0709 13:18:40.674242 (+  6017us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.674390 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34709,"prepare.queue_time_us":39023,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":3861,"raft.queue_time_us":358152,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":35236,"spinlock_wait_cycles":44007808,"thread_start_us":373917,"threads_started":1,"wal-append.queue_time_us":1166649}
I20260709 13:18:40.685842 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 680) took 1863 ms. Trace:
W20260709 13:18:40.673170 16822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.014s	sys 0.034s
I20260709 13:18:40.662645 17120 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:40.694003 14193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.003s	sys 0.026s
W20260709 13:18:40.694205 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 1.02725e+06us
I20260709 13:18:40.641333 17006 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.667814 16551 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.662911 17214 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:40.673771 17063 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:40.698632 17179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.015s	sys 0.019s
W20260709 13:18:40.688196 16973 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.017s	sys 0.023s
W20260709 13:18:40.740427 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68030.4us
I20260709 13:18:40.741251 14270 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:40.690929 16825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.023s	sys 0.067s
I20260709 13:18:40.746063 17115 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:40.747062 16825 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:40.747643 16825 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:40.748597 16825 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:40.749078 16921 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.707870 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:40.699023 14228 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.750834 14228 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:40.720705 14299 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
I20260709 13:18:40.693297 16991 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.701223 17188 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:40.721243 14229 rpcz_store.cc:276] 0709 13:18:38.822892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.823087 (+   195us) service_pool.cc:224] Handling call
0709 13:18:38.823496 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.840260 (+ 16764us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:38.903500 (+ 63240us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.989827 (+1086327us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:40.685362 (+695535us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.685436 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:40.685498 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.685600 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.685747 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58965,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":207616,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":65503872,"thread_start_us":1722831,"threads_started":2,"wal-append.queue_time_us":909537}
I20260709 13:18:40.688357 17026 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:40.728742 14193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.003s	sys 0.026s
W20260709 13:18:40.713551 17104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.005s	sys 0.019s
I20260709 13:18:40.698771 16846 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:40.734930 14222 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:40.678792 17162 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:18:40.743791 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:40.740554 17214 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:40.738319 17179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.015s	sys 0.020s
I20260709 13:18:40.754547 17220 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.739269 17063 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.733412 16822 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.754851 14297 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:40.725849 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:40.760445 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:40.761137 16718 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:40.762488 14221 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:40.739411 17120 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:40.798175 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 191366us
W20260709 13:18:40.805868 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 45509.9us
I20260709 13:18:40.806080 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:40.791330 17209 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:40.813472 17198 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.769s	user 0.012s	sys 0.000s
I20260709 13:18:40.813611 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:40.799115 17206 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:40.814198 17198 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.814643 17198 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:40.815084 17198 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.809370 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:40.759245 16991 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:40.850374 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48507.5us
I20260709 13:18:40.851227 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:40.852504 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:40.799505 17053 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:40.805768 17220 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:40.863379 14297 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:40.818262 17223 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
W20260709 13:18:40.854365 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 111555us
I20260709 13:18:40.869771 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:40.870680 14229 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.874361 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:40.876191 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:40.876911 14227 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:40.878157 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:40.812119 17104 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:40.848431 17188 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:40.892045 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:40.817907 17135 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:40.804853 16822 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.897365 17188 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.909937 17188 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.909677 17220 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:40.880481 17166 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:40.913882 17214 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:40.916373 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 238411us
W20260709 13:18:40.919480 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 105950us
I20260709 13:18:40.923404 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:40.934592 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:40.941361 14229 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:40.942126 17236 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.942334 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:40.942658 17236 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:40.943553 16889 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.943724 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:40.944092 16889 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:40.944861 17236 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:40.945948 17236 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:40.946537 17236 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:40.946794 14893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 828) took 2089 ms (client timeout 1736 ms). Trace:
I20260709 13:18:40.944861 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:40.948400 17236 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:40.949940 17196 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:40.950551 17196 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:40.951007 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:40.951627 14370 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:18:40.952584 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:40.952670 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:40.953254 14374 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.956527 17063 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:40.956944 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:40.957327 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:40.958123 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:40.958737 14375 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:40.959321 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:40.959925 14369 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:40.960433 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:40.960546 14374 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:18:40.960814 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:40.961280 17162 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:40.961654 17162 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.962028 17162 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.963158 17190 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.963687 17190 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:40.965960 17190 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:40.947250 14893 rpcz_store.cc:269] 0709 13:18:38.857298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.893426 (+ 36128us) service_pool.cc:224] Handling call
0709 13:18:40.946579 (+2053153us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54005212d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:40.946712 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3747194240}
I20260709 13:18:40.967165 17199 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.967696 17199 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:40.968312 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:40.969108 17116 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.969852 17116 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:18:40.970198 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.970350 17053 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.970647 17116 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:40.970742 14897 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:40.971105 17116 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:40.970175 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 244505us
I20260709 13:18:40.971938 17116 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:40.970130 17115 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.973006 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:40.973174 17116 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:40.975328 16676 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:40.970851 17053 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:40.978619 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.979552 17053 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:40.979624 17217 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:40.982465 17200 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:40.982884 17200 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:40.983798 17200 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:40.982067 17053 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:18:40.985054 17200 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.987946 16551 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.990330 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:40.996440 17115 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:40.997009 17115 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:40.997848 14303 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:41.004086 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:40.981633 17217 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:18:41.004877 14298 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:41.004971 17217 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:41.005362 17217 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:41.005988 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.006078 17208 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:41.006853 14298 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:41.007642 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.008646 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.008199 17115 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.004125 17125 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.010311 17125 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.011792 17199 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.012346 17125 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:41.013252 17125 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:40.945330 16889 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.013849 17125 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.014458 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:41.014684 16889 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.015884 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.016151 17125 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.016815 14303 raft_consensus.cc:2410] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:41.017686 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.022121 14303 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:41.024552 14303 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:41.022411 17217 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.028056 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:41.028349 17217 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.030978 14897 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.009662 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.034543 14897 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:18:41.034613 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.035307 14298 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
I20260709 13:18:41.034998 14897 pending_rounds.cc:85] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 6
I20260709 13:18:41.036646 14897 pending_rounds.cc:107] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:18:41.036918 14897 raft_consensus.cc:2889] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:41.039412 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.040584 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.041215 14897 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:41.044440 14369 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:41.045574 17162 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.046063 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:41.048240 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:41.048434 17162 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.048923 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:41.049726 14223 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.050419 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.051642 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.052580 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.036329 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.054178 14298 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:41.055025 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:41.055989 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.056514 14298 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:41.057273 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.058341 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:40.934887 14342 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:41.059821 14223 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:41.061681 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:41.062361 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:41.062970 14893 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.923520 17166 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:41.067445 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 132638us
I20260709 13:18:41.069734 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:40.932972 17135 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:41.070927 14297 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:41.072372 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:40.923542 17189 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.072860 14342 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:41.076824 14193 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:40.890422 16846 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.087265 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:41.059031 16614 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.072603 17162 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:41.096650 17162 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:40.934443 17242 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.175s
I20260709 13:18:41.098235 17162 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.099056 17242 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:41.099463 17242 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:41.100231 17242 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.101419 17242 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.087059 14898 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:41.078249 17135 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:41.104580 17135 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.107550 14228 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:41.107641 17087 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.110610 16822 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:41.111241 16822 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:41.111586 16822 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:41.111931 16822 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.113412 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:41.114215 14900 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:41.115659 17006 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:41.116989 17164 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:41.117928 16991 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.119717 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:41.121619 17241 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:18:41.093832 16718 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.075574 17166 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:41.126165 17166 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.126736 17065 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:41.129424 17228 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:18:41.090337 17125 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:41.125465 17120 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:41.135878 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.160775 14893 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
W20260709 13:18:41.132618 17197 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.033s	user 0.006s	sys 0.004s
I20260709 13:18:41.179980 17188 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:41.137892 14192 connection.cc:256] RPC call timeout handler was delayed by -1.432023350999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 13:18:41.184051 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3375233509998452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 13:18:41.184527 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3357233509998423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:18:41.184885 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3321233509998365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 13:18:41.185250 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3006233510000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:18:41.185563 14192 connection.cc:256] RPC call timeout handler was delayed by -1.0315233509998052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 13:18:41.185957 14192 connection.cc:256] RPC call timeout handler was delayed by -1.0072233509999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
I20260709 13:18:41.153376 17125 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:41.198236 17051 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.003s
I20260709 13:18:41.154116 17006 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:41.198611 17135 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.198961 17006 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.200240 16846 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.201957 17197 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:41.202744 17197 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.203205 17198 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.203836 17197 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:41.204267 17197 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.204607 17197 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.205053 14372 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.091312 17053 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:18:41.206127 14371 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:41.206450 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.198189 17125 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.207382 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.207973 14900 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:41.209497 14376 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:41.090709 17196 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.167778 17161 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:18:41.211215 17135 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:41.211552 17196 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.211892 17135 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:41.212342 17135 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.212740 17135 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.213090 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.205507 17198 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:41.217644 14303 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:41.165874 17065 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.165378 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.228118 14298 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:41.243259 14295 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:41.247136 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:41.254851 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:41.255666 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49615.4us
I20260709 13:18:41.257687 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:41.262583 14220 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:41.201979 16551 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.265261 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:41.269860 17208 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.270108 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:41.213778 14898 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:41.271325 17188 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:41.254890 17065 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.272559 14297 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:41.268151 17200 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.273996 17065 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.256789 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.255939 14893 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:41.264874 14895 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:41.276461 16822 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.285924 17231 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:41.302639 17231 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:41.303566 17231 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.304798 17231 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.308890 14192 leader_election.cc:400] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6.
I20260709 13:18:41.309903 14899 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:41.298179 14897 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:41.301959 14896 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:18:41.253695 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 75639.4us
I20260709 13:18:41.259945 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:41.310026 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:41.308977 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:41.321540 14220 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:41.332522 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:41.258620 17006 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:41.334687 17053 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.338853 16614 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:41.293463 17166 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.256019 17227 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:18:41.292614 17189 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:41.358693 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:41.351293 16614 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:41.359447 14223 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.341068 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:41.292429 17109 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.000s
I20260709 13:18:41.345486 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:41.369189 14220 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.345017 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:41.341749 17196 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.373382 14370 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:41.376711 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:41.391269 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.351934 17208 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:41.396823 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 51867.2us
I20260709 13:18:41.407248 14223 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
W20260709 13:18:41.377532 17218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.031s	sys 0.022s
I20260709 13:18:41.415247 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:18:41.432526 14341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.002s	sys 0.022s
I20260709 13:18:41.367964 16614 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:41.439172 14341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.002s	sys 0.022s
W20260709 13:18:41.440323 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 696575us
I20260709 13:18:41.392889 14270 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:41.444574 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.446869 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.430528 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:41.454880 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:41.396517 16746 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.457993 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.412819 17164 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:41.413041 17214 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:41.442945 17218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.031s	sys 0.022s
I20260709 13:18:41.480974 14223 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:18:41.481504 14223 pending_rounds.cc:85] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 6
I20260709 13:18:41.481827 14223 pending_rounds.cc:107] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:41.482152 14223 raft_consensus.cc:2889] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.397006 16822 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:41.463640 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.415112 17053 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:41.432387 17101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.009s	sys 0.018s
I20260709 13:18:41.464265 17161 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.472501 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:41.483091 14299 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.008s	sys 0.020s
I20260709 13:18:41.371515 17189 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.374801 16973 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
W20260709 13:18:41.517282 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 62469us
I20260709 13:18:41.463557 17200 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:41.521468 14299 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.008s	sys 0.020s
I20260709 13:18:41.469065 17051 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:18:41.412312 17196 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:41.483038 17209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.001s	sys 0.017s
I20260709 13:18:41.522816 14220 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:41.478559 17164 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.466033 17246 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:41.522125 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 129320us
I20260709 13:18:41.544960 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:41.464318 17188 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:18:41.547713 14341 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:41.526129 17093 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.017s	sys 0.007s
W20260709 13:18:41.517309 17101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.009s	sys 0.018s
I20260709 13:18:41.524307 17161 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.510702 17053 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:41.473148 17217 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 13:18:41.551358 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.517647 17214 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:41.548483 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:41.551916 14341 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:41.552063 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:41.552515 14296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.006s	sys 0.009s
W20260709 13:18:41.553879 14267 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.004s	sys 0.032s
W20260709 13:18:41.545189 14227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.007s	sys 0.008s
W20260709 13:18:41.555558 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.469871 17125 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.478852 16746 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:41.467957 14114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8c137013238f4b1dbae260e32cb316dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9b2cf49ceed478480fb0f27ccf55d81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:18:41.564026 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.549203 17164 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.550699 16889 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:41.564244 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 397438us
W20260709 13:18:41.587735 14267 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.004s	sys 0.034s
W20260709 13:18:41.605057 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 642043us
W20260709 13:18:41.562711 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 471495us
I20260709 13:18:41.566922 14220 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:41.596338 14304 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:41.594769 14114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 127016us
W20260709 13:18:41.597149 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 45313.6us
I20260709 13:18:41.599619 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:41.553592 17093 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.017s	sys 0.007s
W20260709 13:18:41.586333 14296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.007s	sys 0.010s
I20260709 13:18:41.549347 17200 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:41.607955 14298 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.563859 17053 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:41.608372 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.561605 17161 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.562042 16822 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:41.587143 14227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.008s	sys 0.008s
W20260709 13:18:41.595153 16825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.013s	sys 0.020s
I20260709 13:18:41.589188 17218 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:41.637338 14228 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 7: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:41.564253 17199 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:41.643760 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:41.603230 16551 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.646209 14341 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:41.638816 16822 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:41.620954 17209 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:18:41.649461 17209 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.650861 17214 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.642694 17087 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:18:41.643610 17166 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:41.657737 17218 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:41.638695 17198 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:41.661162 17164 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.661732 14298 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:41.596805 16991 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:18:41.612674 17065 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.648226 16822 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.659404 17196 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:41.701969 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.598549 17197 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.721243 14226 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:41.727126 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:41.639401 16825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.014s	sys 0.020s
I20260709 13:18:41.628078 16921 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.674467 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:41.699986 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:41.728844 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.736673 17198 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.752976 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 78584.6us
I20260709 13:18:41.754684 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:41.737628 17164 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.662163 17125 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.742177 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:41.743431 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:41.744118 17250 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:18:41.769870 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.744855 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:41.744648 17200 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.664556 17248 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:41.745299 17197 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:41.745687 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:41.735882 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.751299 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51433.7us
I20260709 13:18:41.683748 16973 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.641093 17135 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.761756 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:41.762293 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.785491 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.762986 16718 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:41.765380 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.768563 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.776080 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.788044 14900 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:41.798492 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:41.806254 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:41.807024 14378 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:41.706427 17065 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.807916 14371 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:41.808126 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:41.763464 17245 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.808887 14374 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.808894 14370 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:41.810387 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:41.819314 14376 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:41.820165 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:41.820964 14371 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:41.822116 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:41.822785 14371 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:41.763316 17243 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:41.824337 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:41.813228 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:41.824431 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:41.830425 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 357996us
I20260709 13:18:41.825281 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:41.828579 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:41.832232 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:41.834040 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:41.780804 17248 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:41.785386 17231 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.666668 17218 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.824941 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:41.829707 14374 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:41.807880 17087 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:41.850170 14375 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 4: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:41.796811 16718 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:41.845801 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:41.855676 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.859759 14893 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:41.857758 14370 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:41.851648 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:41.811793 17196 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:41.850313 14373 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:41.764182 17198 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:41.810456 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.830930 17243 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.803845 16973 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.947427 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 699) took 1251 ms. Trace:
I20260709 13:18:41.958253 14224 rpcz_store.cc:276] 0709 13:18:40.696061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.696226 (+   165us) service_pool.cc:224] Handling call
0709 13:18:40.696627 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.968273 (+271646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.968304 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.968761 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.354149 (+385388us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:41.354191 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.678095 (+323904us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b54001491d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:41.678152 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.888613 (+210461us) raft_consensus.cc:1685] finished
0709 13:18:41.888642 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.947350 (+ 58708us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215784,"raft.queue_time_us":217118,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":127591680,"thread_start_us":385022,"threads_started":1,"wal-append.queue_time_us":592483}
I20260709 13:18:41.826292 17164 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:18:41.860599 17006 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.834869 16825 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:18:41.841730 17248 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.781708 16921 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:41.847616 17265 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 13:18:41.860404 17087 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:41.988677 14377 raft_consensus.cc:2410] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:41.989261 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:41.989774 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:41.863306 16718 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.046643 14375 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:42.035178 14370 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:42.070416 14893 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:41.849620 17245 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:41.987351 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 135763us
I20260709 13:18:42.106518 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:42.084689 14373 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:42.080075 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.019556 17189 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:41.954800 17243 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.988440 17058 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:41.848932 17231 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:42.040639 14374 raft_consensus.cc:2955] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:42.072497 17087 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.955502 14898 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:41.956143 17196 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:42.106150 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:42.109959 14193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.013s	sys 0.028s
W20260709 13:18:42.153424 14193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.013s	sys 0.032s
W20260709 13:18:42.153882 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 555563us
I20260709 13:18:42.044170 17161 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.084439 14376 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:41.992687 17006 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:42.114180 17276 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:42.134267 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1798) took 1265 ms. Trace:
I20260709 13:18:42.143386 14370 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:42.143580 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.014s	sys 0.041s
I20260709 13:18:42.074084 16889 raft_consensus.cc:697] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:42.108628 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:42.157953 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:42.184060 14295 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:42.146368 17163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.010s	sys 0.034s
I20260709 13:18:42.140033 17190 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:42.170145 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.014s	sys 0.041s
W20260709 13:18:42.188241 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 547070us
I20260709 13:18:42.189172 14373 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:42.166852 14227 rpcz_store.cc:276] 0709 13:18:40.868889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.877658 (+  8769us) service_pool.cc:224] Handling call
0709 13:18:40.895362 (+ 17704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.930000 (+ 34638us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:40.937968 (+  7968us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.130814 (+1192846us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.132765 (+  1951us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.132821 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:42.132877 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.132952 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.134199 (+  1247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9110,"prepare.queue_time_us":7241,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":7211,"raft.queue_time_us":28462,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":15768,"spinlock_wait_cycles":3087104,"thread_start_us":1192126,"threads_started":2,"wal-append.queue_time_us":1016103}
W20260709 13:18:42.187196 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 78671.5us
I20260709 13:18:42.134660 17245 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:42.192386 17270 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:18:42.194051 17125 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:42.187736 17163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.010s	sys 0.034s
I20260709 13:18:42.149909 17135 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:42.124887 16822 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.197999 17065 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:42.166824 14895 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.167615 17006 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.204316 14295 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:42.204509 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.206666 14893 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:42.215191 14372 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:42.165620 17058 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:42.167802 17276 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:42.216828 17272 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.354s	user 0.001s	sys 0.001s
I20260709 13:18:42.236721 14373 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:42.222618 17198 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:42.256003 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 171670us
I20260709 13:18:42.245215 14375 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:42.248178 14193 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:42.248919 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:42.250185 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 437117us
I20260709 13:18:42.250439 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:42.224709 14864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.006s	sys 0.032s
I20260709 13:18:42.257397 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.239248 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.267858 14370 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:42.261345 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.220541 17245 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:42.269932 14864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.006s	sys 0.032s
W20260709 13:18:42.246047 17266 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
I20260709 13:18:42.269174 14369 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:42.273725 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.274901 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:42.276026 14369 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:18:42.243841 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 794) took 1169 ms. Trace:
I20260709 13:18:42.279362 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.255565 17242 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:42.276412 14369 pending_rounds.cc:85] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 6
I20260709 13:18:42.277205 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 509) took 1233 ms. Trace:
I20260709 13:18:42.281278 14373 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:42.258451 17276 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:42.283174 14302 rpcz_store.cc:276] 0709 13:18:41.044242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.093218 (+ 48976us) service_pool.cc:224] Handling call
0709 13:18:41.093509 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.172366 (+ 78857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.172397 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.216844 (+ 44447us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.615133 (+398289us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:41.615184 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.615273 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.277011 (+661738us) raft_consensus.cc:1685] finished
0709 13:18:42.277031 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.277151 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1042,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":26485,"thread_start_us":349931,"threads_started":1,"wal-append.queue_time_us":690311}
I20260709 13:18:42.285429 14369 pending_rounds.cc:107] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:42.286840 14369 raft_consensus.cc:2889] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:42.280779 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:42.291318 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.292512 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.294574 14376 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:42.298599 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:42.305769 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.306928 14370 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:42.282622 17125 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:42.318022 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.320905 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:42.321045 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:42.321660 14371 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.324483 14373 raft_consensus.cc:2410] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:18:42.326484 14376 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:42.328754 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:42.281091 17065 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:18:42.335430 17125 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:42.336180 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.336427 17125 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:42.276541 16889 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.337905 16921 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:42.339150 16921 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:42.340003 16921 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.340408 16921 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:42.340785 16921 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:42.325908 17253 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:18:42.342723 16822 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:42.346071 17058 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.347124 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:42.290388 16973 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:18:42.352726 14371 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:18:42.359521 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:42.362006 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:42.366338 14369 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.365317 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.368836 14371 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:42.370060 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.371023 14371 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 3: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:42.372004 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.372781 14371 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:42.379207 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:42.382851 17200 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.383602 17200 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.384198 17298 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.384943 17298 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.386122 16973 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.386683 17200 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:42.386693 16973 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:42.354027 17271 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:18:42.410818 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:42.274082 17196 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.411593 14373 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
W20260709 13:18:42.373915 16614 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.908s	user 0.002s	sys 0.010s
I20260709 13:18:42.418073 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:42.425244 16551 consensus_meta.cc:287] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.749s	user 0.005s	sys 0.004s
I20260709 13:18:42.426432 17161 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:42.428772 17243 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:42.432143 17053 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.788s	user 0.006s	sys 0.002s
W20260709 13:18:42.434427 17291 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:18:42.428839 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:42.421376 14371 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:42.480535 14374 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:42.415305 17273 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.301s	user 0.000s	sys 0.002s
I20260709 13:18:42.458623 14192 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:42.460664 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:42.467428 14341 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:42.485663 14225 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:42.472043 14298 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:42.486763 14341 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:42.478993 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 97727.6us
I20260709 13:18:42.488425 17262 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:42.488668 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:42.473345 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 843) took 1300 ms. Trace:
I20260709 13:18:42.478842 14224 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:42.389693 16973 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:42.414848 17231 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:42.450896 17275 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.306s	user 0.000s	sys 0.002s
I20260709 13:18:42.460274 17280 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.450443 17065 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:42.471359 16551 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:42.504025 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:42.489923 14894 rpcz_store.cc:276] 0709 13:18:41.173428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.173545 (+   117us) service_pool.cc:224] Handling call
0709 13:18:41.173979 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.174464 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:41.614971 (+440507us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.076687 (+461716us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.110184 (+ 33497us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.110389 (+   205us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:42.110775 (+   386us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.459415 (+348640us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b18003da680. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287
0709 13:18:42.459599 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.459687 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.473027 (+ 13340us) raft_consensus.cc:1685] finished
0709 13:18:42.473059 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.473267 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71427,"prepare.queue_time_us":569914,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":75,"raft.queue_time_us":151743,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":43594,"spinlock_wait_cycles":10177408,"thread_start_us":973515,"threads_started":3,"wal-append.queue_time_us":585752}
I20260709 13:18:42.515280 17101 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:42.512152 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:42.517109 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 138081us
I20260709 13:18:42.518740 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:42.519860 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:42.497395 14864 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:42.521826 14374 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.522434 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:42.521618 14371 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:42.524796 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:42.457830 16614 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.525305 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2356) took 1299 ms. Trace:
I20260709 13:18:42.496434 17218 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:42.503433 17198 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:42.475032 17277 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:18:42.509979 17065 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:42.543120 16846 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:42.493535 16973 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:42.546934 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 707) took 1262 ms. Trace:
I20260709 13:18:42.547065 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1804) took 1282 ms. Trace:
I20260709 13:18:42.504789 17280 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.534704 17101 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:42.484937 17053 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.550911 14378 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.541496 14374 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:42.538369 17218 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:42.536692 17302 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.585465 14229 rpcz_store.cc:276] 0709 13:18:41.284503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.284653 (+   150us) service_pool.cc:224] Handling call
0709 13:18:41.289428 (+  4775us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.307406 (+ 17978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.307436 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.336281 (+ 28845us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.753295 (+417014us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:41.753356 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.753474 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.546665 (+793191us) raft_consensus.cc:1685] finished
0709 13:18:42.546688 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.546860 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22920,"raft.queue_time_us":25239,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4056,"thread_start_us":381175,"threads_started":1,"wal-append.queue_time_us":694644}
W20260709 13:18:42.595209 16718 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.002s
I20260709 13:18:42.585646 14221 rpcz_store.cc:276] 0709 13:18:41.264686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.264991 (+   305us) service_pool.cc:224] Handling call
0709 13:18:41.275206 (+ 10215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.275615 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.275648 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.276143 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.611643 (+335500us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:41.611695 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.611762 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.546851 (+935089us) raft_consensus.cc:1685] finished
0709 13:18:42.546871 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.547003 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8021,"raft.queue_time_us":1664,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":22161,"thread_start_us":333228,"threads_started":1,"wal-append.queue_time_us":762151}
I20260709 13:18:42.532994 14300 rpcz_store.cc:276] 0709 13:18:41.226360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.226525 (+   165us) service_pool.cc:224] Handling call
0709 13:18:41.259330 (+ 32805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.259784 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.259817 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.260269 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.735293 (+475024us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:41.735351 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.735448 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.525107 (+789659us) raft_consensus.cc:1685] finished
0709 13:18:42.525129 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.525252 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1707,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":9228,"thread_start_us":474563,"threads_started":1,"wal-append.queue_time_us":784646}
I20260709 13:18:42.518849 17300 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:42.500623 17276 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.519991 17262 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:42.604735 17281 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:18:42.537911 17200 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:18:42.608655 17006 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.611689 17053 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:42.612227 14222 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:42.614418 17290 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.616425 17306 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:42.618291 17295 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:42.493762 17161 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:18:42.637418 14369 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:42.589571 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:42.640218 14378 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
W20260709 13:18:42.621729 17305 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:42.642093 17300 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:42.657884 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 199342us
I20260709 13:18:42.651865 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:42.646570 17231 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:42.600538 17101 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:42.637347 17196 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:42.646462 17251 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:18:42.644490 17262 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.594875 16889 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:18:42.648455 17200 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:42.639307 17302 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.550091 17188 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:18:42.722869 17101 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:42.712122 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:42.711288 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 121865us
I20260709 13:18:42.646654 17276 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:42.724936 17196 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:42.735787 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:42.641759 14895 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 3.
W20260709 13:18:42.724040 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.654023 16718 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.717855 17189 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.714390 17300 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.596221 17280 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:42.727366 17087 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 13:18:42.673401 17290 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:42.702626 17065 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.721259 14898 raft_consensus.cc:2376] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6. Re-sending same reply.
I20260709 13:18:42.279498 14892 rpcz_store.cc:276] 0709 13:18:41.073976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.074692 (+   716us) service_pool.cc:224] Handling call
0709 13:18:41.103283 (+ 28591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.103863 (+   580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.103909 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.211385 (+107476us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b2c0010c018. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb985a11 00007f8deb995372 00007f8ded0c7a01 00007f8ded08c43a 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2
0709 13:18:41.211830 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.609091 (+397261us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:42.149383 (+540292us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.167191 (+ 17808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.182124 (+ 14933us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.219896 (+ 37772us) raft_consensus.cc:1685] finished
0709 13:18:42.226860 (+  6964us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.238357 (+ 11497us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30370,"prepare.queue_time_us":130015,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":25,"raft.queue_time_us":115728,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":5947,"spinlock_wait_cycles":140189056,"thread_start_us":812006,"threads_started":2,"wal-append.queue_time_us":917441}
I20260709 13:18:42.738482 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:42.749161 17196 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.733436 17302 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.723439 17218 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:42.743970 16746 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:42.744902 16614 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:42.745461 17243 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:42.752332 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.728713 17262 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.730340 17200 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:42.757268 14864 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:42.774878 17065 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.783154 16718 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:42.786057 14375 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:42.787230 17200 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:42.788326 17200 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.789664 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:42.790405 14229 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:42.790441 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:42.793642 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:42.794579 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 1800) took 1533 ms. Trace:
I20260709 13:18:42.795007 14228 rpcz_store.cc:276] 0709 13:18:41.244805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.246833 (+  2028us) service_pool.cc:224] Handling call
0709 13:18:42.776644 (+1529811us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540033de54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:42.778241 (+  1597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834667776}
I20260709 13:18:42.796301 14224 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:18:42.759169 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 194730us
I20260709 13:18:42.739128 17318 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:42.761395 17058 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:42.798309 17209 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.753758 17032 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.800567 17209 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:42.801704 16614 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:42.798400 16746 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.762490 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:42.805409 17101 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.806135 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:42.806552 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 44130.6us
I20260709 13:18:42.807350 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:42.807814 14898 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:42.808471 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:42.809033 17053 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:42.809197 14898 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:42.754660 17189 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.758690 17290 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.810005 17189 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:42.811007 17286 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.511s	user 0.000s	sys 0.002s
I20260709 13:18:42.775331 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:42.812121 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2120) took 1012 ms. Trace:
I20260709 13:18:42.812305 17276 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.812845 17276 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:42.813460 17276 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.813987 17058 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.814428 17058 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:42.814806 17058 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.776391 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:42.817337 14895 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:42.778254 17218 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.759943 17087 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:42.819753 17087 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:42.755090 17245 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.820995 17198 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.775561 16921 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.821573 17198 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.821947 17006 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:42.823393 16921 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:42.812553 14377 rpcz_store.cc:276] 0709 13:18:41.799676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.799810 (+   134us) service_pool.cc:224] Handling call
0709 13:18:42.811895 (+1012085us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54000609d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:42.812029 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360324992}
I20260709 13:18:42.823810 17198 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:42.814828 17248 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.000s
I20260709 13:18:42.821837 17245 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:42.825162 17248 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.802954 17209 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:42.826342 14373 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:42.828029 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:42.828558 14225 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:42.797485 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:42.837906 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.838066 14864 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:42.839174 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:42.842909 17302 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.845403 17302 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:42.845988 16746 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:42.846257 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:42.846083 17276 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:42.848912 17276 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:42.856238 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:42.856843 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:42.857241 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:42.855597 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:42.858968 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:42.860345 14378 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:42.861052 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:42.861644 14374 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.863265 14864 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:42.867491 14374 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:42.874684 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:42.875303 14377 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:42.874432 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:42.879418 14376 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:42.856251 17318 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.798444 16718 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:18:42.890021 17196 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.857138 17163 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:42.862113 17245 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:42.872766 16746 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:42.906572 17245 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:42.906692 16746 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.906906 17198 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.907091 17245 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.907248 16746 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.907482 17198 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.878810 17190 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.910317 17190 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:42.912401 17190 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:42.880731 17161 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:42.878643 16614 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:42.914292 16614 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.885782 14225 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:42.872931 17065 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:18:42.891538 17231 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:42.882321 17093 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:42.861706 17276 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:42.862205 17295 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:42.878635 17214 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:42.919121 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:42.861630 17087 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:42.873725 17302 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:42.861845 16921 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:42.897048 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 494) took 2937 ms. Trace:
I20260709 13:18:42.878248 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:42.925182 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:42.918195 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:42.856886 17217 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:18:42.861479 17006 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:18:42.849310 17262 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:42.936659 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 81125.7us
I20260709 13:18:42.915197 17231 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.934043 17214 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.978890 14226 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.923769 17101 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:42.934161 17188 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:42.995801 17188 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.998696 17188 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:43.001106 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:43.002066 14220 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:42.939255 17276 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.914734 16614 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.979952 16921 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:42.932324 17265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.000s	sys 0.006s
I20260709 13:18:42.981104 14304 rpcz_store.cc:276] 0709 13:18:39.959991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.037616 (+ 77625us) service_pool.cc:224] Handling call
0709 13:18:40.062318 (+ 24702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.607350 (+1545032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.896713 (+1289363us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54001a0ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:42.896960 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3527340800}
I20260709 13:18:42.932199 16746 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:42.937004 17320 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:18:42.935972 17053 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:43.044235 14224 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
W20260709 13:18:42.986474 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 108337us
I20260709 13:18:42.914544 17196 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:42.926532 17281 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.994598 17289 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:43.022058 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 140231us
I20260709 13:18:43.060668 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:43.044250 17265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.000s	sys 0.008s
I20260709 13:18:43.038789 17093 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:43.057298 16746 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:18:42.985172 17087 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:42.937747 17058 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:43.086925 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 168832us
W20260709 13:18:43.233337 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 172792us
I20260709 13:18:43.208721 16614 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:43.234325 14114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8c137013238f4b1dbae260e32cb316dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9b2cf49ceed478480fb0f27ccf55d81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:18:43.225028 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.235163 17058 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.235965 16614 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:43.100941 17280 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:43.236939 14192 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.100s (SENT) [suppressed 15 similar messages]
I20260709 13:18:43.237246 14227 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:43.237970 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:43.238049 17245 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.239281 17280 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:43.083468 17281 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.241401 17245 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.091116 17289 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:43.242347 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.235950 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:43.244120 17093 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.244709 17109 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:43.242938 17289 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.248282 17109 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:43.248912 17109 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:43.092823 17233 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.261s
I20260709 13:18:43.054358 17115 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:43.011118 17214 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:43.184587 14377 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:43.057371 17276 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.200416 14226 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:43.273672 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:43.282528 17218 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:43.294343 17218 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:43.294080 17109 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.295073 17218 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:43.296581 17109 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:43.296512 17218 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.299738 17262 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.303757 17087 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:43.310736 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:43.318724 16921 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:43.322109 17337 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:43.292836 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:43.322929 17337 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.323889 17109 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:43.324442 17109 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:43.325412 17337 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:43.325280 17109 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.325321 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:43.327138 17290 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
W20260709 13:18:43.208179 17327 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:18:43.224375 17295 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:43.328315 16921 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.329159 17087 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:43.332935 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:43.355783 14223 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:43.336594 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.117830 17248 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:43.368757 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.339558 17189 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.000s
I20260709 13:18:43.359118 17295 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.360010 17281 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:43.361913 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.376267 17337 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:43.394181 17189 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.396121 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 713) took 1317 ms. Trace:
I20260709 13:18:43.396711 14222 rpcz_store.cc:276] 0709 13:18:42.079185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.080308 (+  1123us) service_pool.cc:224] Handling call
0709 13:18:42.111457 (+ 31149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.656460 (+545003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.395774 (+739314us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54002779d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:43.396044 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151236864}
I20260709 13:18:43.411501 14223 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:43.082610 17300 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.340669 17115 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:43.422317 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:43.427525 14223 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
W20260709 13:18:43.428067 14344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.575s	user 0.014s	sys 0.017s
W20260709 13:18:43.428414 14344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.575s	user 0.014s	sys 0.017s
I20260709 13:18:43.381103 16921 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:43.428997 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 2.57633e+06us
I20260709 13:18:43.430611 16921 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.431440 17283 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:43.431667 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:43.431916 17283 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:43.432497 14222 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:43.432852 17283 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.398245 17189 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:43.389521 17087 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.391750 17337 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.340286 17290 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.450815 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:42.683872 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:43.463533 14220 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:43.466470 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:43.469178 17115 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.470399 17290 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:43.470880 17295 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:43.471135 17035 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:43.472055 14226 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:43.472916 17307 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.930s	user 0.001s	sys 0.000s
W20260709 13:18:43.474681 17284 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.931s	user 0.000s	sys 0.001s
I20260709 13:18:43.475607 17337 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:43.476223 17242 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:43.476711 17242 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.477587 17087 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.478488 17300 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.482118 17248 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:43.482275 17198 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.485561 17337 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.486922 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57234.4us
I20260709 13:18:43.500249 14344 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:18:43.468075 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46629.5us
I20260709 13:18:43.501348 14220 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:43.502254 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:43.505319 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:43.514837 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:43.515815 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:43.516989 14344 leader_election.cc:400] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6.
I20260709 13:18:43.517429 14344 leader_election.cc:403] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:43.509876 17198 raft_consensus.cc:2764] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:43.524298 14220 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
W20260709 13:18:43.524744 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 104719us
I20260709 13:18:43.525746 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:43.512107 17087 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:43.514835 17189 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:43.503545 17214 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.485404 17283 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:43.519279 16614 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:43.519935 17282 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.530088 17248 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6.
I20260709 13:18:43.543895 17189 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:43.557464 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:43.505622 17337 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.553824 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:43.511895 17295 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:43.532859 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 816) took 1758 ms. Trace:
I20260709 13:18:43.518324 17093 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:18:43.538830 17087 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:43.518180 16921 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:18:43.560837 14893 rpcz_store.cc:276] 0709 13:18:41.774548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.120539 (+345991us) service_pool.cc:224] Handling call
0709 13:18:42.152152 (+ 31613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.245254 (+ 93102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.532514 (+1287260us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b54004c0ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:43.532781 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124746496}
I20260709 13:18:43.563140 16848 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:43.566907 17248 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:43.584908 16848 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:43.567092 17295 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:43.586074 17295 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:43.586632 17295 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:43.585923 16848 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.589257 16848 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:43.574756 17298 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:43.575699 17087 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:43.560453 17282 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:43.602651 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.604012 16825 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:43.604619 16825 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:43.604794 17189 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.605299 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:43.605965 14221 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:43.606124 17189 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:43.567725 17331 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:43.610023 17331 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:43.579792 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2343) took 1883 ms. Trace:
I20260709 13:18:43.611229 14298 rpcz_store.cc:276] 0709 13:18:41.696568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.700835 (+  4267us) service_pool.cc:224] Handling call
0709 13:18:41.701226 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.486686 (+785460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.579514 (+1092828us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b5400154ad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:43.579723 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772035840}
I20260709 13:18:43.613508 14867 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:43.604125 17282 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:43.615571 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61902.8us
I20260709 13:18:43.617139 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.620729 14295 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:18:43.621479 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.619607 14344 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:43.630837 14298 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:43.634089 17332 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.634893 17332 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.636543 17243 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.637197 17243 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.638747 17332 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.639386 17332 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:43.639498 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.560642 16614 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:43.655387 16614 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.645401 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.658357 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.653110 17243 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.641696 17032 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:43.649574 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.653543 14300 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.660789 14298 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:43.654134 14222 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:43.659047 14297 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:43.658546 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.632067 17300 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:43.664247 17331 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.665143 17300 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.647171 17262 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:43.605656 16825 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.667192 17262 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:43.668210 17248 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:43.669322 17300 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.669988 17295 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.665616 17331 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:43.675307 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:43.681496 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.682996 14295 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:43.695447 14303 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:43.685278 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.659467 17032 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.705997 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.708026 14223 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.713426 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.714927 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.715570 14297 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
W20260709 13:18:43.710958 17231 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.689s	user 0.015s	sys 0.000s
I20260709 13:18:43.708393 17032 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:43.675630 17332 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:43.747225 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.729928 17231 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:43.755697 17274 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.589s	user 0.000s	sys 0.003s
I20260709 13:18:43.757198 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 797) took 2665 ms. Trace:
I20260709 13:18:43.757579 14901 rpcz_store.cc:276] 0709 13:18:41.091697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.091836 (+   139us) service_pool.cc:224] Handling call
0709 13:18:41.298573 (+206737us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:41.298838 (+   265us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:41.299329 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.299369 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:41.300130 (+   761us) log.cc:844] Serialized 52 byte log entry
0709 13:18:41.755261 (+455131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:41.756314 (+  1053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.756408 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.755092 (+1998684us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:43.756925 (+  1833us) raft_consensus.cc:1685] finished
0709 13:18:43.756944 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.757099 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":208319104,"thread_start_us":454518,"threads_started":1,"wal-append.queue_time_us":815076}
W20260709 13:18:43.761005 14372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2114) took 1973 ms (client timeout 2100 ms). Trace:
I20260709 13:18:43.765883 17334 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:43.766415 17334 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:43.767601 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1856) took 1462 ms. Trace:
I20260709 13:18:43.767344 17334 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.768010 14375 rpcz_store.cc:276] 0709 13:18:42.304934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.306144 (+  1210us) service_pool.cc:224] Handling call
0709 13:18:42.785883 (+479739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.786505 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.767394 (+980889us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54003c05d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:43.767541 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077737216}
I20260709 13:18:43.768559 17334 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.773720 17087 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.778738 17295 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:43.741357 14297 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.785681 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.800348 14298 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:18:43.761497 14372 rpcz_store.cc:269] 0709 13:18:41.787305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.788842 (+  1537us) service_pool.cc:224] Handling call
0709 13:18:43.760779 (+1971937us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54001c9dd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:43.760928 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775484288}
I20260709 13:18:43.790320 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:43.804556 16848 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:43.808724 17343 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:18:43.810465 17344 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:18:43.810756 17350 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:43.815042 17242 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.816195 14225 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:43.817296 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:43.817454 17242 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:43.823065 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.845479 14374 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:43.818562 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:43.846015 14374 pending_rounds.cc:85] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 3
I20260709 13:18:43.846313 14374 pending_rounds.cc:107] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:43.846526 14298 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:43.838191 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:43.839318 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:43.848053 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.848338 14377 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:43.848723 14298 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:43.846549 14374 raft_consensus.cc:2889] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.849658 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.850399 14295 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:18:43.827180 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.851676 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.852263 14295 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:43.852586 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:43.855026 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.855914 14301 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
W20260709 13:18:43.856464 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.818310 14220 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:43.818924 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:43.857522 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:43.837201 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:43.858160 14900 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:43.858234 14372 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:43.781525 17263 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.739s	user 0.000s	sys 0.003s
I20260709 13:18:43.862865 14894 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:43.868185 14220 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.841509 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:43.821450 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:43.870791 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.873699 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:43.874745 14374 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:43.871471 14295 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:43.876200 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.877039 14298 raft_consensus.cc:2410] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:43.878721 14894 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:43.880188 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 58810.7us
I20260709 13:18:43.880960 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:43.883194 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:43.887097 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.887830 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.888222 14304 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:43.889119 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:43.889940 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 230490us
I20260709 13:18:43.890103 14899 raft_consensus.cc:2410] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:18:43.891348 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:43.892280 14375 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:43.896114 14374 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:43.903239 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.903451 14893 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:43.904994 14370 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:43.908655 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:43.915192 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:43.822407 16718 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:43.833096 16825 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.918231 14296 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:43.918957 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:43.927398 14894 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:43.919888 14344 leader_election.cc:400] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5.
I20260709 13:18:43.920660 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2338) took 3265 ms. Trace:
I20260709 13:18:43.929073 14344 leader_election.cc:403] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:43.929128 14299 rpcz_store.cc:276] 0709 13:18:40.655415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.756415 (+101000us) service_pool.cc:224] Handling call
0709 13:18:40.756718 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.841899 (+ 85181us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:41.537527 (+695628us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.252592 (+715065us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.252671 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:42.252742 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.920434 (+1667692us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b54000fc8d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:43.920482 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.920602 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":220518,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":118275,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":16854,"spinlock_wait_cycles":195221760,"thread_start_us":1356029,"threads_started":3,"wal-append.queue_time_us":656060,"wal-append.run_cpu_time_us":1181,"wal-append.run_wall_time_us":1001185}
I20260709 13:18:43.905428 14370 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:43.819011 17337 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.922878 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.868335 16614 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.935243 14295 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:43.923527 14301 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:18:43.936043 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.939123 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:43.937047 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:43.924314 14372 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:43.819641 17231 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.820078 17214 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:43.825835 17006 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.822611 17335 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:18:43.821179 17332 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:43.857405 17283 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:43.933964 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:43.936686 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:43.937863 14900 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:43.945554 16822 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5.
I20260709 13:18:43.972781 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:43.924465 14225 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:43.887162 17035 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.945940 14301 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:43.944744 14377 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:43.947065 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.976402 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.948562 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.820875 17290 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:18:43.906481 17277 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:43.950892 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:43.919430 17276 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:43.919749 17115 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:43.904654 17306 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:43.953647 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:43.831171 17065 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:18:43.958578 14372 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:43.949632 14370 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:43.994016 14370 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:43.926398 17242 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:43.998194 17242 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.926007 16718 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:43.961596 14893 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:43.944061 14897 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:43.972998 14374 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:18:44.007447 14374 pending_rounds.cc:85] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 2
I20260709 13:18:44.007818 14374 pending_rounds.cc:107] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:44.008128 14374 raft_consensus.cc:2889] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:43.945627 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55011us
I20260709 13:18:43.983071 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:44.011389 14898 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:43.934527 17199 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:18:44.019402 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:44.019980 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 1810) took 1231 ms. Trace:
I20260709 13:18:44.020506 14227 rpcz_store.cc:276] 0709 13:18:42.788666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.790169 (+  1503us) service_pool.cc:224] Handling call
0709 13:18:44.019708 (+1229539us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54002bcfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:44.019900 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1025600768}
I20260709 13:18:43.952198 16614 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.980852 17277 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.031682 14302 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:44.034164 14894 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.040156 14300 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:43.988951 17276 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:44.065723 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:43.987536 17115 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:44.087865 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:44.090488 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 723) took 1171 ms. Trace:
I20260709 13:18:43.976046 17248 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:18:43.969763 17283 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.093272 14374 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:44.094486 14295 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:44.093184 14229 rpcz_store.cc:276] 0709 13:18:42.919205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.919558 (+   353us) service_pool.cc:224] Handling call
0709 13:18:42.919968 (+   410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:43.260811 (+340843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.260840 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:43.330243 (+ 69403us) log.cc:844] Serialized 52 byte log entry
0709 13:18:43.524475 (+194232us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:43.732104 (+207629us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b1800262780. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:18:44.068598 (+336494us) log.cc:844] Serialized 14 byte log entry
0709 13:18:44.068868 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.068966 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.069018 (+    52us) raft_consensus.cc:1685] finished
0709 13:18:44.090277 (+ 21259us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.090430 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46571,"prepare.queue_time_us":217373,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":70026,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":28424,"spinlock_wait_cycles":6227200,"thread_start_us":862280,"threads_started":3,"wal-append.queue_time_us":223093}
I20260709 13:18:43.963891 17006 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:43.985208 17035 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.105540 17035 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:44.113466 16614 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:44.116510 17006 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:44.122362 17358 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:44.122948 17358 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:44.064783 17277 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.101655 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:44.091010 17276 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.097589 17115 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.142369 14374 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:44.155519 14894 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:44.111303 17032 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.016573 17306 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.166543 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:44.167367 14374 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
W20260709 13:18:44.173918 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.164964 17109 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.032s	sys 0.034s
I20260709 13:18:44.175608 14899 raft_consensus.cc:2368] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6.
I20260709 13:18:44.163103 16822 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:44.182462 14374 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:44.158418 17242 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:44.182596 17109 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.032s	sys 0.034s
I20260709 13:18:44.173629 17087 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:44.180330 17006 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:44.241776 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 355284us
W20260709 13:18:44.233882 17361 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:18:44.139183 16718 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:44.236963 16822 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:44.253316 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:44.259357 14893 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
W20260709 13:18:44.261216 14226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.015s	sys 0.049s
W20260709 13:18:44.262220 14226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.016s	sys 0.049s
I20260709 13:18:44.246560 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:44.294754 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.276458 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 377008us
I20260709 13:18:44.296727 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:44.306289 14372 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:44.298236 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:44.246969 17335 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:44.168104 17358 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:44.310146 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:44.275776 16718 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.293042 16973 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.310765 14377 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:44.319253 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.321416 14226 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:44.322886 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.252895 17006 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.328016 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:44.331670 17321 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.621s	user 0.004s	sys 0.000s
I20260709 13:18:44.335666 17281 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.339352 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:44.343169 14225 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:44.351958 16822 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:44.358566 17306 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:44.303889 17035 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:18:44.320698 16973 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.391856 16973 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.320421 17335 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.377946 17306 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.378585 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.380548 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:44.383368 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.407579 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:44.414875 14897 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.384588 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:44.408226 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:44.418251 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.417675 14371 raft_consensus.cc:2368] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4.
I20260709 13:18:44.387547 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:44.421626 14377 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:44.405781 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.424818 14341 connection.cc:256] RPC call timeout handler was delayed by -1.0336658020000868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
I20260709 13:18:44.425971 14226 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:44.389139 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:44.427928 14378 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:44.389699 17032 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:44.431834 14304 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:44.432255 14304 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:44.423471 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:44.433022 14220 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.434998 14228 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:44.388504 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:44.438151 14376 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.406700 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:44.440240 14895 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:44.407358 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:44.413275 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:44.441731 14295 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:44.418505 14896 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.385906 17006 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:44.386183 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:44.444685 14369 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:44.445526 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:44.446171 14369 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.447160 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:44.448084 14371 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 6: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:44.450374 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:44.391876 17035 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:44.453091 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:44.430785 14225 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:44.461741 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:44.464233 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.464730 17379 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.465267 14228 raft_consensus.cc:2368] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6.
I20260709 13:18:44.457453 14304 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:44.465595 17379 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:44.466424 14304 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.468575 17379 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:44.470501 17371 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:44.472684 14896 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
W20260709 13:18:44.544435 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.473423 14304 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:44.425705 14341 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:44.474292 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.451278 14378 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:44.420563 17306 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.456374 14897 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:44.488952 14220 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:44.500875 14377 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:18:44.487691 14225 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:44.504611 14371 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:44.515791 17356 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.539s	user 0.001s	sys 0.000s
I20260709 13:18:44.505978 17373 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.519392 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:44.457985 17035 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:44.520674 17281 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:44.527729 17283 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:44.530154 16825 consensus_meta.cc:287] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.004s
I20260709 13:18:44.531555 17337 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:44.423707 17276 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:44.004015 17231 consensus_queue.cc:1175] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bee4f7fc1b4740dc875537c79309664f" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:44.536055 17115 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.538291 17358 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.540308 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2130) took 2017 ms. Trace:
W20260709 13:18:44.527817 17334 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.759s	user 0.014s	sys 0.006s
I20260709 13:18:44.545451 14297 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:44.545480 14295 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:44.545876 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.553610 14369 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:44.555847 14228 raft_consensus.cc:1217] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 13:18:44.522848 17335 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:44.568059 17262 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.594672 17262 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.597288 17262 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:44.568209 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 142616us
I20260709 13:18:44.570938 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:44.598593 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:44.598755 14378 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:44.599756 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:44.601291 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:44.601465 14378 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:44.572937 14371 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:44.602646 14378 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:44.602833 17358 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:44.603215 14371 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:44.573685 17035 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.579969 14373 rpcz_store.cc:276] 0709 13:18:42.522764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.522924 (+   160us) service_pool.cc:224] Handling call
0709 13:18:42.543898 (+ 20974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.826725 (+282827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.540032 (+1713307us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002ec054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:44.540230 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649133440}
I20260709 13:18:44.589514 14228 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:44.561714 14376 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
W20260709 13:18:44.606376 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.593354 14295 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:44.569499 14304 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:44.571933 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:44.573385 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 54103us
I20260709 13:18:44.614579 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:44.591895 14369 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:44.581138 14222 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:44.630324 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.631270 14220 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:44.631461 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:44.628018 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:44.640563 14225 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:44.646250 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:44.649703 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:44.603387 17358 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:44.602643 17262 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:44.652657 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 403542us
I20260709 13:18:44.655596 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.666662 14220 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:18:44.666673 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.668975 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:44.673168 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.678136 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.679076 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:44.683228 14226 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.680001 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.573544 17087 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:44.696424 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:44.686878 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:44.706230 14220 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.701268 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.579672 17115 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:44.572666 17306 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:44.574684 17337 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:44.718634 14223 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:44.719687 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.703619 14224 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:44.642792 16718 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:44.576953 17276 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:44.720321 14221 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:44.722803 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:44.655025 16825 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.582362 17198 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:18:44.654606 16848 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:44.655309 17035 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.582857 17248 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:18:44.589449 17277 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:44.713428 17280 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.055s	sys 0.071s
I20260709 13:18:44.704665 17214 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:44.655045 17245 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 13:18:44.694830 17262 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:44.750082 14220 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:44.752002 14226 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:44.572662 17373 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:44.654893 16921 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:18:44.704334 17325 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:18:44.634812 17315 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:18:44.769245 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.772468 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:44.803081 14226 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:44.775763 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:44.708022 17378 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:44.702915 17125 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:18:44.703202 17335 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:18:44.801568 14225 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: [5.4-8.5]
W20260709 13:18:44.765374 17280 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.056s	sys 0.072s
I20260709 13:18:44.714510 17006 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:18:44.807449 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:44.754530 16848 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:44.721709 17379 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:18:44.841028 14370 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:44.837719 14226 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:44.749011 17242 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:18:44.743588 17376 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:44.755505 17087 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.845096 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.769966 17115 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:44.849543 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.758493 17214 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.848671 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:44.856540 14226 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:44.850044 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.017s	sys 0.032s
W20260709 13:18:44.862862 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.017s	sys 0.032s
W20260709 13:18:44.863585 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 553517us
I20260709 13:18:44.805599 17378 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:44.867115 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:44.870939 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:44.871604 14897 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:44.871914 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57951.4us
I20260709 13:18:44.843957 17276 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:44.808384 17262 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.874202 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:44.889372 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:44.769553 17383 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
W20260709 13:18:44.915413 14375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.022s	sys 0.018s
W20260709 13:18:44.915786 14375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.022s	sys 0.018s
I20260709 13:18:44.915553 14896 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
W20260709 13:18:44.855569 14900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.080s	sys 0.104s
I20260709 13:18:44.886946 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:44.909808 14894 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:44.911096 14899 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:18:44.919019 14900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.080s	sys 0.104s
I20260709 13:18:44.919508 14893 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:44.894544 14226 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:44.850128 17245 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.862623 17214 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.914625 14895 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:44.924338 14897 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:44.924388 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:44.868481 17376 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:44.937162 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:44.938578 14372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.015s	sys 0.032s
I20260709 13:18:44.938658 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:44.944264 14372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.015s	sys 0.032s
I20260709 13:18:44.869671 17378 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.949527 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:44.920004 17298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.008s	sys 0.042s
W20260709 13:18:44.950219 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 497381us
I20260709 13:18:44.954170 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:44.956058 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:44.966346 14114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8c137013238f4b1dbae260e32cb316dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9b2cf49ceed478480fb0f27ccf55d81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:44.956457 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.967707 14223 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 4: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:44.868315 17115 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.961771 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:44.869378 17289 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:18:44.926419 17227 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:44.979919 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.980938 14220 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:44.864670 17087 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.870977 16973 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.988101 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:44.872455 17384 raft_consensus.cc:2764] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:44.841629 17337 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:44.817317 17358 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.917872 17276 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:44.977458 17298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.008s	sys 0.042s
I20260709 13:18:44.978215 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:44.978797 14900 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:44.951182 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:45.007572 14867 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:44.986402 14893 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:44.993194 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:44.993520 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:44.951009 17245 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:44.995957 14226 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:44.997529 14227 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:44.998222 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:45.000677 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:45.007723 14899 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:45.071653 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:45.072255 17382 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:45.072824 17382 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.073226 14899 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:45.075619 14222 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:45.080516 14894 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:45.011775 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:45.084579 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79761us
I20260709 13:18:45.085085 14901 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:44.999094 17379 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:44.989475 16889 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.091s
W20260709 13:18:45.094125 17233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.006s	sys 0.034s
I20260709 13:18:45.079391 17337 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:45.098428 14892 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.644s	user 0.013s	sys 0.000s
W20260709 13:18:45.100243 17380 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.339s	user 0.001s	sys 0.003s
I20260709 13:18:45.095949 17298 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:44.988535 16848 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:45.123906 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.114806 17233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.006s	sys 0.034s
I20260709 13:18:45.108659 17277 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:45.132869 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 455739us
I20260709 13:18:45.123535 17163 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.129088 16822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.032s	sys 0.024s
W20260709 13:18:45.140954 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.124475 14892 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:45.129375 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:45.134819 17032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.013s	sys 0.023s
W20260709 13:18:45.147035 14864 leader_election.cc:336] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.636s (SENT)
W20260709 13:18:45.137842 17220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.021s	sys 0.015s
W20260709 13:18:45.151959 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 469667us
I20260709 13:18:45.150697 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:45.149484 14341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.015s	sys 0.022s
W20260709 13:18:45.154772 14341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.015s	sys 0.022s
W20260709 13:18:45.134352 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 477818us
W20260709 13:18:45.156327 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 555051us
I20260709 13:18:45.156893 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:45.158464 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:45.143905 16822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.032s	sys 0.025s
I20260709 13:18:45.143936 17298 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:45.176052 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:18:45.154647 17220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.021s	sys 0.016s
W20260709 13:18:45.151425 17032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.013s	sys 0.024s
W20260709 13:18:45.186868 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.100952 17376 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.162302 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 808) took 1271 ms. Trace:
I20260709 13:18:45.145155 17163 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.133908 17276 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.182605 17390 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:45.207504 17373 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:45.188680 17332 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:18:45.205406 17220 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:18:45.210845 17087 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:45.213044 16973 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:45.216185 17198 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:45.231345 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.222657 17387 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 13:18:45.261406 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 305454us
I20260709 13:18:45.222143 17245 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:45.205729 14892 rpcz_store.cc:276] 0709 13:18:43.882516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.914349 (+ 31833us) service_pool.cc:224] Handling call
0709 13:18:44.380366 (+466017us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:45.153470 (+773104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9049984}
I20260709 13:18:45.265523 14193 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:45.234735 17198 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:18:45.275615 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.218600 17384 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:18:45.317042 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.323945 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:45.341872 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:45.323057 14296 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:45.322654 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:45.355648 14298 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:45.261698 17399 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:45.358402 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:45.323452 14297 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:45.324658 14299 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:45.324258 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:45.316653 17392 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:18:45.332021 17233 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.373836 17233 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:45.326299 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.332976 17334 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:45.308238 17388 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.317s	user 0.002s	sys 0.000s
W20260709 13:18:45.278474 17396 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:45.267107 17400 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:45.275399 17277 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:45.286545 17393 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:18:45.314774 17035 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.000s
I20260709 13:18:45.369592 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:45.378744 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 202791us
I20260709 13:18:45.275799 17379 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
W20260709 13:18:45.407764 14864 leader_election.cc:336] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.887s (SENT)
I20260709 13:18:45.344844 17058 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:45.420213 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2139) took 1037 ms. Trace:
I20260709 13:18:45.420820 14372 rpcz_store.cc:276] 0709 13:18:44.382994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.383777 (+   783us) service_pool.cc:224] Handling call
0709 13:18:44.384254 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.384622 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.384655 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.385173 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.955243 (+570070us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:44.955294 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.955370 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.419932 (+464562us) raft_consensus.cc:1685] finished
0709 13:18:45.419964 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.420152 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3719,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":558995,"threads_started":1,"wal-append.queue_time_us":780810}
I20260709 13:18:45.342084 17389 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.324141 17248 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:45.381837 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 221604us
W20260709 13:18:45.388665 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.016s	sys 0.016s
W20260709 13:18:45.432340 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.016s	sys 0.016s
W20260709 13:18:45.432788 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 821830us
I20260709 13:18:45.306178 17408 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:18:45.393705 14295 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:45.280544 17306 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:45.318028 17163 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:45.337889 17220 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:45.317461 17227 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:45.407160 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.266764 17373 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 13:18:45.228353 17298 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.273550 17315 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
W20260709 13:18:45.379680 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 198412us
I20260709 13:18:45.411106 14299 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:45.273097 17087 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 13:18:45.440708 17248 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.458925 17087 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:45.413898 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:45.459805 17248 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:45.460626 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 52892.3us
I20260709 13:18:45.461043 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:45.461627 14302 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.415427 17404 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:45.464932 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:45.416159 17382 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:45.416987 17290 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:45.368263 17325 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:18:45.434208 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.314086 17199 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:45.380643 17399 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.420655 14270 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:45.446957 17407 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:45.432346 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:45.405301 17125 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:45.443943 14221 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:45.443907 17306 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.410086 17277 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.447014 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:45.376763 17334 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.445188 14224 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:45.419480 17058 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:45.463284 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:45.463874 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:45.448500 16825 consensus_meta.cc:287] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.704s	user 0.009s	sys 0.004s
I20260709 13:18:45.470085 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:45.407650 17262 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.445227 17227 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.470780 14369 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:45.466708 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:45.475014 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54442.9us
I20260709 13:18:45.434767 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:45.536612 14297 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:45.477392 14299 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:45.538048 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:45.538793 14299 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:45.464936 17163 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:45.484546 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:45.490052 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2140) took 1106 ms. Trace:
I20260709 13:18:45.557961 14375 rpcz_store.cc:276] 0709 13:18:44.383380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.386621 (+  3241us) service_pool.cc:224] Handling call
0709 13:18:44.386958 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.387300 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.387327 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.387812 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.916156 (+528344us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:44.916196 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.916263 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.489822 (+573559us) raft_consensus.cc:1685] finished
0709 13:18:45.489842 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.489987 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1294,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"thread_start_us":527949,"threads_started":1,"wal-append.queue_time_us":815557}
I20260709 13:18:45.440107 17389 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.492182 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:45.470793 17290 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:45.561396 17282 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:45.523088 14192 leader_election.cc:336] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.100s (SENT)
I20260709 13:18:45.562558 17282 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:45.562645 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:45.563081 17282 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:45.560606 17032 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:18:45.471977 17199 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:45.532560 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:45.459867 17087 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:18:45.564725 17335 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.510654 14302 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:45.502684 17277 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:45.512181 17035 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:45.478899 17382 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:18:45.492125 17125 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:45.512878 16718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.010s	sys 0.013s
W20260709 13:18:45.530382 17214 consensus_meta.cc:287] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.566s	user 0.004s	sys 0.008s
I20260709 13:18:45.490557 17379 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:18:45.847323 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.917017 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.989421 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.504510 17399 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.503162 17408 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.917140 14371 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:45.470058 17404 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.483697 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:45.564033 17282 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.562279 17290 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:45.652989 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.004182 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.533896 16825 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:45.556686 17248 consensus_queue.cc:1059] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:18:45.566298 17233 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:45.490198 17407 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.566973 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:45.529959 17051 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:18:45.474228 17325 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:45.936602 14302 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:45.936461 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 476076us
W20260709 13:18:45.934566 16848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.006s	sys 0.008s
I20260709 13:18:45.956307 17394 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
W20260709 13:18:46.042526 17378 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.075s	user 0.014s	sys 0.005s
W20260709 13:18:45.957664 17409 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.500s	user 0.002s	sys 0.007s
W20260709 13:18:45.964169 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47576us
I20260709 13:18:46.076071 14297 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:45.928422 17400 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:45.926256 17376 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.981251 14299 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:45.909121 17220 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:45.534310 17413 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:45.598397 17412 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:45.953325 17421 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.998929 14377 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.035s	sys 0.033s
W20260709 13:18:45.977680 16718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.021s	sys 0.018s
I20260709 13:18:45.929291 16921 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:18:46.057379 14341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.017s	sys 0.052s
I20260709 13:18:46.063815 14373 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
W20260709 13:18:46.107928 14341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.017s	sys 0.052s
W20260709 13:18:46.108589 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 676291us
I20260709 13:18:46.109372 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:45.948437 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 471920us
I20260709 13:18:46.067050 14372 raft_consensus.cc:1813] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Handling vote request from an unknown peer bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:46.110536 14372 raft_consensus.cc:2410] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:18:46.111918 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:46.114377 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.115087 14304 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 3.
W20260709 13:18:46.067907 14298 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.564s	user 0.013s	sys 0.000s
I20260709 13:18:45.999753 17418 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:18:45.951437 14225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.020s	sys 0.008s
I20260709 13:18:46.000092 17276 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:46.080881 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:18:46.120167 14225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.021s	sys 0.008s
I20260709 13:18:46.084517 14220 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:18:46.069242 16848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.007s	sys 0.008s
I20260709 13:18:46.062616 17290 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:45.995786 17214 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:46.097693 14377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.035s	sys 0.033s
I20260709 13:18:46.070749 17282 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.028401 17408 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:45.999383 17379 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:45.980912 17058 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.106225 17306 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.112087 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.078828 17378 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:45.994366 17199 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.133469 17417 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.089809 17413 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:46.107316 16718 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:46.106474 17262 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.084843 17428 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.155402 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:46.159714 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47716.5us
I20260709 13:18:46.116870 14298 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:46.092425 17376 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.156467 17432 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.201967 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.202900 14369 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:46.203802 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.204327 14369 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:46.164346 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 159322us
I20260709 13:18:46.162786 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.207541 14375 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:46.194406 14222 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.135689 17233 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.156725 17433 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:46.176163 17058 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:46.177364 14898 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.070s	user 0.018s	sys 0.002s
I20260709 13:18:46.110762 17443 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:18:46.106081 17421 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.222888 14222 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:46.224414 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.149446 17276 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.200349 17428 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.233543 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.220846 17233 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.239217 14375 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:46.185288 17115 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.247059 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.170522 17335 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:18:46.221050 17337 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.097s	user 0.013s	sys 0.007s
I20260709 13:18:46.250834 14375 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:46.258759 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.260438 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.261121 14375 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.233747 17276 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.134934 17418 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.263715 14369 raft_consensus.cc:2410] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:46.264611 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.265128 14369 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.265275 17418 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.242762 17125 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.240386 17214 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.226008 14898 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:18:46.241671 17379 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.239372 17233 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.236871 17376 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.235435 17428 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.176872 17417 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.234586 17433 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:46.270020 17415 raft_consensus.cc:3055] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:46.285804 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 204955us
I20260709 13:18:46.170605 17400 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:46.280519 14898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 853) took 1412 ms (client timeout 1799 ms). Trace:
I20260709 13:18:46.216251 17220 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.290158 14375 raft_consensus.cc:2410] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:46.290000 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.294854 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.296331 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.297166 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.281311 17325 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.216454 17432 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.297189 14298 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:46.298156 14375 raft_consensus.cc:2410] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:46.299182 14369 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:46.287598 17415 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:46.293242 17411 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.302850 14342 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:46.291725 14898 rpcz_store.cc:269] 0709 13:18:44.868457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.871706 (+  3249us) service_pool.cc:224] Handling call
0709 13:18:46.280432 (+1408726us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:46.293459 17399 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.301005 17404 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.316468 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:46.306263 17453 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.301920 17407 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.323704 17298 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:46.324847 17432 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:46.325920 17423 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.205s	user 0.001s	sys 0.001s
I20260709 13:18:46.326824 17434 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:46.276732 16718 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.267119 17413 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.329617 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:46.330601 14403 heartbeater.cc:646] Failed to heartbeat to 127.12.208.190:37027 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.208.190:37027 timed out after 15.000s (SENT)
I20260709 13:18:46.312996 17456 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:18:46.313802 17325 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:18:46.328410 17378 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.320595 17376 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:18:46.309885 17406 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:46.335222 17399 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:46.335693 17448 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:18:46.336324 17445 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:18:46.339219 14344 leader_election.cc:400] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6.
I20260709 13:18:46.339814 17450 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:46.340471 17434 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:46.322032 17379 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:46.378396 17379 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:46.378103 17434 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.378964 17379 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:46.380038 17379 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:46.345467 17440 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:18:46.327411 17417 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.385217 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.367126 14303 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:46.386088 14378 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 6: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:46.387007 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.387583 14378 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:46.381647 17379 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.394203 17450 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:46.394701 17450 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:46.396148 14344 leader_election.cc:403] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:46.364811 17453 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.374696 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.399453 14377 raft_consensus.cc:2376] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8. Re-sending same reply.
I20260709 13:18:46.328059 17262 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.385444 17298 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.406353 17421 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.406754 17298 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.409351 17298 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.361223 17282 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.398427 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.368055 17438 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.333745 17433 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.375463 17408 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:46.417389 17438 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.362926 17432 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.425645 17432 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.313982 17411 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:46.415320 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 76250us
I20260709 13:18:46.372762 17399 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:46.436704 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.416314 14378 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:46.420095 14192 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:46.362368 17277 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.430341 17438 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:46.432757 17437 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:18:46.455081 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.455753 14376 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:18:46.426424 17227 consensus_meta.cc:287] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.835s	user 0.012s	sys 0.005s
I20260709 13:18:46.470167 17227 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.473155 17227 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.475553 17376 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.476156 17376 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.478744 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 755) took 1037 ms. Trace:
I20260709 13:18:46.447820 17382 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:46.411470 17456 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6.
I20260709 13:18:46.449802 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.451112 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 540) took 1127 ms. Trace:
I20260709 13:18:46.452175 17411 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:46.400161 17406 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.411976 17453 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.427645 17450 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.483920 14303 rpcz_store.cc:276] 0709 13:18:45.324148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.324821 (+   673us) service_pool.cc:224] Handling call
0709 13:18:45.325163 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.385938 (+1060775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.450777 (+ 64839us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003af554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:46.451038 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2395719424}
I20260709 13:18:46.444294 17399 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.485809 14376 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:46.483996 14377 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
W20260709 13:18:46.497571 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68392.7us
I20260709 13:18:46.475433 17245 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:46.502486 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.498585 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:46.498840 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.504154 14378 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 6: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:46.500752 17245 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:46.509251 14376 raft_consensus.cc:2376] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6. Re-sending same reply.
I20260709 13:18:46.513356 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:46.514494 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.492199 17382 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:46.516340 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:46.517324 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.528003 14378 raft_consensus.cc:2376] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8. Re-sending same reply.
I20260709 13:18:46.529438 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.513532 17450 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.509712 17376 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.512872 17277 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.528537 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:46.519143 17456 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.515507 17434 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:46.515826 17298 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:46.538702 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.541049 17453 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:46.510819 17245 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.529237 17227 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.543776 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.531823 17371 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.545595 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:46.544082 17298 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.543303 17394 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:46.547171 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:46.547488 14897 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:46.545441 14378 raft_consensus.cc:2376] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8. Re-sending same reply.
I20260709 13:18:46.548777 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.550293 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.549079 14893 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:46.551901 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.551848 14344 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:46.551213 17434 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.555825 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.538501 17432 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.558900 17453 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.561949 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.568109 14377 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:46.568488 17403 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:46.569140 17403 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:46.570075 17403 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.569909 17394 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.570887 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.571753 14892 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:46.572400 17394 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.575248 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:46.542497 17433 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.588136 17433 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:46.588182 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.582653 14894 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:18:46.589066 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:46.589867 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.590994 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.591966 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:46.592903 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:46.583804 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.584184 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.593406 14894 raft_consensus.cc:2376] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4. Re-sending same reply.
I20260709 13:18:46.594410 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.595530 14894 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:46.595700 14378 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:46.598011 17432 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:46.598752 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.599100 17432 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:46.599551 17434 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.600318 17231 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.568137 17399 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.584556 14897 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:46.597303 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.574642 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.585367 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.587922 17198 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.601336 17433 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:46.549700 17245 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.611003 17433 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.612659 17383 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:46.613253 17383 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:46.584436 17298 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.602409 14899 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:46.597697 14894 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:46.609501 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.611210 17198 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.628005 17450 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.631889 17383 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.629861 17434 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:18:46.635268 14341 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.635516 17411 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:46.636371 17411 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.637953 17456 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.638187 17227 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.638615 17456 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.638778 17227 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.549901 17371 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:46.644501 17358 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.339s	user 0.013s	sys 0.016s
I20260709 13:18:46.645385 17384 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.602489 17382 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.650002 17411 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:46.651472 17431 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:46.651961 17456 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:46.652019 17431 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:46.648679 17358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.343s	user 0.013s	sys 0.017s
W20260709 13:18:46.655381 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 458402us
I20260709 13:18:46.663048 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.666306 16825 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:18:46.669085 17441 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:46.655254 16848 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:46.669607 17415 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.673591 17415 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.675982 14901 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:46.676113 17399 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.676280 17335 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:46.676779 17335 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:46.678332 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2389) took 1188 ms. Trace:
I20260709 13:18:46.678779 17227 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.679605 17371 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.678735 14302 rpcz_store.cc:276] 0709 13:18:45.490447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.069029 (+578582us) service_pool.cc:224] Handling call
0709 13:18:46.082648 (+ 13619us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:46.113568 (+ 30920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.113605 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:46.133377 (+ 19772us) log.cc:844] Serialized 52 byte log entry
0709 13:18:46.305412 (+172035us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:46.311719 (+  6307us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.678029 (+366310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.678100 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.678141 (+    41us) raft_consensus.cc:1685] finished
0709 13:18:46.678154 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.678275 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":396531,"prepare.queue_time_us":5433,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":50230,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":51,"thread_start_us":171282,"threads_started":1,"wal-append.queue_time_us":240783}
I20260709 13:18:46.681959 17400 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.682435 17400 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.683652 17441 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.684247 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.684859 14303 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
I20260709 13:18:46.685012 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.685256 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.685631 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:46.686298 14295 raft_consensus.cc:2368] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8.
I20260709 13:18:46.687621 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.687546 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.690374 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.690505 14370 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:46.677582 17335 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.695588 17405 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.696059 17418 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.695207 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.687470 17441 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.698657 17400 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.698555 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.696430 17335 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.675019 17431 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.704800 17400 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.705889 17441 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.707724 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.707914 17400 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:46.709724 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.713696 14378 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:46.723706 14377 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:46.724368 17400 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:46.724787 17400 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:46.725004 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.725528 17400 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.726783 17400 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.723124 17441 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.730041 14377 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:46.731290 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.732262 14377 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:46.733842 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:46.736006 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.722067 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.739439 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.740272 17245 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.743220 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1880) took 2505 ms. Trace:
I20260709 13:18:46.743623 14374 rpcz_store.cc:276] 0709 13:18:44.238127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.238475 (+   348us) service_pool.cc:224] Handling call
0709 13:18:44.238897 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.239202 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.239238 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.239768 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.658037 (+418269us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:44.658092 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.658187 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.741368 (+2083181us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b240037ba28. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fddfb0 00007f8decc54488 00007f8decc54be8 00007f8decc2c398 00007f8decc2776a 00007f8decc26bb6
0709 13:18:46.742474 (+  1106us) raft_consensus.cc:1685] finished
0709 13:18:46.742500 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.743154 (+   654us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8724224,"thread_start_us":382456,"threads_started":1,"wal-append.queue_time_us":734930}
I20260709 13:18:46.745520 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.744395 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.746538 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1896) took 1280 ms. Trace:
I20260709 13:18:46.746920 14373 rpcz_store.cc:276] 0709 13:18:45.466006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.468654 (+  2648us) service_pool.cc:224] Handling call
0709 13:18:46.746383 (+1277729us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54003c05d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:46.746483 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337234688}
I20260709 13:18:46.747339 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.746223 14374 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:46.749148 17441 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.749396 16822 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:46.749918 16822 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:18:46.750025 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.742708 17473 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:18:46.753935 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.759503 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.760815 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:46.765331 17397 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.463s	user 0.006s	sys 0.010s
I20260709 13:18:46.743927 17245 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.744457 17402 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:46.759756 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.760747 17280 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:46.750911 16822 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.754395 17431 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:46.767370 17402 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:46.770514 17280 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:46.785274 17280 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:46.789093 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.791015 14299 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:46.791927 14304 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:46.813120 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:46.814808 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 56190.4us
I20260709 13:18:46.818313 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.815383 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.876019 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:46.818679 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2384) took 1355 ms. Trace:
I20260709 13:18:46.851151 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.871501 16822 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.814874 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.877875 14301 rpcz_store.cc:276] 0709 13:18:45.462970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.471922 (+  8952us) service_pool.cc:224] Handling call
0709 13:18:46.816594 (+1344672us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b5400090028. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e69924 00007f8df2052227 00007f8df2051ab8 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:46.818604 (+  2010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14804864}
I20260709 13:18:46.880892 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.882954 14303 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:46.884044 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:46.882472 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.856775 17280 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.884162 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:46.838764 17441 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:46.877475 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:46.892659 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:46.894001 17449 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.894464 17449 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:46.894778 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.894905 17449 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.895730 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1897) took 1429 ms. Trace:
I20260709 13:18:46.896118 14371 rpcz_store.cc:276] 0709 13:18:45.466273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.466427 (+   154us) service_pool.cc:224] Handling call
0709 13:18:45.466742 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.026095 (+559353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.895469 (+869374us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400060ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:46.895666 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305287552}
I20260709 13:18:46.897316 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.899333 17470 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:46.826795 17402 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:46.901046 17402 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.894227 17469 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:46.884793 17371 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.906236 14303 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:46.910904 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:46.927016 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.928544 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.929505 14371 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:46.931697 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:46.933640 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.934782 14371 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.887712 17418 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:18:46.949422 17383 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:46.946904 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:46.951510 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 754) took 1510 ms. Trace:
I20260709 13:18:46.953362 14302 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:46.956033 14295 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:46.956629 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:46.958045 14222 rpcz_store.cc:276] 0709 13:18:45.440646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.446698 (+  6052us) service_pool.cc:224] Handling call
0709 13:18:46.951340 (+1504642us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400135bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:46.951450 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598584192}
I20260709 13:18:46.959074 14369 raft_consensus.cc:2410] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:46.960366 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.951254 14371 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:18:46.965811 14267 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:46.966663 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.968700 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:46.969480 14901 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:46.969733 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.969949 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:46.970608 14896 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.968506 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:46.973917 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.984650 14896 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:18:46.986411 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.987346 14373 raft_consensus.cc:2410] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:46.965194 17412 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:46.978922 17306 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:46.989771 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:46.990423 14369 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:46.967047 17418 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:46.991021 17418 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.991693 17389 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:46.993695 17418 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:46.994184 17306 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:46.995126 17306 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:46.975317 16848 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:47.001206 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.005685 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:47.002542 17469 consensus_queue.cc:1243] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:46.997519 17412 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:46.999215 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:47.020495 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:47.012081 17389 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.022989 14898 raft_consensus.cc:2376] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6. Re-sending same reply.
I20260709 13:18:47.023275 17389 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.023590 17479 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:47.024544 14898 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:47.003168 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:47.013654 17245 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:47.022348 17412 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:47.041069 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:47.041821 14373 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:47.043159 17469 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.046262 17469 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.047394 14373 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:47.038347 17245 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.061048 17469 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:47.062386 17389 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:47.067916 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.068394 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.068889 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.069383 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.075722 14377 raft_consensus.cc:2410] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:47.078365 17449 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.079870 14899 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:47.081424 14374 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:47.054092 17245 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.085564 17483 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.086781 17483 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.088533 17371 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:47.089006 17483 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:47.090718 14303 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:18:47.099457 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 87429us
I20260709 13:18:47.100960 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:47.104077 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:47.105070 17441 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.105449 17412 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:47.106045 17441 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:47.106616 17441 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:47.107550 17441 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.109215 17199 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.111905 17412 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:47.112715 17449 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:47.113818 17413 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:47.115028 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:47.116779 14376 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:47.120882 14894 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:47.121343 14894 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:47.123310 14894 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.127789 17412 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:47.129998 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.133917 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:47.135380 17412 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:47.139159 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:47.142199 14893 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:47.144910 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:47.145215 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:46.479279 14223 rpcz_store.cc:276] 0709 13:18:45.440933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.441060 (+   127us) service_pool.cc:224] Handling call
0709 13:18:45.443278 (+  2218us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:45.936975 (+493697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.937009 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.937618 (+   609us) log.cc:844] Serialized 52 byte log entry
0709 13:18:46.070320 (+132702us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:46.070385 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.070505 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.478471 (+407966us) raft_consensus.cc:1685] finished
0709 13:18:46.478491 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.478665 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4647,"raft.queue_time_us":20049,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6032,"thread_start_us":467821,"threads_started":2,"wal-append.queue_time_us":258763}
I20260709 13:18:47.155552 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:47.157764 17410 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.158232 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:47.158334 17410 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.153679 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:47.159730 14378 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:47.161126 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:47.161801 14897 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:47.157517 14898 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:47.160530 17410 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:47.166189 14864 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:47.167891 14864 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:47.172935 14894 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:47.174566 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:47.176334 17415 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:47.197599 14303 raft_consensus.cc:1217] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Deduplicated request from leader. Original: 2.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:18:47.198180 14303 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:47.199186 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 753) took 1758 ms. Trace:
I20260709 13:18:47.199616 14303 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:18:47.200275 14303 pending_rounds.cc:85] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 2
I20260709 13:18:47.184484 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:47.185475 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.186105 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:47.204401 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:47.205662 17415 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:47.206221 17415 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.206547 17415 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.199689 14227 rpcz_store.cc:276] 0709 13:18:45.440339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.446569 (+  6230us) service_pool.cc:224] Handling call
0709 13:18:45.467085 (+ 20516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.917594 (+450509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.917637 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.917676 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:45.917711 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.198892 (+1281181us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540033ed54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:47.198953 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.199108 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231516416}
W20260709 13:18:47.215202 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.216212 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.217015 17378 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.217386 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:47.217549 17378 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.209292 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:47.223727 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:47.222174 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:47.186514 17449 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:47.247864 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:47.249756 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:47.227239 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 59435.6us
I20260709 13:18:47.251353 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:47.200838 14303 pending_rounds.cc:107] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:47.254132 14303 raft_consensus.cc:2889] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:47.236639 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:47.237881 14378 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:47.230872 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:47.242710 14901 raft_consensus.cc:2376] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9. Re-sending same reply.
W20260709 13:18:47.246631 17494 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.056s	user 0.003s	sys 0.007s
I20260709 13:18:47.258234 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:47.264695 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:47.264967 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:47.268208 14303 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:47.246955 17495 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.016s
W20260709 13:18:47.273145 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.271101 14369 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:18:47.263239 17501 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:18:47.247293 17386 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 2.160s	user 0.009s	sys 0.008s
W20260709 13:18:47.262429 17485 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.013s
I20260709 13:18:47.276595 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:47.247121 17279 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:47.241998 17479 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.270068 17410 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.262125 17280 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:47.266814 17404 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:47.253536 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:47.247864 17449 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:47.263621 17483 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.274360 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 805) took 1110 ms. Trace:
W20260709 13:18:47.302273 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 48846.4us
I20260709 13:18:47.302575 14369 rpcz_store.cc:276] 0709 13:18:46.163634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.270499 (+1106865us) service_pool.cc:224] Handling call
0709 13:18:47.270796 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.274045 (+  3249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.274298 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.303587 14864 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:47.303833 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 60077.2us
I20260709 13:18:47.279760 14297 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:18:47.304327 14369 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:47.304574 14297 pending_rounds.cc:85] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 5
I20260709 13:18:47.304916 14297 pending_rounds.cc:107] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:18:47.304613 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:47.305258 14297 raft_consensus.cc:2889] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:47.274350 17231 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:47.272496 17262 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:18:47.282439 17431 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:47.283914 14894 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:47.295449 14378 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:47.307451 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 806) took 1135 ms. Trace:
I20260709 13:18:47.309110 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:47.286476 17418 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:47.284616 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:47.274223 17383 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:18:47.314345 14369 rpcz_store.cc:276] 0709 13:18:46.172140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.303580 (+1131440us) service_pool.cc:224] Handling call
0709 13:18:47.303868 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.304676 (+   808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.307388 (+  2712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.317454 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:47.320900 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 808) took 1098 ms. Trace:
I20260709 13:18:47.301535 17449 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:47.283403 17415 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:47.321676 14369 rpcz_store.cc:276] 0709 13:18:46.222784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.320028 (+1097244us) service_pool.cc:224] Handling call
0709 13:18:47.320335 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.320513 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.320538 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.320579 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:47.320615 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.320665 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.320842 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.328493 14369 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:47.328862 14369 pending_rounds.cc:85] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 3
I20260709 13:18:47.329154 14369 pending_rounds.cc:107] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:47.329463 14369 raft_consensus.cc:2889] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:47.307551 17231 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.313071 17163 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:47.319999 17298 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 13:18:47.332966 14864 leader_election.cc:336] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.848s (SENT)
I20260709 13:18:47.305962 17470 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:47.339376 14864 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:47.341320 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 64009.3us
I20260709 13:18:47.341920 17371 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.314400 17487 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:47.321386 17491 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.340539 14369 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:47.326187 17418 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:47.311682 17245 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:47.336696 17231 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.337577 17469 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.338709 17483 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.363207 17506 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:47.363742 17506 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:47.364128 17506 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:47.366535 17418 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.380755 14304 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:47.371111 17280 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:47.385367 17334 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:47.384819 17280 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:47.394533 17279 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:47.395452 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 90936.7us
I20260709 13:18:47.396130 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.396522 14193 leader_election.cc:400] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8.
I20260709 13:18:47.370258 17469 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.357908 17371 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:18:47.400286 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.357061 17479 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:18:47.401901 14193 leader_election.cc:403] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:18:47.414541 14225 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:47.418501 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.420835 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.426187 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.426429 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:47.460151 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:47.394323 17470 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.475380 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:47.476629 14298 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:47.429922 14297 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:47.477496 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:47.479691 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.482200 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:47.480409 14225 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:47.484869 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.485457 14225 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:47.416818 17334 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.427428 17335 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8.
I20260709 13:18:47.427956 17508 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.474454 17378 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:47.432825 17383 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:47.501271 14303 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:47.522600 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.524379 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.488751 17412 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:18:47.536168 17493 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:18:47.507295 17503 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.491601 17513 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:18:47.496094 17514 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:47.530011 17262 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:47.554827 17415 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:47.495683 17279 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:47.534552 17412 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.589864 17245 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:47.529657 17508 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:47.608866 17509 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:18:47.566385 17514 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.617780 17508 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:47.619021 17514 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:47.619040 17506 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.621672 17506 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:47.492151 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:47.656764 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 164520us
W20260709 13:18:47.691094 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.691176 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.692457 17528 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:47.695266 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.699815 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:47.693534 17528 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.705487 17528 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.706640 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.705453 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.693027 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:47.713999 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.716255 14220 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
W20260709 13:18:47.717971 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 240450us
I20260709 13:18:47.718118 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.719532 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:47.720402 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.720552 14369 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.726747 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:47.729087 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:47.720278 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:47.758769 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.759526 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.759938 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.760509 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.762212 14221 raft_consensus.cc:2410] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:47.762048 17413 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.778472 17413 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:47.768008 17412 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:47.763743 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.783389 14220 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:47.784127 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.770295 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:47.770310 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.785902 14221 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:47.787153 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.787663 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.787955 17502 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:47.788221 14225 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:47.789233 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 756) took 2330 ms. Trace:
I20260709 13:18:47.788776 17502 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.785673 14298 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.789865 17519 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.790786 17519 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:47.791662 17502 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:47.792465 14226 rpcz_store.cc:276] 0709 13:18:45.441243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.447097 (+  5854us) service_pool.cc:224] Handling call
0709 13:18:45.447415 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.079869 (+632454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.079915 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:46.079973 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:46.080020 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.771273 (+1691253us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b540026cad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:47.771341 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.771549 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453908352}
I20260709 13:18:47.794950 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.796475 17413 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:47.799932 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:47.801156 14892 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:47.799993 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.492832 17334 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.802426 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2372) took 1011 ms. Trace:
I20260709 13:18:47.802716 14226 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:47.802860 14295 rpcz_store.cc:276] 0709 13:18:46.791083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.792126 (+  1043us) service_pool.cc:224] Handling call
0709 13:18:46.792459 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.961151 (+168692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.801901 (+840750us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54000fc8d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:47.802209 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375682304}
I20260709 13:18:47.805169 14227 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:47.788846 14221 raft_consensus.cc:2410] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:47.806830 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.806922 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 552) took 2351 ms. Trace:
I20260709 13:18:47.807504 14296 rpcz_store.cc:276] 0709 13:18:45.455149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.462289 (+  7140us) service_pool.cc:224] Handling call
0709 13:18:45.462573 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.542783 (+ 80210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.542827 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.542880 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:45.542926 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.806281 (+2263355us) spinlock_profiling.cc:243] Waited 79.9 ms on lock 0x7b5400333e54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:47.806389 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.806697 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183848192}
I20260709 13:18:47.809823 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:47.810920 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 804) took 1649 ms. Trace:
I20260709 13:18:47.810659 14296 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:47.811434 14378 rpcz_store.cc:276] 0709 13:18:46.161095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.269091 (+1107996us) service_pool.cc:224] Handling call
0709 13:18:47.269377 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.313918 (+ 44541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.810367 (+496449us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b54003c05d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:47.810709 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59467008}
I20260709 13:18:47.796049 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.826205 14225 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:47.794534 17528 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.832046 17528 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:47.808214 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.793351 17519 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:47.842625 14225 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:47.846258 14221 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:47.847836 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.850631 14223 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:47.837258 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:47.851804 17519 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:47.862941 14892 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:18:47.863307 14225 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:18:47.870185 14224 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:47.877892 14224 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:47.872816 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 828) took 1327 ms. Trace:
W20260709 13:18:47.883666 14123 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37096 (request call id 353) took 17136 ms (client timeout 15000 ms). Trace:
I20260709 13:18:47.882385 14900 rpcz_store.cc:276] 0709 13:18:46.544713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.544919 (+   206us) service_pool.cc:224] Handling call
0709 13:18:46.546503 (+  1584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.081131 (+534628us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:47.123028 (+ 41897us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.227142 (+104114us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.227215 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:47.227286 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.872237 (+644951us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b540066dad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:47.872311 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.872570 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21587,"prepare.queue_time_us":44480,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":41919,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":10324,"spinlock_wait_cycles":1228980992,"thread_start_us":120275,"threads_started":2,"wal-append.queue_time_us":65479}
I20260709 13:18:47.874598 14895 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:47.886432 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 831) took 1339 ms. Trace:
I20260709 13:18:47.886991 14895 rpcz_store.cc:276] 0709 13:18:46.547336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.547454 (+   118us) service_pool.cc:224] Handling call
0709 13:18:47.873625 (+1326171us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:18:47.874066 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.886094 (+ 12028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.886370 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3687680}
I20260709 13:18:47.887993 14222 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:47.875174 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:47.889765 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:47.890678 14295 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.899351 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:47.900318 14378 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:47.902063 17431 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:47.902617 17431 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:47.906278 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:47.906589 17334 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:47.876049 14223 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:47.852280 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 130609us
I20260709 13:18:47.910266 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:47.910972 17469 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:47.917194 17497 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.564s	user 0.000s	sys 0.000s
I20260709 13:18:47.920454 14295 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:18:47.919579 14369 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:18:47.921885 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 555) took 1046 ms. Trace:
W20260709 13:18:47.919241 17505 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.492s	user 0.000s	sys 0.001s
I20260709 13:18:47.930567 17248 raft_consensus.cc:2764] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:47.931485 14371 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 9. Ops: []
I20260709 13:18:47.932639 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1902) took 1139 ms. Trace:
I20260709 13:18:47.933043 14371 rpcz_store.cc:276] 0709 13:18:46.793369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.930564 (+1137195us) service_pool.cc:224] Handling call
0709 13:18:47.931025 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.932343 (+  1318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.932568 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.933424 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 816) took 1630 ms. Trace:
I20260709 13:18:47.924575 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:47.917552 14298 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:18:47.942032 14297 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:47.930441 14300 rpcz_store.cc:276] 0709 13:18:46.875241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.885476 (+ 10235us) service_pool.cc:224] Handling call
0709 13:18:46.885854 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.890301 (+  4447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.890331 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.890812 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.077216 (+186404us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b4800241ed8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
0709 13:18:47.156041 (+ 78825us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18003bd580. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:18:47.279197 (+123156us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:47.279252 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.279339 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.916174 (+636835us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:47.921306 (+  5132us) raft_consensus.cc:1685] finished
0709 13:18:47.921330 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.921619 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4036,"raft.run_cpu_time_us":2564,"raft.run_wall_time_us":185083,"spinlock_wait_cycles":16928000,"thread_start_us":122959,"threads_started":1,"wal-append.queue_time_us":434522}
W20260709 13:18:47.943137 17231 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.582s	user 0.018s	sys 0.000s
I20260709 13:18:47.943832 17231 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:47.945844 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:47.948011 17334 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:47.936297 14377 rpcz_store.cc:276] 0709 13:18:46.302565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.733241 (+430676us) service_pool.cc:224] Handling call
0709 13:18:47.932991 (+1199750us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54003c37d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:47.933240 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783859584}
I20260709 13:18:47.948845 14223 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:47.949182 17334 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:47.953519 17231 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:47.969640 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:47.978816 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 171830us
I20260709 13:18:47.970199 17334 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:47.995042 14229 raft_consensus.cc:2410] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:47.997906 17035 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.884276 14123 rpcz_store.cc:269] 0709 13:18:30.746768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.754810 (+  8042us) service_pool.cc:224] Handling call
0709 13:18:47.883226 (+17128416us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:39.353735 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:39.836320 (+482585us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:39.836373 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:18:39.836391 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:39.837124 (+   733us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:39.837195 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:39.837224 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:39.837905 (+   681us) tablet.cc:701] Row locks acquired
0709 13:18:39.837954 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:18:39.838114 (+   160us) write_op.cc:270] Start()
0709 13:18:39.838290 (+   176us) write_op.cc:276] Timestamp: P: 1783603119838052 usec, L: 0
0709 13:18:39.838313 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:39.838994 (+   681us) log.cc:844] Serialized 2094 byte log entry
0709 13:18:39.976919 (+137925us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8de9f820ac 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b
0709 13:18:41.746046 (+1769127us) op_driver.cc:464] REPLICATION: finished
0709 13:18:42.506887 (+760841us) write_op.cc:301] APPLY: starting
0709 13:18:42.507020 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:42.507252 (+   232us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:42.507299 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:42.514389 (+  7090us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:42.514750 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:18:42.514796 (+    46us) write_op.cc:312] APPLY: finished
0709 13:18:42.515149 (+   353us) log.cc:844] Serialized 47 byte log entry
0709 13:18:42.515355 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.515465 (+   110us) write_op.cc:454] Released schema lock
0709 13:18:42.515534 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:42.516012 (+   478us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.516049 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2926594,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":736333,"apply.run_cpu_time_us":3522,"apply.run_wall_time_us":17286,"num_ops":5,"prepare.queue_time_us":618641,"prepare.run_cpu_time_us":40663,"prepare.run_wall_time_us":1512433,"raft.queue_time_us":687265,"raft.run_cpu_time_us":19054,"raft.run_wall_time_us":444380,"replication_time_us":1907591,"spinlock_wait_cycles":15109760,"thread_start_us":2155160,"threads_started":4,"wal-append.queue_time_us":910869,"wal-append.run_cpu_time_us":93346,"wal-append.run_wall_time_us":2903085}]]}
W20260709 13:18:47.993718 14192 connection.cc:256] RPC call timeout handler was delayed by -1.2599594810001236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260709 13:18:47.977900 17431 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:48.094183 14192 connection.cc:256] RPC call timeout handler was delayed by -1.107859481000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
W20260709 13:18:48.094761 14192 connection.cc:256] RPC call timeout handler was delayed by -1.0404601980001189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 13:18:48.100271 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 801) took 1941 ms. Trace:
I20260709 13:18:48.102478 17431 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:48.122493 17519 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.123503 17519 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.137030 14296 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:47.944394 14300 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:48.103394 14376 rpcz_store.cc:276] 0709 13:18:46.158535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.082434 (+923899us) service_pool.cc:224] Handling call
0709 13:18:47.082710 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.117386 (+ 34676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.099549 (+982163us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b540004ced4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:48.100055 (+   506us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77668224}
I20260709 13:18:48.143078 17519 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:48.154927 14371 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:48.165306 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1903) took 1371 ms. Trace:
I20260709 13:18:48.167788 17518 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:48.193140 17519 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.188952 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.194290 17519 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.197329 17519 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:48.032584 17472 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.350s	user 0.000s	sys 0.003s
I20260709 13:18:48.200860 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1904) took 1406 ms. Trace:
I20260709 13:18:48.201417 14371 rpcz_store.cc:276] 0709 13:18:46.793997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.952858 (+1158861us) service_pool.cc:224] Handling call
0709 13:18:48.154496 (+201638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.200562 (+ 46066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.200794 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.190869 14369 rpcz_store.cc:276] 0709 13:18:46.793668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.935101 (+1141433us) service_pool.cc:224] Handling call
0709 13:18:48.164247 (+229146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.164839 (+   592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.164875 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.164949 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:48.164992 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.165061 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.165204 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.209846 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 822) took 1260 ms. Trace:
I20260709 13:18:48.210381 14376 rpcz_store.cc:276] 0709 13:18:46.948977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.199577 (+1250600us) service_pool.cc:224] Handling call
0709 13:18:48.200177 (+   600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.209394 (+  9217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.209426 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.209475 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:48.209509 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.209585 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.209729 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.211673 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:48.214272 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:48.191757 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 209414us
I20260709 13:18:48.192440 17525 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.217461 17525 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.218973 17404 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:48.219643 17404 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:48.220461 17525 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:48.220978 17404 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:48.224120 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:48.226043 17525 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:48.239548 17262 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:48.245771 17524 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.420s	user 0.005s	sys 0.000s
I20260709 13:18:48.257903 14125 catalog_manager.cc:5697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:48.256552 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.264321 17525 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:48.265347 17525 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.300554 17262 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.301489 17262 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:48.306242 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:48.310225 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44330.6us
I20260709 13:18:48.314339 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:48.315438 17525 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:48.315958 17451 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.316601 17451 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:48.317548 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.315388 14896 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:48.317759 14125 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 1 to 4, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 4 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:48.329977 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.333012 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:48.338189 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1913) took 1375 ms. Trace:
I20260709 13:18:48.339736 14296 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:48.340361 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 882) took 1347 ms. Trace:
I20260709 13:18:48.339118 14371 rpcz_store.cc:276] 0709 13:18:46.963333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.202421 (+1239088us) service_pool.cc:224] Handling call
0709 13:18:48.202909 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.203387 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:48.274519 (+ 71132us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.337306 (+ 62787us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.337444 (+   138us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:48.337571 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.337719 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.338050 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":112500,"threads_started":2}
I20260709 13:18:48.341271 14896 rpcz_store.cc:276] 0709 13:18:46.970992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.988919 (+ 17927us) service_pool.cc:224] Handling call
0709 13:18:48.252832 (+1263913us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:48.318708 (+ 65876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18636160}
I20260709 13:18:48.325848 14125 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 4 to 8, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 8 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.319360 17262 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:48.290160 17519 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:18:48.366880 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1914) took 1403 ms. Trace:
I20260709 13:18:48.379952 17451 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:48.364280 17525 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:48.381191 17525 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:48.383659 17525 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:48.388283 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:48.368273 14369 rpcz_store.cc:276] 0709 13:18:46.963728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.205686 (+1241958us) service_pool.cc:224] Handling call
0709 13:18:48.206181 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.206888 (+   707us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:48.283707 (+ 76819us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.365518 (+ 81811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.365670 (+   152us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:48.365981 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.366218 (+   237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.366643 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14052,"thread_start_us":120310,"threads_started":2}
W20260709 13:18:48.411511 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 78736.9us
I20260709 13:18:48.031621 17035 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.367754 14125 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 3 to 5, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 5 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:48.428107 17035 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:48.451467 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.452512 17451 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.452795 16848 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.453254 17451 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:48.453472 16848 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.455874 16848 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:48.457109 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2389) took 1095 ms. Trace:
I20260709 13:18:48.457616 14302 rpcz_store.cc:276] 0709 13:18:47.361552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.361729 (+   177us) service_pool.cc:224] Handling call
0709 13:18:47.369009 (+  7280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.369315 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.369344 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.377847 (+  8503us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.846593 (+468746us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:47.846705 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.846858 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.244555 (+397697us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:48.456549 (+211994us) raft_consensus.cc:1685] finished
0709 13:18:48.456575 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.456903 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":513,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":15244,"spinlock_wait_cycles":16100224,"thread_start_us":468017,"threads_started":1,"wal-append.queue_time_us":447010}
I20260709 13:18:48.460530 17451 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:48.468262 17533 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:48.469547 17262 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.469209 17533 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.472616 17533 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:48.473485 17262 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:48.475522 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:48.103806 17449 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.689s	user 0.013s	sys 0.007s
I20260709 13:18:48.477286 17262 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:48.477054 17449 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.368449 17404 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.485913 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:48.495471 17431 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:48.505717 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:48.511516 14369 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:48.527361 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1917) took 1449 ms. Trace:
I20260709 13:18:48.527763 14369 rpcz_store.cc:276] 0709 13:18:47.062801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.420546 (+1357745us) service_pool.cc:224] Handling call
0709 13:18:48.498999 (+ 78453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.512235 (+ 13236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.512611 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.539817 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:48.529160 16848 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:48.549714 16848 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.550175 16848 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:48.526855 14125 catalog_manager.cc:5697] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 5, term changed from 3 to 6, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132), cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.551910 14125 catalog_manager.cc:5697] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 5, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 5 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:48.534317 17431 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:48.555294 17431 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:48.556483 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 178048us
I20260709 13:18:48.534842 17525 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.562736 17525 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.563752 17444 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.564457 17444 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.574011 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:48.553496 14125 catalog_manager.cc:5697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.563463 17525 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:48.580025 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57014us
I20260709 13:18:48.526374 17262 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.590950 17451 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:48.601812 14896 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:48.605517 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:48.609421 14895 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.605372 17451 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:48.613131 17451 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:48.579964 16973 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.647466 17469 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:18:48.580191 17404 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:48.649273 17334 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:48.650816 16973 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.658208 14369 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:48.608181 14125 catalog_manager.cc:5697] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 2 to 4, term changed from 1 to 4, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129), cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:48.667814 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1891) took 3203 ms. Trace:
I20260709 13:18:48.668205 14372 rpcz_store.cc:276] 0709 13:18:45.464549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.464683 (+   134us) service_pool.cc:224] Handling call
0709 13:18:48.667291 (+3202608us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b5400349ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:48.667591 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382767488}
I20260709 13:18:48.674472 17248 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.675369 17248 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.678880 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 794) took 2533 ms. Trace:
I20260709 13:18:48.679342 14374 rpcz_store.cc:276] 0709 13:18:46.145529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.768058 (+622529us) service_pool.cc:224] Handling call
0709 13:18:47.081212 (+313154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.081926 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.678365 (+1596439us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540027a6d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:48.678662 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719219584}
I20260709 13:18:48.669713 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:48.733429 14895 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:48.752383 14372 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:48.721201 14125 catalog_manager.cc:5697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 4 to 5, term changed from 4 to 5, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132), VOTER bee4f7fc1b4740dc875537c79309664f (127.12.208.130) evicted, no longer has a pending config: VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129), VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131), VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 5 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.789865 17413 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.800740 17413 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:48.807468 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 195947us
I20260709 13:18:48.808755 14295 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:18:48.809701 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:48.835906 14372 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:48.836169 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:48.837823 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1919) took 1769 ms. Trace:
I20260709 13:18:48.838243 14372 rpcz_store.cc:276] 0709 13:18:47.068230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.836756 (+1768526us) service_pool.cc:224] Handling call
0709 13:18:48.837167 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.837392 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.837423 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.837491 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.837545 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.837597 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.837704 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.839325 17413 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:48.840354 14372 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:48.841035 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1921) took 1653 ms. Trace:
W20260709 13:18:48.846112 14344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 1.942s (SENT) [suppressed 27 similar messages]
I20260709 13:18:48.841387 14372 rpcz_store.cc:276] 0709 13:18:47.188001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.839546 (+1651545us) service_pool.cc:224] Handling call
0709 13:18:48.839992 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.840772 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.840961 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.753312 17262 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.810994 17248 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:48.858668 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.859946 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:48.812740 17334 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:48.871536 14369 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:48.880151 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:48.880846 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1918) took 1813 ms. Trace:
I20260709 13:18:48.881258 14369 rpcz_store.cc:276] 0709 13:18:47.067936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.810117 (+1742181us) service_pool.cc:224] Handling call
0709 13:18:48.859978 (+ 49861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.880534 (+ 20556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.880786 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.834860 17404 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:48.859449 17416 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:48.908089 14896 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:48.903649 14900 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:48.887601 14125 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 3 to 5, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 5 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.917603 14369 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:48.927367 17416 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.917923 14372 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:48.929056 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1923) took 1128 ms. Trace:
I20260709 13:18:48.929364 14372 rpcz_store.cc:276] 0709 13:18:47.800563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.850001 (+1049438us) service_pool.cc:224] Handling call
0709 13:18:48.899469 (+ 49468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.928831 (+ 29362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.929007 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.931051 17525 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:48.926748 17298 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.944414 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 98329.4us
W20260709 13:18:48.947335 17471 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 2.264s	user 0.003s	sys 0.003s
I20260709 13:18:48.950147 14300 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:48.950055 17298 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:48.926088 16848 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:48.952421 16848 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:48.952632 17416 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:48.917488 14864 leader_election.cc:336] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.689s (SENT)
I20260709 13:18:48.953984 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:48.962560 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.952425 17298 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:49.022212 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1916) took 2055 ms. Trace:
I20260709 13:18:49.014514 14125 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.022710 14371 rpcz_store.cc:276] 0709 13:18:46.967140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.364520 (+1397380us) service_pool.cc:224] Handling call
0709 13:18:48.426516 (+ 61996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.427300 (+   784us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:48.600570 (+173270us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.021816 (+421246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.021871 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:49.021924 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.022005 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.022142 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15847,"thread_start_us":390380,"threads_started":2}
I20260709 13:18:49.031380 17415 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:49.032008 17415 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:48.992815 17469 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:49.040474 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 126896us
I20260709 13:18:49.040705 17415 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:49.041460 17479 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:49.060199 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:49.067384 17431 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:49.074705 17406 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:49.078550 17262 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:49.081528 17262 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.080773 14125 catalog_manager.cc:5697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 6, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 6 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:49.085498 17220 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:49.085973 17220 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.086315 17220 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:49.082202 17262 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.080178 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:49.105597 14125 catalog_manager.cc:5697] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 4, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 4 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:49.110707 14250 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0b60 after lost signal to thread 13125
W20260709 13:18:49.112113 14250 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2680 after lost signal to thread 14161
I20260709 13:18:49.112983 16848 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:49.113425 16848 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.113770 16848 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.142400 14125 catalog_manager.cc:5697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.190812 14125 catalog_manager.cc:5697] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 4, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 4 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:49.191512 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55561.1us
W20260709 13:18:49.202380 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 169252us
I20260709 13:18:49.224210 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:49.245803 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:49.255847 17533 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:49.258702 17414 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:49.260389 14250 debug-util.cc:398] Leaking SignalData structure 0x7b080031eda0 after lost signal to thread 14253
I20260709 13:18:49.266969 17262 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:49.250012 14125 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.269382 14125 catalog_manager.cc:5697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.273455 17262 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.273942 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:49.274904 14900 raft_consensus.cc:2410] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:18:49.274303 17262 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.277136 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:49.277848 14896 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:49.278285 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:49.278923 14899 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:49.278836 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:49.280076 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:49.282640 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:49.283484 14371 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:49.290489 17441 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:49.290936 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:49.291417 17519 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.292222 17519 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.294181 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:49.295354 14892 raft_consensus.cc:2410] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:49.297827 17415 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:49.297878 17453 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.298456 17415 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.293606 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:49.350287 14295 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:49.357918 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:49.350281 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:49.367471 14372 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:49.374590 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:49.375782 14892 raft_consensus.cc:2410] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:49.376346 17415 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:49.382597 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.311282 17431 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:18:49.310647 17533 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:18:49.315650 16848 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:49.299190 17453 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.462826 17519 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:49.463584 17519 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:49.463930 14375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 812) took 3186 ms (client timeout 1848 ms). Trace:
I20260709 13:18:49.464217 17519 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:49.468431 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:49.464406 14375 rpcz_store.cc:269] 0709 13:18:46.280456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.463523 (+3183067us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:49.463673 (+   150us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:18:49.469318 14374 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:49.360935 17220 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.417253 17415 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.498780 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1927) took 1009 ms. Trace:
I20260709 13:18:49.505975 14374 rpcz_store.cc:276] 0709 13:18:48.478460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.680389 (+201929us) service_pool.cc:224] Handling call
0709 13:18:49.468170 (+787781us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:49.487932 (+ 19762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10554112}
I20260709 13:18:49.512426 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:49.513064 17519 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:49.514065 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:49.519377 17453 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:49.534235 17415 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:49.537065 17415 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:49.538908 17262 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:49.561975 14372 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:49.565302 17220 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:49.567759 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:49.568854 17262 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:49.570935 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:49.587738 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:49.592111 14375 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:18:49.609597 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:49.617689 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 333371us
I20260709 13:18:49.629024 14375 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:49.600947 17415 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:18:49.644024 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 56412.3us
I20260709 13:18:49.646999 16848 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:49.653973 17415 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:49.654762 17415 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:49.655903 17415 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.662979 17383 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.663846 17383 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.686944 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:49.718070 14341 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:49.716636 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:49.743069 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.759673 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:49.768164 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51625.6us
I20260709 13:18:49.758456 17231 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:49.758560 17431 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.625025 17262 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 13:18:49.789853 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:49.809808 14298 raft_consensus.cc:2393] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:49.712436 17469 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:49.737977 17220 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.716217 16848 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:49.827244 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:49.796895 17451 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.796947 17441 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:49.855654 17109 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.867883 17109 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.868614 17504 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:49.869091 17504 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.869479 17504 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:49.870623 17109 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:49.872107 17198 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:49.872792 17198 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.850544 17412 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:18:49.875140 17198 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:49.875661 17198 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.876573 17441 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.878330 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:49.850878 17262 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:49.842113 17220 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.943311 17220 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:49.885367 17231 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.944360 17231 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.945806 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:49.953385 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:49.824697 17431 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.968617 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:49.970456 14296 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:49.969161 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:49.826043 17469 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:49.992031 14300 raft_consensus.cc:2410] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:49.952438 16822 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:49.993086 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:50.010027 14297 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
W20260709 13:18:50.014254 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.79746e+06us
I20260709 13:18:49.937054 17262 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.014462 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:49.979853 17220 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:18:49.979553 17412 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:18:50.020849 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:49.881168 16848 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:50.020393 17441 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:49.896013 17451 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:49.914338 17198 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:50.005492 16822 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.014295 17231 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:50.029771 17262 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.063225 17416 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:50.073685 17441 raft_consensus.cc:2764] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:50.098201 14302 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:50.063522 17412 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.101374 17412 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:50.057994 16822 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.099164 17231 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.155925 17198 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:50.102246 17109 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.173180 17109 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:50.175163 17504 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:50.175876 17109 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:50.176293 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.176478 17199 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.176842 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.177291 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.177775 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.157564 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.170893 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53641us
I20260709 13:18:50.139302 17416 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:50.178237 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.178007 17502 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.191273 17231 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:50.191571 17502 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:50.192286 17431 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:50.177208 17199 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:50.138988 17412 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:50.201892 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:50.206699 14223 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:50.177649 17504 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:50.210183 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:50.228441 14375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.034s	sys 0.075s
W20260709 13:18:50.228987 14375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.034s	sys 0.075s
I20260709 13:18:50.193295 17528 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.239439 17528 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:50.240653 14229 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:18:50.241109 14229 pending_rounds.cc:85] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 6
I20260709 13:18:50.253697 17416 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:50.253934 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:50.255177 17528 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:50.255685 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:50.256199 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.257313 14228 raft_consensus.cc:2410] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:18:50.184612 17508 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.258524 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.210130 17231 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:50.241380 14229 pending_rounds.cc:107] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:18:50.258495 16848 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:50.348877 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:50.454514 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 198924us
I20260709 13:18:50.383188 14228 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
W20260709 13:18:50.459463 14372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.008s	sys 0.008s
W20260709 13:18:50.470714 14372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.009s	sys 0.008s
I20260709 13:18:50.467196 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.471371 14229 raft_consensus.cc:2889] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.501686 14296 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:18:50.513031 14227 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:50.529640 14296 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:50.528478 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51191us
I20260709 13:18:50.499495 14222 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
W20260709 13:18:50.541388 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.007s	sys 0.052s
W20260709 13:18:50.541909 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.008s	sys 0.052s
I20260709 13:18:50.548115 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.350494 17199 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:50.565449 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.257746 17416 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:50.350003 17469 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:50.591281 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.574841 14268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.010s	sys 0.009s
I20260709 13:18:50.589363 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.281738 17502 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:50.607208 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.607975 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:50.714107 14268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.010s	sys 0.018s
I20260709 13:18:50.714259 14228 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:50.350791 17451 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:50.407794 17508 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:50.685184 14344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.010s	sys 0.034s
W20260709 13:18:50.724928 14344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.010s	sys 0.035s
I20260709 13:18:50.499810 17334 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:50.616691 17051 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:50.716327 14227 raft_consensus.cc:2410] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:50.716902 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:50.717298 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:50.723654 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.727877 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.662808 17528 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.737115 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:50.742146 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.746124 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.743866 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.748927 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:50.729455 17051 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.745618 17410 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.753042 14222 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:50.750311 14296 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:50.735399 17198 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.752501 17051 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:50.769104 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.773080 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:50.737072 17469 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.783514 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.782480 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:50.785573 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:50.793864 14228 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
W20260709 13:18:50.787775 14341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.016s	sys 0.035s
W20260709 13:18:50.794853 14341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.016s	sys 0.036s
W20260709 13:18:50.795250 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 1.03559e+06us
I20260709 13:18:50.796311 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:50.801009 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.788571 14229 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:50.811745 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:50.816464 14296 raft_consensus.cc:2410] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:50.816479 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:50.820961 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 281119us
W20260709 13:18:50.821223 14267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.012s	sys 0.028s
W20260709 13:18:50.824929 14267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.012s	sys 0.028s
W20260709 13:18:50.825299 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 819652us
W20260709 13:18:50.768816 14114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8c137013238f4b1dbae260e32cb316dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9b2cf49ceed478480fb0f27ccf55d81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:18:50.831633 17545 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:18:50.832406 17547 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 13:18:50.833532 17566 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:50.756892 17451 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:50.826107 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:50.748030 17334 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:50.833455 17557 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 13:18:50.837527 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:18:50.809585 17418 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.017s	sys 0.061s
I20260709 13:18:50.844831 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:50.831710 14114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 150196us
I20260709 13:18:50.748932 17528 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:50.835111 17575 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
I20260709 13:18:50.847435 17415 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:50.788967 17198 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:50.867998 14223 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
W20260709 13:18:50.924731 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 98744.8us
I20260709 13:18:50.888350 14296 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:50.926120 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:50.892742 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 76961.4us
I20260709 13:18:50.902195 14223 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
W20260709 13:18:50.902367 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 431347us
W20260709 13:18:50.890853 14224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.051s
W20260709 13:18:50.930652 14224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.013s	sys 0.052s
I20260709 13:18:50.929497 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:50.924243 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2399) took 2573 ms. Trace:
W20260709 13:18:50.871738 17538 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:18:50.788451 17410 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:50.935518 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:50.866925 17451 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:50.872393 17577 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:18:50.940125 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.955979 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 213710us
W20260709 13:18:50.873608 17539 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:18:50.958454 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:50.873174 17541 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:18:50.868338 17418 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.017s	sys 0.062s
W20260709 13:18:50.962865 17540 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.220s	user 0.001s	sys 0.001s
I20260709 13:18:50.897322 17415 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.932323 14301 rpcz_store.cc:276] 0709 13:18:48.261197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.261356 (+   159us) service_pool.cc:224] Handling call
0709 13:18:48.261730 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.262380 (+   650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.262405 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.262940 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.292569 (+ 29629us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:48.292782 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.292923 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.834594 (+2541671us) raft_consensus.cc:1685] finished
0709 13:18:50.834621 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.834803 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63620,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":154,"thread_start_us":25232,"threads_started":1,"wal-append.queue_time_us":2204356}
I20260709 13:18:50.869246 17504 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:50.953812 17262 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.776s	user 0.007s	sys 0.012s
I20260709 13:18:50.872813 17581 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.845844 17469 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:50.975272 14192 leader_election.cc:336] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.663s (SENT)
I20260709 13:18:50.872071 17576 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:50.967473 17562 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:18:50.872462 17532 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:50.977747 17578 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:50.975668 17415 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.987282 17508 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:50.987890 17508 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:50.988313 17469 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:50.988385 17508 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:50.984241 17578 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:50.990792 17583 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:18:50.991710 17578 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:50.992408 17565 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:18:50.993325 17532 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:50.994652 17109 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:50.996333 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 842) took 2433 ms. Trace:
I20260709 13:18:50.984871 17504 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:50.997361 17504 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:50.996708 14894 rpcz_store.cc:276] 0709 13:18:48.562829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.565923 (+  3094us) service_pool.cc:224] Handling call
0709 13:18:48.585948 (+ 20025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.634647 (+ 48699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.634682 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.645264 (+ 10582us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.087293 (+442029us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b1800219580. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:18:49.192599 (+105306us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:49.192890 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.193343 (+   453us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.995865 (+1802522us) raft_consensus.cc:1685] finished
0709 13:18:50.995886 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.996113 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33566,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":170,"spinlock_wait_cycles":15552384,"thread_start_us":104190,"threads_started":1,"wal-append.queue_time_us":2227862}
W20260709 13:18:51.002400 17574 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:18:51.002601 17198 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:51.002950 17504 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:51.003590 14867 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:50.989683 17508 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:51.004947 14192 leader_election.cc:336] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.851s (SENT)
I20260709 13:18:51.005384 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:50.979786 17262 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:50.986315 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:51.008184 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1934) took 1713 ms. Trace:
I20260709 13:18:50.980551 17576 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:51.015592 14374 rpcz_store.cc:276] 0709 13:18:49.294457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.515086 (+220629us) service_pool.cc:224] Handling call
0709 13:18:49.515427 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.518646 (+  3219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.518714 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:49.559101 (+ 40387us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.799743 (+240642us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:49.799794 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.799880 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.007952 (+1208072us) raft_consensus.cc:1685] finished
0709 13:18:51.007970 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.008120 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":196,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":227973,"threads_started":1,"wal-append.queue_time_us":1267037}
I20260709 13:18:51.025671 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:51.039271 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:51.037993 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1936) took 1742 ms. Trace:
I20260709 13:18:51.039574 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:51.003297 17564 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:51.039192 17563 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:50.995801 17532 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:50.988332 17410 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:50.979001 17555 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:51.061462 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2251) took 3637 ms. Trace:
I20260709 13:18:51.041132 14375 rpcz_store.cc:276] 0709 13:18:49.295099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.630113 (+335014us) service_pool.cc:224] Handling call
0709 13:18:49.630493 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.644234 (+ 13741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.644300 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:49.698630 (+ 54330us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.229447 (+530817us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:50.229505 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.229603 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.037696 (+808093us) raft_consensus.cc:1685] finished
0709 13:18:51.037724 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.037921 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13176,"raft.queue_time_us":25025,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"thread_start_us":530292,"threads_started":1,"wal-append.queue_time_us":859348}
W20260709 13:18:51.045735 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 116317us
I20260709 13:18:51.058375 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:51.060338 17532 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:50.989868 17584 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:51.063308 14894 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:51.063678 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 58734.4us
I20260709 13:18:51.063951 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2403) took 3358 ms. Trace:
I20260709 13:18:51.064421 17563 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:51.064996 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:51.061933 14226 rpcz_store.cc:276] 0709 13:18:47.424194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.809898 (+385704us) service_pool.cc:224] Handling call
0709 13:18:47.810319 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.810922 (+   603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.810954 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.811556 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.090438 (+278882us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:48.090478 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.090585 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.061243 (+2970658us) raft_consensus.cc:1685] finished
0709 13:18:51.061263 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.061402 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":187,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"thread_start_us":268559,"threads_started":1,"wal-append.queue_time_us":2656444}
I20260709 13:18:51.017220 17469 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:18:51.048458 17564 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.066197 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 830) took 1731 ms. Trace:
I20260709 13:18:51.068058 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 834) took 1501 ms. Trace:
I20260709 13:18:51.078445 14375 rpcz_store.cc:276] 0709 13:18:49.566348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.066976 (+1500628us) service_pool.cc:224] Handling call
0709 13:18:51.067388 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.067628 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.067664 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:51.067717 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:51.067768 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.067835 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.067964 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:50.995748 17582 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:18:51.029469 17576 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:51.069892 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 832) took 1651 ms. Trace:
I20260709 13:18:51.073514 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1915) took 4104 ms. Trace:
I20260709 13:18:51.079926 14374 rpcz_store.cc:276] 0709 13:18:49.430146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.037200 (+1607054us) service_pool.cc:224] Handling call
0709 13:18:51.049327 (+ 12127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.069413 (+ 20086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.069455 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:51.069520 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:51.069576 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.069658 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.069820 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.066169 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:51.086100 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:51.061815 17555 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.071678 17532 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.077275 14371 rpcz_store.cc:276] 0709 13:18:49.347674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.391390 (+1043716us) service_pool.cc:224] Handling call
0709 13:18:50.515802 (+124412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.662565 (+146763us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:50.662600 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.741841 (+ 79241us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.898971 (+157130us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:50.899017 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.899105 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.065970 (+166865us) raft_consensus.cc:1685] finished
0709 13:18:51.065989 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.066123 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17073,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":70937,"thread_start_us":109927,"threads_started":1,"wal-append.queue_time_us":278948}
I20260709 13:18:51.080026 14376 rpcz_store.cc:276] 0709 13:18:46.964978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.211388 (+1246410us) service_pool.cc:224] Handling call
0709 13:18:48.211922 (+   534us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:48.212685 (+   763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.212717 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:48.298904 (+ 86187us) log.cc:844] Serialized 52 byte log entry
0709 13:18:48.532785 (+233881us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.532939 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.533375 (+   436us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.069544 (+2536169us) raft_consensus.cc:1685] finished
0709 13:18:51.069568 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.069740 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":188626,"threads_started":1,"wal-append.queue_time_us":2726687}
W20260709 13:18:51.099448 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 117034us
I20260709 13:18:51.072335 14303 rpcz_store.cc:276] 0709 13:18:47.693372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.729945 (+ 36573us) service_pool.cc:224] Handling call
0709 13:18:47.730537 (+   592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.186452 (+455915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.186492 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.187645 (+  1153us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.277556 (+ 89911us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:48.277608 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.277705 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.051268 (+2773563us) raft_consensus.cc:1685] finished
0709 13:18:51.051290 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.051421 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39035,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":270,"thread_start_us":515183,"threads_started":2,"wal-append.queue_time_us":2471514}
I20260709 13:18:51.072948 17563 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.110599 14375 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:51.110491 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:51.110488 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:51.111857 14371 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:51.111820 14374 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:51.116750 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 836) took 1549 ms. Trace:
I20260709 13:18:51.117069 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:51.117331 14375 rpcz_store.cc:276] 0709 13:18:49.567165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.079525 (+1512360us) service_pool.cc:224] Handling call
0709 13:18:51.105713 (+ 26188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.116401 (+ 10688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.116680 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.117930 14895 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:51.077165 17334 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:51.087016 17564 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:51.105216 17532 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.100219 17555 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.115154 17563 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.123415 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:51.124540 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:51.133396 14296 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:51.122367 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 163974us
I20260709 13:18:51.124493 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:51.134696 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:51.137969 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:51.138818 14375 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:51.133713 14376 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:51.140142 14303 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:51.134614 14371 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:51.111949 14892 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:51.142119 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:51.144477 14374 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:18:51.142799 14192 leader_election.cc:336] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.886s (SENT)
W20260709 13:18:51.142798 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.126009 17262 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:51.131989 16822 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.991s	user 0.009s	sys 0.004s
I20260709 13:18:51.126392 17334 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:51.147576 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:51.150123 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:51.150720 14376 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:51.151014 14375 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.142032 17584 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:51.157580 14867 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:51.152640 14371 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:18:51.163740 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.201653 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 74077.6us
I20260709 13:18:51.153330 16822 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:51.192844 17593 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:51.236111 17298 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:51.236922 17298 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:51.192634 17595 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:51.198429 14374 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:51.201377 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:51.247434 14892 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
W20260709 13:18:51.249259 14192 leader_election.cc:336] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.234s (SENT)
W20260709 13:18:51.249392 17553 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.801s	user 0.004s	sys 0.000s
W20260709 13:18:51.202044 17585 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:18:51.192634 17546 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:18:51.204972 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:51.205875 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:51.254348 17449 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:51.255610 14901 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 4: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:51.208863 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:51.212226 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 828) took 1914 ms. Trace:
I20260709 13:18:51.200485 17584 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:51.256381 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47614.1us
I20260709 13:18:51.219798 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1933) took 1925 ms. Trace:
W20260709 13:18:51.258132 17537 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.561s	user 0.001s	sys 0.000s
I20260709 13:18:51.258939 17418 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:51.256246 14372 rpcz_store.cc:276] 0709 13:18:49.297535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.647320 (+349785us) service_pool.cc:224] Handling call
0709 13:18:49.647727 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.675117 (+ 27390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.675162 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:49.715181 (+ 40019us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.471273 (+756092us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:50.621655 (+150382us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.625777 (+  4122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.625908 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.211989 (+586081us) raft_consensus.cc:1685] finished
0709 13:18:51.212014 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.212150 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99850,"prepare.queue_time_us":150355,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":4536,"raft.queue_time_us":39497,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":43760,"thread_start_us":681911,"threads_started":1,"wal-append.queue_time_us":1438735}
I20260709 13:18:51.259491 17418 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.259668 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1857) took 3828 ms. Trace:
I20260709 13:18:51.260051 17418 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:51.261152 17544 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.539s	user 0.000s	sys 0.000s
I20260709 13:18:51.258132 14369 rpcz_store.cc:276] 0709 13:18:49.294072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.297888 (+  3816us) service_pool.cc:224] Handling call
0709 13:18:49.298217 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.298433 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.298457 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:49.298958 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.443573 (+144615us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:49.443623 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.443710 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.219502 (+1775792us) raft_consensus.cc:1685] finished
0709 13:18:51.219528 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.219718 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":144208,"threads_started":1,"wal-append.queue_time_us":1830190}
W20260709 13:18:51.263391 17561 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.580s	user 0.000s	sys 0.000s
I20260709 13:18:51.257222 17584 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:51.224846 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.265368 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.260075 14220 rpcz_store.cc:276] 0709 13:18:47.431413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.839591 (+408178us) service_pool.cc:224] Handling call
0709 13:18:47.931178 (+ 91587us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:47.931692 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.931736 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:47.934445 (+  2709us) log.cc:844] Serialized 52 byte log entry
0709 13:18:48.272977 (+338532us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.273608 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.276081 (+  2473us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.256163 (+2980082us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b24001504e8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fddfb0 00007f8decc54488 00007f8decc54be8 00007f8decc2c398 00007f8decc2776a 00007f8decc26bb6
0709 13:18:51.259395 (+  3232us) raft_consensus.cc:1685] finished
0709 13:18:51.259416 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.259612 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":5388160,"thread_start_us":337571,"threads_started":1,"wal-append.queue_time_us":2594502}
I20260709 13:18:51.236198 17593 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:51.268038 17593 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:51.269079 17600 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:18:51.158761 14303 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:51.271207 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:51.246384 17595 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:51.275543 14377 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:51.201962 17508 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:51.276268 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1912) took 4479 ms. Trace:
I20260709 13:18:51.249806 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:51.254937 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2262) took 1062 ms. Trace:
I20260709 13:18:51.276650 14377 rpcz_store.cc:276] 0709 13:18:46.796417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.274740 (+4478323us) service_pool.cc:224] Handling call
0709 13:18:51.275164 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.276001 (+   837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.276210 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.278438 17508 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:51.277619 14224 rpcz_store.cc:276] 0709 13:18:50.192933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.201388 (+  8455us) service_pool.cc:224] Handling call
0709 13:18:50.221457 (+ 20069us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.239382 (+ 17925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.239411 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.240012 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.944755 (+704743us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:50.944826 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.944931 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.254681 (+309750us) raft_consensus.cc:1685] finished
0709 13:18:51.254703 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.254847 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18137,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":23296,"thread_start_us":690671,"threads_started":1,"wal-append.queue_time_us":853598}
I20260709 13:18:51.238468 17298 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:51.280185 17298 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.141876 16848 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:18:51.152340 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 61658.1us
I20260709 13:18:51.284377 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:51.285557 14297 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:51.205402 17051 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:51.275138 17595 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:51.257941 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:51.299677 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:51.287554 17596 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:51.315217 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 57411.5us
W20260709 13:18:51.266906 17556 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.603s	user 0.002s	sys 0.000s
W20260709 13:18:51.289523 17594 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:18:51.264539 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1859) took 3776 ms. Trace:
I20260709 13:18:51.289755 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:51.350835 17603 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.351402 17603 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:51.269384 17593 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:51.235421 14375 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:51.235085 14894 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
W20260709 13:18:51.279328 14192 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 2.248s (SENT)
W20260709 13:18:51.316846 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.200505 17592 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:51.317729 14223 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:51.349170 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:51.349387 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 216524us
I20260709 13:18:51.362509 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:51.363793 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46170.8us
I20260709 13:18:51.264608 16822 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:51.367499 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:51.350256 14221 rpcz_store.cc:276] 0709 13:18:47.487745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.847163 (+359418us) service_pool.cc:224] Handling call
0709 13:18:47.847772 (+   609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.848384 (+   612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.848413 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.849055 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.058963 (+209908us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:48.059007 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.059094 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.257420 (+3198326us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:18:51.264147 (+  6727us) raft_consensus.cc:1685] finished
0709 13:18:51.264176 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.264457 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":173,"spinlock_wait_cycles":16348544,"thread_start_us":209431,"threads_started":1,"wal-append.queue_time_us":2618713}
I20260709 13:18:51.370850 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:51.373946 14226 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:51.353639 17603 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:51.373986 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 94710.6us
I20260709 13:18:51.373129 14228 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.375664 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:51.375749 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:51.376559 14223 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:51.379714 14224 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:51.372360 14220 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:18:51.378122 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:51.349844 16848 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.384611 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:51.358254 17578 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:51.391570 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:51.292204 17576 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:51.404611 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:51.411459 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.359541 17449 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:18:51.385934 17416 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.387259 16848 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.443331 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:51.437606 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:51.431975 16973 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:51.434010 14378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.507s	user 0.016s	sys 0.008s
I20260709 13:18:51.444810 14224 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
W20260709 13:18:51.451252 14378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.524s	user 0.017s	sys 0.008s
I20260709 13:18:51.452163 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1901) took 4659 ms. Trace:
I20260709 13:18:51.452246 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:51.453212 14223 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:51.480360 14192 connection.cc:256] RPC call timeout handler was delayed by -2.0542055359999267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2276s for a response
W20260709 13:18:51.480719 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 89244.8us
I20260709 13:18:51.435909 17589 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.452533 14378 rpcz_store.cc:276] 0709 13:18:46.793092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.901126 (+1108034us) service_pool.cc:224] Handling call
0709 13:18:47.901631 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.926471 (+ 24840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.926505 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.927100 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.451825 (+3524725us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:51.451862 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.451947 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.451986 (+    39us) raft_consensus.cc:1685] finished
0709 13:18:51.451997 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.452103 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5526,"raft.queue_time_us":5666,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155,"thread_start_us":3524303,"threads_started":1,"wal-append.queue_time_us":2540487}
I20260709 13:18:51.490126 14220 raft_consensus.cc:2410] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:51.442793 16848 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.454262 17518 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:51.498605 17597 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:51.499433 17051 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:51.500448 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:51.507175 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:51.507910 14224 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:51.509387 14223 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:51.505550 14228 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:18:51.511001 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:51.512063 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:51.490258 17589 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:51.441691 17416 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:51.551883 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:51.561992 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:51.520402 17413 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:51.564370 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 179895us
I20260709 13:18:51.511683 17597 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:51.561239 17415 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 13:18:51.567833 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:51.549901 17589 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.522460 16973 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:51.570241 14228 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:51.590389 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:51.591390 14220 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 7: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:51.587239 17555 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:51.593140 17416 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:18:51.591727 17563 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:51.612998 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:51.610366 14270 connection.cc:256] RPC call timeout handler was delayed by -3.5195840060000592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 13:18:51.658979 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.032243 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 534323us
W20260709 13:18:52.022717 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 522324us
I20260709 13:18:52.033604 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:52.023412 14224 consensus_meta.cc:287] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.011s
W20260709 13:18:51.707325 17532 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.004s
W20260709 13:18:52.022454 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.029501 17444 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:51.647243 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:51.765324 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:51.702299 17413 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.025169 14222 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:52.036358 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.037009 17416 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.037554 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:51.945235 14370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 792) took 5786 ms (client timeout 1848 ms). Trace:
W20260709 13:18:52.038697 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 334576us
I20260709 13:18:52.040904 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.041515 17383 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:52.039991 17615 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:18:52.054193 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:52.051203 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.725035 17560 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.061s	user 0.000s	sys 0.001s
I20260709 13:18:52.045017 14895 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:51.648563 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.046244 14224 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
W20260709 13:18:52.046454 14270 connection.cc:256] RPC call timeout handler was delayed by -3.3755840060000537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
I20260709 13:18:52.047322 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:51.594312 17555 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:52.048529 14899 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:51.572978 17415 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:52.045658 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.062917 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.058193 17595 raft_consensus.cc:2764] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:52.046720 14220 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:52.049299 14898 raft_consensus.cc:2368] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8.
I20260709 13:18:52.053772 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:52.066735 14229 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.056347 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.057101 14227 raft_consensus.cc:2376] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8. Re-sending same reply.
I20260709 13:18:52.057673 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.068099 14221 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:52.060290 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:51.671826 17418 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:51.615778 17564 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.059273 14892 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:52.061691 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:52.065881 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.615356 17576 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:52.064883 16848 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.007s
I20260709 13:18:52.074261 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.064113 17444 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:18:52.077762 17614 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:52.079291 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:52.081060 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:52.050268 14370 rpcz_store.cc:269] 0709 13:18:46.145076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.233181 (+ 88105us) service_pool.cc:224] Handling call
0709 13:18:51.931204 (+5698023us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b540028c654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:51.931431 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026067328}
I20260709 13:18:52.050393 17532 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:52.090951 14301 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:52.088721 14222 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:52.089823 14226 raft_consensus.cc:2376] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8. Re-sending same reply.
I20260709 13:18:52.092983 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.093592 14226 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:52.094703 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.096398 14894 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:51.645573 17597 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.084316 17555 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.059659 17416 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.102799 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.087818 17616 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.108002 14303 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:52.104914 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.104223 14220 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:52.108315 14226 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:52.109262 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.110419 14226 raft_consensus.cc:2410] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:52.112109 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.100162 17614 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.114818 17564 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:52.115679 17614 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:52.117007 17415 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:52.121297 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.107416 17555 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:52.122910 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.123605 14228 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:52.124500 17555 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:52.126520 14250 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2820 after lost signal to thread 14328
W20260709 13:18:52.121472 17589 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.001s
I20260709 13:18:52.127581 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:52.130967 14250 debug-util.cc:398] Leaking SignalData structure 0x7b08003b25c0 after lost signal to thread 14329
I20260709 13:18:52.130934 14228 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:52.128536 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:52.134344 14250 debug-util.cc:398] Leaking SignalData structure 0x7b08003fa3a0 after lost signal to thread 14402
W20260709 13:18:52.135327 14250 debug-util.cc:398] Leaking SignalData structure 0x7b080031e980 after lost signal to thread 14925
I20260709 13:18:52.136957 17563 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:52.101775 17622 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:18:52.138373 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.138443 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.145223 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:52.146903 14222 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.138484 14901 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:18:52.139361 14250 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2000 after lost signal to thread 14926
W20260709 13:18:52.148239 14250 debug-util.cc:398] Leaking SignalData structure 0x7b0800399a80 after lost signal to thread 17163
I20260709 13:18:52.090494 16848 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.125314 17616 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.156790 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.159096 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:52.161540 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:52.163239 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.164492 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:52.163825 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:52.163894 14867 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:52.165874 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.166608 14228 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:52.167256 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:52.170796 14297 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:52.170197 17198 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:52.188366 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.188778 17198 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:52.189237 17198 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.176791 14895 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:52.191330 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.191444 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:52.191995 14228 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:52.139104 17589 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.195825 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:52.196552 14896 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.204288 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:52.199265 17615 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:52.206252 17615 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:52.206614 17615 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.207059 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.207931 14221 raft_consensus.cc:2410] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:18:52.208762 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.209304 14221 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:52.171234 17563 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:52.210122 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.211261 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 906) took 1006 ms. Trace:
I20260709 13:18:52.170615 17555 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:52.211428 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.169169 17415 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:52.205499 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:52.176877 17576 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:52.224685 14227 raft_consensus.cc:2376] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8. Re-sending same reply.
I20260709 13:18:52.225072 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.225586 14899 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.225045 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.169670 16973 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:18:52.232124 17532 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:52.232553 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.232997 16973 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:52.233490 16973 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:52.233992 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.234387 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.234910 14224 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:52.235291 14892 raft_consensus.cc:2410] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:18:52.235759 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.235980 17416 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:52.236620 14224 raft_consensus.cc:2410] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:52.230053 14895 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:52.231456 17616 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:52.227893 17576 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:52.250059 17576 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.239809 14228 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:52.240869 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:52.252007 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:52.252207 14221 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.252521 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.241535 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.221637 14898 rpcz_store.cc:276] 0709 13:18:51.204537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.204678 (+   141us) service_pool.cc:224] Handling call
0709 13:18:52.211045 (+1006367us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54007e7cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:52.211192 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812074752}
I20260709 13:18:52.243016 17622 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:52.237480 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.225085 17415 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:52.259415 14224 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:52.253260 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.255045 14229 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:52.261590 14229 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:52.262279 14896 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:52.266021 14899 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:52.273743 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:52.274770 14228 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.256047 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:52.223521 14222 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:18:52.301473 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:52.304121 14224 raft_consensus.cc:2368] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8.
W20260709 13:18:52.306485 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 228481us
W20260709 13:18:52.308584 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52594.3us
I20260709 13:18:52.264200 17415 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.265980 17418 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:52.341881 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:52.267089 17589 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:52.345086 14344 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:52.300294 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:52.346069 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 289667us
W20260709 13:18:52.344457 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.351137 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:52.347205 17518 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:52.348645 17555 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:52.305872 17622 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:52.350176 17383 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:52.348647 17404 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:52.361061 14898 raft_consensus.cc:2410] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:18:52.369539 16889 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:52.370004 16889 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:52.370849 16889 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.371833 16889 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.378461 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:52.379135 14372 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.379480 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:52.380822 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:52.381393 14369 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.382153 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:52.382876 14374 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:52.359609 17525 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:52.387406 14270 connection.cc:256] RPC call timeout handler was delayed by -3.126284005999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:18:52.387845 14372 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:18:52.388183 14228 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:52.361630 17555 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.388732 14221 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
W20260709 13:18:52.391310 14270 connection.cc:256] RPC call timeout handler was delayed by -3.0110840059999191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
I20260709 13:18:52.368865 17404 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:18:52.394840 14270 connection.cc:256] RPC call timeout handler was delayed by -2.8335973920000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 13:18:52.396706 14270 connection.cc:256] RPC call timeout handler was delayed by -2.7979550820000441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 13:18:52.397004 14221 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:18:52.397274 14270 connection.cc:256] RPC call timeout handler was delayed by -2.68708400599985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2577s for a response
W20260709 13:18:52.397672 14270 connection.cc:256] RPC call timeout handler was delayed by -2.6753840060000584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.259s for a response
W20260709 13:18:52.398025 14270 connection.cc:256] RPC call timeout handler was delayed by -2.4035840060000737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2892s for a response
W20260709 13:18:52.398650 14270 connection.cc:256] RPC call timeout handler was delayed by -2.0390840059999391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32970000000000005s for a response
W20260709 13:18:52.387009 17626 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:52.368552 17518 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:52.384357 16848 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:52.412603 14369 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:52.389823 17525 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.396695 17555 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.471889 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.472617 14897 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:52.474195 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:52.442224 17518 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.444689 17525 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.441497 17404 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.449572 17622 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:52.452972 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:52.479240 14374 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:52.453886 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:52.454947 17627 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:52.379137 14898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2582e91d201c4063b3eff5158b611448"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:58440
W20260709 13:18:52.458127 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 55023us
I20260709 13:18:52.453936 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2408) took 2590 ms. Trace:
I20260709 13:18:52.402746 17584 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:18:52.463690 17383 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:52.463619 17615 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:52.473584 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:52.476539 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:52.484288 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:52.507814 14897 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.508131 14894 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.493989 17618 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.495759 17628 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:52.496114 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51189.2us
I20260709 13:18:52.496179 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:52.527822 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:52.487116 14299 rpcz_store.cc:276] 0709 13:18:49.811443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.811732 (+   289us) service_pool.cc:224] Handling call
0709 13:18:49.840633 (+ 28901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.879253 (+ 38620us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:49.879290 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.879342 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:49.879383 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.401395 (+2522012us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b54001a1654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:52.401457 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.401595 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88190848}
I20260709 13:18:52.483749 17404 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.486570 16848 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.510608 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:52.535005 14374 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:18:52.512959 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 169871us
I20260709 13:18:52.512646 17383 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:52.581826 14302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2415) took 2640 ms (client timeout 3114 ms). Trace:
W20260709 13:18:52.585444 14302 rpcz_store.cc:269] 0709 13:18:49.941720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.969443 (+ 27723us) service_pool.cc:224] Handling call
0709 13:18:52.581515 (+2612072us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b54000dded4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:52.581682 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158805888}
I20260709 13:18:52.586851 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2409) took 1291 ms. Trace:
I20260709 13:18:52.512470 14898 raft_consensus.cc:606] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:52.589589 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:52.582401 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:52.587443 14297 rpcz_store.cc:276] 0709 13:18:51.288523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.390521 (+101998us) service_pool.cc:224] Handling call
0709 13:18:52.579398 (+1188877us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54001f8454. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:52.579578 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1760080128}
I20260709 13:18:52.541114 17614 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:52.543010 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.577979 17629 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:52.612895 14897 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
W20260709 13:18:52.725111 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.713480 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:52.612071 14894 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
W20260709 13:18:52.726507 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.726681 14374 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:52.714221 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:52.745654 14369 raft_consensus.cc:1813] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Handling vote request from an unknown peer bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:52.746620 14369 raft_consensus.cc:2410] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:18:52.575314 17518 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:52.578342 17633 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 13:18:52.542106 16848 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.612469 17614 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.838165 14270 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:52.563843 17415 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:52.711992 17502 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:52.845973 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.846042 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 263726us
I20260709 13:18:52.531554 17618 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:52.846689 17614 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.851974 17383 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:52.866228 14374 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:52.812176 17629 raft_consensus.cc:697] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:52.895057 14372 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:52.901753 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:52.904204 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.910457 14222 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:52.876565 17616 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:52.880066 17109 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:52.960317 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:52.961333 14225 raft_consensus.cc:2376] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8. Re-sending same reply.
I20260709 13:18:52.969159 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:52.970600 14222 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.980326 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:52.981420 14376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2179) took 1822 ms (client timeout 1986 ms). Trace:
W20260709 13:18:52.981843 14376 rpcz_store.cc:269] 0709 13:18:51.159307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.966730 (+1807423us) service_pool.cc:224] Handling call
0709 13:18:52.981319 (+ 14589us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:52.965013 17198 consensus_meta.cc:287] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.774s	user 0.010s	sys 0.003s
W20260709 13:18:52.984702 14225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2261) took 2779 ms (client timeout 1740 ms). Trace:
W20260709 13:18:53.000072 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.000375 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 797) took 6622 ms. Trace:
W20260709 13:18:53.004344 14225 rpcz_store.cc:269] 0709 13:18:50.192643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.201455 (+  8812us) service_pool.cc:224] Handling call
0709 13:18:52.960158 (+2758703us) spinlock_profiling.cc:243] Waited 887 us on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67eee 0000000000375939 00007f8df1fdb1e0 00007f8df20a40c4 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:52.972399 (+ 12241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068224}
W20260709 13:18:53.025089 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 168271us
W20260709 13:18:53.005259 17597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.003s	sys 0.028s
I20260709 13:18:52.959767 17109 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.007063 14373 rpcz_store.cc:276] 0709 13:18:46.150697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.049256 (+898559us) service_pool.cc:224] Handling call
0709 13:18:48.667555 (+1618299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.667987 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.668009 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.859164 (+191155us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.010606 (+151442us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:49.010676 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.092774 (+ 82098us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.998330 (+1905556us) raft_consensus.cc:1685] finished
0709 13:18:50.998350 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.606927 (+1608577us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400349ed0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:52.772623 (+165696us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3699029376,"thread_start_us":150815,"threads_started":1,"wal-append.queue_time_us":1631405,"wal-append.run_cpu_time_us":3826,"wal-append.run_wall_time_us":1493658}
I20260709 13:18:52.967648 17616 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 13:18:53.032526 17597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.003s	sys 0.029s
W20260709 13:18:53.044296 17525 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.003s
I20260709 13:18:53.044802 17525 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:53.046468 17646 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:53.050112 17629 consensus_queue.cc:237] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:53.063561 14303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2430) took 1799 ms (client timeout 2147 ms). Trace:
W20260709 13:18:53.064220 14303 rpcz_store.cc:269] 0709 13:18:51.264440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.270846 (+  6406us) service_pool.cc:224] Handling call
0709 13:18:53.063273 (+1792427us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54000dc5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:53.063473 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911300992}
W20260709 13:18:53.067620 17642 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:18:53.014504 17198 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.069949 17109 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:53.071415 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 44493.4us
I20260709 13:18:53.072923 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.074836 17588 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.077311 14371 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:53.030354 17615 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:53.081530 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:53.066673 17404 consensus_meta.cc:287] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
W20260709 13:18:53.095724 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 284088us
I20260709 13:18:53.101058 16848 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:53.101490 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.095551 17588 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:53.096698 17645 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:18:53.098024 17618 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:53.113413 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:53.115990 14225 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:53.099977 17576 consensus_meta.cc:287] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.849s	user 0.008s	sys 0.005s
I20260709 13:18:53.100319 17525 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:53.101686 17593 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:53.112006 14222 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:53.136883 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:53.137717 14222 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:53.113391 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:53.113510 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 477499us
I20260709 13:18:53.139127 14375 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
W20260709 13:18:53.105202 14864 leader_election.cc:336] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.824s (SENT)
I20260709 13:18:53.140045 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:53.140525 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.102612 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.145620 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.114820 16848 raft_consensus.cc:2764] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:53.150682 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:53.151368 14375 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:53.156819 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 54326.8us
W20260709 13:18:53.156773 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 236743us
I20260709 13:18:53.144169 17109 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:53.113308 17603 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.011s	sys 0.029s
I20260709 13:18:53.143839 17615 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:53.163344 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2301) took 1044 ms. Trace:
I20260709 13:18:53.145063 17415 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:53.165994 14229 rpcz_store.cc:276] 0709 13:18:52.118559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.262361 (+143802us) service_pool.cc:224] Handling call
0709 13:18:52.300834 (+ 38473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:52.312653 (+ 11819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.342355 (+ 29702us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:52.344282 (+  1927us) log.cc:844] Serialized 26 byte log entry
0709 13:18:52.607136 (+262854us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:52.607189 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.607263 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.163107 (+555844us) raft_consensus.cc:1685] finished
0709 13:18:53.163132 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.163275 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44556,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":7291,"thread_start_us":245058,"threads_started":1,"wal-append.queue_time_us":564279}
I20260709 13:18:53.174132 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:53.164880 17603 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.011s	sys 0.029s
I20260709 13:18:53.180969 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:53.182241 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.185060 14897 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:53.185454 14894 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:53.183137 14373 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:53.136124 17576 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:53.189170 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.200287 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:53.201074 14373 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:53.201303 14894 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:53.202888 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.204986 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.177912 17525 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:53.206876 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:53.207585 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:53.209468 14894 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:53.217310 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.219885 14900 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:18:53.214278 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:53.220809 14373 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:53.222335 14376 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:53.223464 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.224148 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.226507 14222 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:18:53.227337 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.223485 14897 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:18:53.222348 14375 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:53.229008 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.229105 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.237531 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.238818 14896 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:53.188231 17615 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.241757 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:53.246554 14341 connection.cc:256] RPC call timeout handler was delayed by -1.7370768849998512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2413s for a response
I20260709 13:18:53.242789 14895 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:53.250442 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:53.251511 14897 raft_consensus.cc:2368] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8.
I20260709 13:18:53.258527 14900 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:53.263960 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:53.264487 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.264943 14896 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:53.237885 17532 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:53.247588 17555 consensus_meta.cc:287] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.000s
I20260709 13:18:53.272117 14375 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:53.267508 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:53.273229 17383 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:53.273607 17383 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.273658 14341 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.274134 17383 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.274904 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.275655 16822 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:53.276983 14341 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.277771 16822 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:53.229077 17525 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:53.278118 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54048us
I20260709 13:18:53.284899 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.287645 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:53.290331 17658 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:18:53.290668 17525 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:53.291734 17661 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:18:53.294238 17647 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:18:53.295320 17615 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:53.296023 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.296795 14377 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 6: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:53.297605 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.297719 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.284477 17518 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:53.317030 14225 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:53.319819 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.272511 17532 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:53.315217 14270 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:53.334988 14895 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:18:53.335433 14895 pending_rounds.cc:85] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 8
I20260709 13:18:53.341845 14895 pending_rounds.cc:107] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:18:53.342159 14895 raft_consensus.cc:2889] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:53.344306 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 86818.2us
I20260709 13:18:53.283474 17555 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:53.348657 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:53.335734 17532 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.354022 14225 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:53.358654 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:53.358904 14370 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:53.359297 14229 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:53.362794 14220 raft_consensus.cc:2393] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:53.349596 17629 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:53.365769 17629 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:53.366369 17629 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.369239 14867 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:53.370106 14223 raft_consensus.cc:2410] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:18:53.373198 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.374148 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:53.374454 14895 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:53.360849 17614 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:53.341379 17518 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.375598 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.391927 14375 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
W20260709 13:18:53.376405 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64873.9us
I20260709 13:18:53.392449 14229 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:53.379321 17555 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:53.391927 14373 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:53.383162 17383 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.385149 17576 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:53.407771 17383 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:53.411348 17614 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:53.412873 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:53.408444 14302 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:53.413640 14225 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:53.374226 17629 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:53.396916 17298 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:53.397099 14297 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:53.425527 17629 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:53.398295 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:53.425864 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:53.401054 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:53.398310 14301 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:53.394133 17582 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:53.435969 14225 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:53.400336 14377 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:53.401597 17518 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:53.440058 16973 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.446995 14267 leader_election.cc:400] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8.
I20260709 13:18:53.447435 14267 leader_election.cc:403] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:53.448060 17413 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:53.448202 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:53.449144 17614 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:53.449530 17614 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:53.449602 14267 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.449956 17614 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.450615 17659 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.401996 14867 leader_election.cc:400] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8.
I20260709 13:18:53.403113 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.421433 17528 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:53.451556 14867 leader_election.cc:403] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:18:53.408078 17671 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.451903 14895 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:18:53.452081 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60872.7us
I20260709 13:18:53.452391 17671 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8.
I20260709 13:18:53.452754 14867 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:53.455554 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:53.456485 17659 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:53.457055 17659 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:53.457175 14220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2291) took 1393 ms (client timeout 1776 ms). Trace:
W20260709 13:18:53.457680 14220 rpcz_store.cc:269] 0709 13:18:52.064779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.108950 (+ 44171us) service_pool.cc:224] Handling call
0709 13:18:53.456960 (+1348010us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002a17d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:53.457095 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2796167040}
I20260709 13:18:53.361711 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.459386 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:53.459919 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.460201 17418 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:53.411978 17532 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.460688 17418 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:53.461570 17418 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.462479 17532 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:53.453663 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:53.463429 17198 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:53.425426 14229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42c37f8aa458494687312360eddb12a9"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:18:53.397928 17410 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:53.464318 17394 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:53.398517 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:53.464877 17394 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:18:53.465489 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67062.8us
I20260709 13:18:53.429097 14375 raft_consensus.cc:2376] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7. Re-sending same reply.
I20260709 13:18:53.429883 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.471307 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.471947 14375 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:18:53.472340 17614 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.464509 14229 raft_consensus.cc:606] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:53.473333 14229 raft_consensus.cc:614] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:53.465989 17394 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:53.474807 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.466971 17672 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:53.468458 17616 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:53.459710 17597 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:53.480484 17616 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:53.481442 17616 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:53.457121 17298 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:53.503696 17298 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:53.508598 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1956) took 1025 ms. Trace:
I20260709 13:18:53.510905 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1937) took 1135 ms. Trace:
I20260709 13:18:53.511454 14370 rpcz_store.cc:276] 0709 13:18:52.375483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.380048 (+  4565us) service_pool.cc:224] Handling call
0709 13:18:52.380353 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.359262 (+978909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.509680 (+150418us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54001b9754. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:53.510816 (+  1136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2249935104}
I20260709 13:18:53.512744 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.515611 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.516619 14377 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:53.481937 17597 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:53.519146 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1945) took 1123 ms. Trace:
I20260709 13:18:53.519431 17597 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:53.519598 14372 rpcz_store.cc:276] 0709 13:18:52.395568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.415613 (+ 20045us) service_pool.cc:224] Handling call
0709 13:18:52.416141 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.895751 (+479610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.518922 (+623171us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54002ec554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:53.519095 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100736256}
I20260709 13:18:53.520740 17597 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:53.520834 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:53.522282 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1948) took 1071 ms. Trace:
I20260709 13:18:53.522670 14371 rpcz_store.cc:276] 0709 13:18:52.450519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.452438 (+  1919us) service_pool.cc:224] Handling call
0709 13:18:52.452795 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.077756 (+624961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.522038 (+444282us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54003340d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:53.522210 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435770240}
I20260709 13:18:53.523794 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.524502 14371 raft_consensus.cc:2393] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:53.505069 17298 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.525215 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.460680 14374 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:53.521646 16973 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.526945 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:53.528061 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.529107 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.529590 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:53.530174 14304 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.530400 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 776) took 1356 ms. Trace:
I20260709 13:18:53.532624 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:53.533435 17563 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:53.533826 17563 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:53.534194 17563 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:53.534776 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 777) took 1360 ms. Trace:
I20260709 13:18:53.535389 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.535998 14369 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:53.536811 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.537672 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:53.538436 14223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 1880) took 1988 ms (client timeout 1615 ms). Trace:
W20260709 13:18:53.538801 14223 rpcz_store.cc:269] 0709 13:18:51.550286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.550839 (+   553us) service_pool.cc:224] Handling call
0709 13:18:53.538251 (+1987412us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54003359d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:53.538373 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4178653568}
W20260709 13:18:53.541018 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 148218us
I20260709 13:18:53.541764 14228 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:18:53.542150 14228 pending_rounds.cc:85] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 6
I20260709 13:18:53.542158 17662 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:53.542941 17662 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.542557 14228 pending_rounds.cc:107] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:18:53.545059 14228 raft_consensus.cc:2889] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:53.513525 14370 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:53.546298 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:53.546758 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.547154 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:53.547345 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:53.547446 14370 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
W20260709 13:18:53.548115 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.535128 14224 rpcz_store.cc:276] 0709 13:18:52.174476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.886884 (+712408us) service_pool.cc:224] Handling call
0709 13:18:52.925060 (+ 38176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.976743 (+ 51683us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:53.186992 (+210249us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.534302 (+347310us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.534445 (+   143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.534492 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:53.534542 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.534604 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.534710 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200662,"prepare.queue_time_us":65121,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":198274,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":336304,"threads_started":2,"wal-append.queue_time_us":189214}
I20260709 13:18:53.551470 14226 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:53.555738 14297 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:53.548635 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.555749 14298 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:53.556931 14374 raft_consensus.cc:2410] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:53.548447 14378 raft_consensus.cc:2368] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7.
I20260709 13:18:53.549501 14299 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.530776 14221 rpcz_store.cc:276] 0709 13:18:52.174178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.398071 (+223893us) service_pool.cc:224] Handling call
0709 13:18:52.439706 (+ 41635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.446722 (+  7016us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:52.921290 (+474568us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.236124 (+314834us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.379618 (+143494us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b18004453c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f6d2a6 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1
0709 13:18:53.380148 (+   530us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b18004453c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:18:53.529483 (+149335us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b18004453c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:18:53.529853 (+   370us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.530034 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.530124 (+    90us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:53.530178 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.530241 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.530348 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":281,"prepare.queue_time_us":553997,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":85,"raft.queue_time_us":660,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6451,"spinlock_wait_cycles":37656448,"thread_start_us":708110,"threads_started":2,"wal-append.queue_time_us":406028}
I20260709 13:18:53.458104 17659 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.472822 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.568289 14304 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:53.567613 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:53.509160 14376 rpcz_store.cc:276] 0709 13:18:52.483053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.982558 (+499505us) service_pool.cc:224] Handling call
0709 13:18:52.982920 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.228893 (+245973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.508348 (+279455us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54000b9854. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:53.508530 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550008576}
I20260709 13:18:53.585484 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:53.588354 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:53.585678 14341 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:53.590222 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 122430us
I20260709 13:18:53.590312 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:53.591035 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.593039 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:53.592926 17563 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.593564 17519 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.594244 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:53.594456 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:53.594826 14896 raft_consensus.cc:2376] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8. Re-sending same reply.
I20260709 13:18:53.595599 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:53.596282 14301 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:53.596915 14341 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.598157 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:53.548331 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.521654 14372 raft_consensus.cc:2368] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8.
I20260709 13:18:53.561484 14371 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:53.560696 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:53.562865 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.562144 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:53.605247 14369 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:53.596979 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:53.562099 17662 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:53.605556 14370 raft_consensus.cc:2376] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7. Re-sending same reply.
I20260709 13:18:53.612941 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:53.517455 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:53.611445 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:53.624945 14296 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:53.624364 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 76114us
I20260709 13:18:53.613994 14375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
W20260709 13:18:53.613822 14192 connection.cc:256] RPC call timeout handler was delayed by -1.6445973650002088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:18:53.627269 14192 connection.cc:256] RPC call timeout handler was delayed by -1.6445973650002088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:18:53.627696 14192 connection.cc:256] RPC call timeout handler was delayed by -1.6076973650001491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 13:18:53.614460 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:53.627524 14377 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
W20260709 13:18:53.628389 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3970973650002634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 13:18:53.629878 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3880973650002488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 13:18:53.630262 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3880973650002488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260709 13:18:53.631296 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:53.630614 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3268973650001499s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
I20260709 13:18:53.632043 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:53.632356 14192 connection.cc:256] RPC call timeout handler was delayed by -1.2485973650002506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 13:18:53.632798 14192 connection.cc:256] RPC call timeout handler was delayed by -1.2323973650002245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 13:18:53.633224 14192 connection.cc:256] RPC call timeout handler was delayed by -1.22969736500022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
I20260709 13:18:53.632586 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:18:53.633968 14192 connection.cc:256] RPC call timeout handler was delayed by -1.1684973650001211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
I20260709 13:18:53.578528 17504 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:53.638089 17504 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:53.638617 17504 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:53.612787 17198 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:53.508739 17614 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:53.642416 14341 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:53.647872 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.626592 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:53.650332 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:53.626564 14375 raft_consensus.cc:606] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:53.650918 14375 raft_consensus.cc:614] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:53.651081 14302 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:53.658273 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:53.666344 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.674978 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2300) took 1570 ms. Trace:
I20260709 13:18:53.565855 17629 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:18:53.554605 17582 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.611264 17415 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:53.694535 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 103573us
I20260709 13:18:53.633711 17334 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.624194 17576 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.685424 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:53.693084 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 855) took 1657 ms. Trace:
I20260709 13:18:53.693459 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:53.705288 14296 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:53.641350 17555 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:53.699661 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55382.8us
I20260709 13:18:53.699949 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:53.711380 14298 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:53.675410 14227 rpcz_store.cc:276] 0709 13:18:52.107074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.261232 (+154158us) service_pool.cc:224] Handling call
0709 13:18:52.266279 (+  5047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.392013 (+125734us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:52.902764 (+510751us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.115872 (+213108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.115922 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:53.115972 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.674741 (+558769us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540033cf54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:53.674798 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.674912 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9477,"prepare.queue_time_us":593114,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":111,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":20005,"spinlock_wait_cycles":288691968,"thread_start_us":702109,"threads_started":2,"wal-append.queue_time_us":287301}
I20260709 13:18:53.589104 17584 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:18:53.707139 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:53.660740 17525 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:53.705097 14901 rpcz_store.cc:276] 0709 13:18:52.036814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.037458 (+   644us) service_pool.cc:224] Handling call
0709 13:18:52.037764 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.147603 (+109839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.674436 (+1526833us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54005212d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:53.693011 (+ 18575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230857984}
I20260709 13:18:53.713776 14377 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:53.713398 14270 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.710541 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:53.718366 17482 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.719879 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:53.714259 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:53.674252 17198 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:53.723747 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 110878us
I20260709 13:18:53.715596 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1959) took 1175 ms. Trace:
I20260709 13:18:53.623471 17406 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:18:53.725435 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.741117 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:53.708874 17262 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:53.747745 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 103791us
I20260709 13:18:53.748368 14374 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:53.748303 17685 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:53.749120 17506 raft_consensus.cc:2764] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:18:53.750344 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 123831us
I20260709 13:18:53.712790 17383 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:53.764921 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:53.765638 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:18:53.761072 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49035.3us
I20260709 13:18:53.767853 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.711495 17334 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.676640 17593 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:18:53.685966 17595 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:18:53.773084 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 47878.2us
I20260709 13:18:53.719091 17482 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.779040 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:53.751047 17418 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:53.712200 16973 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:18:53.743395 17525 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:53.782178 14192 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:53.763002 17262 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:53.783201 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 117280us
I20260709 13:18:53.710475 16822 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:18:53.797978 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:53.788396 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 126656us
I20260709 13:18:53.760996 17198 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:53.772014 17513 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:53.769970 17383 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:53.774034 17414 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:53.803999 14369 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:18:53.789366 17622 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:53.807610 14376 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:53.780893 17692 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:53.802531 17615 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:53.809641 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45081.4us
I20260709 13:18:53.814849 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:53.785593 17418 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:53.822722 14893 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:53.806716 17383 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:53.823582 17688 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
I20260709 13:18:53.818472 17506 raft_consensus.cc:2764] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:53.823691 17414 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:53.826004 17678 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 13:18:53.826725 17576 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:53.827750 17525 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.777005 17685 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:53.829222 17582 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:53.801156 17629 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:18:53.866959 17629 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:53.867314 17629 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:53.867743 17685 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:53.868139 17629 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:53.830293 17563 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:53.797387 17262 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.843905 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:53.874854 17618 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:53.875295 17618 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.875636 17618 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:53.876266 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:53.878525 17677 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:18:53.736899 14371 rpcz_store.cc:276] 0709 13:18:52.539839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.604458 (+1064619us) service_pool.cc:224] Handling call
0709 13:18:53.604794 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.605034 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:53.633092 (+ 28058us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.695394 (+ 62302us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.715258 (+ 19864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.715322 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:53.715374 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.715437 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.715542 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40800,"prepare.queue_time_us":94753,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":2325,"raft.queue_time_us":170576,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7206,"spinlock_wait_cycles":20078592,"thread_start_us":45517,"threads_started":1,"wal-append.queue_time_us":105233}
I20260709 13:18:53.869510 17629 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:53.880744 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 98711us
I20260709 13:18:53.882225 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:53.847126 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79080.3us
I20260709 13:18:53.823717 16822 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:53.819546 17622 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:53.862346 14301 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:53.828325 17695 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:53.846560 17687 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.208s	user 0.000s	sys 0.004s
I20260709 13:18:53.796988 17662 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:18:53.864245 17198 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:53.864929 17601 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:18:53.831110 17692 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:53.880234 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:53.869426 17413 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8.
I20260709 13:18:53.883395 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:53.929136 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 155569us
I20260709 13:18:53.945303 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.907657 14304 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:53.902899 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2305) took 1768 ms. Trace:
W20260709 13:18:53.855414 17644 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:53.858132 17689 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:18:53.946578 14270 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:53.847708 17418 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:53.866132 17679 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:18:53.955786 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1958) took 1422 ms. Trace:
I20260709 13:18:53.880167 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:53.950225 14228 rpcz_store.cc:276] 0709 13:18:52.134568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.395790 (+261222us) service_pool.cc:224] Handling call
0709 13:18:53.541463 (+1145673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.553435 (+ 11972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.902655 (+349220us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003359d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:53.902825 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2634013568}
I20260709 13:18:53.883438 17685 raft_consensus.cc:2764] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:53.982154 14372 rpcz_store.cc:276] 0709 13:18:52.533384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.603936 (+1070552us) service_pool.cc:224] Handling call
0709 13:18:53.644235 (+ 40299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.644424 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:53.694468 (+ 50044us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.955394 (+260926us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.955457 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:53.955518 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.955599 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.955722 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14493,"prepare.queue_time_us":51881,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":6184,"thread_start_us":246030,"threads_started":1}
I20260709 13:18:53.979489 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:53.986683 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:53.856884 17691 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:53.943310 17622 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:53.898756 17415 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:54.002921 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 223980us
I20260709 13:18:53.946617 17692 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:53.978121 17588 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:54.007143 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 123833us
I20260709 13:18:53.978780 16822 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:53.935298 17504 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:53.897259 17616 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.004300 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:54.006167 17415 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.999437 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:53.884358 17618 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.027827 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:54.039338 17698 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:54.039968 17698 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:54.040621 17712 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:54.041191 17712 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:54.040917 17698 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.028388 14342 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:53.954140 17615 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:18:54.033212 14295 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:53.978647 17582 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:18:54.045559 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 787) took 1803 ms. Trace:
I20260709 13:18:54.029124 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:54.030798 17413 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:54.021364 17662 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:54.111868 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 82799.5us
I20260709 13:18:54.098155 14222 rpcz_store.cc:276] 0709 13:18:52.241777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.236207 (+994430us) service_pool.cc:224] Handling call
0709 13:18:53.239595 (+  3388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.673621 (+434026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.673697 (+    76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.693953 (+ 20256us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.818038 (+124085us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:53.822358 (+  4320us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.822565 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.822635 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.045329 (+222694us) raft_consensus.cc:1685] finished
0709 13:18:54.045347 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.045490 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267807,"prepare.queue_time_us":11686,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":289332,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":6234,"thread_start_us":195988,"threads_started":2,"wal-append.queue_time_us":322791}
I20260709 13:18:54.034499 17710 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:54.142885 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:54.051293 17504 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:54.045987 17713 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.059625 17694 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:54.104233 17691 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:54.038647 17334 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.160727 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:54.143352 17710 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:54.048156 17414 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:54.003356 17693 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:18:54.026837 17685 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:18:54.102705 17413 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:54.166527 14372 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:54.049767 17482 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:54.179620 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.149473 17588 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:54.026453 16822 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.231103 17588 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:54.232125 17588 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.054226 17506 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
W20260709 13:18:54.209913 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 171136us
W20260709 13:18:54.212152 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 220035us
W20260709 13:18:54.212309 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 51642.1us
I20260709 13:18:54.237298 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.192471 17705 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:54.237957 17705 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:54.238592 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:54.238801 17705 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.237429 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:54.239810 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.240483 17555 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:54.240775 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.241971 17506 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.161854 17262 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.249915 14900 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:54.225278 17519 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:54.251473 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.251932 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:54.216450 17593 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:54.042083 17712 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.256778 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:54.246920 17598 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.255995 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.271157 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.272424 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.273404 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:18:54.267849 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 321346us
I20260709 13:18:54.247120 17518 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:54.244537 17555 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:54.253257 17519 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:54.288471 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:54.246199 17451 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.290136 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.265151 17672 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:54.268795 17593 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:54.269219 17406 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:54.247629 17614 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:18:54.276576 17410 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:54.275799 17513 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:54.279072 17584 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:54.279331 17694 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:54.305948 14378 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:54.278476 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:54.291713 17685 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:54.347201 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:54.353669 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:54.354218 14376 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.325325 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:54.288266 17404 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:54.356292 14374 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:18:54.358551 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 74408us
I20260709 13:18:54.358882 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.291085 17672 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.363256 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:54.358887 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80474.4us
I20260709 13:18:54.293197 17595 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:54.364215 17506 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:54.364275 17410 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:54.370875 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:54.366032 17672 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:54.366801 17394 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:54.373643 17394 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:54.374241 17394 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:54.374333 17711 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:18:54.375299 17691 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:54.375765 17691 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.366916 17694 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:54.376897 17694 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.378661 17451 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:54.379102 17451 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:54.379503 17451 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.302556 17513 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:54.368472 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.371133 17410 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.380000 17513 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.364279 17298 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:54.382171 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 92110.3us
I20260709 13:18:54.382953 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:54.383719 17298 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.383946 14192 leader_election.cc:400] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7.
I20260709 13:18:54.385102 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.385762 17595 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:54.386044 17506 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.386516 17595 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:54.387176 17595 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.305830 17699 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:54.386425 17721 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:18:54.395789 17601 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:54.390471 17518 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.385300 14864 leader_election.cc:400] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8.
W20260709 13:18:54.434864 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49800.8us
I20260709 13:18:54.435639 14864 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:18:54.402221 17718 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 13:18:54.402945 17716 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:18:54.401203 17691 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.281975 17710 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.326068 17519 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.401325 17394 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:54.409703 17719 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:18:54.410166 17706 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:54.405185 17684 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:54.413358 17705 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.414315 17555 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.414894 17334 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:54.376072 17415 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:54.416339 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53188.5us
I20260709 13:18:54.416894 17720 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.299896 17593 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.424615 14376 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:18:54.300355 17406 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:54.427816 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.303961 17616 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:54.360975 17685 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:54.449100 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.469890 17482 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:54.527639 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 78636.7us
I20260709 13:18:54.495756 17684 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:54.497432 17334 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:54.515020 17629 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.634s	user 0.012s	sys 0.000s
I20260709 13:18:54.506271 17706 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:54.420884 17699 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:54.474257 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:54.552248 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 78104.7us
I20260709 13:18:54.553251 14193 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.475308 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.496124 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2415) took 1102 ms. Trace:
I20260709 13:18:54.413590 17618 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.327049 17413 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.468881 17601 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.571852 17601 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.512866 17406 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.519819 17685 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:54.559453 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.519161 17707 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.522359 17519 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.482440 17663 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:18:54.554821 14303 rpcz_store.cc:276] 0709 13:18:53.393247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.393392 (+   145us) service_pool.cc:224] Handling call
0709 13:18:53.398584 (+  5192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.715642 (+317058us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:53.992848 (+277206us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.186695 (+193847us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.186788 (+    93us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:54.186886 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.495838 (+308952us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54001a0ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:54.495890 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.496045 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":78245,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2192,"raft.queue_time_us":36269,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":77,"spinlock_wait_cycles":728694144,"thread_start_us":415096,"threads_started":2,"wal-append.queue_time_us":280250}
I20260709 13:18:54.541267 17563 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.523530 17518 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:18:54.559008 17695 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:54.598929 14376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:47988
I20260709 13:18:54.599578 14376 raft_consensus.cc:606] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.599915 14376 raft_consensus.cc:614] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:54.600709 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:54.582624 17383 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.718s	user 0.011s	sys 0.000s
I20260709 13:18:54.578857 17588 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:54.602973 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:54.590005 17479 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.611531 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:54.590431 17506 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:54.627607 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:54.618383 14229 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.449466 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1960) took 1634 ms. Trace:
I20260709 13:18:54.621276 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:54.632979 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:54.634455 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:54.558228 17298 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:18:54.622951 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:54.636868 17298 raft_consensus.cc:3055] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:54.637364 17298 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:54.638538 17298 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.640841 17298 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.629959 14370 rpcz_store.cc:276] 0709 13:18:52.815442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.623398 (+807956us) service_pool.cc:224] Handling call
0709 13:18:53.631046 (+  7648us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:53.631408 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.631435 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:53.657979 (+ 26544us) log.cc:844] Serialized 52 byte log entry
0709 13:18:53.994778 (+336799us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:54.435839 (+441061us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.436257 (+   418us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.446606 (+ 10349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.449206 (+  2600us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.449252 (+    46us) raft_consensus.cc:1685] finished
0709 13:18:54.449265 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.449411 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59470,"prepare.queue_time_us":18855,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":89,"raft.queue_time_us":10437,"raft.run_cpu_time_us":421,"raft.run_wall_time_us":48691,"spinlock_wait_cycles":72651008,"thread_start_us":692344,"threads_started":2,"wal-append.queue_time_us":469998}
I20260709 13:18:54.593139 17198 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:54.653290 14222 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:18:54.594928 17482 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:54.578624 17672 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:18:54.600756 17695 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:54.588462 16973 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:18:54.669245 14225 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:54.671149 14220 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:54.672070 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:54.626631 17597 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.105s	user 0.006s	sys 0.009s
I20260709 13:18:54.677055 14227 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:54.693902 14229 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:54.698853 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:54.699692 14227 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.601197 17563 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.610638 17383 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.709896 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:18:54.710326 14375 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:54.711542 17383 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:54.676450 17695 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.716529 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:18:54.703510 17692 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.000s
I20260709 13:18:54.652380 17699 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.683938 17588 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.594036 17707 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:54.721519 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 246313us
W20260709 13:18:54.728363 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 164440us
I20260709 13:18:54.730862 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:54.734299 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 306518us
I20260709 13:18:54.735795 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:54.668839 17198 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.722146 17672 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:54.667642 17334 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:54.751719 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 198466us
I20260709 13:18:54.765769 14295 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:54.756757 14303 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:54.770166 14220 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 13:18:54.772907 14295 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:54.630005 17684 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.776681 14297 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:54.730803 17691 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.774819 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:54.777808 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:54.777820 17394 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:54.749171 17699 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.768831 17722 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.775818 17672 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.781296 17513 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.798866 17722 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:54.800819 17736 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:18:54.801723 17729 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:18:54.728330 17692 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.814128 17588 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:54.788628 17698 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:54.789400 17720 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:54.818113 17746 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.818554 17691 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.819018 17394 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:54.819011 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.819602 17563 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:54.693159 17706 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.806202 17745 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:54.824738 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:54.828433 14227 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:54.784343 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:54.840828 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:54.845810 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:54.847150 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 111504us
W20260709 13:18:54.843327 17598 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.000s
W20260709 13:18:54.843281 17418 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.849s	user 0.005s	sys 0.007s
W20260709 13:18:54.843020 17622 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.816s	user 0.010s	sys 0.002s
I20260709 13:18:54.857929 14228 raft_consensus.cc:1813] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Handling vote request from an unknown peer bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:54.821245 17198 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:54.843493 17734 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:54.864148 14299 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
W20260709 13:18:54.843232 17735 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:18:54.848361 17737 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:18:54.872438 14300 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:54.873003 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.897706 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:54.874871 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 138126us
I20260709 13:18:54.784291 17525 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:18:54.903584 17525 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:54.904033 17525 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:54.905015 17525 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.907883 17525 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.909353 14270 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:54.881877 14227 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:54.910699 14270 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:54.910876 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:54.911422 17692 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.911303 17593 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.912051 17692 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:54.885205 14228 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:54.912243 17712 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:54.914198 17751 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.914357 17451 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.003s
I20260709 13:18:54.914844 17451 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.917040 17451 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.912142 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:54.918341 14227 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:54.918618 17722 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.919209 17695 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.920274 17707 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.887478 17418 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.876173 17691 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.923686 17418 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.914804 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:54.924417 14296 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:54.924662 17691 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.925148 17745 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.925640 17745 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.926034 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 599) took 1327 ms. Trace:
I20260709 13:18:54.926409 14296 rpcz_store.cc:276] 0709 13:18:53.598797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.715134 (+116337us) service_pool.cc:224] Handling call
0709 13:18:53.757549 (+ 42415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.924870 (+1167321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.925811 (+   941us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001a09d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:54.925980 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683014016}
I20260709 13:18:54.927615 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:54.927786 17745 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:54.928269 17745 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:54.928689 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:54.929085 14377 raft_consensus.cc:2410] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:54.883601 17598 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.875790 17746 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.900315 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:54.913522 17593 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.901867 17406 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.957764 17746 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:54.958241 17406 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:54.906781 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:54.900316 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:54.929738 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:54.931581 14114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8c137013238f4b1dbae260e32cb316dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9b2cf49ceed478480fb0f27ccf55d81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:54.959806 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:54.960186 14296 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:54.960453 17262 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.962186 14297 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:54.962383 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:54.963016 14301 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:54.912075 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:54.933190 14192 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.546s (SENT) [suppressed 33 similar messages]
W20260709 13:18:54.964083 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52062.9us
I20260709 13:18:54.934602 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:54.936035 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:54.924463 14228 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:54.939205 14377 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:54.966706 14270 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:54.967002 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:54.942373 17513 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:54.891049 17622 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.943204 14376 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:54.924667 17595 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 13:18:54.988119 17672 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:54.988245 17595 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.989076 14228 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:54.991042 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:54.991901 14227 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:54.992806 17743 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.993551 17741 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:54.994168 17741 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:54.995152 17741 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:54.914733 17751 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.928711 17745 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.996110 14221 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:54.947371 17747 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.859622 17742 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:18:54.743403 17482 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:54.974753 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:54.984901 14224 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:54.987767 14297 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:54.995589 17622 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:54.999128 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:54.944063 14372 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:18:55.003192 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 230534us
I20260709 13:18:55.004509 14229 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:55.039321 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.964303 17695 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:55.055214 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.039146 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 160877us
I20260709 13:18:54.975903 17722 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.080109 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:55.107582 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.172221 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.998052 17705 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.184s
W20260709 13:18:55.181510 17685 consensus_meta.cc:287] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.006s
I20260709 13:18:55.174839 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:55.057673 14229 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:55.199213 14865 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:55.191768 14376 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:54.996722 17298 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:54.996419 17712 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.187s
I20260709 13:18:55.205708 14220 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:55.206652 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:55.186790 17595 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:55.210999 17699 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:55.212172 17752 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:55.205449 17685 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.191174 17706 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:55.261063 14901 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:55.262621 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:55.263286 14899 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
W20260709 13:18:55.241449 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 308252us
I20260709 13:18:55.264561 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:55.265100 14899 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:55.242928 14228 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:55.254338 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:55.055275 17747 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.265024 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:55.265777 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:55.269210 14370 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:55.270097 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:55.270959 14377 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:55.266494 14220 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:55.194288 17563 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:55.267890 14374 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:55.272590 14373 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:55.273643 14378 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:55.274025 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:55.283288 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:55.284642 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:55.276067 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:55.287671 14376 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:55.288985 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:55.289774 14369 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:55.240893 17406 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:55.240972 17298 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:55.255705 17519 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:55.304656 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:55.316031 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:55.325977 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:55.328096 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:55.276162 17525 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:55.339857 14369 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:55.308131 17691 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:55.343397 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:55.347476 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:55.348052 14220 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:55.346632 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:55.349500 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:55.352854 17518 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:55.353370 17518 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:55.355545 17685 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:55.349710 17759 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:18:55.342999 14372 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:55.334065 17699 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:55.269860 17706 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.290647 17672 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:18:55.360221 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 158727us
I20260709 13:18:55.291952 17563 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.385136 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:55.344354 17615 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:55.382616 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.383718 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:55.385778 14901 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:55.337533 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:55.318627 17406 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:55.388883 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:55.387243 14900 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:55.347769 17691 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.390689 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:55.390849 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:55.391451 14371 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:55.392221 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:55.393165 14900 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
I20260709 13:18:55.334806 17519 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:55.395973 14302 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:55.395764 14299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2442) took 1828 ms (client timeout 2174 ms). Trace:
I20260709 13:18:55.397254 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:55.399603 14299 rpcz_store.cc:269] 0709 13:18:53.567267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.567407 (+   140us) service_pool.cc:224] Handling call
0709 13:18:55.395499 (+1828092us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400154854. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:55.395668 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2575457024}
I20260709 13:18:55.402649 14369 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:55.403654 17414 consensus_queue.cc:1059] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:55.404125 17706 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:55.405243 17414 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:55.405639 17414 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:55.406675 17745 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:55.406577 17414 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.407927 17414 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:55.410451 17746 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:55.411026 17746 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.411463 17746 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.347158 17720 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:18:55.417526 17747 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:55.417649 17763 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:55.378481 17699 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:55.347131 17525 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.395808 17691 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.397140 14900 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:55.426268 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:55.393862 17615 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.424599 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:55.453128 14897 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:55.457410 14299 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:55.466459 14299 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:55.476039 14299 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:18:55.476327 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 157096us
I20260709 13:18:55.476675 14301 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:55.454517 17615 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:55.487095 14301 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:55.488917 17525 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:55.485634 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:55.493129 14299 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:55.493901 14901 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:55.494385 14220 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:55.495216 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:55.496568 14220 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:55.421921 17298 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.501155 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1965) took 2058 ms. Trace:
I20260709 13:18:55.501605 14375 rpcz_store.cc:276] 0709 13:18:53.442960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.824987 (+382027us) service_pool.cc:224] Handling call
0709 13:18:53.825376 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.710778 (+885402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.500945 (+790167us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54000609d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:55.501100 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034615168}
I20260709 13:18:55.503566 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:55.522442 17749 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.702s	user 0.010s	sys 0.000s
W20260709 13:18:55.526410 17774 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:55.533141 17563 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:55.534545 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:55.535177 17406 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:55.535265 14375 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:55.538460 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:55.545373 17671 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:55.548493 14370 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:55.500452 17519 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:55.545837 17671 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:55.555166 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:55.558593 14299 raft_consensus.cc:2376] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7. Re-sending same reply.
I20260709 13:18:55.568290 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:55.570456 17519 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.567159 17671 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.577509 17752 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:55.578013 17752 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:55.578852 17752 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.579861 17752 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:55.581030 17414 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.573343 17519 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.582227 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:55.582074 17414 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.586056 17414 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:55.587605 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:55.599228 16822 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:55.600210 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:55.599248 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:55.602240 14228 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:55.602968 16822 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:55.603451 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:55.603905 17513 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:55.604539 17513 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.604724 16822 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:55.604977 17513 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:55.606458 14370 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:18:55.565353 17746 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.608907 17334 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.606985 17513 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:55.601516 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:55.609385 17746 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:55.609669 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:55.609894 14228 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.610250 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:55.633968 14227 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 7: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:55.599270 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.635332 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.636559 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:55.611749 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:55.641217 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:55.621022 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:55.625309 14229 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:55.619480 14192 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:55.641263 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:55.641295 14370 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.601511 14225 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:55.630272 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:55.674140 14370 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:55.676507 14228 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 4.
W20260709 13:18:55.687088 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 67692.4us
I20260709 13:18:55.639531 17406 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:55.687919 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:55.686172 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:55.708458 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.671942 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:55.696753 14192 leader_election.cc:400] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8.
I20260709 13:18:55.716492 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:55.613960 17479 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:55.720115 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50495.8us
I20260709 13:18:55.697530 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:55.721815 14225 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:55.722991 14228 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:55.727002 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:55.728399 14228 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:55.729522 14229 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:55.725728 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:55.731746 14228 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:55.734401 14228 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:55.735503 14228 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:18:55.737226 14225 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:55.738426 14225 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:55.740222 14225 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:55.666774 17746 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:55.642298 17752 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:55.744252 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:55.611843 16822 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 13:18:55.691361 17663 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:55.670291 17525 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.619710 17513 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:55.614552 17519 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:55.621559 17414 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 13:18:55.750264 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:55.611439 17615 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.690943 17685 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.629524 17712 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:18:55.629402 16848 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:18:55.629036 17689 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 13:18:55.630211 17722 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 13:18:55.723519 14192 leader_election.cc:403] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:18:55.723981 17584 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.771028 14299 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:55.730731 17563 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:55.715732 17334 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:18:55.615023 17691 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.777762 14378 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:55.778693 17691 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:55.723806 17745 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.759315 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.725239 17479 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:55.682816 17753 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:18:55.691147 17595 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:18:55.791489 14302 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:55.744302 17622 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.764061 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:55.765847 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.629832 17629 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.126s
I20260709 13:18:55.753814 17663 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.626360 17699 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:55.773538 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47898.2us
I20260709 13:18:55.758344 17525 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.775440 14376 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:55.800565 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:55.774034 14227 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:55.773450 17519 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:55.784017 17615 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:55.890565 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.883302 16822 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.899147 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 98662.7us
I20260709 13:18:55.902174 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:55.792255 17418 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:55.909152 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:55.806286 17563 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:55.914044 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:55.806460 17685 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8.
I20260709 13:18:55.799412 17745 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:55.899916 16822 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.808311 17663 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:55.811082 17691 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:55.899164 17404 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:55.891736 17519 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:55.932159 17780 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:18:55.934301 17781 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:18:55.917342 17479 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.811465 17746 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:18:55.923005 17198 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:55.938316 17198 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:55.938809 17198 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:55.940152 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 243532us
I20260709 13:18:55.914489 17722 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:55.916296 17720 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:55.942447 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:55.808657 17622 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:55.929149 17615 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:55.928901 17671 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:55.951754 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.941653 17722 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:55.954663 14228 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:55.957005 17783 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:55.948475 17720 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:55.948434 17788 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:55.962914 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:55.967164 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:55.975862 14373 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:55.968251 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.968238 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:55.978116 14371 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:55.970477 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:55.977625 16822 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:55.975956 14375 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:55.984432 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:55.982590 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:55.985620 14369 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 6: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:55.986445 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:55.987624 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:55.989707 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:56.002018 14373 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
W20260709 13:18:56.004037 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.007017 17198 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:56.009465 17720 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:56.009948 17198 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:56.013437 17595 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:56.013949 17595 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:56.014870 17595 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.022914 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 1894) took 1400 ms. Trace:
I20260709 13:18:56.023439 14224 rpcz_store.cc:276] 0709 13:18:54.622889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.623137 (+   248us) service_pool.cc:224] Handling call
0709 13:18:56.022705 (+1399568us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b540033cf54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:56.022846 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627532160}
I20260709 13:18:55.992832 17334 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.973830 17767 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:18:56.040935 17751 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:56.042623 17745 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:56.048136 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:55.957248 17563 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.071626 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:56.121093 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:56.122192 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.990425 17722 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:56.126469 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 317041us
I20260709 13:18:56.128489 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:56.128783 14373 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:56.181540 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 267612us
I20260709 13:18:56.048645 17334 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.186699 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:56.183813 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 194386us
I20260709 13:18:56.192066 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:56.185506 17722 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.223585 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:56.194283 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.191780 17383 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.200258 17663 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.210896 17691 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:56.211938 17404 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:56.212450 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1899) took 1588 ms. Trace:
I20260709 13:18:56.217970 17615 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:56.221077 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:56.257733 14223 rpcz_store.cc:276] 0709 13:18:54.624419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.642591 (+ 18172us) service_pool.cc:224] Handling call
0709 13:18:54.642980 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.643239 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:54.869457 (+226218us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.211705 (+1342248us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b1800445480. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:18:56.211909 (+   204us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.212111 (+   202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.212162 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:56.212213 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.212278 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.212394 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":346908,"prepare.queue_time_us":1248903,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":10013,"raft.queue_time_us":38058,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":32664,"spinlock_wait_cycles":26895744,"thread_start_us":599926,"threads_started":2,"wal-append.queue_time_us":406362}
I20260709 13:18:56.191519 17671 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:56.264516 17720 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.266857 17720 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:56.269865 17720 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:56.263978 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:56.272336 14223 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.265087 14373 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:56.275249 14304 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:56.280269 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2319) took 1086 ms. Trace:
I20260709 13:18:56.192240 17198 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:18:56.274379 17383 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.193661 17767 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:18:56.280797 14222 rpcz_store.cc:276] 0709 13:18:55.193852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.351568 (+157716us) service_pool.cc:224] Handling call
0709 13:18:55.351875 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.352100 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:56.219123 (+867023us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.279929 (+ 60806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.279989 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:56.280036 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.280097 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.280215 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":881789,"prepare.queue_time_us":866849,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":45306,"threads_started":1}
I20260709 13:18:56.289057 14222 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:18:56.280212 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 89976.1us
W20260709 13:18:56.298131 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.281134 17788 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.282869 17513 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.305946 14223 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:56.262434 17797 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:18:56.276862 17796 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:18:56.331561 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:56.286387 17383 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.343216 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:56.334597 17506 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.321483 17807 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:18:56.342324 17198 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:18:56.351300 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:56.332417 17685 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:18:56.360380 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:56.361562 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 617) took 1180 ms. Trace:
I20260709 13:18:56.362028 14303 rpcz_store.cc:276] 0709 13:18:55.181331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.409891 (+228560us) service_pool.cc:224] Handling call
0709 13:18:56.360220 (+950329us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:56.361469 (+  1249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32989952}
I20260709 13:18:56.371452 14341 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:56.375890 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:56.376047 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.377455 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.378286 14895 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:56.378116 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:56.378904 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:56.380025 14901 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:56.388209 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.389626 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:56.389977 14901 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:56.388237 14894 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:56.390606 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.390971 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:56.394124 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.394373 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:56.381222 17757 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.381410 17671 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:56.388195 17593 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.370056 17506 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:56.410874 17757 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.394773 17796 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:56.413729 14901 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:56.450131 14896 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
W20260709 13:18:56.457875 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.402194 17807 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:56.410006 17663 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:56.409296 17790 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:56.479197 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.480145 14901 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
W20260709 13:18:56.459391 17800 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.150s	user 0.000s	sys 0.005s
I20260709 13:18:56.518601 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.520335 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:56.457506 17198 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:56.411190 17593 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.459177 17799 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.524214 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:56.519723 14893 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:18:56.525266 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:56.527320 14901 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.416031 17671 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.521584 17685 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:56.473135 17790 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:56.537356 17802 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:18:56.568140 14901 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:56.529258 17198 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.530495 17805 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.470654 17807 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:56.540125 17404 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:18:56.578773 17804 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:18:56.592397 14892 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
W20260709 13:18:56.579403 17806 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:18:56.595155 14229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2318) took 1401 ms (client timeout 1503 ms). Trace:
W20260709 13:18:56.636051 14229 rpcz_store.cc:269] 0709 13:18:55.193544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.206304 (+ 12760us) service_pool.cc:224] Handling call
0709 13:18:56.594944 (+1388640us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400277ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:56.595079 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955330304}
I20260709 13:18:56.609658 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2324) took 1414 ms. Trace:
I20260709 13:18:56.594127 17506 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:56.579483 17198 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:56.574674 17685 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.574087 17754 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:56.574478 17710 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:56.617835 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.640347 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.640949 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.641894 14898 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:18:56.637063 14220 rpcz_store.cc:276] 0709 13:18:55.195310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.497437 (+302127us) service_pool.cc:224] Handling call
0709 13:18:55.501189 (+  3752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.608997 (+107808us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:56.219829 (+610832us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.569251 (+349422us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.569728 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.569942 (+   214us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:56.570231 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.573389 (+  3158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.573474 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.609444 (+ 35970us) raft_consensus.cc:1685] finished
0709 13:18:56.609460 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.609601 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":683781,"prepare.queue_time_us":611365,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":82,"raft.queue_time_us":82292,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":9368,"thread_start_us":337005,"threads_started":2,"wal-append.queue_time_us":86787}
I20260709 13:18:56.531561 17799 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:56.640990 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.644956 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:56.582538 17757 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:56.649125 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.649879 17798 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:56.650327 17798 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:56.651494 17799 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:56.651208 17798 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.652137 17812 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:56.652459 17798 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:56.652745 17733 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.876s	user 0.000s	sys 0.012s
I20260709 13:18:56.652675 17812 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:56.656687 17746 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:56.657413 17746 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.590499 17790 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.662742 17790 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.666174 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:56.667642 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:56.670418 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:56.671027 14225 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:56.671636 17518 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:56.672443 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 602) took 3044 ms. Trace:
I20260709 13:18:56.673157 17518 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.674252 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:56.674996 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 621) took 1492 ms. Trace:
I20260709 13:18:56.675299 14297 rpcz_store.cc:276] 0709 13:18:55.182633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.403854 (+221221us) service_pool.cc:224] Handling call
0709 13:18:56.674107 (+1270253us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:18:56.674937 (+   830us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50701184}
I20260709 13:18:56.673635 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1892) took 2051 ms. Trace:
I20260709 13:18:56.678130 14221 rpcz_store.cc:276] 0709 13:18:54.622311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.622473 (+   162us) service_pool.cc:224] Handling call
0709 13:18:54.666634 (+ 44161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.996516 (+329882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.673425 (+1676909us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400341554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:56.673575 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757283072}
I20260709 13:18:56.597021 17601 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:56.672814 14300 rpcz_store.cc:276] 0709 13:18:53.627737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.847056 (+219319us) service_pool.cc:224] Handling call
0709 13:18:53.862174 (+ 15118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.893909 (+1031735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.672213 (+1778304us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003ee4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:56.672389 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2322727808}
I20260709 13:18:56.644706 16973 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:56.679538 14867 connection.cc:256] RPC call timeout handler was delayed by -1.1539870620001693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 13:18:56.684068 14867 connection.cc:256] RPC call timeout handler was delayed by -1.1016745920001085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 13:18:56.690887 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:56.692183 14220 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:56.699594 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1912) took 1103 ms. Trace:
I20260709 13:18:56.700212 14227 rpcz_store.cc:276] 0709 13:18:55.596183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.726837 (+130654us) service_pool.cc:224] Handling call
0709 13:18:55.750983 (+ 24146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.900605 (+149622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.699278 (+798673us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b54002a21d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:56.699530 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52043136}
W20260709 13:18:56.706636 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 177806us
I20260709 13:18:56.707490 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:56.644413 17506 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.715173 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:56.688279 17413 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:56.773398 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 58304us
I20260709 13:18:56.776166 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:56.777412 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 70061.1us
I20260709 13:18:56.778155 14341 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:56.708704 17751 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.785411 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:56.687525 16973 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.762265 17525 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:56.783684 17598 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:56.803913 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 109581us
I20260709 13:18:56.805027 14867 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:56.788661 17767 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:56.675702 17754 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:56.790345 17794 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.761940 17506 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.774502 17513 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:56.799203 17799 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:56.793421 17751 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.803293 17598 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:56.807668 17685 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:56.838037 17595 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:56.839608 17699 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:56.840807 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 1984) took 1526 ms. Trace:
I20260709 13:18:56.816640 17525 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:56.805982 17821 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:56.816606 17593 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:56.816455 17815 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:56.817179 17807 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:56.847949 14378 rpcz_store.cc:276] 0709 13:18:55.314258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.327758 (+ 13500us) service_pool.cc:224] Handling call
0709 13:18:56.840493 (+1512735us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54003985d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:56.840717 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031845120}
W20260709 13:18:56.827159 17730 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 2.099s	user 0.006s	sys 0.000s
I20260709 13:18:56.828769 17767 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:56.851066 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 72987.4us
I20260709 13:18:56.864606 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:56.866132 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:56.841806 17415 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:56.844041 17722 consensus_meta.cc:287] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.009s
I20260709 13:18:56.850065 17525 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.834474 17799 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:56.860001 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 74651.7us
I20260709 13:18:56.849941 17746 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:18:56.878140 17198 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.878782 17525 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.890388 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:56.877480 17739 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:56.899567 14378 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:18:56.880013 17816 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:56.878593 17767 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:56.904801 16973 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:56.905045 17519 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:56.882462 17598 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:56.900743 17746 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:56.912999 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:56.901474 17513 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:56.866773 17815 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:56.916872 17506 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:56.901340 17198 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:18:56.925583 17814 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:18:56.917905 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.946292 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.946552 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.917872 17684 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.901624 17816 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:56.916991 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 873) took 1123 ms. Trace:
I20260709 13:18:56.906471 17746 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:56.918643 17629 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:56.944054 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:56.950773 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 145875us
I20260709 13:18:56.932789 17513 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.950384 14370 rpcz_store.cc:276] 0709 13:18:55.793861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.794056 (+   195us) service_pool.cc:224] Handling call
0709 13:18:55.794460 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.185163 (+390703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.185192 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.185655 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.333466 (+147811us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:56.333500 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.916577 (+583077us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54002594d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:56.916626 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.916671 (+    45us) raft_consensus.cc:1685] finished
0709 13:18:56.916684 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.916912 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11831,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":80,"spinlock_wait_cycles":295425920,"thread_start_us":334641,"threads_started":2,"wal-append.queue_time_us":197089}
I20260709 13:18:56.958671 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:56.959223 14375 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:56.956187 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:56.960235 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.959352 14229 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:18:56.955274 14378 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:56.943142 17757 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:56.966053 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:56.978334 14373 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:18:56.966333 17751 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:56.966852 17786 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:56.971346 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.979290 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:56.972790 14298 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:18:56.980257 14298 pending_rounds.cc:85] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 6
I20260709 13:18:56.980504 14298 pending_rounds.cc:107] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:18:56.980847 14298 raft_consensus.cc:2889] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:56.953099 17816 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.954856 17629 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:56.954588 17746 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:56.984675 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.985337 14896 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:56.975636 17799 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:56.961606 17513 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.981287 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.989698 14898 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:56.990209 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:56.984566 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:56.981580 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.980430 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:56.986981 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:56.991456 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:56.987498 14894 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:56.992623 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:56.995036 17790 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:56.995052 17506 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.995445 17790 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.995991 17790 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.003815 17622 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:56.995731 16973 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:56.993580 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:56.983533 17786 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:57.013026 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.031383 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.031862 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:57.030758 17752 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:57.037380 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:57.041301 14341 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:57.035806 17622 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.046141 17786 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.047385 17786 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.031162 17519 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:57.053897 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.090457 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 97070.8us
I20260709 13:18:57.005578 17751 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:18:57.095062 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57757.5us
I20260709 13:18:57.096314 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:18:57.097860 17733 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:57.109051 17334 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:56.985076 17767 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.038642 17506 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:57.116052 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:57.086750 17519 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:57.111474 17831 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:57.125761 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:57.127117 17833 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:57.129635 14301 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:18:57.130962 14301 pending_rounds.cc:85] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 5
I20260709 13:18:57.131299 14301 pending_rounds.cc:107] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:18:57.131525 14301 raft_consensus.cc:2889] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:57.095506 17797 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.136328 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:57.138845 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:57.139624 14897 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:57.022799 17198 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.141746 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:57.119801 17622 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:57.120612 17788 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:57.129468 17811 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:57.083593 17698 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:18:57.128751 17519 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.149631 17807 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:57.168833 17807 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.169409 17807 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.152432 17720 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.136533 17506 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:57.170089 17720 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.167033 14226 raft_consensus.cc:2410] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:57.170920 17506 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.171370 17506 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:57.186914 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 154732us
I20260709 13:18:57.130995 17752 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:57.146519 17334 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:57.146695 17739 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.085711 17629 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:57.217089 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 91696.7us
I20260709 13:18:57.155193 17765 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:57.136108 17790 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.227952 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 1985) took 1906 ms. Trace:
I20260709 13:18:57.232177 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:57.167436 17622 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:57.234517 14376 rpcz_store.cc:276] 0709 13:18:55.321711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.324366 (+  2655us) service_pool.cc:224] Handling call
0709 13:18:55.343922 (+ 19556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.881404 (+537482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.225677 (+1344273us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400060ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:57.225893 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991853952}
I20260709 13:18:57.150714 17746 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.217089 17334 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:57.241613 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:57.244171 14898 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:57.247807 14341 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:57.228859 17765 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.250202 17829 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:18:57.250521 17406 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:57.251255 17790 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.252424 17622 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.269464 17812 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.267031 17754 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.279731 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:57.281454 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:57.304931 14372 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:57.246922 17334 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.241328 17751 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:18:57.259066 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 811) took 1645 ms. Trace:
I20260709 13:18:57.314847 14228 rpcz_store.cc:276] 0709 13:18:55.613468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.745972 (+132504us) service_pool.cc:224] Handling call
0709 13:18:55.746226 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.955243 (+209017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.258713 (+1303470us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54003e0154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:57.258984 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478780288}
I20260709 13:18:57.243569 17595 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:57.285959 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:57.289597 17846 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:57.243892 17815 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.244864 17629 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.295624 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2464) took 2407 ms. Trace:
I20260709 13:18:57.327332 14298 rpcz_store.cc:276] 0709 13:18:54.888210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.888464 (+   254us) service_pool.cc:224] Handling call
0709 13:18:54.899501 (+ 11037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.986694 (+2087193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.295309 (+308615us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b54001a1154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:57.295543 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4767279872}
I20260709 13:18:57.296993 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2473) took 1810 ms. Trace:
I20260709 13:18:57.329573 17746 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:57.298424 17752 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.234102 17513 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.279166 17765 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.226508 17739 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.320675 14376 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.325739 17720 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:57.286249 17406 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:57.328914 14301 rpcz_store.cc:276] 0709 13:18:55.486604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.491960 (+  5356us) service_pool.cc:224] Handling call
0709 13:18:55.499015 (+  7055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.131952 (+1632937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.296698 (+164746us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54000906d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:57.296917 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3749261184}
W20260709 13:18:57.308149 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 76043.7us
I20260709 13:18:57.340982 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:57.302278 17506 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.346498 17406 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:57.356755 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 131351us
I20260709 13:18:57.358207 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:18:57.365903 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.327450 17595 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.369774 17746 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:57.370321 17746 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:57.370728 17746 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.372077 17845 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:57.373162 17845 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:57.374370 14376 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:57.375896 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:57.376886 17767 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:57.377489 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.377671 17767 raft_consensus.cc:697] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:18:57.378153 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.378459 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.379041 14229 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:18:57.378968 17767 consensus_queue.cc:237] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.380107 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.380338 17479 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.380704 14227 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:57.381603 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:57.351162 17720 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.378146 14228 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:57.396893 14867 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:57.398396 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:57.401587 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:57.368983 17844 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.423872 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:57.424095 14375 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:57.425014 14371 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:57.433141 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:57.397526 17816 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.401527 17846 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:57.460443 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 622) took 1787 ms. Trace:
I20260709 13:18:57.407416 17298 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:57.468180 14296 rpcz_store.cc:276] 0709 13:18:55.673522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.781066 (+107544us) service_pool.cc:224] Handling call
0709 13:18:55.809848 (+ 28782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.928674 (+118826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.928704 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.928746 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:55.928839 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.439834 (+1510995us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54000910d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:18:57.460228 (+ 20394us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.460375 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272804096}
I20260709 13:18:57.460877 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2436) took 1648 ms. Trace:
I20260709 13:18:57.461396 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:57.463275 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:57.412146 17803 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.077s	user 0.000s	sys 0.004s
I20260709 13:18:57.411758 17824 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:57.487149 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2437) took 1526 ms. Trace:
W20260709 13:18:57.431277 17805 consensus_meta.cc:287] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.812s	user 0.003s	sys 0.010s
I20260709 13:18:57.470556 14376 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:57.414256 17671 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.485363 14373 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:57.487622 14295 rpcz_store.cc:276] 0709 13:18:55.960655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.960783 (+   128us) service_pool.cc:224] Handling call
0709 13:18:55.961135 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.961366 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:55.961650 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.486724 (+1525074us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.486812 (+    88us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:57.486867 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.486943 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.487081 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1524792,"prepare.queue_time_us":368,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33}
W20260709 13:18:57.489334 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.398267 17720 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.426909 17739 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.515261 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.467670 17846 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:57.477418 17298 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.463462 17751 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:18:57.524724 14375 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:57.493229 17844 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:57.509006 17584 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:57.486615 17824 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:57.467754 17757 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:18:57.535101 14222 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:57.520263 17598 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:57.516901 17684 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.517271 17805 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.517431 17754 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:57.542397 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.555878 14295 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:18:57.524902 17846 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.524261 17298 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.545390 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:18:57.531677 17525 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
I20260709 13:18:57.506170 17767 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.525061 17622 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:57.493922 17787 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:18:57.548795 17792 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:57.548394 17722 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:57.621444 17622 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.621809 17722 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.623878 17622 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.624153 17722 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.528232 17383 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:57.555874 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.555213 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 1.42672e+06us
I20260709 13:18:57.532306 17584 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:57.533742 17844 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.625192 17767 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.626232 17792 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.627311 17844 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.627912 17767 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.633265 17616 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:57.633878 17616 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.634333 17816 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.561450 17754 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.635849 17616 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.636360 17616 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.636512 17754 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.600845 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:57.567585 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.599406 17791 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:57.600153 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.560298 17793 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:57.543089 17824 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.576467 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.584717 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.658739 14224 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:57.618038 17595 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.585598 17789 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.618724 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.568702 17513 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.620217 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.586937 17659 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.557914 17684 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.640528 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:57.642614 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:57.684759 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.685360 14304 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:18:57.655717 14270 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:57.558809 17525 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.637442 17334 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.658077 17601 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:18:57.662307 17699 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:18:57.666282 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.666653 17746 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.644824 14301 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 2.
I20260709 13:18:57.660807 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.628528 17792 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.669818 14297 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:57.678328 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:57.687114 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 628) took 1622 ms. Trace:
I20260709 13:18:57.693291 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.696573 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:57.655844 17418 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:18:57.704407 14229 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:57.706964 14224 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:57.708736 14222 raft_consensus.cc:2376] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6. Re-sending same reply.
I20260709 13:18:57.656905 17616 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.715306 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:57.667835 17722 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:18:57.712492 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.710985 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.702229 14299 rpcz_store.cc:276] 0709 13:18:56.064917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.352351 (+287434us) service_pool.cc:224] Handling call
0709 13:18:56.352641 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.352854 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:56.366931 (+ 14077us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.671153 (+1304222us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.686439 (+ 15286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.686488 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:57.686537 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.686603 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.686755 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":933517,"prepare.queue_time_us":6162,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":960074,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":351010,"threads_started":2,"wal-append.queue_time_us":320223}
I20260709 13:18:57.690505 17595 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.698542 17699 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:57.706555 17582 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.658887 17406 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.720546 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:57.724860 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.738859 14224 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 4.
I20260709 13:18:57.740145 14270 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:57.740250 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.690790 17659 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.727470 16973 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:57.727921 17519 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.003s
I20260709 13:18:57.765915 17519 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.767678 17659 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.767961 17519 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.730688 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.768589 14296 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:57.694598 17787 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:57.769418 17787 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.771608 17787 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.714506 17767 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.782119 14229 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:18:57.783445 14270 connection.cc:256] RPC call timeout handler was delayed by -1.0956145840000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2536s for a response
I20260709 13:18:57.783615 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.735452 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.735935 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.743301 17601 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:57.744395 17334 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.793293 14223 raft_consensus.cc:2410] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:57.786252 17659 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:57.794174 17659 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:57.795095 17659 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.797951 17767 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.751781 17595 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:57.820957 17857 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:18:57.757277 17684 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.758080 17699 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.758885 17525 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.660782 17793 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.822712 17699 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.822928 17595 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.771371 17406 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.760386 17616 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.763482 14300 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:18:57.737294 17712 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.770195 14372 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:57.770990 17844 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.719983 17792 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:57.772817 14893 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:18:57.699757 17837 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.734036 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.784926 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.732326 17720 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:57.786276 17413 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:18:57.818691 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.470024 14302 rpcz_store.cc:276] 0709 13:18:55.813026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.813205 (+   179us) service_pool.cc:224] Handling call
0709 13:18:55.813564 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.813812 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:55.900624 (+ 86812us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.440963 (+1540339us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b180033b320. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:18:57.460530 (+ 19567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.460588 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:57.460636 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.460702 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.460823 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9245,"prepare.queue_time_us":94351,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":62,"raft.queue_time_us":1570922,"spinlock_wait_cycles":11402496}
I20260709 13:18:57.840341 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.840996 14302 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:18:57.841910 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.691248 17765 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.820091 17601 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:57.821213 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 137400us
I20260709 13:18:57.755462 17846 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.826870 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:57.816411 17563 raft_consensus.cc:3055] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:57.772969 17807 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.556s	user 0.004s	sys 0.008s
I20260709 13:18:57.836921 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:57.859715 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:57.838464 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.860076 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.860569 14298 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:18:57.669189 17791 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:57.856770 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:57.863049 14865 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:57.832710 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:57.864339 14193 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:18:57.814183 17693 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.817414 16848 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:57.793282 17789 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.813951 17767 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.890961 17841 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:57.816939 17824 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.892020 14220 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:57.787211 17629 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:18:56.583664 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:57.891765 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:57.897719 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.836723 17712 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.865413 17807 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.898429 17506 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.900066 14297 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:57.900415 14895 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:57.855451 17786 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:57.901814 17712 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.851624 17792 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:57.836549 17844 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.933606 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:57.919051 14228 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:57.889464 17598 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:57.866950 16848 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:57.871685 17616 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.901830 17807 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.829113 17695 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.933316 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:57.858940 17829 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.873996 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:57.946439 14267 connection.cc:256] RPC call timeout handler was delayed by -1.0276814890000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 13:18:57.891182 17601 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.946894 17684 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:57.901008 17693 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.944411 17598 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:57.891233 17671 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:57.899695 17767 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:57.858870 17563 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:57.919807 17824 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.918313 17791 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.932987 17789 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:57.962841 17705 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:57.952805 17793 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:57.982144 17598 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.974493 17684 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:57.892503 17743 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:18:57.985105 17767 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:57.901856 17786 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.973017 17695 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:57.851933 17837 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:58.003509 17849 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.644s	user 0.001s	sys 0.004s
I20260709 13:18:57.985519 17629 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:18:57.998286 17684 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.006330 17693 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:58.001598 17767 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:58.007594 17861 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:58.006362 17844 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:57.996358 17789 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:58.011119 17858 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:58.015055 17846 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:18:58.015712 17765 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:58.004778 17792 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.018102 17786 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:58.020896 17837 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:58.051689 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:58.056634 14224 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:58.055341 14225 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:58.061055 14225 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:57.975975 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:18:58.067612 14298 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:57.975878 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:58.069404 14302 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:58.071844 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:58.072346 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 630) took 1995 ms. Trace:
W20260709 13:18:58.069237 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 93173.5us
I20260709 13:18:58.075680 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:58.072870 14303 rpcz_store.cc:276] 0709 13:18:56.076661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.363073 (+286412us) service_pool.cc:224] Handling call
0709 13:18:56.363571 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.530534 (+1166963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.530569 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.531029 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.781225 (+250196us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:57.781262 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.781318 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.071749 (+290431us) raft_consensus.cc:1685] finished
0709 13:18:58.071804 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.072117 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1166508,"raft.queue_time_us":1168908,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6971,"thread_start_us":220256,"threads_started":1,"wal-append.queue_time_us":427580}
I20260709 13:18:58.083953 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 879) took 1137 ms. Trace:
I20260709 13:18:57.949432 17298 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.086143 17582 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:58.086964 17582 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:58.087713 17334 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:58.090498 16848 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.093163 16848 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.098320 17723 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:58.089393 17298 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:58.093824 14229 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:18:57.962594 17616 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.084544 14901 rpcz_store.cc:276] 0709 13:18:56.946513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.947206 (+   693us) service_pool.cc:224] Handling call
0709 13:18:56.947474 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.947906 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.947948 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.954126 (+  6178us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.664111 (+709985us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b180033e440. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:18:57.719080 (+ 54969us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:57.726821 (+  7741us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.727025 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.727111 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.083107 (+355996us) raft_consensus.cc:1685] finished
0709 13:18:58.083310 (+   203us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.083649 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6620,"prepare.queue_time_us":8011,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":10089,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":19482,"spinlock_wait_cycles":8497408,"thread_start_us":54800,"threads_started":1,"wal-append.queue_time_us":849371}
I20260709 13:18:58.099601 17723 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.093432 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.099399 17693 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:57.994865 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 131881us
I20260709 13:18:58.088974 17582 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.119913 17789 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:58.125891 14302 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:58.127782 17616 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:58.127998 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.132218 17684 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.132570 17723 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:58.133143 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:58.129680 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:57.985265 17659 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:18:58.142014 14228 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:58.141266 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:58.138283 17787 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.152949 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:58.155594 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:58.158254 14225 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:18:58.157366 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:58.161919 14193 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:18:58.158283 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.162773 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:57.996618 17705 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.169090 14304 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:58.175531 14304 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:58.177075 17837 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:58.181478 14229 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.183158 17584 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.194542 17746 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:58.196336 17705 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:58.190346 17695 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:58.206997 14226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 1893) took 3584 ms (client timeout 2536 ms). Trace:
W20260709 13:18:58.208930 14226 rpcz_store.cc:269] 0709 13:18:54.622605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.622720 (+   115us) service_pool.cc:224] Handling call
0709 13:18:58.206472 (+3583752us) spinlock_profiling.cc:243] Waited 2.53 s on lock 0x7b540026e3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:58.206780 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5818694528}
I20260709 13:18:58.190472 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:58.210657 17746 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:58.216832 17787 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:58.226924 17767 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.228585 14224 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:58.232023 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66831.1us
I20260709 13:18:58.238497 17298 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:58.240123 17840 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:58.240459 14228 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:58.240640 17840 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:58.242475 17840 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.245283 17840 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.240149 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:58.247685 17699 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:58.248474 17699 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:58.248872 14867 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:58.251569 17298 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:58.250625 17699 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.252241 17298 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.252720 17298 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.220367 17695 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:58.253629 14301 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:18:58.270758 14301 pending_rounds.cc:85] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 2
I20260709 13:18:58.275838 16973 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.278056 17672 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.278828 17672 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:58.279975 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.280460 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.271130 14301 pending_rounds.cc:107] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:58.265865 17684 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:58.282410 14301 raft_consensus.cc:2889] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:58.288587 17789 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:58.290073 17695 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:18:58.284391 17672 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:58.295082 17598 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.344982 17598 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:58.295719 17739 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:58.346494 17739 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:58.347026 17739 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.290762 17789 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:18:58.296829 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.297726 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 64021.6us
I20260709 13:18:58.276922 16973 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:58.305243 17853 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.715s	user 0.002s	sys 0.000s
I20260709 13:18:58.307137 17298 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.353703 17843 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:58.354275 17843 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:58.354421 17789 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.355552 17298 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:58.356083 17789 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.357817 16973 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:58.324896 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:58.325711 14295 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:58.321192 17563 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.327653 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:58.327816 14299 raft_consensus.cc:3055] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:58.328773 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:58.330375 14893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 880) took 1383 ms (client timeout 1645 ms). Trace:
I20260709 13:18:58.330436 14894 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:58.336293 17334 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:58.337181 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:58.349385 14229 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
W20260709 13:18:58.361109 14893 rpcz_store.cc:269] 0709 13:18:56.946830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.947429 (+   599us) service_pool.cc:224] Handling call
0709 13:18:58.329982 (+1382553us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b5400268ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:18:58.330144 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826058496}
I20260709 13:18:58.362283 14896 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.360605 14299 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:58.368459 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.370245 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.374307 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:58.375000 14228 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.375252 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:58.376529 14227 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:18:58.380868 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.382910 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.383320 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.383692 14901 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:58.384057 14895 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:58.384303 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:58.386029 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:58.386950 14899 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.387154 14299 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.384009 17334 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.392370 17712 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:58.400398 14299 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.400087 17712 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:58.405686 17712 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.406881 17712 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.408293 17584 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.416723 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:58.418093 17767 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:58.426479 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 931590us
I20260709 13:18:58.426817 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 886) took 1002 ms. Trace:
I20260709 13:18:58.427893 17563 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.428211 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:18:58.430833 17790 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:58.431301 17790 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:58.431694 17790 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:58.434988 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 943123us
I20260709 13:18:58.437047 16822 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:58.437620 16822 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:18:58.437918 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.446339 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:58.412237 17695 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:58.448015 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.449865 14896 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:58.454437 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.427261 14369 rpcz_store.cc:276] 0709 13:18:57.424072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.424192 (+   120us) service_pool.cc:224] Handling call
0709 13:18:57.464077 (+ 39885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.464304 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:57.473378 (+  9074us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.410572 (+937194us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b18003ec140. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:18:58.426171 (+ 15599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.426271 (+   100us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:58.426361 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.426468 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.426611 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17772,"prepare.queue_time_us":21886,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"spinlock_wait_cycles":36850560}
I20260709 13:18:58.459038 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:58.458228 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.465132 17519 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.465442 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:58.466286 14898 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.465842 17519 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.467859 14303 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:58.470067 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.476684 14900 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.470870 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:58.482194 14899 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:18:58.483680 14228 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:58.446177 17479 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:18:58.485708 17479 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:58.486141 17479 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:58.489884 17843 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.491626 16822 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.499544 14867 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:58.462517 17695 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:58.498205 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.508594 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.509399 14300 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.511677 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:58.512082 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:58.512868 14895 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.514607 17404 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:58.515610 17404 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:58.515980 17404 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:58.529919 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.530825 14893 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 4.
W20260709 13:18:58.538064 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 112056us
I20260709 13:18:58.538700 14227 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:58.539310 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:58.540620 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:58.541491 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.541942 14221 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:58.542104 14295 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.543177 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:58.543854 14897 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.521699 14895 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:18:58.559463 14898 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:58.493767 14126 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 3 to 6, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 6 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:58.569970 14900 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:18:58.516935 17404 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.590907 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.561568 17298 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:58.630980 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.562037 17598 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:58.565431 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:58.635653 17815 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:58.636066 17383 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.637342 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.567936 17334 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:58.648113 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80757us
W20260709 13:18:58.650326 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88258.5us
I20260709 13:18:58.651652 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:58.652837 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 112278us
I20260709 13:18:58.667346 14295 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:58.639323 17684 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:58.672504 17404 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.672981 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:58.672658 17684 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.676059 17684 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:58.676327 17334 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:58.672626 14901 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:58.681313 14894 raft_consensus.cc:2410] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:58.670631 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:58.640676 17699 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:58.657656 17767 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:58.654085 17815 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.658332 17843 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.693617 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:58.679808 17298 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:18:58.695755 14304 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:58.710777 17722 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:18:58.702095 17383 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.711905 17722 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:58.712306 17722 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:58.713879 17812 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.710810 17298 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.714720 17383 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:58.713466 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:18:58.719206 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48718.7us
I20260709 13:18:58.720196 17684 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:58.720253 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:58.720708 17684 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.721192 17684 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.721473 17334 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:58.723220 17334 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:58.723742 17334 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:58.724709 17334 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.730036 17684 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:58.737737 17877 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:18:58.731045 17479 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.739413 17479 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.740425 17684 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:58.742094 17699 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.744971 14372 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:58.745524 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:58.746616 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:58.747519 14370 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:58.747706 17805 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:58.747720 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:58.750718 14374 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:18:58.751901 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57620.9us
I20260709 13:18:58.753319 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:18:58.702095 17262 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.756390 17262 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.691576 17840 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:58.759430 17262 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:58.759719 14900 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:58.696995 17836 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:58.760594 17836 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:58.762527 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.763931 17836 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:58.764329 14298 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:58.704422 17519 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:58.714433 17812 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.733405 14224 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:58.771174 14303 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:58.775341 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.695083 17767 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.783499 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.789963 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.790217 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.790987 17598 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.791419 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:58.791569 17598 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.791847 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.792737 14895 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:58.696944 17815 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.796263 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:58.799489 14221 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:18:58.750866 17699 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:58.792168 14892 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:58.802428 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.803427 14296 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:58.773916 14300 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:18:58.806097 14374 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:58.713230 17722 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:18:58.807600 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 246289us
I20260709 13:18:58.809283 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.811266 14297 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:18:58.812318 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.815385 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.814915 17684 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.818498 17595 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:58.819175 14228 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:18:58.819685 17799 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:58.797936 17767 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.794754 17519 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.742797 17790 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.831569 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.835592 14220 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:58.833012 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:58.829111 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:58.826570 14228 pending_rounds.cc:85] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 4
I20260709 13:18:58.845278 14228 pending_rounds.cc:107] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:58.845975 17595 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.847568 17519 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.845566 14228 raft_consensus.cc:2889] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:58.851426 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.860453 14900 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:58.861992 14899 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:58.867069 14897 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:18:58.853011 17383 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.824048 17262 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:58.871805 14374 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:58.705165 17695 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.873466 14901 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:58.878732 17816 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:58.879184 17598 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:58.879928 17598 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.879678 17816 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.880576 17598 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:58.882078 17262 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.884681 17262 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:58.882078 14126 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 3 to 8, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 8 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:58.886041 17383 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.889004 17383 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:58.888433 14126 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 2 to 3, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 3 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:58.874750 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.828617 17799 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:18:58.875415 14898 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:58.894285 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.797385 17739 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.942687 14899 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:58.945187 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:18:58.949357 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.939051 17799 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.853250 17684 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:58.968425 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:58.969897 17723 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:58.971781 17723 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:58.972806 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:58.974448 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.974893 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.969460 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:58.939134 17262 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.983935 14374 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:58.866565 17404 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:18:58.973393 17723 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:58.987807 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:58.953063 17722 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.994179 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:58.980340 17582 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:58.994839 17383 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:18:58.992087 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:58.995748 17694 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.998045 17198 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:59.073772 17198 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.074311 17198 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.075277 17595 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:59.000877 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.004142 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:59.004978 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:58.998034 17262 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.008061 17684 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:59.020908 17805 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:59.030022 17720 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:59.031405 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 73035.4us
I20260709 13:18:59.069658 14126 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:59.031950 17563 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:59.033160 17699 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:59.034782 17788 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:59.038679 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.974149 17601 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:59.060878 16822 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:59.053872 17584 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:18:59.059520 17723 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:18:59.118717 17816 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:59.119341 17723 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:59.065604 17582 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:59.120431 17582 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.078706 14303 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 7 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:59.121579 17582 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.066375 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.122527 17699 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.125020 17699 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:59.080044 14301 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:59.070763 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.125589 17262 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:59.125666 17788 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:59.070044 14342 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:18:59.127969 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 134093us
I20260709 13:18:59.128201 17788 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:59.128888 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:59.068743 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.097512 14297 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.099215 14376 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:59.100037 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:59.100827 17519 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:59.102496 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:59.085911 17712 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.003s
I20260709 13:18:59.104889 17598 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:59.097733 17601 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:59.083806 17694 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:59.106382 16822 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:18:59.106424 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.106950 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.108103 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:59.132880 14299 consensus_meta.cc:287] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.000s
I20260709 13:18:59.138547 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.147408 14371 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:59.148694 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.148859 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.149814 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.114248 14126 catalog_manager.cc:5697] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 5 to 8, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 8 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:59.118620 17739 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:59.072657 17334 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:59.099875 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:59.113541 14125 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36074 (request call id 213) took 17376 ms (client timeout 15000 ms). Trace:
I20260709 13:18:59.102909 17751 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:59.118974 17790 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:59.146248 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46339.9us
I20260709 13:18:59.136631 14193 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:59.146019 14373 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:59.157361 14299 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:59.160354 14299 pending_rounds.cc:85] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 3
I20260709 13:18:59.160717 14299 pending_rounds.cc:107] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:59.161091 14299 raft_consensus.cc:2889] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:59.143811 17789 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.006s
W20260709 13:18:59.163836 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.144074 17816 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.142465 17720 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:59.145709 17712 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.162304 16822 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.145460 17694 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:59.171880 14898 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.178184 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.170490 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:59.171020 14126 catalog_manager.cc:5697] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 4 to 9, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 9 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:59.179939 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 459730us
I20260709 13:18:59.180711 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:59.150079 17767 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.182442 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.183705 17767 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:59.183823 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.184818 14370 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
W20260709 13:18:59.154047 14125 rpcz_store.cc:269] 0709 13:18:41.736674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.736921 (+   247us) service_pool.cc:224] Handling call
0709 13:18:59.113281 (+17376360us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:50.730801 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:50.981937 (+251136us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:50.986237 (+  4300us) write_op.cc:435] Acquired schema lock
0709 13:18:50.998906 (+ 12669us) tablet.cc:662] Decoding operations
0709 13:18:51.067796 (+ 68890us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:51.067874 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:51.067902 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:18:51.087527 (+ 19625us) tablet.cc:701] Row locks acquired
0709 13:18:51.105323 (+ 17796us) write_op.cc:260] PREPARE: finished
0709 13:18:51.127605 (+ 22282us) write_op.cc:270] Start()
0709 13:18:51.146093 (+ 18488us) write_op.cc:276] Timestamp: P: 1783603131122442 usec, L: 0
0709 13:18:51.146999 (+   906us) op_driver.cc:348] REPLICATION: starting
0709 13:18:51.212438 (+ 65439us) log.cc:844] Serialized 6844 byte log entry
0709 13:18:52.334860 (+1122422us) op_driver.cc:464] REPLICATION: finished
0709 13:18:53.029571 (+694711us) write_op.cc:301] APPLY: starting
0709 13:18:53.056807 (+ 27236us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:53.074323 (+ 17516us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:53.074508 (+   185us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:53.287723 (+213215us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:53.288122 (+   399us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:18:53.288172 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:53.288606 (+   434us) log.cc:844] Serialized 119 byte log entry
0709 13:18:53.357829 (+ 69223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:53.361305 (+  3476us) write_op.cc:454] Released schema lock
0709 13:18:53.404127 (+ 42822us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:53.404631 (+   504us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:53.404675 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":604607,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":629043,"apply.run_cpu_time_us":11396,"apply.run_wall_time_us":400857,"num_ops":17,"prepare.queue_time_us":998988,"prepare.run_cpu_time_us":84749,"prepare.run_wall_time_us":871850,"raft.queue_time_us":647523,"raft.run_cpu_time_us":44523,"raft.run_wall_time_us":518354,"replication_time_us":1114680,"thread_start_us":1357247,"threads_started":5,"wal-append.queue_time_us":476621,"wal-append.run_cpu_time_us":43451,"wal-append.run_wall_time_us":2546041}]]}
I20260709 13:18:59.166155 17751 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.186235 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2457) took 1254 ms. Trace:
I20260709 13:18:59.186671 14299 rpcz_store.cc:276] 0709 13:18:57.931784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.327138 (+395354us) service_pool.cc:224] Handling call
0709 13:18:58.327466 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.185986 (+858520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.186178 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.188144 17751 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:59.145501 17584 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.191766 17584 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:59.193698 14295 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:59.179325 17598 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:59.196676 17837 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:59.198854 17479 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:18:59.177402 17334 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:59.204524 17334 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:59.207286 17198 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:59.210052 17198 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:59.210520 17479 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.211269 17479 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.213886 17479 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:59.214831 17843 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.506s	user 0.001s	sys 0.010s
I20260709 13:18:59.143307 17601 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.217761 17601 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.179767 17699 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:59.218621 17699 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.219192 17699 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.225884 17812 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:59.139318 17815 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:59.225615 14375 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:18:59.231550 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:59.233136 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 62752.3us
I20260709 13:18:59.234601 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.235064 14126 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 2 to 4, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 4 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:18:59.237489 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 56883.7us
I20260709 13:18:59.235702 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.239226 14375 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:59.241734 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:59.242607 14373 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:59.238824 17598 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:59.246366 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.247149 14377 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:59.247071 17598 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.243664 17595 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:59.252451 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.253249 14378 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:18:59.238521 17767 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:59.239652 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.263577 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.272802 14371 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:59.278137 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.279182 14375 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:59.280515 14342 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:59.280927 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.298513 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.299245 14373 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.277112 14126 catalog_manager.cc:5697] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 3 to 7, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 7 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:59.307413 14376 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.332167 14371 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.302639 17790 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:59.279979 17595 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:59.339774 14297 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:18:59.341246 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:59.345067 14899 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:59.298230 17767 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:18:59.350564 14378 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:59.371485 14375 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:18:59.379179 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.375224 17884 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:59.387066 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:59.387989 14897 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.397521 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:59.400152 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.407790 17884 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:59.411146 17884 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:59.403756 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:59.350335 17790 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.417037 14899 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 7: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:59.430653 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:18:59.431507 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.433734 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 62628.8us
I20260709 13:18:59.436069 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:59.423564 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:18:59.437193 14901 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:59.415877 17815 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:18:59.425185 17790 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.450495 14897 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:18:59.444478 14126 catalog_manager.cc:5697] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 1 to 5, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 5 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:59.456398 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:18:59.442597 17298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.014s	sys 0.022s
W20260709 13:18:59.506356 17298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.014s	sys 0.022s
I20260709 13:18:59.458802 14376 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:59.481760 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.425421 17799 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:59.483860 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.488693 14378 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:59.511180 14378 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:59.492113 14375 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:18:59.501394 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.503193 14898 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 3.
I20260709 13:18:59.481938 17788 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:59.520177 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.556066 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.519937 17788 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.566454 14375 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
W20260709 13:18:59.569656 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 151617us
I20260709 13:18:59.571652 14126 catalog_manager.cc:5697] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 3 to 5, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 5 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:18:59.577334 14370 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:18:59.567914 14267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.053s
W20260709 13:18:59.582214 14267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.011s	sys 0.053s
I20260709 13:18:59.586414 14126 catalog_manager.cc:5697] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 5 to 7, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 7 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:59.592144 14373 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
W20260709 13:18:59.592828 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.011s	sys 0.033s
W20260709 13:18:59.594252 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.011s	sys 0.033s
W20260709 13:18:59.596971 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.581650 14892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.030s	sys 0.030s
I20260709 13:18:59.562489 17695 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:59.598886 14892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.030s	sys 0.030s
W20260709 13:18:59.566506 14344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.015s	sys 0.049s
W20260709 13:18:59.599992 14344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.016s	sys 0.049s
I20260709 13:18:59.562311 17812 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:59.604074 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.563879 17788 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.506577 17595 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:59.606624 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 637191us
W20260709 13:18:59.604200 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 727591us
W20260709 13:18:59.605095 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.567974 17334 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:18:59.609552 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.520205 17767 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:59.560096 17723 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:59.618742 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.610888 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.576771 17720 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:18:59.627921 14373 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:59.630481 14194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.013s	sys 0.044s
W20260709 13:18:59.630968 14194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.013s	sys 0.044s
W20260709 13:18:59.636876 14114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8c137013238f4b1dbae260e32cb316dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9b2cf49ceed478480fb0f27ccf55d81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:18:59.637673 14221 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:59.638108 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.639712 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:59.606683 17884 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:59.622486 17812 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.657816 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:59.651650 17884 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.656586 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:59.662145 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:59.603749 17695 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.621166 17334 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.661525 14224 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:18:59.613269 17699 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.677166 14229 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:18:59.677153 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 48251.1us
I20260709 13:18:59.679387 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.680542 14373 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:59.682449 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:59.686858 14297 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:59.692535 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:18:59.662031 17712 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:59.672381 17198 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:59.710599 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.711863 14299 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:59.722036 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.724720 14224 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:59.733354 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.733690 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.734259 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.700785 14126 catalog_manager.cc:5697] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:18:59.693990 17383 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:59.735801 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 43517.4us
I20260709 13:18:59.668210 17722 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:18:59.762353 17383 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:18:59.764503 14269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.029s	sys 0.039s
W20260709 13:18:59.764966 14269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.029s	sys 0.039s
I20260709 13:18:59.740044 14296 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:18:59.767268 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.768949 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.770263 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.771042 14375 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.774288 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.775933 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:18:59.776832 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.777639 14301 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:18:59.778216 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.778569 14286 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9 with delete_type TABLET_DATA_TOMBSTONED (TS bee4f7fc1b4740dc875537c79309664f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54352
I20260709 13:18:59.782200 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.733577 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:18:59.783936 14369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.061s	sys 0.114s
I20260709 13:18:59.704052 17712 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:59.719240 17563 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:59.746582 17883 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:18:59.747582 17889 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:18:59.738806 17890 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:59.749006 14302 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:18:59.728008 17789 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:18:59.753187 17723 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:59.755146 17699 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:59.763821 17383 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.831009 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:18:59.784588 14369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.061s	sys 0.114s
I20260709 13:18:59.738950 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:59.740360 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:59.839200 14229 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:18:59.787072 14299 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:18:59.647300 17790 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:18:59.789434 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.843007 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.843503 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.844236 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.792644 14295 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:59.777305 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.743592 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.797219 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.735898 14126 catalog_manager.cc:5697] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:59.798978 14298 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 5: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:18:59.801239 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 62756.2us
I20260709 13:18:59.723129 17799 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:18:59.809597 16822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.013s	sys 0.046s
I20260709 13:18:59.802359 14370 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:18:59.847328 16822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.013s	sys 0.046s
I20260709 13:18:59.811367 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.798646 17712 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.848037 14301 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:59.823482 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:59.850066 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.810240 17890 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:18:59.857537 14376 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:18:59.860554 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:59.863350 14302 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.862782 14126 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:59.856279 14220 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:18:59.870354 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.871408 14295 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:18:59.872570 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:59.875882 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:59.877764 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.878573 14297 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:18:59.883165 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:18:59.885218 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:59.885807 14300 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.882447 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.809247 17582 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:18:59.847560 17722 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:59.894630 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.898919 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:59.804898 17563 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.901255 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.865330 17897 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.926793 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.932016 14375 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:18:59.931658 14224 raft_consensus.cc:2410] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:59.930274 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:18:59.937186 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:18:59.943666 14295 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:59.936762 14298 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:18:59.946519 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:59.952497 14223 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:59.953279 14226 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:59.955219 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:59.956018 17790 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:59.932713 17601 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:18:59.962688 14222 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.966455 14297 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:59.966969 14297 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:59.967556 17896 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:59.968197 17896 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:59.967878 14297 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.969074 14297 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.966517 14227 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:59.966523 17695 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:18:59.940928 17897 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:18:59.972872 14229 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.974084 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:18:59.974422 17897 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:18:59.975613 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.975930 17884 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:59.976657 17582 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.935068 17723 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:18:59.977231 17582 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.977969 17723 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:59.976141 14226 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.978518 17723 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:59.979374 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:18:59.980242 17582 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:18:59.979652 17723 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.980832 17582 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:59.984546 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:18:59.985189 17895 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:59.985737 17895 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:59.986133 14896 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:59.986670 17895 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:18:59.987526 14898 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.988039 17895 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.988590 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:18:59.989171 14900 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:59.985255 14377 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.990404 17334 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:18:59.984786 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.991922 14302 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:18:59.993279 14371 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:59.994267 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:18:59.987298 17816 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.813s	user 0.007s	sys 0.004s
I20260709 13:18:59.994874 14898 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:59.981520 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:59.999608 14900 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:19:00.002300 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:18:59.995906 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 66632.5us
I20260709 13:18:59.995555 14300 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:00.003934 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:00.005089 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.005199 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:18:59.903023 17722 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:18:59.868170 17890 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:00.009387 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 397687us
I20260709 13:19:00.021430 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:00.030293 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48872.5us
W20260709 13:19:00.031605 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.032372 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:00.034139 14295 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:00.003165 16822 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:19:00.030121 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:00.035820 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:00.036116 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:00.029141 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:00.038013 14369 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:18:59.877981 17684 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.149s
I20260709 13:19:00.048136 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:00.038352 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:00.009279 17816 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:00.039609 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:18:59.942415 17894 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:00.050287 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:00.055101 14228 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:00.027463 17764 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.051925 17897 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.008394 17695 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:19:00.039475 17767 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.969421 17896 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.040608 17812 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:00.039206 17891 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:00.062150 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:00.027710 17815 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.064677 16822 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:00.062150 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:00.063979 17884 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.047046 17582 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:59.981479 17723 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.055438 17198 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:00.060402 17764 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.055546 17739 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:19:00.088439 17815 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:00.091270 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 328689us
I20260709 13:19:00.089429 17891 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:00.132649 17198 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.145234 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:00.158483 17720 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:00.182086 17198 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.184392 14222 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:00.184698 17720 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:00.185292 17720 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.137971 17816 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 13:19:00.160498 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 292096us
I20260709 13:19:00.145661 17896 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.134311 17764 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.177873 17563 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:00.090270 17767 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:00.202224 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.189035 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:00.222136 14228 raft_consensus.cc:2410] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:19:00.186463 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:00.145567 17815 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.227363 14304 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:00.150465 17891 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.186779 17816 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:00.243196 14220 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:00.222561 17563 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.241695 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:00.246228 14298 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:19:00.246488 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 246050us
I20260709 13:19:00.185760 17720 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.186902 17722 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:00.301295 17905 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:19:00.247313 17910 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:00.298547 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:00.245814 17816 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:00.353565 17722 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.353775 17816 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:00.250244 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:00.357303 14304 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.310201 17712 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.358839 14302 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:00.361686 17712 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:00.261245 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.363001 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.362761 14867 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:00.363807 14864 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.866s (SENT) [suppressed 10 similar messages]
I20260709 13:19:00.364234 17563 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:00.346283 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 298200us
W20260709 13:19:00.248029 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.352069 17910 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:00.316527 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:00.375526 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:00.382084 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:00.269588 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 237294us
W20260709 13:19:00.315775 17788 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.004s
I20260709 13:19:00.393999 14228 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
W20260709 13:19:00.402611 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.327299 17767 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:00.408826 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:00.413610 14304 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:00.404791 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:00.418082 14227 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:00.382079 17695 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:00.451476 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:00.452061 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:00.453099 17789 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:00.379413 17712 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.453976 17789 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:00.454656 17789 consensus_queue.cc:1243] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:00.455186 17789 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:00.455515 17789 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:00.454092 17712 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.309566 17198 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:00.463095 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 400829us
I20260709 13:19:00.442503 17894 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:00.462984 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:00.471716 14220 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:19:00.464210 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 51901.9us
W20260709 13:19:00.462572 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 426103us
I20260709 13:19:00.473773 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:00.434940 17799 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:00.391021 17699 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:19:00.470446 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.475237 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 66481.8us
I20260709 13:19:00.476545 14341 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:00.479910 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:00.437273 17601 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:00.459985 17805 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:00.486900 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:00.404212 17788 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:00.456961 17695 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:00.484804 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:00.470069 17911 tablet_replica.cc:333] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:19:00.460656 17921 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:19:00.456612 17920 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
W20260709 13:19:00.511554 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.552693 14898 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:00.491333 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:00.483819 17601 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:00.554171 14897 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:00.510921 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:00.555146 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:00.527395 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:00.556428 14227 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:00.556453 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 78909.7us
I20260709 13:19:00.513484 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:00.560034 14894 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.557135 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:00.518136 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:00.525034 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48600.4us
I20260709 13:19:00.559870 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:00.556789 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 69964.6us
I20260709 13:19:00.558318 14900 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:00.561125 14228 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.560829 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:00.565083 14221 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:00.549211 17895 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.554s	user 0.014s	sys 0.000s
I20260709 13:19:00.500979 17383 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.570300 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:00.554042 17695 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:00.582027 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.501708 17799 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:00.589583 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 109741us
I20260709 13:19:00.590668 14897 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:00.526988 17805 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:00.596035 17198 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:00.598104 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:00.601737 17926 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:00.575484 17383 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.501400 17789 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.603081 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:00.603061 17799 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.568493 17884 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:00.605922 17788 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:00.606329 17904 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:19:00.607321 17563 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:00.611110 14227 raft_consensus.cc:2410] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:00.690286 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:00.690596 14897 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:00.689661 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:00.621721 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.625077 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.633502 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:00.484586 17910 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.643281 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:00.644017 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:00.644132 17918 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:00.653975 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 93197.3us
I20260709 13:19:00.655411 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:00.608373 17694 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:00.709939 16822 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:00.656931 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:00.649482 17699 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:00.620867 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:00.691810 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.480962 17894 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:00.681998 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:00.695494 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:00.635803 17383 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.703974 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:00.717870 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:00.656616 17884 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:00.695655 14377 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:00.695855 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:00.689723 17928 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.680274 14228 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:19:00.715101 14375 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:00.695326 14372 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:00.710541 17920 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:00.722106 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:00.722921 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:00.735508 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 165292us
I20260709 13:19:00.753949 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:00.714139 17896 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.001s
I20260709 13:19:00.719710 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:00.712592 17919 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:00.768253 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 57708.7us
I20260709 13:19:00.692919 17932 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:00.760215 17815 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.760454 17891 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:00.762004 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.716423 17922 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:00.712826 17699 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.764657 14893 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:00.708269 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:00.771148 14378 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:00.770998 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 168063us
W20260709 13:19:00.771690 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.773070 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.774884 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:00.727967 17884 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.713701 17918 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.719381 17943 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:00.767871 17904 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:19:00.750388 17927 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:00.787132 14375 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
W20260709 13:19:00.789713 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.779325 17941 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:00.779352 17936 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.693025 17601 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:00.772785 17712 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:00.772682 17932 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:00.787904 17908 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:19:00.801093 14304 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:19:00.827914 14304 pending_rounds.cc:85] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 7
I20260709 13:19:00.828086 14295 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:00.783142 17910 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.810204 14300 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:00.805512 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:00.830643 14296 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.782639 17934 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.831859 14192 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:00.824013 14893 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:00.819028 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:00.807675 17699 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.828260 14304 pending_rounds.cc:107] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:19:00.834492 14304 raft_consensus.cc:2889] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:00.834795 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:00.812311 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:00.810055 17924 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:00.848649 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63641.9us
I20260709 13:19:00.763188 17928 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.852509 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:00.851862 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:00.860504 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:00.861773 14344 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:00.822873 17936 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.862612 17936 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.865968 17896 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:00.862010 17941 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:00.848810 17955 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:19:00.877480 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:00.879678 14222 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.816702 17942 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:00.774880 17919 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.867369 17934 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:00.787777 17805 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.827031 17684 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:19:00.838671 17788 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:19:00.838415 17712 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.827342 17932 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.822561 17598 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:19:00.890702 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:00.884488 17961 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:19:00.818708 17943 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.893450 17935 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.893560 17955 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:00.823412 17927 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:00.895325 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 891) took 1855 ms. Trace:
I20260709 13:19:00.977984 14898 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:19:00.981611 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 149788us
W20260709 13:19:01.011132 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 120502us
I20260709 13:19:00.981987 17922 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:00.982295 17967 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:00.984349 14224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.017s	sys 0.013s
W20260709 13:19:01.016027 14224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.017s	sys 0.014s
W20260709 13:19:00.987157 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 199864us
I20260709 13:19:00.987636 17971 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:01.036101 17971 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:01.037442 17971 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:00.993129 14229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.006s	sys 0.005s
W20260709 13:19:00.984156 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 181988us
I20260709 13:19:01.007319 14298 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:19:01.051481 14229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.006s	sys 0.005s
I20260709 13:19:01.012578 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:01.053507 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:01.012761 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 98739us
I20260709 13:19:01.013686 14220 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:01.016930 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:00.887825 17739 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:01.056825 14341 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:01.055473 14193 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:01.010376 14374 rpcz_store.cc:276] 0709 13:18:59.039821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.047244 (+  7423us) service_pool.cc:224] Handling call
0709 13:18:59.059925 (+ 12681us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:59.097647 (+ 37722us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:59.623500 (+525853us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.300263 (+676763us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:00.348130 (+ 47867us) log.cc:844] Serialized 52 byte log entry
0709 13:19:00.348288 (+   158us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:00.348563 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.349074 (+   511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.349155 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.895020 (+545865us) raft_consensus.cc:1685] finished
0709 13:19:00.895056 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.895231 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":523558,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":1896,"raft.queue_time_us":62119,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":8389,"thread_start_us":1147531,"threads_started":3,"wal-append.queue_time_us":560888}
I20260709 13:19:01.027215 17922 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.035514 14224 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:01.006448 17921 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.065042 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.000s	sys 0.022s
I20260709 13:19:01.061305 14267 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:01.065414 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 203734us
W20260709 13:19:01.089577 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.974865 17712 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:01.089701 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:01.092190 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.000s	sys 0.028s
I20260709 13:19:01.093019 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:01.093032 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:01.111158 14224 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:01.017442 17920 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:01.111009 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:01.086895 17722 consensus_meta.cc:287] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.712s	user 0.007s	sys 0.003s
I20260709 13:19:01.051116 17971 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.856751 17924 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:01.139081 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 127212us
I20260709 13:19:01.054201 17958 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:01.094368 17712 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.119833 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:01.111336 17895 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.139963 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:01.009479 17694 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:01.110042 17955 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:01.149437 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 95988.9us
I20260709 13:19:01.118754 17739 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:01.154937 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:00.889922 17942 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.154870 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:01.163045 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 107646us
I20260709 13:19:01.163304 14864 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:01.050248 17935 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.142510 17815 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.166358 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:01.146509 17948 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:01.167887 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:01.149659 17684 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.094751 17921 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.185475 14193 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:01.156404 17891 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:01.196177 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 103284us
I20260709 13:19:01.186017 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:01.204092 14222 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
W20260709 13:19:01.203320 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 92418.1us
W20260709 13:19:01.207646 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 44444.3us
I20260709 13:19:01.182010 17598 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.190405 17788 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:01.216668 14894 consensus_meta.cc:287] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
I20260709 13:19:01.185745 17739 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.183518 17961 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:01.224073 14894 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:01.203111 17563 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:01.143754 17958 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.233189 14193 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:01.208979 17684 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:01.228456 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 73597.8us
W20260709 13:19:01.227888 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.229915 16822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.006s	sys 0.002s
I20260709 13:19:01.230189 14897 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:01.235687 17952 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:01.236157 17977 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:01.236573 17903 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:19:01.237166 17960 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:01.247862 16822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.007s	sys 0.002s
I20260709 13:19:01.242920 17788 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:01.230307 17891 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.246151 17916 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:19:01.297374 17963 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:01.299523 17935 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:01.303465 17699 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.307289 17958 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:01.313711 14296 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:01.253907 17918 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:01.249183 17598 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
W20260709 13:19:01.308712 17890 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.265s	user 0.009s	sys 0.002s
I20260709 13:19:01.323515 17969 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:01.233629 17961 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:01.360637 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 110110us
I20260709 13:19:01.361579 14193 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:01.332077 17919 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.330639 17977 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:01.355971 17935 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:19:01.334496 17934 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:01.371392 17980 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:01.371703 17969 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:01.372797 17921 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.240626 17694 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:01.379199 14193 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:01.309485 17891 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:01.361959 17720 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.011s	user 0.011s	sys 0.006s
W20260709 13:19:01.378070 17965 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:19:01.414762 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:01.416795 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:01.419605 14378 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:01.359724 17943 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.357476 17928 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:01.421649 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:01.432016 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:01.344280 17890 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.436529 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:01.333926 17962 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:19:01.430612 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:01.382088 17938 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:01.410140 17764 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.174s	user 0.013s	sys 0.001s
I20260709 13:19:01.431852 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:01.432413 14375 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.432533 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:01.404196 17924 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.380622 17927 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:01.442682 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:01.444475 14371 raft_consensus.cc:2410] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:01.409256 17980 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:01.419385 17934 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:01.446295 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.443532 14374 raft_consensus.cc:2376] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9. Re-sending same reply.
I20260709 13:19:01.427934 17816 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:01.377735 17712 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.449963 14378 raft_consensus.cc:2376] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8. Re-sending same reply.
I20260709 13:19:01.440145 17699 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:01.460009 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 256761us
I20260709 13:19:01.463899 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:01.427372 17720 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:01.466786 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:01.475528 14296 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:01.469548 14375 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:01.472663 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:01.479058 14297 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:01.443869 17598 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:01.451802 17960 raft_consensus.cc:2764] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:19:01.484934 14370 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:01.476646 17383 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.730s	user 0.008s	sys 0.002s
I20260709 13:19:01.477818 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:01.486354 14371 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.479954 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:01.438865 17932 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.481534 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:01.487449 14297 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:01.481043 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:01.483973 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:01.488556 14299 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:01.473583 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:01.486270 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51701.1us
I20260709 13:19:01.489542 14300 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:19:01.476079 17928 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:01.453130 17980 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.448137 17764 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:01.442082 17788 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:01.492165 17974 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:19:01.476359 17942 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:01.492686 17981 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:19:01.493168 17979 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:19:01.493187 17720 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:01.494433 17988 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:01.438220 17969 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.490226 17598 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:01.474236 17938 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:19:01.510764 14300 pending_rounds.cc:85] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 6
I20260709 13:19:01.531286 14300 pending_rounds.cc:107] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:19:01.531566 14300 raft_consensus.cc:2889] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:01.476233 17799 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:19:01.520045 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 273160us
I20260709 13:19:01.531728 14369 raft_consensus.cc:2368] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9.
I20260709 13:19:01.494462 17987 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.533298 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:01.537267 14304 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:01.531631 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:01.541128 14229 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:01.519845 17699 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.512205 17962 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:01.546759 14228 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:01.478046 17977 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:01.528328 17928 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:01.547055 14304 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:01.496551 17383 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:01.531649 17967 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:01.544184 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:01.563839 17598 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:01.565970 17951 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:19:01.568783 17943 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:01.566366 17890 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.574131 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:19:01.584370 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 51663.4us
I20260709 13:19:01.555827 17699 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.586917 17991 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:19:01.599656 17712 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.605235 17992 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:19:01.604504 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:01.582461 17961 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:01.603425 17984 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:19:01.590816 17891 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:01.615619 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57241.6us
I20260709 13:19:01.620363 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:01.620644 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:01.543113 17987 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.632622 14372 raft_consensus.cc:2410] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:19:01.633276 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:01.633473 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:01.634298 14224 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:01.625810 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:01.635764 14375 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:01.636130 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:01.636847 14304 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:01.637661 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:01.639281 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:01.626827 14371 raft_consensus.cc:2410] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:19:01.628235 18002 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.640951 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:01.642777 18000 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.643450 18000 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.645473 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2367) took 1177 ms. Trace:
I20260709 13:19:01.645948 14226 rpcz_store.cc:276] 0709 13:19:00.459827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.460869 (+  1042us) service_pool.cc:224] Handling call
0709 13:19:00.466619 (+  5750us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:00.522563 (+ 55944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.522595 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:00.525821 (+  3226us) log.cc:844] Serialized 52 byte log entry
0709 13:19:00.993870 (+468049us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:00.994635 (+   765us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.995220 (+   585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.995339 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.637342 (+642003us) raft_consensus.cc:1685] finished
0709 13:19:01.637362 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.637498 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13964,"prepare.queue_time_us":197,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":57594,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":14345,"thread_start_us":467564,"threads_started":1,"wal-append.queue_time_us":616977}
I20260709 13:19:01.648393 17995 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:19:01.573413 17962 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.609057 17699 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:01.609524 17955 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:01.661005 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:01.638381 17991 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:01.676875 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:01.634435 17720 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.673372 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:01.686550 14375 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:01.678956 17699 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:01.693883 14222 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:01.681015 17955 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:01.687157 17938 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:01.707434 18000 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:01.707901 17962 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:01.708487 18001 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:01.708410 17969 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.670359 14229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:19:01.713063 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 1933) took 1763 ms. Trace:
I20260709 13:19:01.723740 14229 raft_consensus.cc:606] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:01.724187 14229 raft_consensus.cc:614] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:01.689378 17891 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.696373 17695 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.085s	user 0.008s	sys 0.004s
I20260709 13:19:01.698115 18002 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.683718 17720 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:01.650831 17928 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:01.720768 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 44056.2us
I20260709 13:19:01.694376 17894 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:01.691656 17932 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.723726 14221 rpcz_store.cc:276] 0709 13:18:59.949895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.951978 (+  2083us) service_pool.cc:224] Handling call
0709 13:18:59.952340 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.565546 (+613206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.712805 (+1147259us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b540011fdd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:01.712996 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408729472}
I20260709 13:19:01.729111 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:01.702841 17997 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:01.707463 17987 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.710264 17764 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:01.703344 17986 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:01.705598 17684 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:01.709941 17948 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:01.698347 17989 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:01.770411 17948 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:01.770532 17989 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:01.724372 17971 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.000s
I20260709 13:19:01.750398 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:01.772902 14897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:01.773589 14897 raft_consensus.cc:606] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:01.773950 14897 raft_consensus.cc:614] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:01.773981 17962 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.769668 17986 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:01.776327 17986 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.729444 17938 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:01.765345 17936 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.902s	user 0.012s	sys 0.000s
I20260709 13:19:01.747980 17695 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.802572 14896 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:01.746198 17891 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.804126 14375 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:01.806048 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:01.786293 17894 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:01.810372 17911 raft_consensus.cc:2243] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:01.811276 17989 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:01.815192 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 154273us
I20260709 13:19:01.816934 17894 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:01.836714 17938 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.837569 17980 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:01.840909 14897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
W20260709 13:19:01.827301 18006 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:19:01.845826 17383 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:01.847043 17980 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:01.853404 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2527) took 1049 ms. Trace:
I20260709 13:19:01.853917 14298 rpcz_store.cc:276] 0709 13:19:00.804374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.810979 (+  6605us) service_pool.cc:224] Handling call
0709 13:19:00.811272 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.051851 (+240579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.853102 (+801251us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400333e54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:01.853334 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449941248}
W20260709 13:19:01.855304 17884 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.037s	user 0.012s	sys 0.000s
I20260709 13:19:01.855831 17884 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.859236 14227 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:01.861109 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2375) took 1226 ms. Trace:
I20260709 13:19:01.861487 14227 rpcz_store.cc:276] 0709 13:19:00.634358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.992508 (+358150us) service_pool.cc:224] Handling call
0709 13:19:00.992879 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.859674 (+866795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.860860 (+  1186us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b540026c5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:01.861046 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1991978880}
W20260709 13:19:01.863859 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.830490 17910 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.991s	user 0.012s	sys 0.001s
I20260709 13:19:01.797118 17936 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.815439 17955 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:01.871798 17936 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:01.873754 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:01.874208 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:01.875181 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:01.873924 17891 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.879390 14373 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:01.826550 17932 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:01.876427 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:01.899861 14224 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:01.876866 14897 raft_consensus.cc:606] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:01.900662 14897 raft_consensus.cc:614] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:01.785435 17997 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:01.880142 17799 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.905685 17932 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:01.936362 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:01.937130 14224 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:01.947928 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:01.936102 17884 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:01.968115 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:01.968904 14374 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:01.968144 14224 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:01.917632 17799 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:01.972177 17695 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:01.983043 14374 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:01.985514 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:01.989300 18010 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:01.984869 17891 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.972606 17997 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:01.972384 17948 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:02.010165 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:02.023249 18015 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:19:02.025395 17949 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.144s	user 0.003s	sys 0.014s
I20260709 13:19:02.029946 17948 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:02.032089 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:02.033182 14894 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:02.012276 17891 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.042394 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:02.058055 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:02.058996 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:02.009460 17932 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.061479 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:02.061857 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:02.064610 14892 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:02.068367 14374 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:02.041280 17938 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.070550 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:02.060956 17694 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:19:02.073776 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:02.084535 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:02.086055 14894 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:02.055657 17986 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.093286 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:02.094331 14901 raft_consensus.cc:2368] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9.
I20260709 13:19:02.097656 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:02.098577 14376 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:02.099424 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:02.106140 14894 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:02.101580 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:02.101472 18016 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:19:02.080598 17938 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.170238 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:02.173771 14376 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:02.174463 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:02.186667 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:02.195029 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:02.198904 14376 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:02.201393 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:02.202162 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:02.202841 14369 raft_consensus.cc:2376] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7. Re-sending same reply.
I20260709 13:19:02.203060 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:02.203691 14229 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:02.204155 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:02.204571 14226 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:02.205037 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:02.205497 14378 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:02.205967 14376 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:02.206609 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:02.212093 14376 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:02.214700 17967 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:02.215194 17967 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:02.216071 17967 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.216672 17947 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:02.219772 14296 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:02.221095 14341 leader_election.cc:400] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9.
I20260709 13:19:02.226625 14341 leader_election.cc:403] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:02.222067 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:02.203717 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:02.255131 14894 raft_consensus.cc:2410] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:19:02.225508 18028 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:19:02.260929 14896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 907) took 1773 ms (client timeout 2143 ms). Trace:
I20260709 13:19:02.261070 14899 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:02.262362 14896 rpcz_store.cc:269] 0709 13:19:00.488116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.488319 (+   203us) service_pool.cc:224] Handling call
0709 13:19:02.260700 (+1772381us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54007d0354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:02.260869 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2857740672}
I20260709 13:19:02.223912 17947 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:02.196898 17996 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:19:02.200135 17694 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:19:02.256139 17816 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9.
I20260709 13:19:02.279564 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:02.280357 14893 raft_consensus.cc:606] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:02.280747 14893 raft_consensus.cc:614] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:02.282019 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:02.266095 17967 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:02.271086 18035 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:19:02.290908 14370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2255) took 1535 ms (client timeout 1757 ms). Trace:
W20260709 13:19:02.291522 14370 rpcz_store.cc:269] 0709 13:19:00.755051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.755245 (+   194us) service_pool.cc:224] Handling call
0709 13:19:02.290622 (+1535377us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54003c3cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:02.290808 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562833792}
W20260709 13:19:02.293375 18037 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:19:02.298991 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:02.300352 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:02.259935 17891 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:02.309211 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 911) took 1510 ms. Trace:
W20260709 13:19:02.270632 18033 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:19:02.310086 14898 rpcz_store.cc:276] 0709 13:19:00.798349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.798747 (+   398us) service_pool.cc:224] Handling call
0709 13:19:00.799043 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.011490 (+212447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.308895 (+1297405us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b54005901d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:02.309132 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228685056}
W20260709 13:19:02.312271 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.313321 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:02.316447 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:02.318682 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:02.264541 17959 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:19:02.318141 18005 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:02.322865 17936 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:02.327708 17699 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:02.316463 17986 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:02.332019 17927 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:02.346969 17936 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.343106 18005 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.356490 17927 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:02.353017 17699 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.344121 17947 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:02.362105 17927 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:02.361215 17936 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:02.361434 17720 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:02.361490 18005 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.363091 17699 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:02.369977 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.366452 17947 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:02.387161 18038 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:19:02.391595 18005 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.393882 18005 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:02.397487 17699 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.398882 17936 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.402143 17699 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:02.402232 17936 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:02.400142 17982 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.009s
W20260709 13:19:02.403242 17982 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.002s	sys 0.009s
I20260709 13:19:02.409358 17927 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.410039 17799 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:02.412127 17927 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:02.440189 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2374) took 1842 ms. Trace:
I20260709 13:19:02.440658 14228 rpcz_store.cc:276] 0709 13:19:00.597677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.761411 (+163734us) service_pool.cc:224] Handling call
0709 13:19:00.762362 (+   951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.556044 (+793682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.439928 (+883884us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b5400082354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:02.440097 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803549568}
I20260709 13:19:02.494798 17601 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.591111 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 925) took 1975 ms. Trace:
I20260709 13:19:02.591588 14899 rpcz_store.cc:276] 0709 13:19:00.615726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.616321 (+   595us) service_pool.cc:224] Handling call
0709 13:19:02.260854 (+1644533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.263144 (+  2290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.590902 (+327758us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54007d0350. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:02.591048 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3707654912}
W20260709 13:19:02.598814 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.630728 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 312131us
I20260709 13:19:02.631916 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:02.632999 14865 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:02.648988 17995 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:02.649508 17995 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:02.650578 17995 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:02.660230 17995 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.667303 17995 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:02.668080 17995 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.673445 14900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:02.674314 14900 raft_consensus.cc:606] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:02.674659 14900 raft_consensus.cc:614] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:02.676082 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:02.676813 17924 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:02.677385 17924 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:02.678467 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:02.678390 17924 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.680779 17924 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.693811 17995 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:02.694751 17995 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:02.695169 17995 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.696372 17995 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.705535 17995 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.709621 17995 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:02.715037 17995 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:02.717770 17995 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:02.718276 17995 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:02.719319 17995 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.720446 17995 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:02.737315 14220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2368) took 2248 ms (client timeout 2017 ms). Trace:
W20260709 13:19:02.740233 14220 rpcz_store.cc:269] 0709 13:19:00.488723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.489063 (+   340us) service_pool.cc:224] Handling call
0709 13:19:02.737091 (+2248028us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400341554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:02.737230 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041191808}
I20260709 13:19:02.739550 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:02.742447 17935 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:02.742998 17935 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:02.744009 17935 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.763553 17334 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:02.764256 17334 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.766758 17334 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:02.781674 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.784696 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:02.789425 17563 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:02.790076 17563 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:02.792718 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.792963 17563 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:02.794108 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.793958 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:02.794881 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.795926 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:02.796582 14220 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:02.798002 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:02.798774 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:02.799782 17334 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.800400 17334 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:02.800457 14220 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:02.803217 17334 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:02.815620 14220 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:02.816942 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:02.820678 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:02.824640 17334 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:19:02.832129 17739 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:02.832752 17739 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:02.836935 18029 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.744s	user 0.000s	sys 0.007s
I20260709 13:19:02.838040 17767 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:02.838937 17767 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.839597 17767 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:02.845968 17334 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:02.847486 17739 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.855145 17767 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:02.858913 17767 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:02.881136 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.889662 14373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2251) took 2244 ms (client timeout 2116 ms). Trace:
W20260709 13:19:02.892865 14373 rpcz_store.cc:269] 0709 13:19:00.645009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.645129 (+   120us) service_pool.cc:224] Handling call
0709 13:19:02.889369 (+2244240us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003980d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:02.889522 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2732124032}
I20260709 13:19:02.913472 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:02.914136 14370 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:02.915624 14377 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:02.914199 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:02.917148 14371 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:02.924260 17789 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:02.937012 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:02.939955 17937 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.940527 17937 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.942358 18009 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:02.942911 18009 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:02.945000 18009 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:02.949255 17739 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.952996 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:02.957002 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:02.957688 14373 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:02.964109 17937 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:02.973104 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:02.974169 14373 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 5: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:02.974478 14377 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:02.974855 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:02.975839 14370 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:02.976615 14900 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:02.978505 14899 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:02.980031 14894 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:02.981217 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:02.983466 14378 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:02.985176 14374 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:02.987721 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:02.991067 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:02.991945 17298 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:02.992820 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:02.993616 17298 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:02.995110 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:02.998227 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:02.998586 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:03.000180 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:03.005200 17720 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.006181 17720 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.007467 14227 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:03.008502 17720 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:03.009473 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:03.009804 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:03.010421 14222 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.010207 14893 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:03.011507 17694 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:03.013268 17694 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:03.014199 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:03.013602 17694 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:03.017513 14896 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:03.017498 17694 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.019238 17694 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.020570 17937 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:03.021416 17937 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.022046 17937 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:03.037154 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 243409us
I20260709 13:19:03.037533 17582 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.038586 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:03.038918 17582 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.040182 14898 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:03.020490 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:03.040988 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:03.045053 14900 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:03.045284 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:03.046908 17986 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:03.047117 17983 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:03.042019 17891 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:03.047999 17891 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:03.046917 17961 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:03.048390 17996 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:03.048606 17891 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.047912 17937 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:03.049028 17996 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:03.049173 17937 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:03.048079 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:03.050235 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:03.050983 14226 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:03.050236 17996 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.050226 17937 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.054150 17937 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.055466 17723 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:03.057543 18009 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:03.060976 17996 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.061981 17712 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:03.064033 17712 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.066314 17712 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.062695 17895 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.068950 17895 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.071177 17895 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.064383 17897 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:03.071774 17911 raft_consensus.cc:2272] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.072111 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:03.074752 17983 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:03.075158 17983 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.075518 17983 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.071959 17897 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:03.076824 17897 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.078043 17897 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:03.079589 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.080889 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.082453 17938 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:03.083091 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.079949 17950 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.084602 14222 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:03.084910 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.085484 14300 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.086741 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.088935 17985 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.084614 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.089560 17985 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.092998 17985 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.084216 17950 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.093852 17983 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.094574 14297 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:03.095520 17950 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:03.096306 17983 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.096483 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.096742 14300 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:03.097172 14298 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.099272 17891 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.101552 17891 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.082576 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:03.103272 17720 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:03.103753 17720 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:03.104229 17720 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.106346 17891 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:03.110006 14301 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:03.110852 17971 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:03.111299 17971 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:03.112061 14301 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:03.112164 17971 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.113456 17971 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.114167 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.114500 17720 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:03.118639 14126 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37080 (request call id 330) took 17791 ms (client timeout 15000 ms). Trace:
I20260709 13:19:03.118908 17595 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:03.071610 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.119720 17595 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.120635 18054 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:03.121110 18054 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.122918 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:03.146569 14222 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:03.123840 14226 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:03.126775 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 81655.1us
W20260709 13:19:03.128177 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.148712 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:03.148844 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:03.134850 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.149665 14229 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.150063 14301 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:03.151957 14220 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:03.154066 14228 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:19:03.154580 14228 pending_rounds.cc:85] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 3
I20260709 13:19:03.154889 14228 pending_rounds.cc:107] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:03.155206 14228 raft_consensus.cc:2889] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:03.156725 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:03.157619 14225 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:03.159279 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:03.160413 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:03.178893 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:03.132999 14867 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:03.186239 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 1.93275e+06us
I20260709 13:19:03.187759 14221 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:03.187786 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:03.192314 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:03.194129 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:03.197326 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:03.202982 14344 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:03.204213 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:19:03.195089 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72905.2us
W20260709 13:19:03.206771 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.204308 14864 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:03.177737 17789 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.179980 17739 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.251212 14229 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:03.252022 14227 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:19:03.147125 17720 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:03.255837 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:03.257019 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:03.257310 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:03.126434 17298 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:03.245210 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57953.6us
W20260709 13:19:03.263439 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 51374.8us
I20260709 13:19:03.265475 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:03.190119 17712 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:19:03.214290 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:03.267795 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 63561.6us
I20260709 13:19:03.277567 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:03.257761 14375 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:03.278626 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:03.279201 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:03.245114 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:03.260609 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:03.261677 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:03.212427 17934 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:03.273384 14898 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:03.286491 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:03.274042 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:03.286687 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:03.244690 17928 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:03.275148 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:03.287864 14900 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:03.288009 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:03.217984 14298 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
W20260709 13:19:03.248719 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44586.5us
I20260709 13:19:03.190853 17978 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.279229 14897 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 3.
I20260709 13:19:03.290148 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:03.290333 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:03.256096 17910 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:03.244498 17982 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:03.307152 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:03.307152 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2530) took 2204 ms. Trace:
I20260709 13:19:03.193933 17985 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
W20260709 13:19:03.308606 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 175693us
I20260709 13:19:03.246181 17767 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.313700 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:03.210670 17799 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:03.251024 17911 ts_tablet_manager.cc:1916] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:03.281620 14222 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.314833 14297 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:03.293828 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.317349 14298 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.250789 17812 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:19:03.260471 17961 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:03.296808 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 668) took 1622 ms. Trace:
I20260709 13:19:03.250309 17952 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:19:03.297329 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 666) took 1703 ms. Trace:
I20260709 13:19:03.298166 14296 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:03.259884 17789 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.287317 14376 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:03.258607 17924 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:03.119094 14126 rpcz_store.cc:269] 0709 13:18:45.326854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.327692 (+   838us) service_pool.cc:224] Handling call
0709 13:19:03.118535 (+17790843us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:00.898139 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:01.282386 (+384247us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:01.310372 (+ 27986us) write_op.cc:435] Acquired schema lock
0709 13:19:01.324248 (+ 13876us) tablet.cc:662] Decoding operations
0709 13:19:01.609548 (+285300us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:01.651636 (+ 42088us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:01.657991 (+  6355us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:19:01.949948 (+291957us) tablet.cc:701] Row locks acquired
0709 13:19:01.954397 (+  4449us) write_op.cc:260] PREPARE: finished
0709 13:19:01.954595 (+   198us) write_op.cc:270] Start()
0709 13:19:01.954777 (+   182us) write_op.cc:276] Timestamp: P: 1783603141954524 usec, L: 0
0709 13:19:01.954799 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:01.955545 (+   746us) log.cc:844] Serialized 5589 byte log entry
0709 13:19:02.366172 (+410627us) op_driver.cc:464] REPLICATION: finished
0709 13:19:02.402137 (+ 35965us) write_op.cc:301] APPLY: starting
0709 13:19:02.402256 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:02.402606 (+   350us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:02.402783 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:02.404945 (+  2162us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:02.405397 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:19:02.405448 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:02.405987 (+   539us) log.cc:844] Serialized 101 byte log entry
0709 13:19:02.406222 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:02.406394 (+   172us) write_op.cc:454] Released schema lock
0709 13:19:02.406452 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:02.406859 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:02.406876 (+    17us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3138506,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":35179,"apply.run_cpu_time_us":4710,"apply.run_wall_time_us":4707,"num_ops":14,"prepare.queue_time_us":264134,"prepare.run_cpu_time_us":95616,"prepare.run_wall_time_us":1387899,"raft.queue_time_us":63995,"raft.run_cpu_time_us":11898,"raft.run_wall_time_us":22054,"replication_time_us":409042,"thread_start_us":507205,"threads_started":4,"wal-append.queue_time_us":323423}]]}
I20260709 13:19:03.306885 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:03.343947 14371 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:03.267765 17739 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.245803 17971 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:19:03.319029 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.308218 14302 rpcz_store.cc:276] 0709 13:19:01.090415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.091160 (+   745us) service_pool.cc:224] Handling call
0709 13:19:01.136624 (+ 45464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.136893 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:01.148233 (+ 11340us) log.cc:844] Serialized 14 byte log entry
0709 13:19:02.956068 (+1807835us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b1800414fa0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:03.294415 (+338347us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.294465 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:03.294514 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.294580 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.294683 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19365,"prepare.queue_time_us":12403,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":47,"raft.queue_time_us":1906764,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"spinlock_wait_cycles":38482688,"thread_start_us":338068,"threads_started":1}
I20260709 13:19:03.287269 14373 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:03.319243 17895 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.283420 17936 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:03.294584 14267 connection.cc:256] RPC call timeout handler was delayed by -1.6311508920000506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 13:19:03.314118 17934 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:03.295385 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:03.336072 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.305110 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:03.306882 17958 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.296066 17910 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.309156 17996 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.313190 17982 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.333886 14295 rpcz_store.cc:276] 0709 13:19:01.594197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.594395 (+   198us) service_pool.cc:224] Handling call
0709 13:19:01.607516 (+ 13121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.607728 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:01.638089 (+ 30361us) log.cc:844] Serialized 14 byte log entry
0709 13:19:01.848155 (+210066us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800309f40. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a 00007f8ded096a2a
0709 13:19:03.285951 (+1437796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.286026 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:03.286094 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.297169 (+ 11075us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.297280 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1123413,"prepare.queue_time_us":30225,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1157525,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":53,"spinlock_wait_cycles":28903168,"thread_start_us":313992,"threads_started":2,"wal-append.queue_time_us":346579,"wal-append.run_cpu_time_us":3875,"wal-append.run_wall_time_us":1037790}
I20260709 13:19:03.279987 17938 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:19:03.308409 14894 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 8. Ops: []
I20260709 13:19:03.319067 17896 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:03.333308 14304 rpcz_store.cc:276] 0709 13:19:01.674860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.677994 (+  3134us) service_pool.cc:224] Handling call
0709 13:19:01.678355 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.678588 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:01.678880 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.296480 (+1617600us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.296532 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:03.296580 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.296643 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.296754 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1334503,"prepare.queue_time_us":490,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":1370124,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":57,"thread_start_us":282145,"threads_started":2,"wal-append.queue_time_us":39389,"wal-append.run_cpu_time_us":2941,"wal-append.run_wall_time_us":1258607}
I20260709 13:19:03.276464 17788 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:19:03.283200 17563 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:19:03.319960 17799 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:03.354282 14267 connection.cc:256] RPC call timeout handler was delayed by -1.4673508920000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
I20260709 13:19:03.287084 17920 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:03.430011 17920 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:03.430575 17920 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.363485 14222 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:03.369899 14298 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:03.292903 17790 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:19:03.385193 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.393471 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:03.372251 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 107129us
I20260709 13:19:03.395651 14296 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
W20260709 13:19:03.396456 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86612.9us
I20260709 13:19:03.396459 14895 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 5: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:03.333248 17961 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.320801 17962 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:19:03.409736 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.328152 17967 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:19:03.424870 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:03.425315 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.379427 18051 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:03.462570 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:03.464306 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:03.455821 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:03.379757 17919 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:19:03.344532 17983 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:19:03.431653 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.431303 17799 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.432087 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.476075 14304 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:03.371165 17936 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.439301 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.480844 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.392773 17694 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.450297 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.488325 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:03.491184 17918 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:03.407869 17982 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.497287 17789 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:03.451484 14297 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:03.498840 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.499971 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.500980 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.503854 14298 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:03.468457 17985 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.396552 17910 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.415040 18009 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:03.470454 14192 leader_election.cc:400] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9.
I20260709 13:19:03.354702 17924 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.481739 14304 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:03.410822 17896 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:03.486160 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:03.579262 14901 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:03.555505 17919 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:03.501524 14297 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
W20260709 13:19:03.505555 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.456403 17961 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.507910 17982 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.510574 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.510911 18058 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:03.511402 17918 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:03.511435 17939 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.512641 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:03.394703 17958 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.514125 17694 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.391881 17895 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.457439 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.487799 14123 catalog_manager.cc:5697] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 7 to 8, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 8 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:03.587460 18009 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:03.519606 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:03.521039 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 231950us
I20260709 13:19:03.408192 17996 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:03.523386 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.526638 17595 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:03.533860 14223 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:03.534513 17739 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.469867 17812 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:03.536041 18064 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:03.544010 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.652037 14302 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:03.515833 17936 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:03.551927 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 87517.1us
I20260709 13:19:03.485469 18055 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:03.665262 14371 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:03.556768 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:03.557042 14893 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:03.478382 18051 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.550742 14892 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:19:03.574210 18070 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.672518 18070 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.673646 17895 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.574420 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.675402 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.676445 17958 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:03.676875 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.657685 17812 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.433132 17952 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:03.678161 17952 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:03.657635 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08002656e0 after lost signal to thread 13125
W20260709 13:19:03.680270 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6fc0 after lost signal to thread 14161
W20260709 13:19:03.681509 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5520 after lost signal to thread 14253
I20260709 13:19:03.650254 18074 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:03.682211 17694 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:03.682924 18074 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:03.658983 18076 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:19:03.684923 18076 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.685734 18076 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:03.599141 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 144771us
I20260709 13:19:03.687002 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:03.687608 14374 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:03.541870 17947 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:19:03.604897 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.606385 14301 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:03.696316 18073 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:03.697057 18070 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.698733 17924 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.699909 14225 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:19:03.639503 17896 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.702600 17896 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.702948 17739 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.703758 17739 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:03.704859 18040 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.511s	user 0.001s	sys 0.003s
I20260709 13:19:03.701542 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:03.706554 17982 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:03.706908 14226 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:19:03.707805 17932 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.708300 17932 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.695770 18055 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:03.711505 18055 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.715095 17952 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:03.688776 17950 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.716904 17950 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.651296 18067 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:19:03.719105 18005 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:03.719848 17950 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.723295 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:03.694819 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.724388 17981 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:03.725075 14301 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:03.724968 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:03.726028 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.726387 17981 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:03.727025 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.727583 14301 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.728011 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:03.728924 14892 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:03.731684 17962 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:03.732283 17962 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:03.735119 17982 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:03.736183 17958 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:19:03.706918 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 211538us
I20260709 13:19:03.737303 17958 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:03.737686 17958 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:03.738574 17958 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.740236 17947 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:03.740679 17947 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:03.733424 17962 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.741533 17947 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.742899 17947 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.571059 18054 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.589641 17919 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.539898 17934 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.747025 17919 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.517719 14895 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:19:03.651708 18064 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:03.553658 17920 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.750854 14303 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:03.751047 17963 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:03.750782 18064 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.751477 17963 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:03.751869 17920 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:03.752147 18064 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:03.622265 14894 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:03.613308 17918 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:03.636438 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 123877us
I20260709 13:19:03.640702 14373 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:19:03.753935 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.753702 17918 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.754554 14304 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.755034 17918 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.644265 18075 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.757098 17962 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.664439 14372 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
W20260709 13:19:03.669958 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.758487 17720 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:03.758944 17720 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:03.759402 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:03.759677 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:03.665520 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:19:03.762538 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 97094.4us
I20260709 13:19:03.763298 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:03.677666 14298 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
W20260709 13:19:03.691586 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5e00 after lost signal to thread 14254
W20260709 13:19:03.765599 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5440 after lost signal to thread 14328
I20260709 13:19:03.618798 17939 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:03.754933 14193 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:03.686105 18076 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:03.782922 14193 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:03.615638 18058 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.783670 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:03.784372 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.766997 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:03.693943 14123 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 4 to 6, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 6 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.758507 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:03.770324 14922 debug-util.cc:398] Leaking SignalData structure 0x7b0800037540 after lost signal to thread 14402
I20260709 13:19:03.784343 14223 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:03.788184 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:03.788584 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:03.789495 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:03.786243 14922 debug-util.cc:398] Leaking SignalData structure 0x7b080034d340 after lost signal to thread 14403
I20260709 13:19:03.649428 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:03.772976 14377 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:03.772886 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:03.772341 14374 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:03.774971 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:03.798313 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:03.799324 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:03.800274 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:03.612463 14378 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:03.736241 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:03.781383 14304 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:03.794869 14302 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:03.775588 14226 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:19:03.800539 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08003f7620 after lost signal to thread 14925
W20260709 13:19:03.804575 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1d60 after lost signal to thread 14926
I20260709 13:19:03.806344 14304 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:19:03.806349 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:03.806936 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:03.773837 17897 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.001s
I20260709 13:19:03.821450 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:03.806954 14304 pending_rounds.cc:85] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 5
I20260709 13:19:03.822207 14304 pending_rounds.cc:107] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:19:03.822641 14304 raft_consensus.cc:2889] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:03.823679 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:03.807809 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:03.826957 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:03.822240 14303 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:19:03.828569 14295 raft_consensus.cc:2376] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10. Re-sending same reply.
I20260709 13:19:03.829252 14123 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 4 to 5, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 5 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:03.805819 17790 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:19:03.742921 17739 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:03.768807 17920 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:03.782334 17924 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:03.835104 14297 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:03.836521 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 189740us
I20260709 13:19:03.836423 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:03.787496 17982 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:03.788081 18005 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:03.874107 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 47244.5us
I20260709 13:19:03.868295 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:03.798605 18067 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:03.787318 17582 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:03.827483 18075 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:03.790041 17981 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:03.909382 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 352660us
W20260709 13:19:03.935292 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 98995.6us
I20260709 13:19:03.944183 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:03.862313 14123 catalog_manager.cc:5697] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 3 to 6, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 6 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.936242 18053 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:03.806160 17895 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.838972 17563 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.822631 18066 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:03.937562 14865 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:03.873395 17790 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.933974 18051 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:03.939517 17739 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:03.805619 17927 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:03.826538 17985 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:03.834939 18050 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:03.947579 14297 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:03.947211 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:03.835284 17723 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:03.936527 17694 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:03.807092 17950 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.073244 17723 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:04.073696 17950 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.073985 17723 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.074174 17950 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.958819 14295 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:03.854435 17897 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 13:19:03.759793 17720 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.933740 17978 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:03.936300 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68121.8us
W20260709 13:19:04.086462 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 126546us
I20260709 13:19:04.088456 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:03.838001 17920 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.839314 18073 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:03.875164 17924 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:03.955323 17982 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:03.986368 14123 catalog_manager.cc:5697] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:19:03.968016 18075 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:04.081652 17694 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:03.834098 17595 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.134s
W20260709 13:19:04.030586 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 83536.1us
I20260709 13:19:04.033135 18079 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:04.035859 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 669) took 2344 ms. Trace:
I20260709 13:19:04.040464 17985 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.048622 17910 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.050310 18058 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:03.994364 18051 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:03.988473 17932 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:03.989629 17739 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.044907 14301 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:03.834491 18065 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 13:19:03.956954 18054 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:03.752436 17963 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:03.995824 17927 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:04.078132 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 342003us
I20260709 13:19:04.182107 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:04.183158 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:04.183514 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:04.183871 14893 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:04.077514 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 269762us
I20260709 13:19:04.185191 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:03.834335 18009 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.084472 14295 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:04.089668 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:04.075680 18056 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.088s	user 0.005s	sys 0.000s
I20260709 13:19:04.091585 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:19:04.191648 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 100178us
I20260709 13:19:04.092865 17920 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:04.198720 17788 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:04.200881 17958 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:04.095518 18070 consensus_queue.cc:1175] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cebb34ac155340899a38c728707ddc0d" responder_term: 11 status { last_received { term: 9 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: [10.11-10.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:04.201887 17334 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:04.097945 17712 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:04.204349 17712 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:04.205286 17712 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:04.206612 17712 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:04.191030 17595 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:04.214182 17939 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:04.216636 14303 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:04.221038 17911 ts_tablet_manager.cc:1929] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:19:04.095170 17720 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.182376 18054 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.246975 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:04.248809 18054 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:04.113370 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.961388 18076 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:04.117442 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 180029us
I20260709 13:19:04.250835 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:04.118119 18005 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:04.001159 17895 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:19:04.047099 17961 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:04.254171 18005 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:04.254308 17298 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:04.254922 17298 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:04.255182 18005 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.255901 17961 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:04.135457 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:04.255761 17298 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.122848 17982 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.124529 17996 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:04.124150 18075 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:04.257987 17928 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:04.123309 14123 catalog_manager.cc:5697] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 6, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 6 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.138692 14300 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:04.125386 17694 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.261193 14123 catalog_manager.cc:5697] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 4, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 4 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.262784 14123 catalog_manager.cc:5697] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:19:04.126550 17936 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.130601 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:04.264515 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 134003us
I20260709 13:19:04.265153 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:04.266469 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:04.266366 14342 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:04.268030 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:04.121732 17799 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.615s	user 0.006s	sys 0.001s
I20260709 13:19:04.147742 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:04.178290 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.274813 14893 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:04.283385 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:04.131146 14299 rpcz_store.cc:276] 0709 13:19:01.691046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.691183 (+   137us) service_pool.cc:224] Handling call
0709 13:19:01.705151 (+ 13968us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:03.280990 (+1575839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.281025 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.317764 (+ 36739us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.783087 (+465323us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:03.783139 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.783214 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.035622 (+252408us) raft_consensus.cc:1685] finished
0709 13:19:04.035646 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.035794 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1318968,"raft.queue_time_us":1358170,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":648521,"threads_started":2,"wal-append.queue_time_us":684969}
I20260709 13:19:03.962404 17582 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.187677 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:04.191807 14301 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:04.094947 18077 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:04.132824 17910 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:04.314711 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 127127us
W20260709 13:19:04.197082 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.129647 17812 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:04.129973 17924 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.222199 17963 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:04.222932 18053 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:04.224594 17983 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:04.226861 17919 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.187994 17927 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.193502 17932 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.231280 18087 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:04.231616 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:04.232582 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 143019us
I20260709 13:19:04.233181 17939 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:04.151902 17891 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.129685 17767 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.001s
I20260709 13:19:04.318341 17962 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:19:04.132787 17985 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:04.149176 17739 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.243046 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:04.422581 14375 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.231323 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:04.144240 18079 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.259994 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:04.349413 17334 consensus_queue.cc:1059] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:19:04.269246 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:04.270376 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:04.100196 14304 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:04.428750 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2549) took 1028 ms. Trace:
I20260709 13:19:04.429221 14304 rpcz_store.cc:276] 0709 13:19:03.399957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.095813 (+695856us) service_pool.cc:224] Handling call
0709 13:19:04.096504 (+   691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.428445 (+331941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.428680 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.274472 14223 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:04.292068 18076 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.291702 17981 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:04.254340 17895 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:04.292963 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.276648 17996 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:04.294073 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:04.436581 14299 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:04.294221 17563 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:04.295096 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:04.438813 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 168535us
I20260709 13:19:04.439422 14300 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.276753 18068 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:04.295873 17961 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:04.307631 14226 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
W20260709 13:19:04.316138 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.420459 17767 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:04.319713 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:04.323514 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:04.324306 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:04.327400 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:04.459120 14375 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:04.459614 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:04.329541 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:04.461418 14897 raft_consensus.cc:2410] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:19:04.329931 14123 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 6 to 7, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 7 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.341015 14893 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:04.343086 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:04.302527 17952 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.465441 14123 catalog_manager.cc:5697] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:04.351527 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.354980 14900 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:19:04.315475 17911 log.cc:1199] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P bee4f7fc1b4740dc875537c79309664f: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/wals/0f6f055b9cea4c76a10e5e5ecf91ffc9
I20260709 13:19:04.314075 18070 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:04.332901 17788 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:04.333412 18073 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:04.302220 17799 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.387974 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:04.389724 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:04.497720 14895 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
W20260709 13:19:04.498126 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 108485us
I20260709 13:19:04.416769 17891 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.499534 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:04.133208 18051 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.444504 18087 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:04.418264 14296 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:04.381052 18054 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.377641 17932 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:04.434846 14304 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:04.520324 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2561) took 1029 ms. Trace:
I20260709 13:19:04.520784 14304 rpcz_store.cc:276] 0709 13:19:03.490792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.434133 (+943341us) service_pool.cc:224] Handling call
0709 13:19:04.434437 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.520048 (+ 85611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.520266 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:04.419253 18086 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:19:04.442075 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:04.318670 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:04.522792 14228 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.423461 17939 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:04.380944 17950 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:04.494903 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:04.435742 17895 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:04.435961 17996 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:04.505868 17812 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.506131 14123 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:04.381335 17983 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:04.511103 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:04.539994 14376 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:04.491264 17985 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:19:04.540866 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:04.494482 17952 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:04.510162 18051 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:04.577898 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 80084us
I20260709 13:19:04.578624 14222 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:04.579582 17996 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.582623 17911 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54352 (request call id 79) took 4962 ms. Trace:
I20260709 13:19:04.576818 14369 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:04.584070 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:04.540428 14375 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:04.512324 18055 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:04.468286 17723 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:04.588378 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 77332.6us
I20260709 13:19:04.513171 17788 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:04.570960 18100 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:19:04.591576 14123 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 3, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 3 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:04.644299 14123 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.534317 17932 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.520058 17910 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:04.490782 17967 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:19:04.521509 17896 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:04.436146 18079 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:04.655385 18107 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:04.596520 14302 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:19:04.596971 18074 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:04.596885 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 102074us
I20260709 13:19:04.763736 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:04.764344 14224 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:04.765759 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:04.509958 18073 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.569653 18070 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:04.505074 14300 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:04.509255 17920 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.575673 17936 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:04.579586 17812 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:04.588912 17959 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:04.591569 17601 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:04.770960 17712 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.002s
I20260709 13:19:04.633767 14228 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:04.534742 18054 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:04.650764 17799 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:04.671372 17952 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:04.674122 17595 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:04.674307 18104 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 13:19:04.675508 18106 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:04.677351 17723 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:04.679181 18087 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:04.681113 17950 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:04.644049 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:04.630012 18009 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.824023 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 180086us
I20260709 13:19:04.693441 17788 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:04.712466 17939 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.713672 17582 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:04.848685 18073 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:04.835801 17601 raft_consensus.cc:2764] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:04.851413 17799 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.852008 17799 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.858388 17799 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:04.859480 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.860661 18101 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
W20260709 13:19:04.861445 14296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 688) took 1416 ms (client timeout 1543 ms). Trace:
I20260709 13:19:04.862082 17918 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.862534 14369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2021) took 1585 ms (client timeout 2094 ms). Trace:
I20260709 13:19:04.862622 17918 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:04.862948 14369 rpcz_store.cc:269] 0709 13:19:03.276684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.278907 (+  2223us) service_pool.cc:224] Handling call
0709 13:19:04.862349 (+1583442us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54000613d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:04.862479 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2900768640}
I20260709 13:19:04.857445 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:04.864892 17959 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:04.865429 17959 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:04.714286 17891 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:04.645514 17911 rpcz_store.cc:276] 0709 13:18:59.652578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.676145 (+ 23567us) service_pool.cc:224] Handling call
0709 13:19:00.292040 (+615895us) ts_tablet_manager.cc:1151] Deleting tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9
0709 13:19:00.371385 (+ 79345us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:19:04.104572 (+3733187us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:04.220900 (+116328us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:04.582512 (+361612us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2511910,"tablet-delete.queue_time_us":460397,"thread_start_us":316625,"threads_started":1}
I20260709 13:19:04.728404 17896 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.704813 17895 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:04.738468 18005 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.739559 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.741978 18109 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:19:04.730011 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:04.751200 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:04.594430 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 93339.1us
I20260709 13:19:04.731667 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:04.735535 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:04.508210 18064 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:19:04.765245 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:04.771621 18076 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:19:04.675529 17919 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:04.759774 18105 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 13:19:04.725661 17996 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.865955 18070 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.958391 14112 catalog_manager.cc:5028] TS bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): tablet 0f6f055b9cea4c76a10e5e5ecf91ffc9 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:19:04.705145 18055 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:04.959955 18055 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.774220 17967 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:19:04.729842 17739 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:04.783942 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:04.965358 14370 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:04.759239 18103 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:19:04.787724 17983 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:04.790241 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 470563us
I20260709 13:19:04.792063 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:04.771730 18067 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:04.996949 18067 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.997547 17739 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:04.999413 18067 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:04.797005 14298 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:04.772167 17961 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:05.001134 17961 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.003548 17961 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:04.800295 14221 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:04.799999 14295 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:19:05.005191 14295 pending_rounds.cc:85] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 3
I20260709 13:19:05.004961 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:05.005503 14295 pending_rounds.cc:107] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:05.005867 14295 raft_consensus.cc:2889] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:04.733475 17927 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.006997 14897 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:04.776876 18074 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:04.795482 18077 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.010108 18077 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.010437 18074 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.011260 14377 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:04.795913 18096 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
I20260709 13:19:04.748893 17910 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.788419 17812 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.820279 14224 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:04.835901 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:05.018803 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 183022us
I20260709 13:19:04.871611 18009 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.775233 17932 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.844494 18054 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:04.845233 18084 raft_consensus.cc:3055] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:05.027228 18084 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:05.027192 18051 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.028451 14297 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:05.028254 18084 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.030049 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 898) took 1265 ms. Trace:
I20260709 13:19:05.030885 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2556) took 1541 ms. Trace:
I20260709 13:19:05.031267 14295 rpcz_store.cc:276] 0709 13:19:03.489475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.432220 (+942745us) service_pool.cc:224] Handling call
0709 13:19:04.432522 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.006338 (+573816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.030675 (+ 24337us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54003d95d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:05.030827 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":844133120}
I20260709 13:19:05.031711 17910 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:05.032460 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.033098 14295 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:04.865540 14896 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:04.861928 14296 rpcz_store.cc:269] 0709 13:19:03.444950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.457104 (+ 12154us) service_pool.cc:224] Handling call
0709 13:19:04.861217 (+1404113us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54003ee4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:04.861359 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833459072}
I20260709 13:19:04.928821 18079 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:04.929442 17601 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:04.866792 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:04.942497 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.942497 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 473446us
W20260709 13:19:04.945917 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.948622 14304 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:04.945274 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.078467 14223 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
W20260709 13:19:04.949213 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 213771us
I20260709 13:19:04.576359 17971 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.851415 17920 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:04.969029 14299 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:04.952600 17950 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:04.950054 18005 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:04.930667 17896 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.009369 17927 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:05.013931 14300 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.019515 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:04.838107 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2543) took 1496 ms. Trace:
I20260709 13:19:05.146862 14302 rpcz_store.cc:276] 0709 13:19:03.342005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.939299 (+597294us) service_pool.cc:224] Handling call
0709 13:19:03.968499 (+ 29200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.758777 (+790278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.837652 (+ 78875us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b5400333954. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:04.838012 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443731200}
I20260709 13:19:04.976567 17918 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:05.021623 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.022524 17919 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:05.022221 17938 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:05.148627 17920 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:05.148912 17938 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:05.149646 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 130204us
I20260709 13:19:05.150538 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:05.151178 17938 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:05.151700 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:05.026595 17932 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:05.152741 17582 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:05.035097 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:05.053045 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.153440 17582 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:05.052913 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.050493 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2513) took 1639 ms. Trace:
I20260709 13:19:05.051788 14221 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:05.154376 14297 rpcz_store.cc:276] 0709 13:19:03.410651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.117489 (+706838us) service_pool.cc:224] Handling call
0709 13:19:04.117861 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.028872 (+911011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.050240 (+ 21368us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54000db6d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:05.050428 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093738240}
I20260709 13:19:05.054215 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.050187 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.155587 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.155884 14295 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:05.057971 14377 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:05.154595 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:05.148643 17919 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.157074 17919 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.157434 17920 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:05.157979 17920 raft_consensus.cc:697] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:05.158809 17920 consensus_queue.cc:237] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.064558 14229 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:05.065567 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2550) took 1665 ms. Trace:
I20260709 13:19:05.162949 17996 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:05.065905 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.030465 14225 rpcz_store.cc:276] 0709 13:19:03.764434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.764622 (+   188us) service_pool.cc:224] Handling call
0709 13:19:03.769135 (+  4513us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:03.955519 (+186384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.955587 (+    68us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:03.996262 (+ 40675us) log.cc:844] Serialized 52 byte log entry
0709 13:19:04.305486 (+309224us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:04.858260 (+552774us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18004448e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf
0709 13:19:04.858406 (+   146us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.864652 (+  6246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.864725 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.029707 (+164982us) raft_consensus.cc:1685] finished
0709 13:19:05.029843 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.029988 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64397,"prepare.queue_time_us":113241,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":74736,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":67650,"spinlock_wait_cycles":25687936,"thread_start_us":432952,"threads_started":3,"wal-append.queue_time_us":289288}
I20260709 13:19:05.163393 17723 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:19:05.021112 17924 consensus_meta.cc:287] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.003s
I20260709 13:19:05.164784 17723 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:05.165200 17723 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:05.163196 14298 rpcz_store.cc:276] 0709 13:19:03.400274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.784119 (+383845us) service_pool.cc:224] Handling call
0709 13:19:05.065290 (+1281171us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001f7f54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:05.065479 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326605696}
I20260709 13:19:05.084815 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.166055 17723 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.085835 14899 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:05.087752 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.049275 17789 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.168059 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:05.168897 17712 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:05.168532 17789 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.174443 17739 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:05.175776 17739 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:05.176164 17739 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:05.171921 17789 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:05.177037 18128 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:19:05.178403 17891 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:05.178229 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 143205us
I20260709 13:19:05.178906 17891 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:05.179368 17891 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:05.182920 18124 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.175s	user 0.002s	sys 0.000s
I20260709 13:19:05.182715 17919 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.184247 14301 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:05.109284 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:05.188884 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:05.093946 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:05.145696 14227 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: [7.6-8.7]
I20260709 13:19:05.156211 14297 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:05.164492 17924 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.167040 17723 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.083393 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:05.143280 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 48199.2us
W20260709 13:19:05.191406 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 97598.5us
I20260709 13:19:05.101693 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:05.200425 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:05.197376 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.197831 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:05.202044 14896 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:05.097872 14370 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:05.203588 14371 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:19:05.207005 14371 pending_rounds.cc:85] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 6
I20260709 13:19:05.207325 14371 pending_rounds.cc:107] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:05.207582 14371 raft_consensus.cc:2889] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:05.215044 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:05.215966 14227 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:05.114840 17601 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.266881 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:05.267134 18009 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:05.268108 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:05.269120 17601 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:05.270078 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.270643 14897 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:19:05.089829 17950 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.272039 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:05.273262 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 163734us
I20260709 13:19:05.274870 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:05.275818 14892 raft_consensus.cc:2368] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10.
I20260709 13:19:05.271136 14897 pending_rounds.cc:85] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 8
I20260709 13:19:05.278357 14897 pending_rounds.cc:107] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:19:05.278887 14897 raft_consensus.cc:2889] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:05.280263 14370 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:05.278298 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 81202.4us
I20260709 13:19:05.269199 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:05.283314 14374 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:05.270732 14299 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:19:05.091117 18079 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:05.294492 14898 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:05.294504 14225 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:05.297094 14892 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:05.300498 14378 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:05.301935 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:05.302631 14225 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.178867 17896 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:05.114939 18054 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.197s
I20260709 13:19:05.236480 17789 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:05.202555 17985 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:05.327250 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.270797 18053 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.331494 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:05.333050 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.324198 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:05.205152 17712 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:05.338879 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.362995 14894 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:05.083334 17910 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.262s
I20260709 13:19:05.115787 17971 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:05.300658 18127 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:19:05.317184 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:05.351428 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:05.351495 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.370235 14229 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:05.289350 17950 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:05.364908 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.375662 14374 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:05.335495 17996 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.396617 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.335561 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:05.398065 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.392961 14227 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:05.399718 14226 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:19:05.393940 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 106994us
I20260709 13:19:05.398145 14370 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:05.303359 17695 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:19:05.409611 14300 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:05.321213 17938 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:19:05.406931 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.414188 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:05.407553 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 207460us
I20260709 13:19:05.407763 14369 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:05.290956 17812 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.410583 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:05.411960 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.405441 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.421535 14192 leader_election.cc:400] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10.
I20260709 13:19:05.430373 14192 leader_election.cc:403] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:05.418722 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:05.412755 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 167392us
I20260709 13:19:05.177042 17739 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.369035 17961 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.414906 14228 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
W20260709 13:19:05.417311 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 393865us
I20260709 13:19:05.443506 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:05.444033 14270 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:05.303968 18079 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.385500 17789 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:05.437032 14344 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:05.406577 18065 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:05.367558 17985 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.382302 17712 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.418027 18123 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:05.461961 18122 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
I20260709 13:19:05.456019 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:05.406823 18085 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.406618 17962 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:05.418767 17959 consensus_meta.cc:287] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.549s	user 0.002s	sys 0.007s
I20260709 13:19:05.435289 14221 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:05.377669 18053 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.465520 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.607679 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.511584 17927 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:05.466445 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:05.605887 17962 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.455106 17967 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.127s
I20260709 13:19:05.550307 17739 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:05.466600 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:05.457288 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 500527us
I20260709 13:19:05.413491 17896 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:05.469378 14223 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:05.467010 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:05.436474 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:05.505573 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.531360 18123 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:05.632920 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 188974us
I20260709 13:19:05.420899 18077 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:05.548038 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:05.637112 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:05.551846 14370 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:05.405606 17996 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.454317 18135 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.433193 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:05.652052 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 218927us
I20260709 13:19:05.653059 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:05.599315 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:05.516018 17601 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:05.462495 17961 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.671886 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.672577 14297 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:19:05.608362 14298 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:19:05.454571 18076 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 13:19:05.609830 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:05.455319 17720 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 13:19:05.466466 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.456498 18087 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.145s
I20260709 13:19:05.405051 18064 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:19:05.603065 18124 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:19:05.637463 14896 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:05.438084 17595 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10.
I20260709 13:19:05.580717 17788 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.641124 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:05.567034 17978 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.641386 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:05.654146 14900 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:05.654788 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:05.717650 14893 raft_consensus.cc:606] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:05.718176 14893 raft_consensus.cc:614] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:05.713210 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:05.636420 17962 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:05.671085 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.429009 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2564) took 1937 ms. Trace:
I20260709 13:19:05.677481 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.729717 14297 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:19:05.511386 18065 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.643009 18070 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:05.636799 18054 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.722396 14295 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:05.714319 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:05.707154 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 273561us
I20260709 13:19:05.671213 17601 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.606125 17959 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.682068 17939 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:05.599956 18085 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.661401 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:05.820815 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 159529us
I20260709 13:19:05.729316 14303 rpcz_store.cc:276] 0709 13:19:03.491612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.436798 (+945186us) service_pool.cc:224] Handling call
0709 13:19:04.437207 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.444375 (+  7168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.444408 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.456496 (+ 12088us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.835957 (+379461us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:05.019213 (+183256us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b18003c0160. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:19:05.182337 (+163124us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:05.428058 (+245721us) log.cc:844] Serialized 14 byte log entry
0709 13:19:05.428555 (+   497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.428664 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.428725 (+    61us) raft_consensus.cc:1685] finished
0709 13:19:05.428741 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.428926 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9285,"prepare.queue_time_us":508556,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":13961,"raft.queue_time_us":11665,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":67214,"spinlock_wait_cycles":5960320,"thread_start_us":715922,"threads_started":2,"wal-append.queue_time_us":447683}
I20260709 13:19:05.823736 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:05.622273 17891 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:05.779606 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46263.2us
W20260709 13:19:05.686748 18136 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:19:05.676934 17927 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:05.690521 17896 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:05.799062 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:05.730276 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 293270us
I20260709 13:19:05.808959 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2573) took 1040 ms. Trace:
I20260709 13:19:05.852124 14295 rpcz_store.cc:276] 0709 13:19:04.769013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.712849 (+943836us) service_pool.cc:224] Handling call
0709 13:19:05.808888 (+ 96039us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.853452 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.691119 18077 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:05.656837 17932 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:05.818229 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 104015us
I20260709 13:19:05.797923 18070 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.810201 17601 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:05.836963 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 205516us
I20260709 13:19:05.819005 17720 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:05.895654 17720 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.896252 17720 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:05.827446 18118 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:19:05.862807 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 63864.8us
I20260709 13:19:05.723042 17788 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.860092 14376 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:05.778988 18076 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:19:05.901158 17788 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:05.887084 18070 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:05.688001 17789 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.907601 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2286) took 1585 ms. Trace:
I20260709 13:19:05.907894 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:05.908483 14300 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:05.679208 18135 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.906695 17812 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:05.857143 18121 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:05.913372 14378 rpcz_store.cc:276] 0709 13:19:04.322464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.324632 (+  2168us) service_pool.cc:224] Handling call
0709 13:19:04.325027 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.301143 (+976116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.907363 (+606220us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54001b9ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:05.907543 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242734848}
I20260709 13:19:05.921129 18079 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:05.925751 14225 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.007s
I20260709 13:19:05.856011 18055 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:05.814702 18054 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:05.913154 17896 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.928335 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:05.959408 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.960662 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:05.962075 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:05.963892 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.965692 14223 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:19:05.929867 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 971) took 1073 ms. Trace:
I20260709 13:19:05.966795 14899 rpcz_store.cc:276] 0709 13:19:04.856638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.866433 (+  9795us) service_pool.cc:224] Handling call
0709 13:19:05.929674 (+1063241us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b540066ce54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:05.929811 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35044224}
I20260709 13:19:05.923367 18132 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:05.926522 17971 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:05.930166 14897 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:05.856921 18077 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:05.730515 17978 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:05.918447 18146 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.926251 14225 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:05.956517 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:05.906950 18144 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:05.791229 18123 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:05.929683 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 73229.3us
I20260709 13:19:05.970731 14227 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:05.981180 14298 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:06.004935 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.005177 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:06.010743 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:05.968843 17938 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.914636 18074 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:19:05.889508 17932 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:06.014078 14375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.000s	sys 0.016s
I20260709 13:19:05.979043 18132 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.941617 17959 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:05.985071 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:06.022571 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 98410.3us
I20260709 13:19:05.967803 17812 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.956120 17788 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:05.926066 18147 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 13:19:05.985628 18130 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.438s	user 0.001s	sys 0.000s
I20260709 13:19:05.949874 18055 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:05.978286 18064 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.017462 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:06.019590 14375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.000s	sys 0.016s
I20260709 13:19:05.994555 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:05.983268 18154 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:06.023363 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:05.978286 17720 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:06.052045 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:06.036356 14301 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:06.041005 14892 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.006s	sys 0.000s
I20260709 13:19:06.043380 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:06.008129 18053 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:05.979010 17896 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.037147 14298 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:06.053293 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2566) took 1286 ms. Trace:
W20260709 13:19:06.018675 17962 consensus_queue.cc:1175] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "181bbac22422408c87cd13b7fe3008f9" responder_term: 9 status { last_received { term: 9 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 9 index: 10 } }
W20260709 13:19:06.053536 14892 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.006s	sys 0.000s
I20260709 13:19:06.027935 18132 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:06.041601 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.054970 14899 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:06.061067 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:06.032691 18123 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.054576 14301 rpcz_store.cc:276] 0709 13:19:04.766814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.015852 (+1249038us) service_pool.cc:224] Handling call
0709 13:19:06.036117 (+ 20265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.053037 (+ 16920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.053225 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:06.100334 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.012684 18146 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.018364 17601 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.036433 17812 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.025456 17938 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.015635 17927 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.182734 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:06.126507 14378 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:06.081694 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.211227 14373 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
W20260709 13:19:06.216638 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 199244us
I20260709 13:19:06.217753 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:06.178292 18151 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:19:06.136186 18166 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.223215 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:06.183161 18142 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:19:06.208300 14301 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.111044 18147 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.209592 18141 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.416s	user 0.002s	sys 0.000s
I20260709 13:19:06.237222 14295 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:06.078406 17959 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:06.253916 17959 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.254551 17959 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.254956 17896 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.255542 17896 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.256172 17896 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:06.256726 17896 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:06.052351 18064 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:06.219200 18085 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.036387 17788 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.171003 18009 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.052135 17939 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.168s
I20260709 13:19:06.053135 18077 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:06.146204 18055 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.124945 18065 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.076797 18053 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.178934 18155 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:19:06.257639 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 184188us
I20260709 13:19:06.138628 17891 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:06.054517 17996 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.240520 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:06.074625 18157 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:06.128652 18161 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.210817 18145 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:06.269917 17896 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:06.175381 18091 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:19:06.337905 17788 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.338115 18084 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.281179 14899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:06.339159 14899 raft_consensus.cc:606] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:06.339656 14899 raft_consensus.cc:614] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:06.285472 14223 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:06.299829 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:06.340790 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2409) took 1288 ms. Trace:
I20260709 13:19:06.341408 14222 rpcz_store.cc:276] 0709 13:19:05.051955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.054817 (+  2862us) service_pool.cc:224] Handling call
0709 13:19:05.055228 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.197935 (+142707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.197971 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.271721 (+ 73750us) log.cc:844] Serialized 26 byte log entry
0709 13:19:05.535603 (+263882us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:05.535657 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.535753 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.340567 (+804814us) raft_consensus.cc:1685] finished
0709 13:19:06.340591 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.340722 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85964,"raft.queue_time_us":102341,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":169432,"threads_started":1,"wal-append.queue_time_us":453250}
I20260709 13:19:06.345122 17938 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:06.346303 17812 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.248126 18166 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.347276 18064 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:06.348932 18166 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:06.264257 18147 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.351955 18147 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.352546 14220 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:06.353525 17720 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:06.354879 17720 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:06.355139 17601 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.355365 17720 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.282961 18009 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.074874 18154 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:06.358438 17723 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.131s	user 0.008s	sys 0.004s
I20260709 13:19:06.359300 14296 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:19:06.360395 18154 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:06.314965 17978 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:06.361024 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:06.316172 18156 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:06.362661 18156 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.366537 17723 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:06.367208 17723 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.367684 17723 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:06.371090 18146 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.371469 17961 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.372015 18146 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:06.372565 18146 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:06.299263 18053 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:06.375377 17895 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.376853 18053 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:06.378667 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2514) took 1307 ms. Trace:
I20260709 13:19:06.379107 14295 rpcz_store.cc:276] 0709 13:19:05.071582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.853100 (+781518us) service_pool.cc:224] Handling call
0709 13:19:06.378456 (+525356us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54001f8454. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:06.378607 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880312704}
I20260709 13:19:06.380213 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:06.270481 17983 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:06.385952 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.273767 18054 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:06.274652 18135 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:06.322433 14301 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:06.360838 18178 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.373631 18134 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.560s	user 0.000s	sys 0.001s
I20260709 13:19:06.335716 18165 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.336054 17950 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.932s	user 0.010s	sys 0.001s
W20260709 13:19:06.381912 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 141479us
I20260709 13:19:06.422045 14900 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:06.365619 18156 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.427281 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:06.360404 14892 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:06.428221 14374 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:06.340874 14227 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:06.315276 18077 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:06.386777 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44427.7us
I20260709 13:19:06.398195 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:06.399571 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:06.404088 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2574) took 1634 ms. Trace:
I20260709 13:19:06.431752 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:06.432365 14301 rpcz_store.cc:276] 0709 13:19:04.769319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.403098 (+1633779us) service_pool.cc:224] Handling call
0709 13:19:06.403495 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.403708 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.403742 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.403794 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:06.403838 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.403907 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.404025 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:06.330304 18176 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.330785 18131 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.988s	user 0.021s	sys 0.011s
I20260709 13:19:06.314147 18157 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:06.383040 14344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 1.864s (SENT) [suppressed 22 similar messages]
I20260709 13:19:06.423534 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.304745 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:06.430812 14374 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:19:06.399441 18053 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:06.434779 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.517524 14374 pending_rounds.cc:85] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 8
I20260709 13:19:06.434872 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.435019 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:06.436702 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:06.431859 14226 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:06.437582 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:06.436939 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 214844us
I20260709 13:19:06.437819 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.438525 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:06.415316 17932 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.412565 17983 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:06.488281 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:06.489079 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.489683 14894 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:19:06.497504 14377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 951) took 1746 ms (client timeout 2086 ms). Trace:
I20260709 13:19:06.497521 14341 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:06.433318 18173 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.486418 14225 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:06.383580 18146 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.427392 18070 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.517881 14374 pending_rounds.cc:107] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 9.9
W20260709 13:19:06.549156 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.517899 14370 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
W20260709 13:19:06.650398 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 152977us
I20260709 13:19:06.650703 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:06.650954 14378 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:19:06.427321 17950 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:06.731258 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 80682us
I20260709 13:19:06.651305 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:06.652871 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 216244us
I20260709 13:19:06.439653 17938 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:06.671417 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:06.632499 14865 leader_election.cc:336] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Timed out: RequestConsensusVote RPC to 127.12.208.130:44127 timed out after 1.543s (SENT)
I20260709 13:19:06.650079 14900 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
W20260709 13:19:06.649660 14377 rpcz_store.cc:269] 0709 13:19:04.750660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.750847 (+   187us) service_pool.cc:224] Handling call
0709 13:19:06.495391 (+1744544us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b5400171454. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:06.497402 (+  2011us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144557824}
I20260709 13:19:06.515926 14193 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:06.471037 18176 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.706578 18054 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:06.505121 18168 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.480963 18157 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.706947 18156 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:06.707916 18174 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:06.708592 18171 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:06.709398 17739 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.067s	user 0.011s	sys 0.000s
I20260709 13:19:06.711457 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:06.712172 18146 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.652012 18053 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:06.713706 14268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.008s	sys 0.017s
W20260709 13:19:06.715375 18132 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.000s
I20260709 13:19:06.518173 18163 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:06.480701 18123 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.237s
W20260709 13:19:06.519008 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.440202 18135 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:06.518426 17978 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:06.719158 14898 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
W20260709 13:19:06.541105 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.429677 18165 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.766402 17720 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.726487 14374 raft_consensus.cc:2889] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:06.415897 18178 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.723805 17961 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:06.740806 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 108363us
I20260709 13:19:06.741935 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.743650 14299 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:06.739442 14369 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
W20260709 13:19:06.722749 17601 consensus_queue.cc:1175] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" responder_term: 6 status { last_received { term: 6 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 6 index: 8 } }
I20260709 13:19:06.751322 18051 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.753085 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 938) took 1461 ms. Trace:
I20260709 13:19:06.755240 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2301) took 1477 ms. Trace:
I20260709 13:19:06.756381 18076 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:06.758898 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 243085us
I20260709 13:19:06.848031 14897 rpcz_store.cc:276] 0709 13:19:05.291401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.291598 (+   197us) service_pool.cc:224] Handling call
0709 13:19:05.929834 (+638236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.979237 (+ 49403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.752794 (+773557us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b540066ce50. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:06.753004 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367417600}
I20260709 13:19:06.898881 14193 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:06.730710 18170 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.758873 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 974) took 1671 ms. Trace:
I20260709 13:19:06.900288 14901 rpcz_store.cc:276] 0709 13:19:05.087181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.087353 (+   172us) service_pool.cc:224] Handling call
0709 13:19:05.136828 (+ 49475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.152678 (+ 15850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.152708 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:05.162244 (+  9536us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:05.162292 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.758552 (+1596260us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b54005f28d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:06.758616 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.758793 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35983232}
I20260709 13:19:06.767010 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:06.772629 17896 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:06.774144 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2578) took 1835 ms. Trace:
I20260709 13:19:06.904477 14304 rpcz_store.cc:276] 0709 13:19:04.938800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.764724 (+1825924us) service_pool.cc:224] Handling call
0709 13:19:06.773579 (+  8855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.773767 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.773808 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.773852 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:06.773886 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.773942 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.774071 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:06.726289 18173 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.776180 18009 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:06.732663 17910 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:19:06.805912 18053 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.776809 18070 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:06.777347 18183 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.738943 17938 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.783692 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:06.784763 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:06.833972 18123 consensus_queue.cc:1243] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:19:06.803912 14268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.009s	sys 0.018s
I20260709 13:19:06.843801 14377 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:19:06.940802 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:06.848276 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.848454 14376 rpcz_store.cc:276] 0709 13:19:05.277692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.322308 (+ 44616us) service_pool.cc:224] Handling call
0709 13:19:05.366988 (+ 44680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.899447 (+532459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.754912 (+855465us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54001b9754. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:06.755155 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125744512}
I20260709 13:19:06.747725 18169 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:19:06.782444 17932 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.778843 17971 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.952332 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.953303 14377 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:06.761765 18054 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.834651 18135 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.765403 18168 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.841807 17961 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.936196 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2579) took 1949 ms. Trace:
I20260709 13:19:06.838397 18179 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:06.746374 18091 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:06.938200 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 555156us
I20260709 13:19:06.960494 14304 rpcz_store.cc:276] 0709 13:19:04.987214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.928092 (+1940878us) service_pool.cc:224] Handling call
0709 13:19:06.935541 (+  7449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.935763 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.935796 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.935859 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:06.935900 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.935966 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.936120 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:06.938866 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:06.961848 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:06.962116 14341 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:06.962451 14901 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:06.844082 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.949272 14899 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:19:06.952212 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.964246 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.834462 17978 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.914716 18051 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:06.780817 18145 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.177s
I20260709 13:19:06.937208 18009 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:06.815596 18132 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.941532 17938 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:06.989428 14371 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:19:06.993305 17950 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:06.970794 17720 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:06.994199 17720 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.994544 17720 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:06.805150 17983 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:06.976060 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:06.999567 14376 raft_consensus.cc:2410] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:06.787087 18174 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.833900 18163 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.955344 17896 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:06.952340 17932 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.804570 18171 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.960247 18135 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.960210 17961 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:07.010459 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.971773 14377 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:19:06.972680 18076 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.958812 18123 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.993369 18176 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.005239 14893 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:06.927834 18170 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:06.948902 18183 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.010079 14371 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:06.963670 17971 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.016315 18067 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:07.024406 18162 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.692s	user 0.012s	sys 0.020s
I20260709 13:19:07.014308 18076 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:07.038801 17739 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:07.042917 17959 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.043618 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.067655 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.068296 14221 raft_consensus.cc:2410] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:07.011723 14377 pending_rounds.cc:85] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 10
I20260709 13:19:07.004143 14342 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:06.980597 18051 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:07.008658 18153 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.504s	user 0.001s	sys 0.001s
I20260709 13:19:07.049161 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:07.045414 17985 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.051069 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.071038 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:07.071578 14227 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:07.071683 14229 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.071759 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:07.072654 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.005779 17932 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.051357 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.013867 18123 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:07.055145 14901 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:07.092525 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:07.093988 18165 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:06.986424 18009 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.006326 17896 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:06.979194 18179 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.068758 14377 pending_rounds.cc:107] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 10.11
W20260709 13:19:07.069344 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 65279.5us
I20260709 13:19:07.099628 14377 raft_consensus.cc:2889] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:07.100162 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.100129 14342 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:19:07.069996 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 328374us
I20260709 13:19:07.074337 14374 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:07.101078 14228 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:19:07.076418 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.102102 14227 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 7: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:07.087369 14229 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:07.052312 18067 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:07.064898 18076 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.104285 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:07.064841 17739 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:07.115175 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:07.102384 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:07.102626 14864 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:07.097623 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 198830us
I20260709 13:19:07.051827 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.109742 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 1976) took 1116 ms. Trace:
I20260709 13:19:07.122206 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.111637 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2295) took 2011 ms. Trace:
I20260709 13:19:07.112534 17971 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.096076 18123 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:07.113204 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.119776 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.127771 14227 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:19:07.124553 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:07.088390 17918 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:07.126839 14222 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:07.113874 18183 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:07.130628 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:07.076458 18147 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:07.123323 14375 rpcz_store.cc:276] 0709 13:19:05.100388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.100769 (+   381us) service_pool.cc:224] Handling call
0709 13:19:05.184361 (+ 83592us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:05.184782 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.184810 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:05.185391 (+   581us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.047296 (+861905us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:06.047351 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.047447 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.023740 (+976293us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:07.111297 (+ 87557us) raft_consensus.cc:1685] finished
0709 13:19:07.111319 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.111575 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1428,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":77969,"spinlock_wait_cycles":118107392,"thread_start_us":861492,"threads_started":1,"wal-append.queue_time_us":1112221}
I20260709 13:19:07.135087 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:07.139158 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:07.119585 14223 rpcz_store.cc:276] 0709 13:19:05.993863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.994231 (+   368us) service_pool.cc:224] Handling call
0709 13:19:07.109544 (+1115313us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b540011fdd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:07.109648 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546058496}
I20260709 13:19:07.180060 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:07.181854 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:07.185868 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55359.1us
I20260709 13:19:07.105909 18175 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.187757 14370 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:07.188233 14370 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:07.113837 18067 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.194164 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.140782 17918 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.141067 17582 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.194456 14370 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.183651 17910 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.133594 17996 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:07.132947 18165 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:07.186898 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:07.236887 14370 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.134135 17985 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:07.132778 18190 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:07.142930 17891 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:07.192781 18176 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:07.134315 17563 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
W20260709 13:19:07.236069 18129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.003s	sys 0.015s
I20260709 13:19:07.235870 17918 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:07.290275 14220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2411) took 2237 ms (client timeout 2188 ms). Trace:
W20260709 13:19:07.290848 14220 rpcz_store.cc:269] 0709 13:19:05.052456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.052586 (+   130us) service_pool.cc:224] Handling call
0709 13:19:07.290037 (+2237451us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002a17d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:07.290185 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2755470592}
I20260709 13:19:07.187928 17952 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:19:07.236274 18173 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.241773 18067 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:07.250118 17927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.012s	sys 0.014s
I20260709 13:19:07.299407 14220 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:07.275333 17985 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:07.287379 18129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.005s	sys 0.020s
I20260709 13:19:07.275061 18164 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.282167 18176 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.301347 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:07.255067 18194 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:07.278789 18191 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.279847 18055 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:07.214895 18175 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.303332 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.330178 14227 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:07.304869 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.308597 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:07.309597 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:07.324765 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.289145 17937 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:07.290486 17996 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:07.291966 18190 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:07.283613 18178 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.354867 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:07.355710 14901 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.320066 18176 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.361155 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:07.327435 18132 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:07.303259 17927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.012s	sys 0.015s
W20260709 13:19:07.256711 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 69925.5us
I20260709 13:19:07.297885 18168 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:19:07.311379 14116 maintenance_manager.cc:419] P 2510e400b67647c7923cee16a251d2de: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033390
I20260709 13:19:07.355122 18163 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:07.346405 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 211425us
I20260709 13:19:07.312755 17985 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.286322 17891 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.245283 17739 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.335407 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.398200 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.323832 18193 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:07.330513 18087 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.336310 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:07.371443 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.329741 18165 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:07.339792 17937 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.377383 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:07.330556 17959 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:19:07.300700 18054 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.355378 18180 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:07.361260 17952 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.329741 18164 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.394824 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:07.395525 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.396298 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.330786 18055 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.396951 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:07.400470 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.420051 14228 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
W20260709 13:19:07.403002 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 90459.6us
I20260709 13:19:07.404484 14371 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:19:07.420063 14229 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:19:07.424928 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.387281 18174 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.330423 18194 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.342506 18191 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.391522 18170 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.393128 18051 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:07.488682 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.414769 18163 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:07.427249 14375 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:07.493846 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.494844 14375 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:07.401130 18171 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.428947 14222 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:19:07.431972 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.413143 17937 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.433655 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.500284 14371 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:07.500662 18197 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:19:07.431896 17739 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:07.486063 18196 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:19:07.406598 17932 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.428769 18055 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.427930 18009 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:07.411291 18087 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.429147 17996 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.498234 18054 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.497910 18170 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.427735 17952 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.539634 14221 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:07.408346 18193 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.547283 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 913) took 1589 ms. Trace:
I20260709 13:19:07.550447 14224 rpcz_store.cc:276] 0709 13:19:05.958248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.963587 (+  5339us) service_pool.cc:224] Handling call
0709 13:19:06.001768 (+ 38181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.278290 (+276522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.278325 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.278368 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:06.278407 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.547035 (+1268628us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400135bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:07.547084 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.547211 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635386240}
I20260709 13:19:07.536041 18054 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:07.553913 18201 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:19:07.555402 18206 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:07.402684 14901 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:07.503048 17720 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.427891 18180 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:07.574448 14300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 700) took 2269 ms (client timeout 1543 ms). Trace:
W20260709 13:19:07.574909 14300 rpcz_store.cc:269] 0709 13:19:05.304606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.466278 (+161672us) service_pool.cc:224] Handling call
0709 13:19:07.574200 (+2107922us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54003ee4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:07.574343 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515763072}
I20260709 13:19:07.574841 18054 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.577564 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:07.522068 18073 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:07.426172 18190 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:07.579345 18077 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.141s	user 0.007s	sys 0.007s
I20260709 13:19:07.580073 18191 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:07.581360 17961 consensus_meta.cc:287] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.002s
W20260709 13:19:07.581650 18053 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.008s
I20260709 13:19:07.585234 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.587473 18123 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:07.595237 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.545944 18170 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:07.598978 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 90280.3us
I20260709 13:19:07.600382 14373 raft_consensus.cc:2410] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:19:07.583050 17920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.271s	user 0.009s	sys 0.021s
I20260709 13:19:07.601621 17961 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.605089 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.590121 18076 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.577574 18194 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.612185 14901 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:07.630520 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.629498 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:07.619858 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:07.626204 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:07.606069 18053 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.632246 14894 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:07.637374 18194 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.637549 18164 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.637920 18194 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.640105 18194 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.640213 18051 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.642817 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.636672 14370 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:19:07.643847 14226 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:07.549163 18165 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:07.620422 18161 consensus_meta.cc:287] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.290s	user 0.022s	sys 0.022s
W20260709 13:19:07.621091 17920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.309s	user 0.009s	sys 0.021s
I20260709 13:19:07.641768 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.645861 14377 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:07.665355 14376 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:07.666482 18161 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.666877 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.664233 18194 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:19:07.643865 14370 pending_rounds.cc:85] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 6
I20260709 13:19:07.668421 14370 pending_rounds.cc:107] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:19:07.669618 14370 raft_consensus.cc:2889] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:07.640805 18051 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.672518 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.678997 14377 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:07.621299 18174 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.681001 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.682003 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.682468 14377 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:07.671761 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:07.684921 14377 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:07.686064 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.686256 14377 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:07.686870 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.688243 14370 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:07.642614 17895 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.267s	user 0.012s	sys 0.007s
I20260709 13:19:07.632105 17891 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.643326 18199 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.622987 18207 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:19:07.691165 17723 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.323s	user 0.016s	sys 0.006s
I20260709 13:19:07.693396 17919 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.698261 17932 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:07.697772 17938 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.698s	user 0.006s	sys 0.001s
I20260709 13:19:07.700261 17712 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.701237 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2308) took 1204 ms. Trace:
I20260709 13:19:07.701526 17720 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.701732 18005 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.663650 18176 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.733318 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.734673 17961 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.706152 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:07.693434 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2044) took 1271 ms. Trace:
I20260709 13:19:07.736608 14373 rpcz_store.cc:276] 0709 13:19:06.422437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.423170 (+   733us) service_pool.cc:224] Handling call
0709 13:19:07.693200 (+1270030us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000618d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:07.693364 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2561174272}
I20260709 13:19:07.699358 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:07.708725 14371 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:07.687356 18174 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.707964 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:07.717060 14374 rpcz_store.cc:276] 0709 13:19:06.496488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.847993 (+351505us) service_pool.cc:224] Handling call
0709 13:19:07.701064 (+853071us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540039b7d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:07.701175 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304462208}
I20260709 13:19:07.718387 18087 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.722121 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:07.722647 18053 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.712415 18199 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.737702 14297 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:07.722707 18193 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:07.699524 18051 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.683115 18163 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:19:07.698621 17924 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.819388 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.827972 14377 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:07.738214 14897 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
W20260709 13:19:07.751492 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.828975 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.830902 14374 raft_consensus.cc:2393] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:07.707223 17789 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.837262 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:07.837962 14377 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.839203 14297 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:07.840550 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:07.848521 14297 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:07.841070 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:07.841236 17712 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.826396 17595 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:07.715862 18170 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.843379 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.843488 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:07.780042 18076 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.737167 17938 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.834180 18051 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.866812 18051 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.867626 18091 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:07.711524 18221 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:07.850752 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:07.868906 14114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8c137013238f4b1dbae260e32cb316dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9b2cf49ceed478480fb0f27ccf55d81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:07.790032 17952 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:07.741909 18123 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.852849 14371 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
I20260709 13:19:07.852931 14370 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:07.764871 18213 log.cc:927] Time spent T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:19:07.853003 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:07.903928 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:07.853713 17924 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:07.853904 17595 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.907043 17924 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:07.908087 17924 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.843494 17789 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.861016 18199 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.766119 18176 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:07.867806 18214 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:19:07.808739 17910 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.005s
I20260709 13:19:07.725273 18180 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.871348 14377 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:07.714943 17723 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:07.897465 14269 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items
I20260709 13:19:07.938064 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.898851 14297 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:07.900347 14901 raft_consensus.cc:2368] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9.
I20260709 13:19:07.908600 17595 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.853577 17712 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.868230 18091 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.943696 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2307) took 1447 ms. Trace:
W20260709 13:19:07.928103 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.916867 14370 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:07.902334 18170 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:07.918295 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:07.939471 14371 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:19:07.913342 17918 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.008s
W20260709 13:19:07.941001 14296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2567) took 3173 ms (client timeout 2054 ms). Trace:
I20260709 13:19:07.943434 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:07.944100 14376 rpcz_store.cc:276] 0709 13:19:06.496170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.003259 (+507089us) service_pool.cc:224] Handling call
0709 13:19:07.013658 (+ 10399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.666613 (+652955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.943491 (+276878us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54002ede54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:07.943648 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497953664}
I20260709 13:19:07.870309 18221 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:07.915144 18135 consensus_meta.cc:287] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.871s	user 0.011s	sys 0.002s
I20260709 13:19:07.916965 17920 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.916903 17910 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:07.952488 14296 rpcz_store.cc:269] 0709 13:19:04.767141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.083136 (+315995us) service_pool.cc:224] Handling call
0709 13:19:07.940740 (+2857604us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540020b054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:07.940902 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2685658368}
W20260709 13:19:07.966518 14298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2527) took 2559 ms (client timeout 3180 ms). Trace:
I20260709 13:19:07.967394 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:07.967957 14304 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:07.968262 14296 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:07.950744 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:07.962126 18135 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:07.963428 18146 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.147s	user 0.008s	sys 0.005s
W20260709 13:19:07.959695 17985 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.003s
I20260709 13:19:07.972960 18163 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:07.953653 18170 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.967198 14298 rpcz_store.cc:269] 0709 13:19:05.407451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.928088 (+520637us) service_pool.cc:224] Handling call
0709 13:19:07.966294 (+2038206us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54000dc5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:07.966444 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49281408}
I20260709 13:19:07.989388 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:07.991073 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:07.991602 14298 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.969480 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:07.994130 18163 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:07.996111 17723 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.974804 17985 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.996917 18163 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:07.999006 17985 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.999704 18170 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:08.000296 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.951257 18176 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:08.001982 18176 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:08.002370 18170 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:07.965965 17920 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.003166 18176 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:08.005278 17920 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:07.988806 17595 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.006304 17595 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:08.009053 17595 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:08.012450 14296 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:19:08.019114 17712 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.019761 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.027083 18135 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:08.035172 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:08.036338 14375 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:07.971447 18076 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:08.053432 18076 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:08.054883 18076 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:08.058893 18221 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:07.938616 14269 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45306 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2589)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2598)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2585)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40120 (request call id 16)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2520)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2523)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 698)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 702)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2593)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2594)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2535)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 711)
I20260709 13:19:08.063633 18179 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:08.065582 18123 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:08.066391 18123 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.077900 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:07.974174 17937 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.092036 14900 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:08.097007 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2570) took 3329 ms. Trace:
I20260709 13:19:08.097903 18175 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.097499 14295 rpcz_store.cc:276] 0709 13:19:04.768090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.381092 (+1613002us) service_pool.cc:224] Handling call
0709 13:19:06.381373 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.413316 (+ 31943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.413361 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.413434 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:06.413482 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.096729 (+1683247us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b540020ab54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:08.096791 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.096942 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72862592}
I20260709 13:19:08.099152 18051 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.099591 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.100363 17938 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:08.097750 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:08.101284 14894 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 7: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:08.102413 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.106539 14298 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:08.111536 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.112663 14298 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:08.114327 14342 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:08.126241 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.129257 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:08.130183 14375 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.060715 18221 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.134594 14298 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:08.135592 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.136631 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.136961 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:08.141402 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.144070 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:08.144910 14298 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.154264 14298 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:08.155494 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.156319 14298 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:08.157464 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.158850 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.159595 14298 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:08.160889 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:08.161594 14298 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.171092 14298 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:08.172451 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.173494 14298 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:08.174525 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.175556 14298 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:08.125975 17937 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:08.176539 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.139213 17971 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:08.177955 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.178237 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:08.178817 14298 raft_consensus.cc:2410] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:08.179595 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.180609 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.180805 17910 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:08.181190 14298 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:19:08.127972 18175 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:08.182026 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:08.182118 18175 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.182718 18175 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.182991 14298 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:08.184461 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.185554 14298 raft_consensus.cc:2410] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:08.186879 18123 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.187024 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.089820 17918 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.188076 14298 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:08.189617 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.191712 14342 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:08.193181 17910 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:08.194387 14298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:40120
I20260709 13:19:08.195137 14894 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:08.195276 14298 raft_consensus.cc:606] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:08.195945 14298 raft_consensus.cc:614] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:08.196184 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.199494 14298 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:08.200446 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2516) took 3128 ms. Trace:
W20260709 13:19:08.132634 18157 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.351s	user 0.014s	sys 0.000s
W20260709 13:19:08.134411 18055 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
I20260709 13:19:08.201344 14375 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:08.202482 14300 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:08.200964 14298 rpcz_store.cc:276] 0709 13:19:05.072236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.198901 (+3126665us) service_pool.cc:224] Handling call
0709 13:19:08.199261 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.200140 (+   879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.200381 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.196184 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:08.214151 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2518) took 3141 ms. Trace:
I20260709 13:19:08.206808 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:08.218542 14303 rpcz_store.cc:276] 0709 13:19:05.072825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.212954 (+3140129us) service_pool.cc:224] Handling call
0709 13:19:08.213413 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.213678 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.213717 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.213801 (+    84us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:08.213855 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.213934 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.214074 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.142257 17712 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.220258 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:08.220211 17712 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:08.221356 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.07744e+06us
I20260709 13:19:08.222426 14270 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:08.223047 17712 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.207144 14302 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:19:08.206823 14299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2519) took 3133 ms (client timeout 1871 ms). Trace:
W20260709 13:19:08.227453 14893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 994) took 1800 ms (client timeout 1568 ms). Trace:
W20260709 13:19:08.228281 14299 rpcz_store.cc:269] 0709 13:19:05.073098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.287947 (+214849us) service_pool.cc:224] Handling call
0709 13:19:08.206613 (+2918666us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400331654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:08.206744 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3175044864}
W20260709 13:19:08.228466 14893 rpcz_store.cc:269] 0709 13:19:06.426792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.426958 (+   166us) service_pool.cc:224] Handling call
0709 13:19:08.227231 (+1800273us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b5400602054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:08.227382 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1326288256}
I20260709 13:19:08.225517 14270 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:08.201931 18123 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.231249 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:08.231494 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.202059 17918 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:08.233755 14375 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:08.233124 14270 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:08.227085 18087 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:08.227825 18051 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:08.228068 17595 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:08.213008 18157 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:08.243734 14270 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:08.234724 17712 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:08.215340 18055 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.247781 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:08.249629 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 262848us
I20260709 13:19:08.227403 18091 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.227985 18199 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:19:08.261592 14373 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:08.243577 18087 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.239813 17582 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:08.243381 17595 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.294239 14295 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:08.237393 18123 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.248428 17712 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.248621 18169 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:08.259135 17985 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.288925 18087 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.275251 18051 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:08.296676 17936 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:08.297456 17595 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:08.308038 17967 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:19:08.333947 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.302747 17582 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:08.302798 17712 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:08.338725 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 91090us
I20260709 13:19:08.348914 14270 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:08.352116 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 154776us
W20260709 13:19:08.353336 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.335918 18184 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.989s	user 0.006s	sys 0.005s
I20260709 13:19:08.355741 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:08.356364 14375 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.364558 14375 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:08.342731 17723 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:08.313500 17985 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:08.370301 18226 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:19:08.372169 17978 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:08.374481 18123 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.374038 17582 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.328095 18051 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.392553 18183 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:08.392787 18051 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.393136 18183 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:08.394155 17932 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:08.394527 18157 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:08.394740 17932 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:08.394184 18183 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:08.398718 17985 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.401809 18091 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:08.403663 18175 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.405146 18055 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.406754 18175 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.409072 18087 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.410339 18183 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.415634 18174 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:08.416078 18225 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.441s	user 0.006s	sys 0.003s
W20260709 13:19:08.492436 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.508464 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2520) took 3434 ms. Trace:
I20260709 13:19:08.509721 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:08.511708 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 211451us
I20260709 13:19:08.515003 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.515547 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.516564 14374 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:08.516808 14377 raft_consensus.cc:2376] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9. Re-sending same reply.
I20260709 13:19:08.518623 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.520722 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.525229 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:08.526714 14371 raft_consensus.cc:2368] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11.
I20260709 13:19:08.526953 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:08.527932 14297 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.528219 14894 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:08.531327 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 982) took 2094 ms. Trace:
I20260709 13:19:08.531831 14867 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:08.531808 14896 rpcz_store.cc:276] 0709 13:19:06.436548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.436696 (+   148us) service_pool.cc:224] Handling call
0709 13:19:06.488552 (+ 51856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.488968 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:06.488998 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.489481 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.965855 (+1476374us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b180032c620. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:19:08.287594 (+321739us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:08.287644 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.287767 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.530619 (+242852us) raft_consensus.cc:1685] finished
0709 13:19:08.530657 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.531085 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":141070,"spinlock_wait_cycles":25057664,"thread_start_us":321539,"threads_started":1,"wal-append.queue_time_us":1876844}
I20260709 13:19:08.509229 14298 rpcz_store.cc:276] 0709 13:19:05.073381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.214800 (+3141419us) service_pool.cc:224] Handling call
0709 13:19:08.215169 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.215598 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:08.215628 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.216137 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.507554 (+291417us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:08.507699 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.507919 (+   220us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.508000 (+    81us) raft_consensus.cc:1685] finished
0709 13:19:08.508026 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.508224 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1228,"raft.queue_time_us":2258,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"thread_start_us":290739,"threads_started":1,"wal-append.queue_time_us":185539}
I20260709 13:19:08.536213 14298 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:08.398857 17936 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:08.541007 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.537286 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 932) took 1494 ms. Trace:
I20260709 13:19:08.536965 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2522) took 3448 ms. Trace:
I20260709 13:19:08.551502 14298 rpcz_store.cc:276] 0709 13:19:05.088593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.535177 (+3446584us) service_pool.cc:224] Handling call
0709 13:19:08.535797 (+   620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.536688 (+   891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.536872 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.550946 14226 rpcz_store.cc:276] 0709 13:19:07.042508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.052155 (+  9647us) service_pool.cc:224] Handling call
0709 13:19:07.052517 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.644262 (+591745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.505938 (+861676us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54002bded4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:08.506577 (+   639us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359404288}
I20260709 13:19:08.554901 18005 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:08.555667 18005 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.556193 18005 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:08.560279 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.562230 18145 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:08.539289 17789 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:08.567400 17789 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:08.566712 18145 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.565127 18174 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:08.569955 17932 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.570334 18174 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.540578 17978 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:08.571465 18145 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.572247 17978 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.574148 17936 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.575716 18210 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:08.576596 18210 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.576922 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.577886 14374 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
W20260709 13:19:08.564872 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 215967us
I20260709 13:19:08.579488 18210 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.545571 18087 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.582410 14224 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:08.582598 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2596) took 1006 ms. Trace:
I20260709 13:19:08.583058 14296 rpcz_store.cc:276] 0709 13:19:07.575983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.969160 (+393177us) service_pool.cc:224] Handling call
0709 13:19:08.582102 (+612942us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b540020b054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:08.582369 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38842752}
W20260709 13:19:08.583599 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.584721 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.587056 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2588) took 1039 ms. Trace:
I20260709 13:19:08.587538 14300 rpcz_store.cc:276] 0709 13:19:07.547271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.577307 (+ 30036us) service_pool.cc:224] Handling call
0709 13:19:08.586637 (+1009330us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54000fdcd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:08.586863 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434527104}
I20260709 13:19:08.587846 17595 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.588891 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.590987 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.591817 14374 raft_consensus.cc:2376] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11. Re-sending same reply.
I20260709 13:19:08.592705 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.594447 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.595477 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.596330 14222 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:08.598075 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.598814 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2304) took 2103 ms. Trace:
I20260709 13:19:08.600456 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.601372 14228 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:08.601563 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:08.602468 14897 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.606038 18166 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:08.607414 18166 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:08.607853 18166 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:08.600807 14222 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:08.611424 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:08.613159 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:08.613972 14222 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: [7.6-8.7]
W20260709 13:19:08.615666 14899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 993) took 2194 ms (client timeout 2418 ms). Trace:
W20260709 13:19:08.616354 14899 rpcz_store.cc:269] 0709 13:19:06.421361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.421586 (+   225us) service_pool.cc:224] Handling call
0709 13:19:08.615241 (+2193655us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54002495d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:08.615459 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684005248}
I20260709 13:19:08.615563 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.630939 14227 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.589628 14300 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:08.639770 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.599251 14372 rpcz_store.cc:276] 0709 13:19:06.495181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.994122 (+498941us) service_pool.cc:224] Handling call
0709 13:19:06.994414 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.012453 (+ 18039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.012482 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.012527 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:07.012564 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.598211 (+1585647us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b5400349ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:08.598309 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.598581 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40984832}
I20260709 13:19:08.638043 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.646365 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:08.647709 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.648231 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.648761 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:08.649215 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.653054 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:08.654186 14373 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:08.654094 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.655185 14374 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:08.655405 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:08.656221 14378 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.657169 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.657852 14223 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.657935 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.659040 14225 raft_consensus.cc:2368] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11.
I20260709 13:19:08.659997 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.662051 18221 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:08.662771 18221 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.662869 17937 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:08.665148 18221 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.665742 18091 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.665995 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.666453 18091 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.666962 14369 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:19:08.669194 14897 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:08.642372 14224 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
I20260709 13:19:08.684316 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.685292 14303 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
W20260709 13:19:08.685333 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 74314.6us
I20260709 13:19:08.685722 18091 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:08.686491 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.687222 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:08.696874 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.697217 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.699348 14300 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:08.689868 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.697691 14296 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:08.702248 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.702968 14296 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:08.704319 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.706854 17978 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:08.713172 17595 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.707479 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:08.714445 14300 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.609301 18166 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.698364 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:08.565097 18157 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.136s
I20260709 13:19:08.718775 18166 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.719144 18157 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:08.719652 18157 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:08.720754 18157 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:08.721629 14222 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.694236 17918 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:08.722309 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.723102 14224 raft_consensus.cc:2376] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11. Re-sending same reply.
I20260709 13:19:08.723603 18157 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.724783 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 948) took 1088 ms. Trace:
I20260709 13:19:08.725167 14901 rpcz_store.cc:276] 0709 13:19:07.636211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.668996 (+ 32785us) service_pool.cc:224] Handling call
0709 13:19:08.724414 (+1055418us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540079a254. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:08.724618 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494874496}
W20260709 13:19:08.714473 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 70836us
I20260709 13:19:08.728210 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:08.728379 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:08.730175 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:08.643930 18087 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:19:08.731045 14897 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.733371 18084 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:08.733834 18084 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:08.735026 18084 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:08.735948 14303 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:08.736557 18084 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.736755 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2525) took 3610 ms. Trace:
I20260709 13:19:08.737375 17896 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.737319 14303 rpcz_store.cc:276] 0709 13:19:05.126523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.734620 (+3608097us) service_pool.cc:224] Handling call
0709 13:19:08.735100 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.736482 (+  1382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.736666 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.732767 18087 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:08.738761 18087 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:08.739010 14303 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:08.739974 18087 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.741094 18145 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.741712 18145 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.744143 18055 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.744822 18055 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:08.747223 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.730108 14342 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:08.749161 18079 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:08.749575 18079 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.747269 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2580) took 3739 ms. Trace:
I20260709 13:19:08.750502 14302 rpcz_store.cc:276] 0709 13:19:05.008067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.929289 (+1921222us) service_pool.cc:224] Handling call
0709 13:19:08.206761 (+1277472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.226246 (+ 19485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.746862 (+520616us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400331650. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:08.747075 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2879269248}
W20260709 13:19:08.754868 14865 connection.cc:256] RPC call timeout handler was delayed by -1.1832733749999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
I20260709 13:19:08.757819 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.758628 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:08.759328 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.760289 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.749938 18079 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:08.763298 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.764737 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.747246 18055 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.689240 17712 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.768965 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:08.769717 14369 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.773689 14225 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:08.774901 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.775521 14225 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:08.782200 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:08.783128 14901 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:08.749888 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:08.760330 14226 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 7: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:08.785130 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.786051 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.786779 14226 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:19:08.787632 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.789234 17967 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:08.789721 17967 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:08.790150 17967 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.786777 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 991) took 2520 ms. Trace:
I20260709 13:19:08.790793 14892 rpcz_store.cc:276] 0709 13:19:06.266727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.266932 (+   205us) service_pool.cc:224] Handling call
0709 13:19:06.267226 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.428379 (+161153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.786201 (+2357822us) spinlock_profiling.cc:243] Waited 92.7 ms on lock 0x7b540066dad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:08.786558 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213242240}
I20260709 13:19:08.729718 14192 leader_election.cc:400] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9.
I20260709 13:19:08.792357 14192 leader_election.cc:403] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.792937 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2581) took 3784 ms. Trace:
W20260709 13:19:08.793350 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 63925.2us
I20260709 13:19:08.793396 14304 rpcz_store.cc:276] 0709 13:19:05.008389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.969090 (+1960701us) service_pool.cc:224] Handling call
0709 13:19:07.967572 (+998482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.971106 (+  3534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.792480 (+821374us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54000dc5d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:08.792744 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292390272}
I20260709 13:19:08.795854 18195 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.796478 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 698) took 3492 ms. Trace:
I20260709 13:19:08.796599 18195 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.796986 14304 rpcz_store.cc:276] 0709 13:19:05.304117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.795086 (+3490969us) service_pool.cc:224] Handling call
0709 13:19:08.795682 (+   596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.796066 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.796091 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.796163 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:08.796204 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.796265 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.796405 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.762682 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 998) took 1420 ms. Trace:
I20260709 13:19:08.762758 14899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ede0d59e482a4cff952455ca90001863"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:08.819551 14304 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:08.765501 14224 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:19:08.802358 18210 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:08.807160 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.760535 17918 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:08.813591 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.816336 14900 rpcz_store.cc:276] 0709 13:19:07.342489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.343248 (+   759us) service_pool.cc:224] Handling call
0709 13:19:08.762193 (+1418945us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b540078f5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:08.762462 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678401280}
I20260709 13:19:08.813915 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:08.773449 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 697) took 3469 ms. Trace:
I20260709 13:19:08.817505 14899 raft_consensus.cc:606] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:08.706919 14296 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:19:08.831393 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 72990.2us
I20260709 13:19:08.834694 14295 rpcz_store.cc:276] 0709 13:19:05.303874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.772238 (+3468364us) service_pool.cc:224] Handling call
0709 13:19:08.772641 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.772966 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.772994 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.773058 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:08.773096 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.773151 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.773267 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.837909 17932 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.838680 18210 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:08.839103 18210 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:08.839602 14295 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:19:08.840373 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 701) took 3535 ms. Trace:
I20260709 13:19:08.840163 18210 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:08.843617 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.845825 14224 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:08.847586 14228 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:19:08.840790 14295 rpcz_store.cc:276] 0709 13:19:05.304835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.838583 (+3533748us) service_pool.cc:224] Handling call
0709 13:19:08.839073 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.840067 (+   994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.840310 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.739750 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 695) took 3536 ms. Trace:
I20260709 13:19:08.849076 14227 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:08.849370 14303 rpcz_store.cc:276] 0709 13:19:05.203451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.738345 (+3534894us) service_pool.cc:224] Handling call
0709 13:19:08.738748 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.739464 (+   716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.739693 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.851351 18174 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.852010 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.854686 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2524) took 3744 ms. Trace:
I20260709 13:19:08.855268 14296 rpcz_store.cc:276] 0709 13:19:05.102390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.706172 (+3603782us) service_pool.cc:224] Handling call
0709 13:19:08.706559 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.846890 (+140331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.847187 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.858492 14223 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
W20260709 13:19:08.859675 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 109955us
I20260709 13:19:08.861215 14297 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:08.849912 17595 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9.
I20260709 13:19:08.857848 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 699) took 3546 ms. Trace:
I20260709 13:19:08.841745 18210 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:08.869742 14297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2587) took 1314 ms (client timeout 1710 ms). Trace:
I20260709 13:19:08.869625 14304 rpcz_store.cc:276] 0709 13:19:05.304361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.818766 (+3514405us) service_pool.cc:224] Handling call
0709 13:19:08.819203 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.847517 (+ 28314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.850230 (+  2713us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.873459 14298 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: [8.7-9.8]
W20260709 13:19:08.871622 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.875111 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:08.873425 14297 rpcz_store.cc:269] 0709 13:19:07.547007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.508860 (+961853us) service_pool.cc:224] Handling call
0709 13:19:08.861763 (+352903us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.882956 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.886317 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.876077 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:08.890724 14304 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
W20260709 13:19:08.892948 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79212.9us
I20260709 13:19:08.893975 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:08.893527 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.894263 17712 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.894937 14304 raft_consensus.cc:2393] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 4: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:08.894984 17712 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:08.895808 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:08.895911 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:08.896405 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.897090 14224 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:08.897266 14304 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:08.898056 14221 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:08.898571 17920 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:08.899935 14295 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:08.904135 14303 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:08.904848 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2528) took 3496 ms. Trace:
I20260709 13:19:08.905130 14303 rpcz_store.cc:276] 0709 13:19:05.408186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.869400 (+3461214us) service_pool.cc:224] Handling call
0709 13:19:08.903894 (+ 34494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.904597 (+   703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.904780 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.905563 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.907806 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 702) took 3602 ms. Trace:
I20260709 13:19:08.908110 14296 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:08.908299 14295 rpcz_store.cc:276] 0709 13:19:05.305060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.853440 (+3548380us) service_pool.cc:224] Handling call
0709 13:19:08.899584 (+ 46144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.902299 (+  2715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.907733 (+  5434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.871699 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.919466 14220 raft_consensus.cc:2410] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:08.920614 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:08.921550 14892 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:08.897342 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:08.924463 14222 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:08.885010 18145 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:08.930967 14227 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:08.931650 14300 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:08.932121 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2586) took 1377 ms. Trace:
I20260709 13:19:08.932885 14296 rpcz_store.cc:276] 0709 13:19:07.546772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.869996 (+1323224us) service_pool.cc:224] Handling call
0709 13:19:08.901967 (+ 31971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.908609 (+  6642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.923752 (+ 15143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.937139 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2523) took 3835 ms. Trace:
I20260709 13:19:08.937737 14298 rpcz_store.cc:276] 0709 13:19:05.102043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.552560 (+3450517us) service_pool.cc:224] Handling call
0709 13:19:08.861764 (+309204us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:08.876245 (+ 14481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.936861 (+ 60616us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54001a1150. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:08.937064 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709868800}
I20260709 13:19:08.941360 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.944437 14302 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:08.948093 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.950534 14221 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:08.951777 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.954734 14225 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:08.958307 14303 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:19:08.960413 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:08.963181 14229 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:08.953608 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:08.968052 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:08.959805 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:08.893460 17936 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:08.975080 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.965896 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 309445us
I20260709 13:19:08.978637 17582 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:08.979242 17582 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.979699 17582 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.906649 17918 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:19:08.983191 14304 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:08.984028 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2593) took 1421 ms. Trace:
I20260709 13:19:08.984390 14304 rpcz_store.cc:276] 0709 13:19:07.562639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.934624 (+1371985us) service_pool.cc:224] Handling call
0709 13:19:08.982893 (+ 48269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.983717 (+   824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.983964 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.986032 14297 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:19:08.988171 18195 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:08.989034 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57757.8us
I20260709 13:19:08.989698 14303 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:08.990419 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2530) took 1147 ms. Trace:
I20260709 13:19:08.990772 14303 rpcz_store.cc:276] 0709 13:19:07.842640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.973065 (+1130425us) service_pool.cc:224] Handling call
0709 13:19:08.989449 (+ 16384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.990144 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.990359 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.991513 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:08.992715 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 708) took 1134 ms. Trace:
I20260709 13:19:08.993201 14303 rpcz_store.cc:276] 0709 13:19:07.858394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.991648 (+1133254us) service_pool.cc:224] Handling call
0709 13:19:08.991993 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.992333 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.992360 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.992402 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:08.992454 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.992528 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.992662 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:09.014286 14369 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:08.999532 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:08.998943 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2521) took 3925 ms. Trace:
I20260709 13:19:09.027405 14221 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:09.036325 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:09.036491 18005 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:08.997946 18054 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.039358 18005 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:19:09.040201 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:09.020738 14299 rpcz_store.cc:276] 0709 13:19:05.073665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.240268 (+3166603us) service_pool.cc:224] Handling call
0709 13:19:08.249057 (+  8789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.249316 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:08.287175 (+ 37859us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.553195 (+266020us) spinlock_profiling.cc:243] Waited 7.21 ms on lock 0x7b1800017f20. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a 00007f8ded096a2a
0709 13:19:08.998310 (+445115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.998406 (+    96us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:08.998469 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.998555 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.998737 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79534,"prepare.queue_time_us":37684,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2845,"raft.queue_time_us":87446,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":9016,"spinlock_wait_cycles":16586496,"thread_start_us":303812,"threads_started":1}
I20260709 13:19:09.042331 17936 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:09.043365 17936 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.044178 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2600) took 1034 ms. Trace:
W20260709 13:19:09.045365 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 148110us
I20260709 13:19:09.046422 14270 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:09.047575 17789 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:09.051215 14295 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:09.053311 14298 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:09.054031 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2594) took 1491 ms. Trace:
I20260709 13:19:09.054441 14298 rpcz_store.cc:276] 0709 13:19:07.562943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.939033 (+1376090us) service_pool.cc:224] Handling call
0709 13:19:09.030791 (+ 91758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.053730 (+ 22939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.053977 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:09.052327 14270 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.063231 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 711) took 1204 ms. Trace:
I20260709 13:19:09.063869 14303 rpcz_store.cc:276] 0709 13:19:07.861301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.023686 (+1162385us) service_pool.cc:224] Handling call
0709 13:19:09.062457 (+ 38771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.062796 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.062832 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.062886 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:09.062930 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.062998 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.063141 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:09.067565 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:09.068248 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 207622us
I20260709 13:19:09.044689 14299 rpcz_store.cc:276] 0709 13:19:08.009842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.042993 (+1033151us) service_pool.cc:224] Handling call
0709 13:19:09.043497 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.043750 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.043786 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.043862 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:09.043906 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.043978 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.044109 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:09.006975 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.068549 14371 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:08.993618 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:09.010306 14304 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:09.074975 14900 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:08.998226 17952 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:09.081468 14300 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:09.074899 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2595) took 1511 ms. Trace:
I20260709 13:19:09.012076 14228 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:09.042537 17962 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.084694 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:09.085086 17962 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.086081 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:09.088160 17962 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:09.089704 14369 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:09.090377 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.082428 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2535) took 1229 ms. Trace:
I20260709 13:19:09.090973 14300 rpcz_store.cc:276] 0709 13:19:07.853482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.999657 (+1146175us) service_pool.cc:224] Handling call
0709 13:19:09.000064 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.082109 (+ 82045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.082355 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:09.092885 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:09.093948 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:09.094302 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 706) took 1236 ms. Trace:
I20260709 13:19:09.094862 14304 rpcz_store.cc:276] 0709 13:19:07.857833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.985402 (+1127569us) service_pool.cc:224] Handling call
0709 13:19:09.004688 (+ 19286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.081445 (+ 76757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.094240 (+ 12795us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:09.096869 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 103349us
I20260709 13:19:09.097362 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.083452 14296 rpcz_store.cc:276] 0709 13:19:07.563475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.957219 (+1393744us) service_pool.cc:224] Handling call
0709 13:19:09.009646 (+ 52427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.069485 (+ 59839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.069514 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.074610 (+  5096us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:09.074658 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.074717 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.074840 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:09.099295 14378 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:09.104897 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:09.105701 14901 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:09.120777 14897 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:09.126255 14226 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:09.127312 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:09.099721 17789 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:09.129231 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 60173.4us
W20260709 13:19:09.134950 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60925.7us
I20260709 13:19:09.142620 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.136042 18070 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:09.140590 14370 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:09.147490 14267 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.149210 17712 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:09.149694 17712 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.150147 17712 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:09.153759 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.132560 17918 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.098838 17967 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.158020 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:09.159092 14378 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:09.163938 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 696) took 3860 ms. Trace:
I20260709 13:19:09.164450 14302 rpcz_store.cc:276] 0709 13:19:05.303555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.751620 (+3448065us) service_pool.cc:224] Handling call
0709 13:19:08.935522 (+183902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.956241 (+ 20719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.163726 (+207485us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540022d8d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:09.163875 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415228288}
I20260709 13:19:09.166481 17952 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:09.166707 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:09.166985 17952 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:09.167419 17952 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.171263 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:09.155412 17789 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.165133 18079 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.154727 18070 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.167419 17967 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:09.187381 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:09.189921 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46995.8us
I20260709 13:19:09.190028 14226 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:09.192482 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:09.193730 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.185139 18070 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.200906 18076 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:09.201942 18246 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:09.182556 17789 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.203444 18079 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:09.207145 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.207662 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:09.208266 18055 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:09.208776 18055 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.209416 18055 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.210762 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:09.212867 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:09.213811 18084 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:09.202019 18076 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:09.208679 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:09.215018 14901 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:19:09.219914 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.173987 17937 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.015s
I20260709 13:19:09.231210 17895 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:09.231997 17712 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.232070 17895 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.234282 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:09.235509 14900 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:09.235807 18145 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:09.236316 18145 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:09.236438 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:09.237336 18145 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.237953 14125 catalog_manager.cc:5697] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:09.224489 17937 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.006s	sys 0.015s
I20260709 13:19:09.218641 18084 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:09.259229 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.259871 18084 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.241671 14193 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.251338 17712 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:09.251778 14342 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.254077 18174 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:09.226655 17920 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.249162 17918 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.219178 18076 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:09.239432 18157 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.006s
W20260709 13:19:09.293397 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 72292.3us
I20260709 13:19:09.219089 17582 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.263875 18091 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:09.296950 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72271.8us
I20260709 13:19:09.299741 18074 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:09.325838 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 199730us
I20260709 13:19:09.299589 18076 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.300740 14226 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
W20260709 13:19:09.330003 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 219071us
I20260709 13:19:09.302596 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:09.330747 14226 pending_rounds.cc:85] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 6
I20260709 13:19:09.306962 17895 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:09.308429 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2576) took 4490 ms. Trace:
I20260709 13:19:09.269440 17896 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.312104 14895 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:09.311950 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:09.312783 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:09.314837 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:09.315652 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.315562 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:09.317962 17967 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:09.320353 14123 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37072 (request call id 323) took 19002 ms (client timeout 15000 ms). Trace:
I20260709 13:19:09.319977 17789 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.301424 14193 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.306568 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:09.336899 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:09.331071 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 350732us
I20260709 13:19:09.354748 17978 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:09.355398 17978 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:09.331061 14226 pending_rounds.cc:107] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:19:09.323758 18091 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.325289 18087 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:09.398053 18091 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.398254 18087 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:09.399307 17918 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:09.399408 18087 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.358650 17601 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:19:09.402562 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 58735.3us
I20260709 13:19:09.404147 17601 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:09.357118 17895 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:19:09.343055 17896 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.406220 17896 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.407146 17918 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:09.410115 17601 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:09.339023 14301 rpcz_store.cc:276] 0709 13:19:04.772759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.433366 (+1660607us) service_pool.cc:224] Handling call
0709 13:19:06.492499 (+ 59133us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:07.077222 (+584723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.077271 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:07.078000 (+   729us) log.cc:844] Serialized 52 byte log entry
0709 13:19:07.318738 (+240738us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:08.595131 (+1276393us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b18003fd240. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf
0709 13:19:08.595449 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.186191 (+590742us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.219811 (+ 33620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.228961 (+  9150us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54000dc0d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:09.229037 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.242845 (+ 13808us) raft_consensus.cc:1685] finished
0709 13:19:09.242866 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.263057 (+ 20191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20812,"prepare.queue_time_us":145919,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":8050,"raft.queue_time_us":32636,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":32621,"spinlock_wait_cycles":1349298688,"thread_start_us":564533,"threads_started":3,"wal-append.queue_time_us":730425,"wal-append.run_cpu_time_us":2523,"wal-append.run_wall_time_us":1156996}
W20260709 13:19:09.342831 14123 rpcz_store.cc:269] 0709 13:18:50.318360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.318647 (+   287us) service_pool.cc:224] Handling call
0709 13:19:09.320084 (+19001437us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:05.287886 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:05.515195 (+227309us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:05.530163 (+ 14968us) write_op.cc:435] Acquired schema lock
0709 13:19:05.549509 (+ 19346us) tablet.cc:662] Decoding operations
0709 13:19:06.037432 (+487923us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:06.050887 (+ 13455us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:06.051948 (+  1061us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:19:06.338984 (+287036us) tablet.cc:701] Row locks acquired
0709 13:19:06.339000 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:19:06.339157 (+   157us) write_op.cc:270] Start()
0709 13:19:06.339271 (+   114us) write_op.cc:276] Timestamp: P: 1783603146339107 usec, L: 0
0709 13:19:06.339293 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:06.339975 (+   682us) log.cc:844] Serialized 5193 byte log entry
0709 13:19:07.020936 (+680961us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8de9f820ac 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b
0709 13:19:07.764563 (+743627us) op_driver.cc:464] REPLICATION: finished
0709 13:19:07.913975 (+149412us) write_op.cc:301] APPLY: starting
0709 13:19:07.914088 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:07.990769 (+ 76681us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:07.990796 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:07.996116 (+  5320us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:07.996411 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 13:19:07.996462 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:07.996813 (+   351us) log.cc:844] Serialized 95 byte log entry
0709 13:19:08.123749 (+126936us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:08.133264 (+  9515us) write_op.cc:454] Released schema lock
0709 13:19:08.139048 (+  5784us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:08.226921 (+ 87873us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:08.226971 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":157936,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":149074,"apply.run_cpu_time_us":5879,"apply.run_wall_time_us":303549,"num_ops":13,"prepare.queue_time_us":304257,"prepare.run_cpu_time_us":33822,"prepare.run_wall_time_us":2143540,"raft.queue_time_us":207885,"raft.run_cpu_time_us":16216,"raft.run_wall_time_us":101143,"replication_time_us":1425096,"spinlock_wait_cycles":31665408,"thread_start_us":1343456,"threads_started":4,"wal-append.queue_time_us":1011488,"wal-append.run_cpu_time_us":55805,"wal-append.run_wall_time_us":1634840}]]}
I20260709 13:19:09.374138 14125 catalog_manager.cc:5697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.376961 17582 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:09.380326 18253 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 13:19:09.380820 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:09.381908 17978 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.383244 18076 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:09.387131 17967 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:09.392074 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:09.393754 14867 leader_election.cc:400] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11.
I20260709 13:19:09.426561 14867 leader_election.cc:403] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:19:09.393666 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 91160.1us
I20260709 13:19:09.325485 17920 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.395686 18210 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:09.395937 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 94659.3us
W20260709 13:19:09.396417 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 59643.3us
I20260709 13:19:09.396804 17595 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:09.327760 17712 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:19:09.357347 14226 raft_consensus.cc:2889] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:09.435222 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.448271 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 121189us
I20260709 13:19:09.451735 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:09.449607 14125 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.494020 18070 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.496481 18070 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:09.497174 18070 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.498186 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:09.498828 14301 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:09.447214 17595 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:09.501577 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:09.502543 14296 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:09.503999 14303 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:09.506431 14300 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:09.508975 14298 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:09.513633 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.513952 18249 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:09.514354 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.515043 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.516314 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64740.9us
I20260709 13:19:09.517057 14300 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:19:09.498651 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 152501us
W20260709 13:19:09.521028 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 129045us
I20260709 13:19:09.519503 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.518162 14301 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:09.523188 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 707) took 1665 ms. Trace:
I20260709 13:19:09.497555 18070 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:09.534302 14864 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:09.548703 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:09.549491 17582 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:09.549598 14223 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.550174 17582 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:09.550925 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:09.551575 14224 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.552440 18079 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:09.548807 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 66600.4us
I20260709 13:19:09.554349 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:09.555200 17918 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:09.553154 18079 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.478494 18210 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:09.433712 18055 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.538913 14297 rpcz_store.cc:276] 0709 13:19:07.858124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.986999 (+1128875us) service_pool.cc:224] Handling call
0709 13:19:08.987388 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.987624 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:08.987997 (+   373us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.379417 (+391420us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:09.522845 (+143428us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.522902 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:09.522956 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.523018 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.523133 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13444,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":6306,"raft.queue_time_us":73690,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":55844608,"thread_start_us":525203,"threads_started":2,"wal-append.queue_time_us":280872}
I20260709 13:19:09.566996 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:09.564082 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 44713.8us
I20260709 13:19:09.567875 14225 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:09.561432 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.568323 14223 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:09.518846 17978 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:09.570273 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 226554us
I20260709 13:19:09.564894 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:09.524718 17595 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.543004 18005 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11.
W20260709 13:19:09.584172 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 238993us
I20260709 13:19:09.587144 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.565536 18070 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.593364 14229 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:09.598629 14229 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:09.595409 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:09.600894 14222 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:09.557673 17918 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:09.596546 14304 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:09.596575 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:09.602385 14301 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.585623 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:09.581642 18221 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:09.597632 14226 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:09.541200 17952 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:09.610896 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 126101us
I20260709 13:19:09.551327 17582 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.613747 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:09.645392 14226 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:09.605005 14125 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 7, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 7 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:19:09.614761 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67116.3us
I20260709 13:19:09.612780 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:09.616238 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 79570.9us
I20260709 13:19:09.617302 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:09.604977 18174 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:09.618366 14229 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.626605 18251 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:09.627079 18265 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:09.637492 18254 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:09.633600 17789 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:09.619110 18221 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:09.641202 14224 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:19:09.613826 18145 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:09.633613 18005 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:09.654513 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.669487 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 99312.3us
W20260709 13:19:09.667544 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50334.2us
W20260709 13:19:09.665563 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 70685.9us
I20260709 13:19:09.672407 14193 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:09.670869 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.673105 14125 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.681510 14229 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:09.683101 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 69940.1us
I20260709 13:19:09.684948 14301 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
W20260709 13:19:09.685326 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.682274 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 991) took 1070 ms. Trace:
I20260709 13:19:09.655900 17920 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:09.696162 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.676520 18265 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:09.692267 14125 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:09.701610 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:09.702282 14222 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.688119 14896 rpcz_store.cc:276] 0709 13:19:08.611656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.631520 (+ 19864us) service_pool.cc:224] Handling call
0709 13:19:08.688256 (+ 56736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.144194 (+455938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.144232 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.144754 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.328634 (+183880us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:09.328686 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.328786 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.682009 (+353223us) raft_consensus.cc:1685] finished
0709 13:19:09.682027 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.682191 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33730,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":178,"thread_start_us":637608,"threads_started":2,"wal-append.queue_time_us":320016}
I20260709 13:19:09.676270 18251 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:09.693051 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.702735 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:09.672653 18084 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:09.633443 17967 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.686436 17895 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:09.683864 18005 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:09.733213 14193 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:09.724479 17920 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.728628 18175 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:19:09.727507 18084 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.728808 14125 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:09.683760 18174 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:19:09.725876 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 43550.6us
I20260709 13:19:09.735452 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:09.735770 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45303.9us
I20260709 13:19:09.735697 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:09.725142 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.766863 14378 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:09.767788 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.703132 14226 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:09.742831 18054 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:09.743598 17895 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:09.742061 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:09.736351 18246 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:09.761759 18260 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:19:09.738955 18267 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:19:09.739499 18259 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:19:09.738379 18261 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:19:09.762586 18265 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.733381 18257 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.735229 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:09.698217 18195 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:09.771602 14222 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:09.769713 14270 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.772595 14864 leader_election.cc:400] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11.
I20260709 13:19:09.680902 17918 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.640617 18210 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:09.847205 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77586.2us
I20260709 13:19:09.780753 14371 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:09.743619 18005 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.793534 14229 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:19:09.853456 14229 pending_rounds.cc:85] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 4
I20260709 13:19:09.853754 14229 pending_rounds.cc:107] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:19:09.854032 14229 raft_consensus.cc:2889] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:09.853467 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54814.8us
I20260709 13:19:09.749616 18262 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.140s
I20260709 13:19:09.788502 14125 catalog_manager.cc:5697] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 4 to 5, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 5 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:09.836578 18195 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:09.728219 18157 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:19:09.799229 14867 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:09.735765 18269 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.199s
I20260709 13:19:09.735396 17920 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.753399 18084 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:09.822407 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54701us
I20260709 13:19:09.823693 18289 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:09.826344 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 44712.9us
I20260709 13:19:09.828118 18286 raft_consensus.cc:2764] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:19:09.833051 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 111146us
I20260709 13:19:09.759466 18055 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:09.735829 18263 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:09.843335 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:09.775117 18079 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:09.774585 18175 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:09.871451 17920 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.751338 18247 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.156s
W20260709 13:19:09.858215 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 92114.9us
I20260709 13:19:09.859799 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:09.746935 17712 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.876370 18246 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:09.890831 17712 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.891446 18288 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:09.892138 18264 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:09.856359 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:09.734989 17896 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.749758 18273 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 13:19:09.852010 17952 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:09.821220 18070 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:09.873977 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 96528.6us
I20260709 13:19:09.788232 18054 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.870493 14125 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 8 to 9, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 9 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.861706 18195 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:09.882807 14373 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:09.856225 18145 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:09.797381 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 61476.2us
I20260709 13:19:09.744727 18251 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.732260 18221 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.850186 18257 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.897096 18264 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:09.896394 17978 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:09.912932 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:09.917827 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:09.894146 18174 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:09.889197 18289 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:09.937422 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49365.1us
I20260709 13:19:09.893174 18175 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:09.930536 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 70818.5us
W20260709 13:19:09.939356 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.939457 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:09.940426 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.930732 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:09.931345 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 189370us
I20260709 13:19:09.896260 18288 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:09.938736 18054 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:09.917364 17712 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:09.958539 14125 catalog_manager.cc:5697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 6, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 6 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:09.905229 17895 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:09.938398 18289 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:09.988952 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 87018.3us
I20260709 13:19:09.993736 18175 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:09.958664 17601 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:09.933844 17978 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:10.006006 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:09.959300 18286 raft_consensus.cc:2764] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:09.936268 18174 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:10.013036 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 52343.9us
I20260709 13:19:09.920567 18145 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.001096 18249 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.014810 14125 catalog_manager.cc:5697] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 7, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 7 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:10.022974 14125 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 8, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 8 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.026254 14125 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 7, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 7 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.007412 17918 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:10.028836 14125 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 3 to 4, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 4 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:10.034365 18279 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:10.038466 18174 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.040126 18174 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:10.008826 17978 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:10.041898 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 120991us
I20260709 13:19:10.012486 17601 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:10.068411 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 66868.1us
I20260709 13:19:10.008313 18263 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:10.065366 14125 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 7 to 9, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 9 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:19:10.078970 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 139601us
I20260709 13:19:10.080318 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:10.083067 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 226772us
I20260709 13:19:10.085877 14369 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:10.088024 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:10.088119 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 217415us
I20260709 13:19:10.092577 14125 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.068630 18074 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:19:10.103250 14125 catalog_manager.cc:5697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:10.081171 17896 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:10.110019 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:10.110201 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:10.113518 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:10.087145 18070 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:10.108796 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:10.117668 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:10.122552 17601 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:10.125880 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.127597 18257 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:10.129473 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:10.130421 14370 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:10.131153 18145 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:10.078898 18288 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:10.136839 17920 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:10.138863 18278 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:19:10.074193 18249 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:10.113181 17595 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.000s
I20260709 13:19:10.150791 14865 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:10.159601 14373 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:10.090065 18054 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:19:10.139811 18074 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:10.218079 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:10.212754 14267 leader_election.cc:336] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.568s (SENT)
I20260709 13:19:10.116834 18247 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:19:10.081578 18264 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.227906 14374 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:10.210769 18074 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:10.231230 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:10.233064 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:10.233120 14864 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:10.234133 14375 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:10.169179 17595 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:10.234120 14376 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
W20260709 13:19:10.326962 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 176290us
I20260709 13:19:10.327994 14865 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:19:10.234907 18281 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 13:19:10.347018 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 165904us
I20260709 13:19:10.417114 18299 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.418632 18262 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:10.424343 14378 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:10.429924 14125 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 8, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 8 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:10.431131 18079 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:10.432291 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 104414us
I20260709 13:19:10.432862 17937 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.454258 14125 catalog_manager.cc:5697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.456554 14125 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 4 to 5, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 5 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.433342 18005 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:10.435091 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.459570 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.461304 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:10.417418 18298 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:10.441670 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.471441 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.472011 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.472342 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.237345 18166 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:10.450060 18079 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:10.453452 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 220378us
W20260709 13:19:10.479508 14267 leader_election.cc:336] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.610s (SENT)
I20260709 13:19:10.417205 17582 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.434787 17896 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:10.466662 18299 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:10.496126 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:10.498474 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:10.499963 18299 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:10.500922 17937 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:10.450126 17967 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.216655 18263 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:10.466958 18005 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:10.477170 18166 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:10.522953 18145 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:10.503348 17918 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:10.538355 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:10.538787 14374 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:10.530901 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:10.530536 18005 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:10.548352 18310 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:10.559350 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:10.560030 14225 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:10.567706 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 133881us
I20260709 13:19:10.569028 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:10.540061 18166 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.502977 17582 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:10.458995 18262 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:10.586704 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.590370 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:10.530467 18300 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.510962 17896 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.611743 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:10.611743 14369 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:10.551446 18145 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.490329 18298 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.526512 17967 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:10.616107 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 136622us
I20260709 13:19:10.628868 14374 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:10.596988 17918 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:10.638366 17595 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:10.653256 14377 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:10.611335 18304 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.339s
I20260709 13:19:10.653676 14225 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:10.568797 18074 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.628120 18249 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:10.667116 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:10.679000 18309 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:19:10.684773 18174 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.002s
I20260709 13:19:10.686203 14371 raft_consensus.cc:2410] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:10.687083 17896 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:10.674431 17920 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:10.687880 18262 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:10.688833 18076 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.258s	user 0.014s	sys 0.000s
W20260709 13:19:10.689267 18084 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.806s	user 0.006s	sys 0.002s
I20260709 13:19:10.624413 18079 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:10.690194 18079 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.690780 17582 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:10.699393 18145 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:10.700059 18298 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:10.700460 18074 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:10.704563 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:10.705044 14344 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.017s	sys 0.044s
W20260709 13:19:10.660881 18308 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:19:10.705355 14344 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.017s	sys 0.045s
I20260709 13:19:10.661691 18319 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:10.706323 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2616) took 1206 ms. Trace:
I20260709 13:19:10.706709 18319 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.709089 18319 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:10.706792 14304 rpcz_store.cc:276] 0709 13:19:09.499893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.507786 (+  7893us) service_pool.cc:224] Handling call
0709 13:19:09.508118 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.603098 (+ 94980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.706018 (+1102920us) spinlock_profiling.cc:243] Waited 88.1 ms on lock 0x7b54000dded4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:10.706249 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202744576}
W20260709 13:19:10.663401 18091 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.265s	user 0.013s	sys 0.002s
I20260709 13:19:10.654629 18269 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:10.705727 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 861178us
I20260709 13:19:10.715873 14895 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:10.630084 18300 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:10.720499 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:10.721326 14374 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:10.720965 18269 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:10.689688 18084 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:10.751367 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:10.837965 14892 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:19:10.802387 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.777350 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:10.785939 14370 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
W20260709 13:19:10.809052 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.753588 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:10.797349 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 338852us
I20260709 13:19:10.800249 18304 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:10.800655 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 159229us
I20260709 13:19:10.856510 14374 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
W20260709 13:19:10.857062 18195 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.923s	user 0.010s	sys 0.001s
I20260709 13:19:10.857851 14375 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:10.846393 18300 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:10.863732 18084 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:10.808724 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 206369us
I20260709 13:19:10.867404 18319 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:10.875074 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.875710 18005 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.877276 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.880462 14897 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:19:10.926433 14897 pending_rounds.cc:85] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 8
I20260709 13:19:10.926725 14897 pending_rounds.cc:107] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:19:10.926980 14897 raft_consensus.cc:2889] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.882288 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.884374 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.886296 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.841380 18269 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:10.890237 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.894223 14221 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:10.811424 18174 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:10.762146 17978 consensus_meta.cc:287] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.703s	user 0.003s	sys 0.008s
I20260709 13:19:10.751266 18076 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.922703 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:10.780874 17967 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:10.916955 18298 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.922497 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:10.927030 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:10.931071 14894 raft_consensus.cc:2368] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10.
I20260709 13:19:10.722467 18091 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:10.932350 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.933167 18174 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.943244 18174 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:10.937053 17978 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.944238 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.945556 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.946710 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.946823 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.780874 18166 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.948160 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.923867 18195 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:10.949216 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.949930 18074 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.950450 18074 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:10.951063 18195 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:10.951166 18005 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:10.951838 14227 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:10.952322 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.952530 18074 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:10.952733 14900 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 7: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:10.952937 14898 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:10.953893 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:10.956125 14896 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:10.954941 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.022970 14369 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:11.020893 14893 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:11.025961 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:10.956468 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.976513 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49682.4us
I20260709 13:19:10.980723 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:11.027572 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.996359 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:11.027963 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.021464 18249 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:19:10.922497 17895 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.967052 14895 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:10.949568 18166 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:11.035475 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49723.7us
I20260709 13:19:11.037853 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.039008 14897 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:10.981266 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:11.033059 14374 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:19:11.040657 14374 pending_rounds.cc:85] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 7
I20260709 13:19:11.042181 14374 pending_rounds.cc:107] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:19:11.042254 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.042750 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:11.042897 14374 raft_consensus.cc:2889] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.980834 18332 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:11.019878 18091 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:10.956538 17978 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:10.931283 18263 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:19:10.982589 18145 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:11.052632 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.058619 14892 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:10.925050 18304 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.039969 18005 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.058029 18249 consensus_queue.cc:1243] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:10.955967 18076 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:11.059834 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.030248 18298 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.069622 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:11.044873 17895 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:11.081122 14894 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:11.082719 17895 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:11.044556 18174 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:19:11.082485 14894 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:11.072100 14901 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:11.076741 14270 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:11.061841 14344 leader_election.cc:336] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 1.864s (SENT)
I20260709 13:19:11.076107 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:11.085342 14894 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:11.087239 14375 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:19:11.092454 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 1.04554e+06us
I20260709 13:19:11.093456 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.093958 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:11.094208 14900 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:11.095530 14900 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:11.095494 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:11.059942 18265 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.095830 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:11.097680 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:11.100534 17895 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:11.103295 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.057605 18264 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:19:11.075330 18005 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:11.098928 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 1.00751e+06us
I20260709 13:19:11.104683 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:11.108196 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.058905 18332 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:11.109448 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:11.064004 17967 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:19:11.100082 17952 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.112423 18289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.001s
I20260709 13:19:11.113332 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:11.115943 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:11.119212 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.120491 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 995) took 1014 ms. Trace:
I20260709 13:19:11.110121 14899 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:11.079226 17712 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:11.082497 18076 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:11.062402 17582 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:19:11.122491 14374 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:11.124255 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:11.107421 14894 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.105762 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:11.123283 18221 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:11.131361 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.152182 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:11.146262 14344 leader_election.cc:336] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 2.188s (SENT)
I20260709 13:19:11.184072 14371 rpcz_store.cc:276] 0709 13:19:10.091687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.091848 (+   161us) service_pool.cc:224] Handling call
0709 13:19:11.106094 (+1014246us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54003980d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:11.106240 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322820864}
W20260709 13:19:11.220721 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.144076 14376 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:19:11.109160 18005 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.103439 18262 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:11.122272 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.130539 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:11.152653 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.249001 14893 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 7: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:11.217046 14898 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:19:11.151149 14370 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:11.211685 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.220697 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 96524.2us
I20260709 13:19:11.222302 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.147003 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:11.110466 18288 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.120967 18210 raft_consensus.cc:2764] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:11.249972 14370 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:11.220196 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:11.253011 14894 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:11.184801 18289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.003s	sys 0.003s
I20260709 13:19:11.233861 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.246178 14369 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:11.251441 14900 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:11.254583 14892 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:11.224015 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 994) took 1136 ms. Trace:
W20260709 13:19:11.255431 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 108515us
I20260709 13:19:11.256533 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.256632 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.262317 14223 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:11.257380 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:11.257529 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 162114us
I20260709 13:19:11.253918 14370 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:11.143504 18315 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:11.186933 17952 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:11.208593 18274 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.274693 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:11.121747 18273 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:19:11.267728 14375 raft_consensus.cc:2410] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:11.268003 14895 raft_consensus.cc:2368] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10.
I20260709 13:19:11.260380 14373 rpcz_store.cc:276] 0709 13:19:10.087172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.087309 (+   137us) service_pool.cc:224] Handling call
0709 13:19:10.103836 (+ 16527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.160113 (+ 56277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.217919 (+1057806us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b54001ba3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:11.223957 (+  6038us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110184704}
W20260709 13:19:11.283869 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 153391us
I20260709 13:19:11.277220 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:11.277606 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.278771 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.267346 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.254632 18288 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.252543 18076 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:11.281420 14374 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:11.281019 18274 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:11.146083 17789 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:11.282307 14372 raft_consensus.cc:2410] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:19:11.345599 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.348696 14369 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:11.299276 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:11.343364 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:11.354849 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 77741.9us
I20260709 13:19:11.217451 17712 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:11.361457 14896 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:11.284956 18292 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:11.365288 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:11.281100 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 134898us
I20260709 13:19:11.357520 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.344949 18288 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.125126 18286 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
W20260709 13:19:11.367072 14267 leader_election.cc:336] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.629s (SENT)
I20260709 13:19:11.369122 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:11.132436 17962 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.212s
W20260709 13:19:11.371416 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 86497.6us
I20260709 13:19:11.372977 14229 raft_consensus.cc:2410] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:19:11.371235 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.373734 14222 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:11.371411 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:11.279419 18279 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.285769 18284 raft_consensus.cc:2764] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:11.370436 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.269577 18299 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.276733 18262 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:11.272987 18315 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:11.380363 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.380637 14223 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:11.360987 18263 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.285284 17967 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:19:11.364586 18145 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.284761 17601 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:19:11.371124 18264 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.393939 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:11.398634 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:11.390115 14344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 2.247s (SENT) [suppressed 45 similar messages]
W20260709 13:19:11.393831 14267 leader_election.cc:336] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 2.418s (SENT)
I20260709 13:19:11.355546 17978 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:19:11.387818 18295 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:11.440141 14222 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:11.440528 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 69199.9us
I20260709 13:19:11.396185 18249 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.385293 18279 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.381680 17932 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:19:11.372635 18300 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:19:11.460358 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 70267.6us
I20260709 13:19:11.452600 14223 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:11.364212 17789 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.415254 18270 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:11.395081 18145 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.455628 17952 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:11.484052 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.464414 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.399219 18087 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:11.506563 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.506832 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 207680us
I20260709 13:19:11.482977 18251 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.464493 17582 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:19:11.440424 17962 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:19:11.513574 18251 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.351608 18332 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:11.541747 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 147975us
I20260709 13:19:11.396997 18263 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:11.523269 18342 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:19:11.510588 18145 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.559221 14299 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:11.566854 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 953) took 1655 ms. Trace:
W20260709 13:19:11.569254 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 63311.6us
I20260709 13:19:11.571767 14225 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:19:11.572065 14222 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:19:11.567519 14227 rpcz_store.cc:276] 0709 13:19:09.911354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.917135 (+  5781us) service_pool.cc:224] Handling call
0709 13:19:09.917518 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.952239 (+1034721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.566470 (+614231us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400135bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:11.566766 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2378276096}
I20260709 13:19:11.578652 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.453539 17595 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:19:11.586748 14901 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:19:11.587674 18341 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.217s	user 0.002s	sys 0.000s
I20260709 13:19:11.587985 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.438832 18264 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:11.597052 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.600777 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 84353.3us
I20260709 13:19:11.605051 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.607547 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:11.611239 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 267955us
W20260709 13:19:11.613718 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.616204 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.618686 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.619508 14901 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:11.616954 14299 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:11.623943 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.624631 14298 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:11.607412 17978 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.631377 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.627663 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:11.633119 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.598877 18265 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:11.634156 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:11.635851 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.613449 17962 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:11.607187 17601 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:19:11.634992 14296 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:11.639801 14298 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:11.651612 14303 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:11.653620 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:11.656405 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.669550 14894 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:11.639751 14297 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.674245 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:11.677583 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.671483 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.675195 14296 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:11.683983 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.684888 14298 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:11.686730 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.638264 18354 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:11.692644 14222 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:11.692842 18343 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.693130 18289 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.693217 18350 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:11.693753 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.694545 18210 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:11.713979 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.694832 18279 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:11.630415 18087 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:19:11.653855 18286 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:11.698827 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:11.698864 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.637694 17978 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:11.699667 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.738503 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:11.738888 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.702291 18251 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:11.703213 18263 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:11.706152 14297 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:11.650921 18347 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:19:11.748235 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:11.694608 18349 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:19:11.713096 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.748960 14295 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.696972 18274 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:11.749197 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:11.711575 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:11.706604 18354 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:11.743928 14303 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:11.679878 18339 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:11.756783 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:11.757200 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2024) took 1220 ms. Trace:
I20260709 13:19:11.656764 18351 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:19:11.690573 17712 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:11.710976 18335 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:19:11.750638 14297 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.754957 18087 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:11.779335 18279 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:11.779675 18087 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:11.780720 17978 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:11.780525 18087 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:11.781472 18346 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:19:11.781621 18087 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.709606 18055 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:11.782709 18055 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:11.783207 18344 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:19:11.784343 18074 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.784976 18055 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:11.784873 18074 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.785912 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2625) took 1690 ms. Trace:
I20260709 13:19:11.787071 18074 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:11.786325 14300 rpcz_store.cc:276] 0709 13:19:10.095528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.095655 (+   127us) service_pool.cc:224] Handling call
0709 13:19:10.109526 (+ 13871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.229876 (+120350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.229910 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.151477 (+921567us) spinlock_profiling.cc:243] Waited 954 us on lock 0x7b2c00000e98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb985a11 00007f8deb995372 00007f8ded0c7a01 00007f8ded08c43a 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2
0709 13:19:11.152035 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.369191 (+217156us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:11.369231 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.369295 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.785574 (+416279us) raft_consensus.cc:1685] finished
0709 13:19:11.785599 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.785847 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16920,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"spinlock_wait_cycles":2194176,"thread_start_us":336572,"threads_started":2,"wal-append.queue_time_us":261716}
I20260709 13:19:11.788264 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2026) took 1180 ms. Trace:
I20260709 13:19:11.788686 14220 rpcz_store.cc:276] 0709 13:19:10.608339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.608548 (+   209us) service_pool.cc:224] Handling call
0709 13:19:10.626264 (+ 17716us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.127022 (+500758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.127062 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.127745 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.360278 (+232533us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:11.360321 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.360387 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.788066 (+427679us) raft_consensus.cc:1685] finished
0709 13:19:11.788087 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.788209 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":498334,"raft.queue_time_us":503469,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":232055,"threads_started":1,"wal-append.queue_time_us":325981}
W20260709 13:19:11.790251 14267 leader_election.cc:336] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.502s (SENT)
I20260709 13:19:11.793197 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:11.794754 14114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 37975f772fc648329a8acae36d33a345 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9b2cf49ceed478480fb0f27ccf55d81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:11.795243 18055 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:11.768946 18257 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:11.795743 18351 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:11.796144 18257 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.796316 18351 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:11.796622 18257 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.799153 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.799249 17712 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:11.803536 18145 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:11.804792 14304 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:11.765383 18339 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.806447 17789 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:11.807832 18005 consensus_meta.cc:287] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.550s	user 0.004s	sys 0.006s
I20260709 13:19:11.808305 18005 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.809603 14896 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:11.763741 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.810650 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.714495 18210 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:11.811582 18210 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:11.757586 14221 rpcz_store.cc:276] 0709 13:19:10.536893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.537047 (+   154us) service_pool.cc:224] Handling call
0709 13:19:10.566367 (+ 29320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.930803 (+364436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.756984 (+826181us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540033e354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:11.757143 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753403264}
I20260709 13:19:11.812822 18210 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.769994 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.737259 18350 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.797207 18351 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.814167 14297 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:11.823356 14295 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:11.776934 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:11.755405 18354 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.758855 18263 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:11.778791 18264 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:11.738361 17962 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:19:11.713979 18343 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.779206 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:11.611459 18262 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:11.776036 18334 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.709s	user 0.003s	sys 0.000s
W20260709 13:19:11.843575 14226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.004s	sys 0.013s
W20260709 13:19:11.848297 14226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.004s	sys 0.013s
I20260709 13:19:11.770138 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.838625 18005 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:11.845367 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.849498 14303 raft_consensus.cc:2410] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:19:11.846397 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:11.847030 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.850484 14896 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:11.814064 17952 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:11.781464 18333 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.718s	user 0.000s	sys 0.003s
I20260709 13:19:11.806473 18347 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.855363 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:11.857726 14223 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:11.863529 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.864535 14223 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:11.867684 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.867599 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:11.869390 14303 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:11.875707 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.876505 14223 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:11.876940 14227 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:11.881664 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:11.877866 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.888335 14227 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:11.885181 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.866115 18351 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:11.900208 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.852900 18074 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:19:11.846627 18263 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:11.910858 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:11.912617 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.915635 14894 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 6: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:11.916523 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:11.917280 14894 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:11.918180 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:11.852609 18288 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.924275 18265 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:11.926087 18265 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:11.928246 14303 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:11.928906 18343 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:11.929816 14303 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:11.878724 18347 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.934993 18350 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:11.937044 18339 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:11.937397 18347 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:11.893409 18354 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.948192 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:11.892570 18352 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:11.956830 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.957856 14227 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:11.961336 14377 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:11.866926 17952 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:11.963893 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:11.905557 17712 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:19:11.966092 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 43659.4us
I20260709 13:19:11.969264 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.970060 14226 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:11.970466 14342 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:11.972874 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.957518 18352 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.976699 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:11.969144 17895 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.980562 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:11.988502 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:11.991012 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:11.992997 18319 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:19:11.996961 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:11.997097 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:11.998287 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:12.000489 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:12.001268 14226 raft_consensus.cc:2376] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9. Re-sending same reply.
I20260709 13:19:11.980185 18300 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:12.002678 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.987615 18304 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:11.986110 17789 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:12.010015 17789 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:12.009655 18257 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.010550 17789 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.981813 18322 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:11.980315 18361 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:19:11.996189 18280 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:11.979142 18352 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.006775 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:11.985306 17952 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:11.983139 18288 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:11.995462 17601 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:11.996496 18145 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:11.995396 18265 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:12.008914 18221 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.761s	user 0.004s	sys 0.006s
I20260709 13:19:12.008889 18355 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:19:12.015379 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.015859 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.015563 17712 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.020498 14301 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.020851 14226 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
W20260709 13:19:12.018684 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 135922us
W20260709 13:19:12.008497 18357 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 13:19:12.005607 18300 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.018707 14227 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:19:12.028862 14225 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:12.033453 14227 pending_rounds.cc:85] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 6
I20260709 13:19:12.012647 18257 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:12.020797 18280 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.032905 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:12.033825 14227 pending_rounds.cc:107] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:19:12.035058 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:12.021809 18361 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.036780 14227 raft_consensus.cc:2889] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.029603 18221 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:12.054991 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:12.056082 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.057173 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:12.058004 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.029843 17595 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.058626 14225 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:12.059525 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:12.061486 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.063462 18325 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:12.064070 18325 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.064355 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.057360 18265 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.060074 14225 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:12.068590 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:12.068751 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.036046 18300 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.069290 14371 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.069736 14225 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:12.028281 17952 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:19:12.079067 18366 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:12.079644 17896 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:12.080086 17896 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:12.080932 17896 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.079106 14229 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:12.082813 14229 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:12.083551 14229 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:12.084507 18289 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:12.084919 18289 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:12.085695 18289 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:12.086329 18263 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:12.086736 18289 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.085708 14370 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.072216 14193 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.072360 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:12.073830 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:12.076584 18360 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.261s	user 0.002s	sys 0.000s
I20260709 13:19:12.089311 14301 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:12.055523 18280 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.090108 14371 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:12.090251 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:12.094200 14228 raft_consensus.cc:2410] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:12.094856 14267 leader_election.cc:400] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10.
I20260709 13:19:12.097415 14267 leader_election.cc:403] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:12.093106 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.097647 14226 raft_consensus.cc:2410] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:12.108048 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:12.135129 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:12.136633 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:12.095319 17896 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.093664 18145 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:12.137900 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.138198 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 66078.9us
I20260709 13:19:12.142639 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:12.143496 14301 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:12.143400 14193 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.092422 18286 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.145903 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.146521 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.097774 18263 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:12.058759 18361 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.087344 18257 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:19:12.150066 18221 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:12.153838 14193 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.151666 18343 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:12.155236 18221 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:12.155539 18343 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:12.155640 18366 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.156014 18343 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.152988 14376 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:19:12.158774 14193 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:12.160463 14193 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:12.070477 17595 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.154695 18257 raft_consensus.cc:3055] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:12.165892 18257 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:12.147533 18091 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:12.166914 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:12.167023 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:12.167454 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 75190.3us
I20260709 13:19:12.169423 14222 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:12.169577 14374 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:12.170671 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:12.171130 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.172493 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.173635 14301 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.138659 17582 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10.
I20260709 13:19:12.175200 18265 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.175716 18091 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:12.178743 14371 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:12.179042 14374 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:12.165781 18366 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:12.176100 18286 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:12.161326 18325 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:12.181327 18091 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.182216 18257 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.178128 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.155702 18221 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.151029 18263 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:12.187050 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:12.187824 14374 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.181066 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:12.189286 14897 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:12.178751 18322 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:12.201877 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.213371 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:12.215449 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.216419 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.184289 18257 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.220319 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:12.221071 14897 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:19:12.186236 18366 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:12.226819 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46587.4us
I20260709 13:19:12.233590 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:12.210662 18263 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.213697 18145 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.233922 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:12.234736 14897 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.235762 14369 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:12.244984 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.247357 14374 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:12.249727 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.260710 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:12.263799 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:12.266280 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:12.269178 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.253924 17582 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.275756 18298 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:12.276474 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.296396 14370 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:12.296955 14370 pending_rounds.cc:85] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 5
I20260709 13:19:12.277065 18265 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:12.278106 17595 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:12.279060 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:12.300025 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:12.301163 14369 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:12.279353 17789 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:12.284346 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:12.233050 18322 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:19:12.286440 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:12.286475 17712 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:12.312201 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:19:12.288133 18331 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.222s	user 0.002s	sys 0.000s
I20260709 13:19:12.297478 14370 pending_rounds.cc:107] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:12.296793 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:12.288909 18292 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:19:12.310753 18286 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:12.293113 18354 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:12.286511 18368 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:19:12.315419 14897 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:12.318625 14370 raft_consensus.cc:2889] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.299589 17896 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:12.305126 18370 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:19:12.322343 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.342803 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.299645 17952 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.322602 14372 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:12.344625 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:12.345991 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:12.347543 14372 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:12.265085 18325 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:19:12.324296 14377 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:12.352828 14377 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:12.352934 18221 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.354802 14372 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.331938 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:12.332646 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2105) took 1254 ms. Trace:
I20260709 13:19:12.361423 14867 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:12.295454 18366 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:12.362967 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.363471 14373 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.369710 14897 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:12.367233 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:12.275768 18343 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.365968 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:12.374984 14300 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
W20260709 13:19:12.366202 18270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.014s	sys 0.010s
I20260709 13:19:12.368381 14370 rpcz_store.cc:276] 0709 13:19:11.078004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.150676 (+ 72672us) service_pool.cc:224] Handling call
0709 13:19:11.150992 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.067718 (+916726us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54004171a0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded001a1d 00007f8decfe81a4 00007f8ded06a447 00007f8ded082fe7 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419
0709 13:19:12.085274 (+ 17556us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b54004171a0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded001a1d 00007f8decfe81a4 00007f8ded06a447 00007f8ded082fe7 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419
0709 13:19:12.331447 (+246173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.332241 (+   794us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397046784}
I20260709 13:19:12.320884 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:12.375749 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.320997 18265 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:12.324370 18355 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:12.381155 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60408.3us
I20260709 13:19:12.385990 18325 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:12.380991 18322 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:19:12.380635 18265 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.386505 18347 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:12.387079 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.387182 17937 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:12.378666 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2091) took 1870 ms. Trace:
I20260709 13:19:12.399958 18265 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.389096 14300 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.390038 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:12.414706 14376 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.391650 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:12.415362 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.398169 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.382252 18270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.014s	sys 0.011s
I20260709 13:19:12.390784 18055 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:19:12.396678 18325 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.411908 14301 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.427400 14896 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.412444 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.428277 14226 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:12.378118 17895 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.431988 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.432796 14224 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:12.392218 18355 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.361500 18091 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.380424 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:12.434509 14897 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:12.400449 14378 rpcz_store.cc:276] 0709 13:19:10.508144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.508275 (+   131us) service_pool.cc:224] Handling call
0709 13:19:10.534617 (+ 26342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:10.550967 (+ 16350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.550997 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:10.586006 (+ 35009us) log.cc:844] Serialized 52 byte log entry
0709 13:19:10.898695 (+312689us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:10.898763 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.898875 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.287486 (+1388611us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:12.366459 (+ 78973us) raft_consensus.cc:1685] finished
0709 13:19:12.366480 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.378584 (+ 12104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5854,"raft.queue_time_us":34902,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":10956,"spinlock_wait_cycles":9056512,"thread_start_us":268200,"threads_started":1,"wal-append.queue_time_us":435447}
I20260709 13:19:12.435663 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:12.436424 14378 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:12.440801 14341 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:12.441912 14378 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:12.426513 14899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1008) took 1540 ms (client timeout 1845 ms). Trace:
I20260709 13:19:12.431510 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.402001 17937 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:12.441810 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:12.442456 14899 rpcz_store.cc:269] 0709 13:19:10.885930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.946479 (+ 60549us) service_pool.cc:224] Handling call
0709 13:19:12.426306 (+1479827us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400611054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:12.426452 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330884480}
I20260709 13:19:12.425520 18322 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:12.417012 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:12.448410 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:12.444757 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:12.445621 14300 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:12.446573 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:12.398954 18319 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:12.450562 14897 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.449220 14192 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:12.460165 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.454627 14224 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.456107 14226 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.461607 14378 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:12.429615 18325 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.467468 14227 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:12.435851 18355 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.434289 17952 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:12.424072 18347 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:19:12.456653 17937 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.462428 17967 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.458532 18354 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:12.428906 18352 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.516251 14300 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:12.501039 14897 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
W20260709 13:19:12.518743 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45965.2us
I20260709 13:19:12.463943 18376 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:12.468338 18274 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.530995 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:12.463819 17595 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:12.524712 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80979.4us
I20260709 13:19:12.462867 18270 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:12.545464 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:12.547541 14375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2103) took 1462 ms (client timeout 1926 ms). Trace:
I20260709 13:19:12.465528 18339 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:12.466471 17962 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:12.447911 18322 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:12.542047 14344 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.515525 18343 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:12.470288 18210 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
W20260709 13:19:12.548089 14375 rpcz_store.cc:269] 0709 13:19:11.077446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.115607 (+ 38161us) service_pool.cc:224] Handling call
0709 13:19:12.537318 (+1421711us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b5400334d54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:12.539820 (+  2502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191479552}
I20260709 13:19:12.443490 18091 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.523139 18354 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:12.466279 18330 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:19:12.542075 18376 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.498464 18304 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:19:12.526176 17967 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.458043 18286 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.546550 14897 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:12.584052 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.624408 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:12.625557 18273 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:12.626042 18273 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.626413 18273 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.628732 17932 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:12.629197 17932 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:12.631070 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:12.632632 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:12.546468 17595 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.630131 17932 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:12.650550 17932 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:12.651044 18289 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 13:19:12.633594 18221 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:12.635304 18359 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.841s	user 0.004s	sys 0.000s
I20260709 13:19:12.635387 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:12.682993 14896 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:12.683285 14297 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:12.685447 14297 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:12.561149 17789 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:12.543865 18347 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.638037 17967 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:12.583457 17952 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.549098 18257 consensus_queue.cc:1059] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:19:12.638975 18376 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:12.639528 18280 consensus_meta.cc:287] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.504s	user 0.000s	sys 0.009s
W20260709 13:19:12.640152 18369 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.554s	user 0.000s	sys 0.001s
I20260709 13:19:12.639890 18265 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.640964 18294 raft_consensus.cc:3055] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:12.641693 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:12.690303 18328 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:12.642964 18091 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:12.558506 18270 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:12.644898 14897 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.731578 14375 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:12.698396 18166 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.690148 14297 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:19:12.691293 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 110731us
I20260709 13:19:12.736953 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:12.600939 18374 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:19:12.552891 18339 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.599468 18352 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:12.652616 17595 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.556005 17962 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.652894 18354 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.641976 18145 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:12.718109 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 260839us
W20260709 13:19:12.719472 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 196541us
I20260709 13:19:12.720659 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:12.733992 14897 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:12.649060 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:12.756307 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.741529 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 351347us
I20260709 13:19:12.716416 18264 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:12.725916 18270 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:12.729950 18300 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.004s
I20260709 13:19:12.715603 18294 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:12.741925 17952 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.722554 18328 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:12.697103 18347 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.757364 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:12.714673 18280 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:12.763360 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 114411us
I20260709 13:19:12.764528 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:12.763281 18366 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:12.592165 18322 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.743561 18339 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.774390 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:12.770989 18265 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:12.754808 17962 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.795245 18328 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.799036 14897 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:12.757573 18264 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:12.773075 17896 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:12.742455 18166 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:12.806197 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.787912 18257 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:12.807817 18388 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.821722 18351 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.812587 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:12.808436 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1011) took 1921 ms. Trace:
I20260709 13:19:12.816491 14376 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 12. Ops: []
I20260709 13:19:12.817413 14901 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:12.801522 18352 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:12.831360 14898 rpcz_store.cc:276] 0709 13:19:10.886828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.058408 (+171580us) service_pool.cc:224] Handling call
0709 13:19:11.216718 (+158310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.252358 (+ 35640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.808202 (+1555844us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b54005212d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:12.808370 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206909312}
I20260709 13:19:12.843919 18257 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:12.845065 14898 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:12.831199 18322 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:12.823702 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49474.8us
I20260709 13:19:12.769773 17937 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.845566 18166 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:12.796545 18386 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:19:12.796485 18384 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:19:12.848286 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:12.849349 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50709.3us
I20260709 13:19:12.814579 18366 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.788358 18300 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:12.856426 14898 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:12.868842 14221 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:12.796375 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 729) took 1036 ms. Trace:
I20260709 13:19:12.830264 18388 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:12.883512 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.848992 18352 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:12.845063 18257 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.874063 14296 rpcz_store.cc:276] 0709 13:19:11.758982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.300598 (+541616us) service_pool.cc:224] Handling call
0709 13:19:12.301030 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.306268 (+  5238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.306305 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.314520 (+  8215us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.396486 (+ 81966us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:12.401401 (+  4915us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.642918 (+241517us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b180037fde0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:19:12.794598 (+151680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.794685 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.794735 (+    50us) raft_consensus.cc:1685] finished
0709 13:19:12.794839 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.794978 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":222,"prepare.queue_time_us":5259,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":24345,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":16924,"spinlock_wait_cycles":17486592,"thread_start_us":433416,"threads_started":2,"wal-append.queue_time_us":183433}
I20260709 13:19:12.891058 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:12.892350 14300 raft_consensus.cc:2410] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:12.896912 14374 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:12.899657 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2462) took 1202 ms. Trace:
I20260709 13:19:12.901991 18284 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:12.902520 18284 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:12.902583 18386 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:12.903476 18284 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.905659 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:12.900079 14222 rpcz_store.cc:276] 0709 13:19:11.697847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.697990 (+   143us) service_pool.cc:224] Handling call
0709 13:19:11.737430 (+ 39440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.169951 (+432521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.899435 (+729484us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b540033de54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:12.899600 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992485248}
I20260709 13:19:12.917470 14898 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:12.898645 18351 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:12.924853 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:12.922894 14898 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:12.927006 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:12.946095 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:12.946734 17952 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:12.915457 18270 raft_consensus.cc:2764] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:12.868844 18264 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:12.949899 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:12.922871 18284 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:12.955121 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:12.944124 18399 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:19:12.907131 18273 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.963876 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:12.971566 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.978756 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:12.980739 18394 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:12.982523 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:12.983232 14295 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:12.983801 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1048) took 1072 ms. Trace:
W20260709 13:19:12.986068 14267 leader_election.cc:336] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.922s (SENT)
I20260709 13:19:12.986763 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.988813 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:12.959615 18288 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:12.984200 14899 rpcz_store.cc:276] 0709 13:19:11.911098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.552102 (+641004us) service_pool.cc:224] Handling call
0709 13:19:12.560301 (+  8199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.584344 (+ 24043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.584389 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.591093 (+  6704us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.741276 (+150183us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:12.741671 (+   395us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.743018 (+  1347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.747344 (+  4326us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.983556 (+236212us) raft_consensus.cc:1685] finished
0709 13:19:12.983578 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.983736 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2095,"raft.queue_time_us":2188,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":9806,"thread_start_us":109297,"threads_started":1,"wal-append.queue_time_us":243370}
I20260709 13:19:13.015481 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:13.031065 14893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 977) took 1234 ms (client timeout 1558 ms). Trace:
I20260709 13:19:13.016075 17595 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.987530 18280 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:13.035496 18366 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:13.039120 17595 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:13.023236 18396 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
I20260709 13:19:13.047258 18300 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:12.985581 18270 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:19:13.001374 18347 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:12.971213 18325 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:13.051011 18325 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:13.059994 18273 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:13.062764 18388 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:13.067962 18263 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.821s	user 0.013s	sys 0.002s
W20260709 13:19:13.060302 18355 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.524s	user 0.004s	sys 0.005s
W20260709 13:19:13.027238 18398 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:19:13.068113 18354 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:12.967008 18264 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.028276 17967 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:13.033932 18288 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.956748 18352 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:13.078233 17937 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:13.104288 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1045) took 1194 ms. Trace:
I20260709 13:19:13.022037 18376 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:13.107059 18376 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:13.109207 18354 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:13.109521 18356 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.358s	user 0.004s	sys 0.000s
I20260709 13:19:13.078914 18361 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:13.080526 18403 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:19:13.080785 18246 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:13.122290 18246 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:13.123829 14299 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:13.084833 18328 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:13.088498 17962 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:13.071256 17952 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:13.033406 14893 rpcz_store.cc:269] 0709 13:19:11.796665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.802332 (+  5667us) service_pool.cc:224] Handling call
0709 13:19:13.015299 (+1212967us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:19:13.030982 (+ 15683us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7909760}
I20260709 13:19:13.101779 18288 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:13.104705 14896 rpcz_store.cc:276] 0709 13:19:11.910059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.910226 (+   167us) service_pool.cc:224] Handling call
0709 13:19:12.427264 (+517038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.684154 (+256890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.104058 (+419904us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400611050. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:13.104220 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156172544}
I20260709 13:19:13.112283 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1022) took 1832 ms. Trace:
I20260709 13:19:13.114217 18339 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:13.115001 18377 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.704s	user 0.003s	sys 0.000s
I20260709 13:19:13.123517 18246 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:13.073272 18263 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:13.101153 18355 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:13.127995 14900 rpcz_store.cc:276] 0709 13:19:11.279710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.280023 (+   313us) service_pool.cc:224] Handling call
0709 13:19:11.346313 (+ 66290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.414845 (+ 68532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.414880 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.462439 (+ 47559us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.602272 (+139833us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:11.602402 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.602655 (+   253us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.108776 (+1506121us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:13.111833 (+  3057us) raft_consensus.cc:1685] finished
0709 13:19:13.111866 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.112199 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20763,"raft.queue_time_us":30486,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":11775,"spinlock_wait_cycles":196996864,"thread_start_us":201062,"threads_started":2,"wal-append.queue_time_us":217605}
I20260709 13:19:13.132437 18246 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.133908 18339 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:13.133957 18328 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:13.169231 17962 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:13.171515 18355 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:13.169524 18263 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:13.148031 18288 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:13.852730 18288 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:13.868289 18380 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.460s	user 0.000s	sys 0.014s
I20260709 13:19:13.872771 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1021) took 2593 ms. Trace:
W20260709 13:19:13.874639 18246 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.739s	user 0.009s	sys 0.001s
I20260709 13:19:13.873260 14892 rpcz_store.cc:276] 0709 13:19:11.279367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.279920 (+   553us) service_pool.cc:224] Handling call
0709 13:19:11.345606 (+ 65686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.352620 (+  7014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.352659 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.362881 (+ 10222us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.282358 (+919477us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b18004442e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:19:12.374814 (+ 92456us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:12.374958 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.375027 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.867525 (+1492498us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:13.872510 (+  4985us) raft_consensus.cc:1685] finished
0709 13:19:13.872533 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.872697 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6459,"raft.queue_time_us":23246,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":13402,"spinlock_wait_cycles":35431680,"thread_start_us":92268,"threads_started":1,"wal-append.queue_time_us":1030232}
W20260709 13:19:13.872777 14378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.033s	sys 0.038s
W20260709 13:19:13.876518 14378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.033s	sys 0.038s
I20260709 13:19:13.877745 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2349) took 1231 ms. Trace:
I20260709 13:19:13.878373 14378 rpcz_store.cc:276] 0709 13:19:12.646608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.838742 (+192134us) service_pool.cc:224] Handling call
0709 13:19:12.851153 (+ 12411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.861769 (+ 10616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.861844 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.866997 (+  5153us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.877283 (+1010286us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:13.877335 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.877433 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.877492 (+    59us) raft_consensus.cc:1685] finished
0709 13:19:13.877509 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.877677 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9754,"raft.queue_time_us":7469,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5647,"thread_start_us":971652,"threads_started":1,"wal-append.queue_time_us":234681}
I20260709 13:19:13.881664 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:13.883827 14378 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:13.884827 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2129) took 1108 ms. Trace:
I20260709 13:19:13.885347 14378 rpcz_store.cc:276] 0709 13:19:12.776749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.883163 (+1106414us) service_pool.cc:224] Handling call
0709 13:19:13.883572 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.884421 (+   849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.884752 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:13.927199 18221 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:13.927778 18221 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:13.928769 18221 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:13.931377 18221 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:13.979455 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.01557e+06us
I20260709 13:19:14.007110 14372 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:14.007934 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1024) took 1113 ms. Trace:
I20260709 13:19:14.008275 14372 rpcz_store.cc:276] 0709 13:19:12.894220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.006554 (+1112334us) service_pool.cc:224] Handling call
0709 13:19:14.006917 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.007640 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.007874 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.011519 14341 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:14.015318 18413 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.737s	user 0.007s	sys 0.003s
I20260709 13:19:14.027999 18221 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:14.028654 18221 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.030881 18221 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.036403 14373 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:19:14.037961 14111 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 37975f772fc648329a8acae36d33a345 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 181bbac22422408c87cd13b7fe3008f9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:14.038465 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1015) took 2104 ms. Trace:
I20260709 13:19:14.039206 14377 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:14.039865 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.040536 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2126) took 1720 ms. Trace:
I20260709 13:19:14.040926 14377 rpcz_store.cc:276] 0709 13:19:12.319756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.599919 (+280163us) service_pool.cc:224] Handling call
0709 13:19:12.600251 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.039672 (+1439421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.040305 (+   633us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540025a3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:14.040478 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3308852992}
I20260709 13:19:14.038859 14373 rpcz_store.cc:276] 0709 13:19:11.934326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.388083 (+453757us) service_pool.cc:224] Handling call
0709 13:19:12.388411 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.036883 (+1648472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.038208 (+  1325us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400259ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:14.038404 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3789407616}
I20260709 13:19:14.043737 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1051) took 1725 ms. Trace:
I20260709 13:19:14.044219 14901 rpcz_store.cc:276] 0709 13:19:12.318046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.841659 (+523613us) service_pool.cc:224] Handling call
0709 13:19:12.845539 (+  3880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.953584 (+108045us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:12.994091 (+ 40507us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.003783 (+1009692us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b180034a860. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a 00007f8ded096a2a
0709 13:19:14.012178 (+  8395us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.012731 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.012872 (+   141us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:14.043023 (+ 30151us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.043298 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.043385 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.043537 (+   152us) raft_consensus.cc:1685] finished
0709 13:19:14.043553 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.043681 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":70296,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":89,"raft.queue_time_us":36173,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":181,"spinlock_wait_cycles":35800320,"thread_start_us":145514,"threads_started":3,"wal-append.queue_time_us":996022}
W20260709 13:19:14.054955 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 1.06882e+06us
I20260709 13:19:14.056972 18419 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:14.057695 18419 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.060671 18419 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:14.072582 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.073414 18416 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:14.074260 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 980) took 1474 ms. Trace:
I20260709 13:19:14.074345 18416 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:14.075160 18416 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:14.076045 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.074802 14220 rpcz_store.cc:276] 0709 13:19:12.599917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.600140 (+   223us) service_pool.cc:224] Handling call
0709 13:19:12.600501 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.600848 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.600875 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.601411 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.794737 (+193326us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:12.794797 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.794884 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.074011 (+1279127us) raft_consensus.cc:1685] finished
0709 13:19:14.074032 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.074195 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2250,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":24495,"thread_start_us":192888,"threads_started":1,"wal-append.queue_time_us":218760}
I20260709 13:19:14.087009 18416 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.088510 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:14.088585 18416 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.089447 18416 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.092597 18416 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.084758 18315 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.094367 18315 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:14.098018 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:14.099076 14377 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:14.106547 18416 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.107545 18416 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.108232 14226 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
I20260709 13:19:14.109992 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 984) took 1150 ms. Trace:
I20260709 13:19:14.110546 14226 rpcz_store.cc:276] 0709 13:19:12.959425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.959578 (+   153us) service_pool.cc:224] Handling call
0709 13:19:14.109776 (+1150198us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540026cad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:14.109910 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2595628288}
W20260709 13:19:14.119658 14295 consensus_meta.cc:287] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.136s	user 0.012s	sys 0.008s
I20260709 13:19:14.121817 14295 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:14.110639 18416 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:14.130021 14295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 735) took 2342 ms (client timeout 1870 ms). Trace:
I20260709 13:19:14.130643 18416 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:14.131456 18421 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.131568 18416 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.134382 18416 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.134709 18422 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:19:14.143503 18421 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.143877 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:14.152390 14226 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.156672 18358 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.157287 18358 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.164171 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.164940 14300 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:19:14.165508 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2566) took 1404 ms. Trace:
I20260709 13:19:14.147569 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:14.150581 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.183704 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.184526 14222 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:14.150707 14227 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:14.151393 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:14.168123 14375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.378s	user 0.021s	sys 0.025s
W20260709 13:19:14.146461 14302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2555) took 2458 ms (client timeout 2135 ms). Trace:
I20260709 13:19:14.169409 18416 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:14.171368 18358 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.194491 18358 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.193354 18416 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.198063 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:14.186295 14302 rpcz_store.cc:269] 0709 13:19:11.688187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.146211 (+2458024us) service_pool.cc:211] Skipping call since client already timed out
0709 13:19:14.146368 (+   157us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:19:14.130580 14295 rpcz_store.cc:269] 0709 13:19:11.780538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.982217 (+1201679us) service_pool.cc:224] Handling call
0709 13:19:14.122389 (+1140172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:14.193454 14375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.022s	sys 0.025s
I20260709 13:19:14.187347 14300 rpcz_store.cc:276] 0709 13:19:12.760565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.163822 (+1403257us) service_pool.cc:224] Handling call
0709 13:19:14.165441 (+  1619us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.192539 14226 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:14.201402 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:14.202013 14300 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.202250 18416 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.202869 18416 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:14.203346 18416 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.203694 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.204258 14224 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:19:14.205542 18416 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.206202 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:14.206359 18358 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.209050 18358 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.210485 18421 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.211180 18319 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:14.211611 18319 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:14.212114 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.212929 14222 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:14.212603 18319 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.213975 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.214764 14226 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:14.214995 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.217626 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.218308 14226 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:14.209036 14300 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:14.220574 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2568) took 1459 ms. Trace:
I20260709 13:19:14.220772 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:14.222115 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 86639.2us
W20260709 13:19:14.221596 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.223079 14224 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:14.225461 14295 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:19:14.226135 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 736) took 1465 ms. Trace:
I20260709 13:19:14.226446 14295 rpcz_store.cc:276] 0709 13:19:12.761022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.200119 (+1439097us) service_pool.cc:224] Handling call
0709 13:19:14.225892 (+ 25773us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.226219 18304 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:14.228121 18319 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.206140 18416 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:14.230022 18416 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.232107 18416 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.232860 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:14.233981 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:14.234838 14295 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.235200 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.236001 14296 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:14.228190 18304 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:14.236407 14296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 741) took 1474 ms (client timeout 1828 ms). Trace:
W20260709 13:19:14.236788 14296 rpcz_store.cc:269] 0709 13:19:12.761724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.983252 (+221528us) service_pool.cc:224] Handling call
0709 13:19:14.236346 (+1253094us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.237713 18304 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.220888 14300 rpcz_store.cc:276] 0709 13:19:12.760870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.201143 (+1440273us) service_pool.cc:224] Handling call
0709 13:19:14.220518 (+ 19375us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.238711 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:14.237722 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.246938 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.248095 14224 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.248766 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 744) took 1486 ms. Trace:
I20260709 13:19:14.250543 14296 rpcz_store.cc:276] 0709 13:19:12.762796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.237458 (+1474662us) service_pool.cc:224] Handling call
0709 13:19:14.248703 (+ 11245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.255259 14295 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:14.255766 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2563) took 1495 ms. Trace:
I20260709 13:19:14.255865 14867 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:14.256067 14295 rpcz_store.cc:276] 0709 13:19:12.760123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.233712 (+1473589us) service_pool.cc:224] Handling call
0709 13:19:14.255719 (+ 22007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.247815 18358 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:14.256933 18304 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:14.257279 18358 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.258335 14270 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:14.258466 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:14.259445 18358 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.259848 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:14.260056 18358 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:14.259697 18425 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:14.261126 18425 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:14.262084 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 740) took 1500 ms. Trace:
I20260709 13:19:14.262465 14300 rpcz_store.cc:276] 0709 13:19:12.761586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.238989 (+1477403us) service_pool.cc:224] Handling call
0709 13:19:14.262029 (+ 23040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.259755 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:14.263873 14867 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:14.264230 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 728) took 2505 ms. Trace:
I20260709 13:19:14.264737 18315 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:14.264659 14301 rpcz_store.cc:276] 0709 13:19:11.758702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.184605 (+425903us) service_pool.cc:224] Handling call
0709 13:19:12.217140 (+ 32535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.427626 (+210486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.262579 (+1834953us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54003ee4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:14.264173 (+  1594us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447311744}
I20260709 13:19:14.265779 14867 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:14.266583 18315 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.268038 18304 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:14.268483 18304 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.268821 18304 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.270368 14224 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:14.272389 18298 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:19:14.272960 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.273450 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.273989 18298 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:14.274379 18298 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:14.250162 18262 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 13:19:14.276420 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.277647 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2652) took 1972 ms. Trace:
I20260709 13:19:14.279507 14295 rpcz_store.cc:276] 0709 13:19:12.305458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.276828 (+1971370us) service_pool.cc:224] Handling call
0709 13:19:14.277142 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.277320 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.277348 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.277387 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:14.277428 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.277490 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.277594 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.278349 18298 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.282159 14295 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:14.263324 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:14.282862 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2564) took 1522 ms. Trace:
I20260709 13:19:14.283239 14295 rpcz_store.cc:276] 0709 13:19:12.760274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.280871 (+1520597us) service_pool.cc:224] Handling call
0709 13:19:14.281655 (+   784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.282622 (+   967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.282810 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.284492 14295 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:14.285051 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2565) took 1524 ms. Trace:
I20260709 13:19:14.285194 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:14.285400 14295 rpcz_store.cc:276] 0709 13:19:12.760422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.284027 (+1523605us) service_pool.cc:224] Handling call
0709 13:19:14.284345 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.284828 (+   483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.285002 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.275226 18330 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:19:14.286361 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:14.287106 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 739) took 1525 ms. Trace:
I20260709 13:19:14.287808 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:14.288463 14301 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:14.288443 14377 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:14.287536 14295 rpcz_store.cc:276] 0709 13:19:12.761451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.286274 (+1524823us) service_pool.cc:224] Handling call
0709 13:19:14.286634 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.286799 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.286826 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.286862 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:14.286890 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.286938 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.287055 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.289443 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2562) took 1529 ms. Trace:
I20260709 13:19:14.289525 14867 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:14.290047 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:14.290221 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:14.289891 14301 rpcz_store.cc:276] 0709 13:19:12.759939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.275644 (+1515705us) service_pool.cc:224] Handling call
0709 13:19:14.288308 (+ 12664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.289228 (+   920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.289394 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.286351 18298 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.297155 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 742) took 1535 ms. Trace:
I20260709 13:19:14.297637 14295 rpcz_store.cc:276] 0709 13:19:12.762277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.289654 (+1527377us) service_pool.cc:224] Handling call
0709 13:19:14.296121 (+  6467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.296809 (+   688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.296849 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.296891 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:14.296924 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.297011 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.297104 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.299016 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:14.303018 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:14.304229 14377 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:14.293959 18426 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:14.306691 18426 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:14.308457 14301 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:14.309376 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 743) took 1546 ms. Trace:
I20260709 13:19:14.309820 14301 rpcz_store.cc:276] 0709 13:19:12.762549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.295752 (+1533203us) service_pool.cc:224] Handling call
0709 13:19:14.308214 (+ 12462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.309042 (+   828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.309301 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.302927 18416 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:14.303558 18262 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.315769 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.317095 18330 raft_consensus.cc:3055] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:14.305824 18423 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:14.326205 18423 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.327688 18430 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:14.327769 18423 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.316439 18429 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:14.325956 18425 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:14.326315 18330 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:14.334265 18315 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:14.352156 18416 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.352932 18429 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.357280 18430 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:14.370440 18429 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.374950 18425 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:14.404529 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 114537us
W20260709 13:19:14.414175 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 124695us
W20260709 13:19:14.420595 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.325891 18262 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.420357 18416 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.334017 18426 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.437000 18304 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.463207 18330 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.474215 18430 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.492681 18426 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.494009 18304 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.494768 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:14.495570 14222 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:19:14.511029 18436 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.076s	user 0.004s	sys 0.000s
I20260709 13:19:14.511828 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2343) took 2450 ms. Trace:
I20260709 13:19:14.512459 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2569) took 1670 ms. Trace:
I20260709 13:19:14.512852 14295 rpcz_store.cc:276] 0709 13:19:12.841904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.298484 (+1456580us) service_pool.cc:224] Handling call
0709 13:19:14.311462 (+ 12978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.311754 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.311791 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.316257 (+  4466us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.355865 (+ 39608us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:14.355905 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.355980 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.512246 (+156266us) raft_consensus.cc:1685] finished
0709 13:19:14.512271 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.512405 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":17389,"threads_started":1,"wal-append.queue_time_us":29945}
I20260709 13:19:14.480823 18425 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.518364 18430 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.518662 18262 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.519289 18262 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.519038 18430 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.512251 14376 rpcz_store.cc:276] 0709 13:19:12.061140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.415995 (+354855us) service_pool.cc:224] Handling call
0709 13:19:12.416266 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.832383 (+416117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.511559 (+1679176us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54000b9d54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:14.511762 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920019840}
W20260709 13:19:14.519176 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 1.53033e+06us
W20260709 13:19:14.521538 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3580097520000436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 13:19:14.480314 18434 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:14.522085 18330 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:14.530840 18416 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.533039 18429 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:14.527002 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 228053us
I20260709 13:19:14.537226 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:14.535955 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:14.538110 14221 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.538563 18367 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:14.539235 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.541666 14222 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:14.519816 18262 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.539742 18343 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.540479 18221 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.551038 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:14.536964 18430 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.551774 18343 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.556754 18343 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.535449 18434 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.557291 18343 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:14.557982 18416 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:14.539727 18441 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.559724 14270 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:14.561985 18221 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.554241 18429 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:14.551617 18449 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:14.568836 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.577244 18449 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:14.577752 18449 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:14.569931 18441 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.575778 18262 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:14.585361 14298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 734) took 2805 ms (client timeout 2148 ms). Trace:
W20260709 13:19:14.587387 14298 rpcz_store.cc:269] 0709 13:19:11.780032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.585158 (+2805126us) service_pool.cc:211] Skipping call since client already timed out
0709 13:19:14.585273 (+   115us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:19:14.590366 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.549897 18367 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.593602 18423 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.595057 18367 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.596614 14221 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:19:14.567847 18221 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.558808 18343 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:14.596774 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.602161 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:14.602957 14299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 737) took 1841 ms (client timeout 1690 ms). Trace:
W20260709 13:19:14.603387 14299 rpcz_store.cc:269] 0709 13:19:12.761163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.954375 (+193212us) service_pool.cc:224] Handling call
0709 13:19:14.602752 (+1648377us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400333e54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:14.602873 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349734656}
I20260709 13:19:14.604480 14300 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:14.606478 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.609652 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.610569 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.610759 17932 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:14.597167 18262 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:14.618799 18441 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.619397 18441 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:14.619269 17932 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.619935 18441 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.620905 18449 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.622219 18441 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:14.622445 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.609405 18221 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:14.605937 18423 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.624202 18221 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.625101 18416 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:14.612298 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.614240 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.607647 18429 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:14.616776 18434 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.638134 14223 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:14.639075 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:14.639698 14226 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:14.640551 14270 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:14.621598 17932 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.633778 18367 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:14.644151 18367 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.645197 18429 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:14.646199 18429 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.612615 18343 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:14.650071 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.658928 18392 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.941s	user 0.008s	sys 0.005s
I20260709 13:19:14.660452 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2046) took 2791 ms. Trace:
I20260709 13:19:14.661931 18221 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.661199 14225 rpcz_store.cc:276] 0709 13:19:11.868555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.074325 (+205770us) service_pool.cc:224] Handling call
0709 13:19:12.074843 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.075184 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.075213 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.627277 (+552064us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b2c000edf88. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb985a11 00007f8deb995372 00007f8ded0c7a01 00007f8ded08c43a 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2
0709 13:19:12.627706 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.724412 (+ 96706us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:12.724467 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.724553 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.658398 (+1933845us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:14.660031 (+  1633us) raft_consensus.cc:1685] finished
0709 13:19:14.660061 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.660302 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40057984,"thread_start_us":96245,"threads_started":1,"wal-append.queue_time_us":89548}
W20260709 13:19:14.667024 14374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2118) took 2854 ms (client timeout 3122 ms). Trace:
W20260709 13:19:14.667634 14374 rpcz_store.cc:269] 0709 13:19:11.812432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.260435 (+448003us) service_pool.cc:224] Handling call
0709 13:19:14.666680 (+2406245us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400258fd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:14.666890 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460743040}
I20260709 13:19:14.669641 18449 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.670233 14369 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:14.679287 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.681140 14226 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:14.697769 14229 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:14.708400 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.719585 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79197.5us
W20260709 13:19:14.722697 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.724747 14229 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:14.725442 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2470) took 2825 ms. Trace:
I20260709 13:19:14.725749 14229 rpcz_store.cc:276] 0709 13:19:11.899894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.078662 (+178768us) service_pool.cc:224] Handling call
0709 13:19:12.078996 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.697165 (+2618169us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b5800729ed0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8decfe80aa 00007f8ded06a447 00007f8ded082fe7 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4
0709 13:19:14.725179 (+ 28014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.725388 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5932907264}
I20260709 13:19:14.727264 18423 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:14.734169 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.728961 18456 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:19:14.740787 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1030) took 2719 ms. Trace:
I20260709 13:19:14.745625 18449 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 13:19:14.747076 14267 leader_election.cc:336] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.920s (SENT)
I20260709 13:19:14.750574 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:14.752303 18425 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:14.758571 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2651) took 2513 ms. Trace:
I20260709 13:19:14.759003 14300 rpcz_store.cc:276] 0709 13:19:12.245363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.277022 (+2031659us) service_pool.cc:224] Handling call
0709 13:19:14.604316 (+327294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.604914 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.758360 (+153446us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b5400333e50. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:14.758507 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752131328}
I20260709 13:19:14.728443 18444 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.775956 18444 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.775138 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2130) took 1998 ms. Trace:
I20260709 13:19:14.776815 14378 rpcz_store.cc:276] 0709 13:19:12.777156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.886454 (+1109298us) service_pool.cc:224] Handling call
0709 13:19:13.886943 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.597959 (+711016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.597989 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.604688 (+  6699us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.728028 (+123340us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:14.728184 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.728257 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.774905 (+ 46648us) raft_consensus.cc:1685] finished
0709 13:19:14.774926 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.775074 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":632517,"thread_start_us":172381,"threads_started":2,"wal-append.queue_time_us":159851}
I20260709 13:19:14.778162 18444 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.760812 14897 rpcz_store.cc:276] 0709 13:19:12.021911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.824609 (+802698us) service_pool.cc:224] Handling call
0709 13:19:12.825081 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.883053 (+ 57972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.883085 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.885209 (+  2124us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.953384 (+ 68175us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:12.953423 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.061991 (+108568us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:14.740324 (+1678333us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b54007add54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:14.740405 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.740471 (+    66us) raft_consensus.cc:1685] finished
0709 13:19:14.740491 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.740707 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21807,"raft.run_cpu_time_us":37,"raft.run_wall_time_us":36,"spinlock_wait_cycles":125996672,"thread_start_us":102233,"threads_started":2,"wal-append.queue_time_us":141244,"wal-append.run_cpu_time_us":5704,"wal-append.run_wall_time_us":1730161}
W20260709 13:19:14.794284 14371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2344) took 2727 ms (client timeout 1692 ms). Trace:
W20260709 13:19:14.794904 14371 rpcz_store.cc:269] 0709 13:19:12.066771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.097615 (+ 30844us) service_pool.cc:224] Handling call
0709 13:19:14.794006 (+2696391us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b54001b9ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:14.794183 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98537344}
I20260709 13:19:14.797596 14894 raft_consensus.cc:606] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:14.798156 14894 raft_consensus.cc:614] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:14.799489 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58440 (request call id 10) took 2887 ms. Trace:
I20260709 13:19:14.799906 14894 rpcz_store.cc:276] 0709 13:19:11.912006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.918029 (+  6023us) service_pool.cc:224] Handling call
0709 13:19:14.799277 (+2881248us) spinlock_profiling.cc:243] Waited 2.88 s on lock 0x7b54005d07d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded086853 00007f8df205460a 00007f8deb5da7d4 00007f8deb5da762 00007f8deb5da691 00007f8deb5da60c 00007f8deb5d98c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:14.799402 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6620550528}
I20260709 13:19:14.808905 18270 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:14.826169 18270 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:14.822199 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.828012 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.829130 14301 raft_consensus.cc:2410] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:14.822901 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:14.830225 14302 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:14.823797 14298 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:14.824707 14295 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:14.818399 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.850980 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:14.845536 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.854135 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 110518us
W20260709 13:19:14.855386 14193 connection.cc:256] RPC call timeout handler was delayed by -1.2582386710000719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
I20260709 13:19:14.855350 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:14.856544 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.858316 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:14.859719 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.861616 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.862752 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:14.862258 14301 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:19:14.844890 18274 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.844625 18453 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.864851 14295 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:14.865283 18274 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.867604 18274 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.856511 18279 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:14.868316 18279 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.865622 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.873217 14302 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:14.875765 18294 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.876909 18294 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.861691 18262 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:14.878872 18262 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:14.860970 18087 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:14.881207 18087 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.881758 18330 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.882293 18330 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.883371 18087 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.857715 18450 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.886940 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.887939 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:14.888644 14897 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:14.888588 14301 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:14.864802 18221 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:14.891170 14897 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:14.896843 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.897970 14894 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:14.864773 14193 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:14.904214 18087 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:14.904716 18087 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:14.905198 18087 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.905292 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.906050 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.909165 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.907903 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.909876 14896 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:14.910593 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.911334 14894 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:19:14.912050 18279 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.915493 18332 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:14.921640 14304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2633) took 3370 ms (client timeout 1674 ms). Trace:
I20260709 13:19:14.921808 14303 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:14.922205 14304 rpcz_store.cc:269] 0709 13:19:11.551431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.561462 (+ 10031us) service_pool.cc:224] Handling call
0709 13:19:14.921362 (+3359900us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540020ab54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:14.921533 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496777472}
I20260709 13:19:14.924131 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2558) took 3235 ms. Trace:
I20260709 13:19:14.924512 14303 rpcz_store.cc:276] 0709 13:19:11.688965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.930616 (+241651us) service_pool.cc:224] Handling call
0709 13:19:14.921515 (+2990899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.922348 (+   833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.923934 (+  1586us) spinlock_profiling.cc:243] Waited 2.99 s on lock 0x7b540020ab50. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:14.924070 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6877645184}
I20260709 13:19:14.930861 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.931427 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:14.932220 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.932363 14901 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:14.931526 14301 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 4.
W20260709 13:19:14.936606 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.937605 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.938501 14301 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:14.929872 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:14.947130 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:14.947892 14301 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.949901 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.950016 14893 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:14.950736 14865 connection.cc:256] RPC call timeout handler was delayed by -1.8425558389999424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:19:14.951133 14865 connection.cc:256] RPC call timeout handler was delayed by -1.81015583899989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
I20260709 13:19:14.949019 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:14.951474 14865 connection.cc:256] RPC call timeout handler was delayed by -1.7219558389999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 13:19:14.951965 14865 connection.cc:256] RPC call timeout handler was delayed by -1.6688558389998889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:19:14.952275 14865 connection.cc:256] RPC call timeout handler was delayed by -1.5599558389999402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:19:14.952565 14865 connection.cc:256] RPC call timeout handler was delayed by -1.469955839000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 13:19:14.952811 14865 connection.cc:256] RPC call timeout handler was delayed by -1.3097558389999904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260709 13:19:14.953056 14865 connection.cc:256] RPC call timeout handler was delayed by -1.2943381090001367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 13:19:14.953297 14865 connection.cc:256] RPC call timeout handler was delayed by -1.2458558389998871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
I20260709 13:19:14.889441 18450 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:14.885366 18453 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.949716 18315 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.960197 18453 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:14.960825 18315 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.961974 18330 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:19:14.954586 18419 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:19:14.962935 18453 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:14.963323 18453 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:14.963517 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:14.964344 14225 raft_consensus.cc:2410] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:14.964408 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2648) took 2932 ms. Trace:
I20260709 13:19:14.964206 18453 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.965543 18453 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:14.967859 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:14.968595 14892 raft_consensus.cc:2368] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8.
I20260709 13:19:14.969410 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.971309 14899 raft_consensus.cc:2368] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12.
I20260709 13:19:14.971572 14892 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:14.961115 18343 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:14.964902 14297 rpcz_store.cc:276] 0709 13:19:12.031818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.736869 (+705051us) service_pool.cc:224] Handling call
0709 13:19:12.737310 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:12.737812 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.737848 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:12.738554 (+   706us) log.cc:844] Serialized 52 byte log entry
0709 13:19:12.819632 (+ 81078us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:12.820014 (+   382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.820086 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.964161 (+2144075us) raft_consensus.cc:1685] finished
0709 13:19:14.964186 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.964349 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1276,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3462,"thread_start_us":56544,"threads_started":1,"wal-append.queue_time_us":113460,"wal-append.run_cpu_time_us":6272,"wal-append.run_wall_time_us":2043813}
I20260709 13:19:14.983570 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.986929 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.987761 14899 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:14.988760 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.969875 18435 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:14.989495 14899 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:14.995497 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.954448 18279 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:14.996403 14892 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:14.997145 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:19:14.998365 14399 debug-util.cc:398] Leaking SignalData structure 0x7b0800300660 after lost signal to thread 13125
I20260709 13:19:14.998955 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:14.999114 14865 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:14.954216 18274 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:19:14.999459 14399 debug-util.cc:398] Leaking SignalData structure 0x7b080020e340 after lost signal to thread 14161
I20260709 13:19:15.000098 18435 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.000725 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:14.887310 18270 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:15.002249 18270 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.002497 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.002681 18435 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:15.003131 14897 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:15.004002 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.005054 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.995600 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:14.999258 18315 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:14.997428 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.006448 18304 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.008343 18450 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:15.008687 14228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2033) took 3753 ms (client timeout 1926 ms). Trace:
I20260709 13:19:15.006536 18251 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:15.009122 14228 rpcz_store.cc:269] 0709 13:19:11.254916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.255075 (+   159us) service_pool.cc:224] Handling call
0709 13:19:15.008476 (+3753401us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54002bcfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:15.008593 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712759680}
I20260709 13:19:15.006639 18435 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:19:15.010530 14893 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:15.011829 18251 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:15.012217 18251 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:15.013058 18251 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:14.977085 18343 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:15.018256 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 117719us
I20260709 13:19:15.005764 14897 raft_consensus.cc:2410] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:15.007159 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2337) took 3240 ms. Trace:
I20260709 13:19:15.022043 14901 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:15.008025 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.064181 14896 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:19:15.065270 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.008025 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:15.023036 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:15.023785 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.019841 14369 rpcz_store.cc:276] 0709 13:19:11.766767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.305442 (+538675us) service_pool.cc:224] Handling call
0709 13:19:14.669951 (+2364509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.670855 (+   904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.006913 (+336058us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b5400258fd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:15.007047 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5397757824}
I20260709 13:19:15.024549 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.024757 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.069551 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.007375 14892 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
W20260709 13:19:15.026822 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.070513 14899 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.028687 18426 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:19:15.034895 18367 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:15.036708 18463 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:19:15.040045 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:15.075618 14893 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:15.043267 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.050127 18087 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.023546 18343 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.028264 18251 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.054814 14895 raft_consensus.cc:2410] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:19:15.081143 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:15.059964 14301 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:19:15.060763 14224 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:15.062922 14228 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:19:15.081091 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 179328us
I20260709 13:19:15.068881 14894 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:15.071892 14897 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:15.083012 14193 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:15.080278 14892 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:19:15.073760 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:15.083966 14892 pending_rounds.cc:85] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 7
I20260709 13:19:15.084263 14892 pending_rounds.cc:107] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:19:15.084539 14892 raft_consensus.cc:2889] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:14.956257 18262 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:15.101084 14221 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:15.102841 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.103518 14894 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:15.103878 18087 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:15.104555 18422 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:15.110786 14893 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:15.111963 14897 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:15.113471 14192 leader_election.cc:400] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12.
I20260709 13:19:15.113840 14192 leader_election.cc:403] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:15.113883 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 120458us
I20260709 13:19:15.121121 18087 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:15.121421 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:15.123153 14192 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:15.123553 18087 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:15.124099 18274 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:15.124152 18087 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:15.124687 18274 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:15.125137 18274 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.121975 18419 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:15.136353 14223 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:15.122088 18450 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:19:15.128841 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 120883us
I20260709 13:19:15.140825 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:15.142181 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:15.119731 18429 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:15.143606 18429 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:15.143725 18435 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:15.144100 18429 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:15.144588 18251 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:15.105875 18298 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.145933 18298 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:15.149063 18437 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.635s	user 0.002s	sys 0.000s
I20260709 13:19:15.120087 18367 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:15.150287 18367 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:15.150520 14895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1038) took 3686 ms (client timeout 1922 ms). Trace:
I20260709 13:19:15.151221 18367 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.151948 14898 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
W20260709 13:19:15.152195 18432 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.657s	user 0.002s	sys 0.002s
I20260709 13:19:15.152369 14898 pending_rounds.cc:85] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 10
I20260709 13:19:15.152631 14898 pending_rounds.cc:107] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:19:15.152877 14898 raft_consensus.cc:2889] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:15.153599 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2650) took 3047 ms. Trace:
I20260709 13:19:15.154629 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:15.144181 14896 raft_consensus.cc:2410] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:15.157306 14899 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:15.154016 14296 rpcz_store.cc:276] 0709 13:19:12.106845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.275393 (+2168548us) service_pool.cc:224] Handling call
0709 13:19:14.288365 (+ 12972us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:14.302746 (+ 14381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.302775 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:14.306829 (+  4054us) log.cc:844] Serialized 52 byte log entry
0709 13:19:14.356770 (+ 49941us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:14.356839 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.356936 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.151632 (+794696us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:15.153334 (+  1702us) raft_consensus.cc:1685] finished
0709 13:19:15.153353 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.153544 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13973,"raft.queue_time_us":25750,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":1184,"spinlock_wait_cycles":8920704,"thread_start_us":49505,"threads_started":1,"wal-append.queue_time_us":129372}
W20260709 13:19:15.150950 14895 rpcz_store.cc:269] 0709 13:19:11.463730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.464048 (+   318us) service_pool.cc:224] Handling call
0709 13:19:15.150297 (+3686249us) spinlock_profiling.cc:243] Waited 3.54 s on lock 0x7b54007dc3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:15.150453 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8138668288}
I20260709 13:19:15.159046 14894 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:15.158440 14865 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:15.129701 18419 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:15.125322 18087 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:15.165356 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.163010 18419 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:15.161355 18251 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:15.162012 18246 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:15.166807 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:15.186193 18246 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:15.186764 18332 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:15.187201 18246 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.188108 14225 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:15.188239 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:15.189023 18332 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:15.164935 18221 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:19:15.190721 18221 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:15.161669 18453 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:19:15.172439 18343 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:15.191704 18467 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.162s	user 0.000s	sys 0.003s
I20260709 13:19:15.193495 18343 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:15.194116 18343 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:15.173527 18251 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:15.196100 18251 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:15.174939 14399 debug-util.cc:398] Leaking SignalData structure 0x7b0800265960 after lost signal to thread 14253
I20260709 13:19:15.176999 18298 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:15.203425 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4c20 after lost signal to thread 14328
W20260709 13:19:15.204205 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08002c49a0 after lost signal to thread 14329
W20260709 13:19:15.208424 14399 debug-util.cc:398] Leaking SignalData structure 0x7b080006fbe0 after lost signal to thread 14402
W20260709 13:19:15.209008 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08003d11e0 after lost signal to thread 14403
W20260709 13:19:15.217823 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08003bbd60 after lost signal to thread 14925
W20260709 13:19:15.218364 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08002bbce0 after lost signal to thread 14926
W20260709 13:19:15.249825 14399 debug-util.cc:398] Leaking SignalData structure 0x7b0800389b60 after lost signal to thread 17967
W20260709 13:19:15.250349 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08003ced40 after lost signal to thread 18288
W20260709 13:19:15.250749 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd520 after lost signal to thread 18328
I20260709 13:19:15.217639 14865 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:15.254801 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1036) took 2610 ms. Trace:
I20260709 13:19:15.255306 14898 rpcz_store.cc:276] 0709 13:19:12.644242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.971020 (+326778us) service_pool.cc:224] Handling call
0709 13:19:15.151539 (+2180519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:15.153287 (+  1748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.251010 (+ 97723us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54007dc3d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:15.254716 (+  3706us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4976131840}
W20260709 13:19:15.275332 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.276633 14267 leader_election.cc:336] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 2.478s (SENT)
W20260709 13:19:15.281111 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 91777.5us
W20260709 13:19:15.282542 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.283409 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:15.284247 14898 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.294492 18461 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.298521 18461 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.301319 18461 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:15.294804 18358 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.302372 18358 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.305011 18358 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:15.294492 18426 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.306149 18426 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:15.307505 18450 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12.
I20260709 13:19:15.308444 18450 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:15.308825 18450 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:15.308911 18426 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:15.315800 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:15.316709 14898 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:15.316826 14229 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
W20260709 13:19:15.321470 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc320 after lost signal to thread 18354
W20260709 13:19:15.321883 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1260 after lost signal to thread 18355
W20260709 13:19:15.322160 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3240 after lost signal to thread 18361
I20260709 13:19:15.324051 18419 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:15.326704 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.3452e+06us
W20260709 13:19:15.330101 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 1.31855e+06us
I20260709 13:19:15.253643 18298 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:19:15.332168 18355 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:15.319291 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:15.258373 18304 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:19:15.272060 18315 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:19:15.335359 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.336120 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 814259us
I20260709 13:19:15.337942 18474 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:15.318377 18435 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:15.340948 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 175124us
I20260709 13:19:15.351915 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:15.354516 18279 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:15.355165 14127 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:15.356856 14193 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:15.356802 14127 catalog_manager.cc:5697] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 7 to 8, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 8 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.359455 14127 catalog_manager.cc:5697] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 4 to 6, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 6 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:15.361630 18279 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:15.362108 18279 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.362473 18279 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.361428 14127 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 6 to 8, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 8 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.368929 14127 catalog_manager.cc:5697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 2 to 5, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 5 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.370326 18279 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.370694 14127 catalog_manager.cc:5697] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 1 to 6, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 6 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:15.366788 14125 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36074 (request call id 214) took 14887 ms (client timeout 15000 ms). Trace:
I20260709 13:19:15.374832 18343 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.375394 18343 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:15.376276 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:15.377475 18343 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:15.378321 18279 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:15.374449 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:15.381844 18343 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:15.382575 18279 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:15.383337 18279 consensus_queue.cc:1243] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:15.384776 18279 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:15.373728 14127 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:15.391455 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:15.407017 14299 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.391978 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:15.392572 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:15.409535 14296 raft_consensus.cc:2410] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:19:15.393464 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:15.394361 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:15.410615 14302 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:15.395174 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:15.395995 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:15.412768 14301 raft_consensus.cc:2410] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:15.396857 18279 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:15.398866 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:15.428449 14303 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.348105 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:15.341872 18076 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:15.343173 18419 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:15.432037 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 84049.1us
W20260709 13:19:15.433022 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 101731us
W20260709 13:19:15.434751 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 217192us
I20260709 13:19:15.447713 14865 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:15.374128 14125 rpcz_store.cc:269] 0709 13:19:00.479419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.479563 (+   144us) service_pool.cc:224] Handling call
0709 13:19:15.366682 (+14887119us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:10.761826 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:10.835810 (+ 73984us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:10.835878 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:19:10.835901 (+    23us) tablet.cc:662] Decoding operations
0709 13:19:10.837743 (+  1842us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:10.932082 (+ 94339us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:10.933226 (+  1144us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:19:11.068205 (+134979us) tablet.cc:701] Row locks acquired
0709 13:19:11.068280 (+    75us) write_op.cc:260] PREPARE: finished
0709 13:19:11.068463 (+   183us) write_op.cc:270] Start()
0709 13:19:11.068604 (+   141us) write_op.cc:276] Timestamp: P: 1783603151068395 usec, L: 0
0709 13:19:11.068632 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:19:11.083208 (+ 14576us) log.cc:844] Serialized 7938 byte log entry
0709 13:19:12.009483 (+926275us) op_driver.cc:464] REPLICATION: finished
0709 13:19:12.105035 (+ 95552us) write_op.cc:301] APPLY: starting
0709 13:19:12.105142 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:12.106524 (+  1382us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:12.106649 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:12.108335 (+  1686us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:12.175003 (+ 66668us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=40
0709 13:19:12.175054 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:12.175699 (+   645us) log.cc:844] Serialized 139 byte log entry
0709 13:19:12.214493 (+ 38794us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:12.222979 (+  8486us) write_op.cc:454] Released schema lock
0709 13:19:12.237211 (+ 14232us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:12.274189 (+ 36978us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:12.274234 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":446720,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":95225,"apply.run_cpu_time_us":5969,"apply.run_wall_time_us":148775,"num_ops":20,"prepare.queue_time_us":237587,"prepare.run_cpu_time_us":97495,"prepare.run_wall_time_us":608694,"raft.queue_time_us":373987,"raft.run_cpu_time_us":4874,"raft.run_wall_time_us":90809,"replication_time_us":910735,"spinlock_wait_cycles":27008,"thread_start_us":648801,"threads_started":4,"wal-append.queue_time_us":287021,"wal-append.run_cpu_time_us":27984,"wal-append.run_wall_time_us":1868273}]]}
I20260709 13:19:15.457515 14127 catalog_manager.cc:5697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 6 to 9, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 9 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.425171 14299 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:15.474562 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:15.478947 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:15.405051 18474 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:15.480003 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.481158 14301 pending_rounds.cc:85] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 4
I20260709 13:19:15.479773 14298 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:15.426381 18435 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:15.309743 18450 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:15.485700 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 145088us
I20260709 13:19:15.432783 18076 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.452634 18444 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:15.519637 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1022) took 3039 ms. Trace:
I20260709 13:19:15.487610 14301 pending_rounds.cc:107] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:15.491434 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:15.521903 14301 raft_consensus.cc:2889] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:15.490302 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:15.522270 14299 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:19:15.490302 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46775.5us
I20260709 13:19:15.342379 18429 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.503687 14295 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:15.505425 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:15.507511 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:15.526528 14300 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:15.529318 14299 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:15.494067 18269 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:19:15.489933 18288 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.517586 14898 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:15.522571 14298 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:15.488499 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:15.509495 17952 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.524428 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.520208 14375 rpcz_store.cc:276] 0709 13:19:12.458631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.745320 (+286689us) service_pool.cc:224] Handling call
0709 13:19:12.757926 (+ 12606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.758163 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:12.789919 (+ 31756us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.497415 (+2707496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:15.497469 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:15.497519 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.497596 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.497726 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1297213,"prepare.queue_time_us":36957,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":1311929,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":1409927,"threads_started":1,"wal-append.queue_time_us":283767,"wal-append.run_cpu_time_us":1788,"wal-append.run_wall_time_us":1001169}
I20260709 13:19:15.530340 14300 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:15.479190 18352 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:15.486755 18330 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:15.535032 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:15.537281 14896 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
W20260709 13:19:15.537250 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48894.9us
I20260709 13:19:15.541914 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.541632 14127 catalog_manager.cc:5697] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.542672 18358 raft_consensus.cc:2764] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:15.543694 18270 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:15.489713 17967 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:19:15.518646 18076 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.518352 18279 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:15.575191 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2136) took 1322 ms. Trace:
I20260709 13:19:15.580298 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:15.581459 14224 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:15.548341 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:15.547379 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:15.540747 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46902.8us
I20260709 13:19:15.550992 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:15.583693 14378 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:15.519601 18444 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.554523 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:15.556656 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.556829 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.550523 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.561241 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:15.532217 18325 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.564168 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:15.564261 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:15.567631 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:15.570432 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:15.622097 14899 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:15.622483 14894 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:15.584488 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:15.537077 18354 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:15.596367 14371 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
W20260709 13:19:15.575958 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 325111us
I20260709 13:19:15.576646 14373 rpcz_store.cc:276] 0709 13:19:14.252435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.252933 (+   498us) service_pool.cc:224] Handling call
0709 13:19:14.260731 (+  7798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.260930 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:14.300000 (+ 39070us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.148539 (+848539us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:15.538610 (+390071us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.574757 (+ 36147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:15.574825 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:15.574889 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.574976 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.575125 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":924560,"prepare.queue_time_us":56950,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1014,"raft.queue_time_us":954384,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":18218,"spinlock_wait_cycles":13041024,"thread_start_us":381433,"threads_started":3,"wal-append.queue_time_us":214138}
I20260709 13:19:15.615142 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:15.617233 14222 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:19:15.617408 14897 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:15.547183 18355 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:15.555233 18246 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:15.567487 17967 consensus_queue.cc:1243] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:15.546612 18330 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:15.634166 14226 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:15.645072 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:15.627748 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.634472 14377 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:15.636929 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:15.626395 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 79086.6us
I20260709 13:19:15.627864 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:15.628726 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.621238 18444 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.563297 18343 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:15.646193 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:15.648049 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:15.570940 18279 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:15.615833 18315 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:15.649896 14374 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:19:15.701136 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.651346 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:15.650815 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:15.649461 14227 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:15.702301 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.547992 18288 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.707528 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:15.708352 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:15.709141 14225 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:19:15.696028 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50122.1us
I20260709 13:19:15.552513 18352 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:15.703383 14374 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:15.712702 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:15.719094 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.702385 14222 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.625941 18450 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:15.723520 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86468.4us
I20260709 13:19:15.594062 18294 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.129s
I20260709 13:19:15.704651 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:15.704725 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 70726.3us
I20260709 13:19:15.746510 14369 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:15.705928 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.639250 18358 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:15.716400 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:15.748044 14371 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:15.656585 18330 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.650498 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.741386 14378 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:15.753419 14377 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:15.754185 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.754608 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.634220 18298 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:19:15.742515 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:15.758037 14221 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:15.760088 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:15.761025 14373 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:15.697038 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 113912us
I20260709 13:19:15.762785 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:15.571616 18274 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.731509 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:15.765561 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 180388us
I20260709 13:19:15.767587 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.711539 18315 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.777400 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:15.770637 14127 catalog_manager.cc:5697] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 6 to 8, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 8 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.778223 14371 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:15.778558 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:15.779211 14377 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.766382 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:15.774847 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.644620 18355 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.634892 18325 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.786113 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:15.648128 18476 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.122s
I20260709 13:19:15.755913 18358 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.657734 18354 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:15.792948 14229 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:15.770606 18463 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:19:15.796867 14127 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 8 to 9, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 9 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:15.797710 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.798527 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.716923 18246 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:19:15.786809 18315 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:15.709826 18482 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:19:15.805105 14371 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:15.810547 14374 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:15.815333 14222 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:15.809451 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.637161 18474 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.638346 18435 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:15.794790 18453 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:15.809379 18460 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:15.801146 18358 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:15.810217 18476 consensus_queue.cc:1243] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:15.803990 18502 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:19:15.834046 14127 catalog_manager.cc:5697] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 2 to 4, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 4 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:19:15.921921 14377 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:15.837850 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.922952 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:15.923695 14377 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:15.843248 14115 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.494s	user 0.008s	sys 0.024s
I20260709 13:19:15.817704 14221 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:15.924556 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.838413 14378 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:15.842126 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.898288 14303 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:15.930318 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.928102 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.931563 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.932142 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.932968 14371 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:15.932230 14378 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:15.844619 18288 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:15.934655 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:15.936057 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.936476 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.938969 14369 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:15.946677 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 215249us
I20260709 13:19:15.939889 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.948185 14377 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:15.940650 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 177994us
I20260709 13:19:15.940193 14378 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:15.952672 14127 catalog_manager.cc:5697] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.954286 14127 catalog_manager.cc:5697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 8 to 9, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 9 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.957011 14378 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:15.957417 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.959913 14378 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:15.960438 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:15.938822 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 226121us
I20260709 13:19:15.961639 14378 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:15.876662 18429 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:15.849714 18475 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:15.979749 14193 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:19:15.844977 18472 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
W20260709 13:19:15.851375 18470 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 13:19:15.967793 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2350) took 3063 ms. Trace:
I20260709 13:19:15.975502 14127 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 4 to 5, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 5 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:15.973757 14378 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:15.987694 14378 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:15.948315 14192 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:15.922093 18304 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:15.843865 18500 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:15.846853 18460 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:15.844772 18478 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.991060 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:15.881403 17952 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:15.880210 18325 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:15.929186 18367 raft_consensus.cc:2764] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:15.882987 18355 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:15.985843 14372 rpcz_store.cc:276] 0709 13:19:12.904864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.009038 (+1104174us) service_pool.cc:224] Handling call
0709 13:19:14.009385 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:15.330039 (+1320654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.330077 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:15.330575 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.471306 (+140731us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:15.471350 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.471428 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.967571 (+496143us) raft_consensus.cc:1685] finished
0709 13:19:15.967592 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.967736 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1474401,"raft.queue_time_us":1324067,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5034,"thread_start_us":139402,"threads_started":1,"wal-append.queue_time_us":444191}
W20260709 13:19:15.941835 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 290584us
I20260709 13:19:16.000766 18518 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:16.002620 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:15.951534 18490 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:15.999136 14127 catalog_manager.cc:5697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 2 to 7, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 7 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:19:16.004799 14220 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:16.005244 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:15.938248 18419 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:16.121393 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 116241us
I20260709 13:19:15.966988 18503 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.169s
I20260709 13:19:16.102373 18087 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:15.937115 18499 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:15.805948 18343 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:15.952289 18482 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:16.065050 18477 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.410s	user 0.001s	sys 0.000s
I20260709 13:19:15.977069 18422 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.055641 18444 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:15.992341 18435 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:16.103745 14222 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:16.111821 14369 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:16.109200 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:16.315546 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 206413us
I20260709 13:19:16.317221 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:16.116601 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 167262us
W20260709 13:19:16.006739 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 58471.9us
I20260709 13:19:15.988600 14378 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:16.113919 18492 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:19:16.205101 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:16.012651 18328 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 13:19:16.340207 14378 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:16.210757 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.095861 18221 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:16.215466 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.343909 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 375243us
W20260709 13:19:16.344475 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.974026 18288 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:16.113562 18490 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:16.248229 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:16.347937 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 142917us
I20260709 13:19:16.349047 14344 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:16.349090 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:16.349476 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:16.349771 14303 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:16.350768 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:16.351444 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:16.352674 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:16.351482 14300 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:16.352993 14222 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:16.252604 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2089) took 1104 ms. Trace:
I20260709 13:19:16.262656 18354 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:16.174480 18511 raft_consensus.cc:2764] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:16.208654 18482 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.221460 18087 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:16.263006 18076 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.648s	user 0.006s	sys 0.003s
I20260709 13:19:16.244798 18274 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:16.264389 18298 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.225587 18499 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:16.250573 14224 raft_consensus.cc:1217] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:19:16.418416 14224 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:16.268265 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:16.228214 18422 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.280134 18279 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:16.284567 18480 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.575s	user 0.000s	sys 0.006s
I20260709 13:19:16.225667 18518 consensus_queue.cc:1243] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:16.395092 18354 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:16.171880 18246 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.226150 18435 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:16.225381 14304 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:19:16.012730 18460 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.324127 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:16.332793 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:16.321290 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:16.061739 18478 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.355974 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:16.249239 18330 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.362308 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:16.367693 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:16.364188 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.012s
I20260709 13:19:16.292796 18508 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:16.467979 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.006s	sys 0.012s
I20260709 13:19:16.368470 14369 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:19:16.471520 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 705162us
W20260709 13:19:16.472129 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 150943us
I20260709 13:19:16.367219 14300 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:16.402355 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:16.398336 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56265us
I20260709 13:19:16.473938 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:16.474517 14302 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
W20260709 13:19:16.417438 14373 consensus_meta.cc:287] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.002s
I20260709 13:19:16.475196 14373 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:16.420615 14303 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:16.403496 14223 rpcz_store.cc:276] 0709 13:19:15.148287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.149640 (+  1353us) service_pool.cc:224] Handling call
0709 13:19:15.150011 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:15.150481 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.150510 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:15.151075 (+   565us) log.cc:844] Serialized 52 byte log entry
0709 13:19:15.342729 (+191654us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:15.342780 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.342870 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.228139 (+885269us) raft_consensus.cc:1685] finished
0709 13:19:16.249916 (+ 21777us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.252393 (+  2477us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77,"raft.queue_time_us":3364,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":53,"thread_start_us":191269,"threads_started":1,"wal-append.queue_time_us":300310}
I20260709 13:19:16.374050 18461 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:16.406484 18526 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.369647 18482 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.368782 18473 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.417282 18528 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:19:16.354836 18510 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:16.444401 14377 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:16.222718 18352 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:16.456199 14378 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:19:16.463320 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 111908us
W20260709 13:19:16.466266 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 133566us
I20260709 13:19:16.534722 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:19:16.466827 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 142787us
I20260709 13:19:16.536336 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:16.409919 18076 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.477285 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:16.569828 14373 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:16.468524 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:16.571432 14222 pending_rounds.cc:85] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 3
I20260709 13:19:16.571722 14222 pending_rounds.cc:107] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:19:16.571969 14222 raft_consensus.cc:2889] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.572448 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:16.491508 18512 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:16.460210 18279 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:16.464419 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 129339us
I20260709 13:19:16.491964 14897 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:16.497961 14299 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:16.502880 14295 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:16.504135 14896 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:16.489748 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:16.430302 18298 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.591737 14299 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:16.591898 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:16.537688 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:16.537750 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:16.520356 18504 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:16.543926 18251 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:16.550558 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.553117 18502 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:16.553884 18361 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:19:16.555477 18493 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
I20260709 13:19:16.563874 18421 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:16.566833 18479 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.857s	user 0.000s	sys 0.007s
I20260709 13:19:16.460707 18514 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:19:16.568005 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:16.568578 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:16.478119 18518 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:16.483880 18461 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.480320 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:16.457922 18274 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.573398 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 98807us
W20260709 13:19:16.574265 14111 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 37975f772fc648329a8acae36d33a345 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 181bbac22422408c87cd13b7fe3008f9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:16.489653 18429 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:16.578372 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:16.461743 18246 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.485960 18221 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:19:16.522274 18354 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:16.542814 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:16.589059 14300 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:16.578442 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2363) took 1004 ms. Trace:
I20260709 13:19:16.811573 14374 rpcz_store.cc:276] 0709 13:19:15.573564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.718781 (+145217us) service_pool.cc:224] Handling call
0709 13:19:16.578268 (+859487us) spinlock_profiling.cc:243] Waited 90.6 ms on lock 0x7b540027a6d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:16.578384 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208438144}
I20260709 13:19:16.604585 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:16.568882 18526 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:16.607411 14375 raft_consensus.cc:2368] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12.
I20260709 13:19:16.572532 18509 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.593098 18488 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.465s	user 0.000s	sys 0.001s
I20260709 13:19:16.568782 18426 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:16.621104 14302 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.486256 18508 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:16.646085 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 108482us
I20260709 13:19:16.918455 18076 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:16.582996 18512 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:16.930051 18512 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.598385 18251 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:16.618988 18525 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:16.604338 18502 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:16.603744 18419 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:16.523084 18473 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.616709 18511 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:16.615222 18501 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:16.485728 18087 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.617887 18444 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:16.746562 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.536260 18510 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:16.751163 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 182649us
I20260709 13:19:16.958463 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:16.701684 18361 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.750504 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:16.572154 18435 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.967823 18435 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:16.530367 18522 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
W20260709 13:19:16.734277 18513 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.437s	user 0.001s	sys 0.000s
I20260709 13:19:16.972990 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:16.783010 14299 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:19:16.757074 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 163291us
I20260709 13:19:16.728130 18288 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.978451 18288 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.979748 14377 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:16.980154 14377 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:16.796239 14111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 222014us
I20260709 13:19:16.803012 14221 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:16.981568 18522 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:16.982069 18522 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:16.981777 14377 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:16.983011 18332 consensus_queue.cc:1175] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" responder_term: 11 status { last_received { term: 11 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 11 index: 11 } }
I20260709 13:19:16.982915 18522 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.734287 18506 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:16.984268 18506 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:16.787427 18300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.077s	user 0.006s	sys 0.006s
W20260709 13:19:16.985993 18300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.285s	user 0.006s	sys 0.006s
W20260709 13:19:16.815012 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 334774us
W20260709 13:19:16.817392 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 212874us
I20260709 13:19:16.987681 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:19:16.988368 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.989709 18511 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:16.990191 18511 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:16.990302 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.990682 18511 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:16.851117 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.991601 18559 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:16.992193 18559 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.917312 18499 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:16.796944 18461 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.864743 18548 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:16.756338 18520 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:16.692858 18504 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
W20260709 13:19:16.881757 18535 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:19:16.883630 18516 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:19:16.884636 18521 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:19:16.890224 18416 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:16.985359 18506 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.012140 18502 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.012355 18416 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.013288 18506 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:17.013422 18502 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:16.897116 18450 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.152s	user 0.009s	sys 0.001s
I20260709 13:19:16.870272 18524 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:16.804973 18274 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:16.899825 18246 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:16.901348 18478 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:17.031365 18520 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:16.870080 18507 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.397s	user 0.001s	sys 0.001s
I20260709 13:19:17.034139 18251 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.801617 14115 maintenance_manager.cc:643] P 2510e400b67647c7923cee16a251d2de: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.289s	user 0.203s	sys 0.093s Metrics: {"bytes_written":31020,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":72817,"dirs.run_cpu_time_us":442,"dirs.run_wall_time_us":10455,"drs_written":1,"lbm_read_time_us":409,"lbm_reads_lt_1ms":4,"lbm_write_time_us":80919,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":320039,"threads_started":2,"update_count":33,"wal-append.queue_time_us":492952,"wal-append.run_wall_time_us":1019288}
I20260709 13:19:17.036041 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2135) took 2784 ms. Trace:
I20260709 13:19:16.819146 18527 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:16.819842 18422 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:16.872161 18474 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:16.863349 18509 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:16.911229 14229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.004s	sys 0.013s
I20260709 13:19:16.918891 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2596) took 1299 ms. Trace:
I20260709 13:19:17.043772 14296 rpcz_store.cc:276] 0709 13:19:15.619463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.634271 (+ 14808us) service_pool.cc:224] Handling call
0709 13:19:15.694970 (+ 60699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:15.832208 (+137238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.832251 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:15.832793 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.941462 (+108669us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:15.941502 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.941571 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.918684 (+977113us) raft_consensus.cc:1685] finished
0709 13:19:16.918703 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.918833 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58729,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":11483,"thread_start_us":241969,"threads_started":2,"wal-append.queue_time_us":1080408}
W20260709 13:19:16.915630 18315 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.063s	user 0.011s	sys 0.002s
W20260709 13:19:16.959659 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 209225us
I20260709 13:19:16.951733 18330 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:17.046247 18315 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:16.955591 18539 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.964126 18547 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:16.957724 18358 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.029s	user 0.008s	sys 0.004s
I20260709 13:19:17.054986 18547 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.055290 18358 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.055006 18539 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:16.959908 18419 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:16.964694 18545 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:19:16.791582 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 175203us
I20260709 13:19:16.952544 18525 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:17.012351 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1073) took 1496 ms. Trace:
I20260709 13:19:17.015815 18504 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:17.006501 18367 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.007375 18444 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:17.036514 14370 rpcz_store.cc:276] 0709 13:19:14.252088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.259931 (+  7843us) service_pool.cc:224] Handling call
0709 13:19:14.260237 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:15.334014 (+1073777us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:15.647135 (+313121us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.955048 (+307913us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.306612 (+351564us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.308704 (+  2092us) log.cc:844] Serialized 26 byte log entry
0709 13:19:16.332851 (+ 24147us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:16.332905 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.333079 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.557316 (+224237us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b18003ff1c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:19:17.035816 (+478500us) raft_consensus.cc:1685] finished
0709 13:19:17.035848 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.035983 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1223045,"prepare.queue_time_us":520543,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":79,"raft.queue_time_us":1412087,"raft.run_cpu_time_us":8859,"raft.run_wall_time_us":112363,"spinlock_wait_cycles":71947008,"thread_start_us":812766,"threads_started":3,"wal-append.queue_time_us":593442}
I20260709 13:19:17.047465 14295 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:17.059177 14116 maintenance_manager.cc:419] P 2510e400b67647c7923cee16a251d2de: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9889 bytes on disk
I20260709 13:19:17.055485 18547 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:17.073272 14893 rpcz_store.cc:276] 0709 13:19:15.516112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.516280 (+   168us) service_pool.cc:224] Handling call
0709 13:19:15.516685 (+   405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:15.517070 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.517100 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:15.517775 (+   675us) log.cc:844] Serialized 52 byte log entry
0709 13:19:15.928294 (+410519us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:16.304183 (+375889us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.307579 (+  3396us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.307761 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.307872 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.012110 (+704238us) raft_consensus.cc:1685] finished
0709 13:19:17.012132 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.012278 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2907,"prepare.queue_time_us":1038550,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":200302,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":271,"thread_start_us":753167,"threads_started":2,"wal-append.queue_time_us":1097203}
I20260709 13:19:17.075522 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2502) took 1456 ms. Trace:
I20260709 13:19:17.075703 14115 maintenance_manager.cc:643] P 2510e400b67647c7923cee16a251d2de: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":335,"lbm_reads_lt_1ms":4}
I20260709 13:19:17.035494 18251 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.046993 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:17.076618 18504 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:17.072896 14295 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:17.047780 14229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.005s	sys 0.013s
W20260709 13:19:17.082731 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.079474 18500 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.110102 18246 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:17.110265 18500 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.058409 14301 raft_consensus.cc:2368] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9.
I20260709 13:19:17.077581 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:17.057626 18358 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.113325 18525 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:17.079820 18330 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.115527 18330 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.118234 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2149) took 1555 ms. Trace:
I20260709 13:19:17.118721 14376 rpcz_store.cc:276] 0709 13:19:15.562482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.562723 (+   241us) service_pool.cc:224] Handling call
0709 13:19:15.563070 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:15.765892 (+202822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.765922 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:15.765965 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:15.765994 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.118029 (+1352035us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54000609d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:17.118070 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.118181 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465923456}
I20260709 13:19:17.121358 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1045) took 1161 ms. Trace:
I20260709 13:19:17.121886 14897 rpcz_store.cc:276] 0709 13:19:15.960078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.960201 (+   123us) service_pool.cc:224] Handling call
0709 13:19:17.121147 (+1160946us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540041d7d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:17.121285 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220357888}
I20260709 13:19:17.077613 18504 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:17.126266 14896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1039) took 1572 ms (client timeout 1964 ms). Trace:
W20260709 13:19:17.126765 14896 rpcz_store.cc:269] 0709 13:19:15.554163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.554290 (+   127us) service_pool.cc:224] Handling call
0709 13:19:17.126044 (+1571754us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b540066dad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:17.126203 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091287424}
I20260709 13:19:17.128376 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2351) took 1561 ms. Trace:
I20260709 13:19:17.128808 14375 rpcz_store.cc:276] 0709 13:19:15.566789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.566908 (+   119us) service_pool.cc:224] Handling call
0709 13:19:17.128161 (+1561253us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54002ec054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:17.128313 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2179498240}
I20260709 13:19:17.078647 18355 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:17.134920 18355 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:17.135896 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2097) took 1034 ms. Trace:
I20260709 13:19:17.136379 14221 rpcz_store.cc:276] 0709 13:19:16.101919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.102089 (+   170us) service_pool.cc:224] Handling call
0709 13:19:16.171676 (+ 69587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.981553 (+809877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.135548 (+153995us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54002a21d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:17.135824 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451459968}
I20260709 13:19:17.139124 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1030) took 1389 ms. Trace:
I20260709 13:19:17.139588 14369 rpcz_store.cc:276] 0709 13:19:15.728063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.489266 (+761203us) service_pool.cc:224] Handling call
0709 13:19:16.489609 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.987175 (+497566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.987209 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.987254 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:16.987288 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.117544 (+130256us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54002594d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:17.117592 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.117744 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143781760}
I20260709 13:19:17.143800 14295 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.145596 14295 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:17.075990 14227 rpcz_store.cc:276] 0709 13:19:15.618776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.702887 (+ 84111us) service_pool.cc:224] Handling call
0709 13:19:15.737749 (+ 34862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.097376 (+359627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.097565 (+   189us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.113404 (+ 15839us) log.cc:844] Serialized 26 byte log entry
0709 13:19:16.578541 (+465137us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:16.740621 (+162080us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.815762 (+ 75141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.815918 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.075302 (+259384us) raft_consensus.cc:1685] finished
0709 13:19:17.075324 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.075464 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101270,"prepare.queue_time_us":293933,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":177130,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":37638,"thread_start_us":930505,"threads_started":4,"wal-append.queue_time_us":580351}
I20260709 13:19:17.195216 18367 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.135911 18355 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:17.211740 18490 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:17.057767 18315 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:17.214946 14377 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:17.238514 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 250833us
W20260709 13:19:17.238555 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 161044us
I20260709 13:19:17.240136 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:17.242313 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.243854 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:17.244565 14897 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:17.245203 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:17.242123 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 283718us
I20260709 13:19:17.014643 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1028) took 1287 ms. Trace:
I20260709 13:19:17.248201 14372 rpcz_store.cc:276] 0709 13:19:15.727555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.443996 (+716441us) service_pool.cc:224] Handling call
0709 13:19:16.581247 (+137251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.581504 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.581541 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.581601 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:16.581653 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.581741 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.013696 (+431955us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540027a6d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:17.014567 (+   871us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314760576}
W20260709 13:19:17.249485 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 137497us
W20260709 13:19:17.250252 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 321568us
I20260709 13:19:17.247746 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:17.239408 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:17.258181 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:17.255069 14898 raft_consensus.cc:1217] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Deduplicated request from leader. Original: 7.7->[9.8-9.8]   Dedup: 9.8->[]
I20260709 13:19:17.255792 14899 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:17.259778 14298 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:17.267688 14342 leader_election.cc:400] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9.
I20260709 13:19:17.267688 14898 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:19:17.270012 14896 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:17.271617 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:17.252840 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:17.272212 14304 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:17.273154 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:17.278172 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.286682 14229 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:16.929356 18426 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:17.285688 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 46368.5us
I20260709 13:19:17.278720 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:17.300024 14894 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:17.300441 14220 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.254314 18504 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.281823 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.269846 17952 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:17.274598 18246 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:17.274947 18490 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.295159 18565 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.281247 18315 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.295773 18566 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:17.296203 18539 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:17.297107 18509 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.297961 18500 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:17.300989 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:17.275303 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2590) took 1884 ms. Trace:
I20260709 13:19:17.302335 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:17.304924 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:17.253925 18538 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:17.299893 18498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.010s	sys 0.004s
I20260709 13:19:17.255383 18450 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.314563 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:17.317442 14897 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:17.316004 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:17.314021 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.371681 14221 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:17.328809 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.274320 18522 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:17.320528 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67892.6us
I20260709 13:19:17.381384 14369 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:17.299707 18328 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:17.270478 18280 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:17.321934 14377 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:17.319419 14302 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
W20260709 13:19:17.343956 18498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.010s	sys 0.005s
W20260709 13:19:17.402045 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.269901 18518 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:17.347715 14867 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:17.318462 18416 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.325312 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:17.400743 18419 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.335234 18538 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.409502 14372 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:17.334086 14301 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:17.333230 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:17.333369 14297 rpcz_store.cc:276] 0709 13:19:15.391301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.391407 (+   106us) service_pool.cc:224] Handling call
0709 13:19:15.391706 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:15.392118 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.392159 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:15.392830 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.580450 (+187620us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:15.580510 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.580606 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.275120 (+1694514us) raft_consensus.cc:1685] finished
0709 13:19:17.275137 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.275251 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5956,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":187136,"threads_started":1,"wal-append.queue_time_us":551432}
I20260709 13:19:17.367283 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:17.366618 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 55367.7us
I20260709 13:19:17.426010 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:17.372229 14220 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:17.374221 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:17.375757 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:17.377260 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:17.381863 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:17.270076 18358 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:17.382488 14376 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:17.376348 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:17.383045 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:17.383708 14341 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:17.301441 18298 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:17.389241 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:17.274174 18562 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:17.389952 14300 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:17.388458 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1036) took 1658 ms. Trace:
I20260709 13:19:17.438638 14377 rpcz_store.cc:276] 0709 13:19:15.729685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.533876 (+804191us) service_pool.cc:224] Handling call
0709 13:19:16.534218 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.979654 (+445436us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400047f20. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded003dc0 00007f8ded08e1c0 00007f8ded08f231 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c
0709 13:19:17.214302 (+234648us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b58005a3ed0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8decfe80aa 00007f8ded06a447 00007f8ded082fe7 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4
0709 13:19:17.388190 (+173888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.388403 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582647808}
W20260709 13:19:17.394151 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.045s	sys 0.048s
I20260709 13:19:17.395406 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:19:17.444819 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49514.4us
I20260709 13:19:17.445775 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:17.402767 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55168.9us
I20260709 13:19:17.447906 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:17.348960 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.330840 18566 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:17.450320 18421 raft_consensus.cc:2764] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:17.451615 18298 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:17.451299 18566 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.406299 18367 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.318830 18444 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:17.453998 18444 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:17.454520 18444 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.406739 18328 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:17.458647 18328 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:17.323736 18352 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:19:17.405634 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:17.459818 14370 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:17.431679 18358 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:17.406412 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.460446 18358 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:17.320704 18270 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:17.320438 18294 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:17.325215 18361 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 13:19:17.461910 18294 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.343976 18527 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 13:19:17.464514 18294 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.318783 18288 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.415115 18559 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.359090 18429 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.465560 18429 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.466729 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:17.467782 18429 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:17.468714 18429 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:17.342268 18508 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:17.416888 18482 consensus_meta.cc:287] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.886s	user 0.023s	sys 0.004s
I20260709 13:19:17.432761 18280 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:17.469906 18482 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.470592 18280 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.472110 18482 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:17.351984 18274 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:17.330556 18315 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.333660 18487 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:17.474416 14892 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:17.344216 18512 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:17.388407 18450 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:17.422401 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.328156 17952 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:17.320324 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 44661.4us
I20260709 13:19:17.424191 14296 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:17.429507 14373 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:17.348832 18251 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:17.576149 18251 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.567188 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.578372 18251 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:17.432246 14302 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:17.410969 18538 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:17.441107 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:17.469941 18304 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.470252 18527 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.418402 18510 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.330236 18565 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.474562 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.422145 18473 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:17.445182 18564 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:19:17.444118 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.045s	sys 0.048s
W20260709 13:19:17.498267 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116531us
I20260709 13:19:17.620388 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:17.495836 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 112211us
I20260709 13:19:17.587380 18539 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:17.507325 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.629247 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:17.423380 18500 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:17.630080 14896 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:17.631083 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:17.632261 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:17.449013 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:17.633023 14297 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:17.633905 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:17.407102 18076 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:19:17.594794 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:17.595656 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:17.595814 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 154769us
I20260709 13:19:17.639169 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:17.476446 18429 raft_consensus.cc:2764] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:17.562304 18355 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:17.602550 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.469408 18511 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.562448 18298 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:17.614209 18548 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:17.624584 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:17.384740 18262 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:19:17.642467 18478 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:19:17.592190 18352 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:17.629559 14228 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:17.587189 18520 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:17.650130 18279 consensus_meta.cc:287] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.052s	user 0.008s	sys 0.009s
W20260709 13:19:17.599278 18460 consensus_meta.cc:287] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.131s	user 0.015s	sys 0.034s
I20260709 13:19:17.644846 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:17.627439 18328 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:19:17.646754 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:17.637411 18500 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.676100 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:17.647435 18557 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:17.664495 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.599910 14225 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:17.638689 18510 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.642540 18270 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:17.626561 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:17.698849 14373 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:17.698673 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:17.752010 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:17.643783 18482 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:19:17.701102 18352 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:17.650235 18251 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:19:17.641390 14344 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:17.433089 18518 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.647404 18325 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:17.742563 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 97825.5us
I20260709 13:19:17.597194 18304 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.743311 18556 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:17.743580 18573 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:19:17.651305 18539 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:17.749620 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1044) took 1792 ms. Trace:
I20260709 13:19:17.702693 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:17.642573 18509 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:17.686656 18508 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:17.753638 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 55050.3us
I20260709 13:19:17.754881 14223 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:17.698201 18355 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:17.757954 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:17.768886 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 127564us
I20260709 13:19:17.799836 14344 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:17.765169 18429 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:17.778286 14267 connection.cc:256] RPC call timeout handler was delayed by -1.8186733939999158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 13:19:17.811307 14267 connection.cc:256] RPC call timeout handler was delayed by -1.4967962670000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:19:17.811350 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 53506.4us
I20260709 13:19:17.768301 18361 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:17.811865 14267 connection.cc:256] RPC call timeout handler was delayed by -1.1580507969997598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
W20260709 13:19:17.812388 14267 connection.cc:256] RPC call timeout handler was delayed by -1.1364733939999496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2324s for a response
I20260709 13:19:17.814152 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:17.814237 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:17.781235 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:17.815825 14378 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.598162 18527 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.742172 18548 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:17.791678 14892 rpcz_store.cc:276] 0709 13:19:15.956995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.957165 (+   170us) service_pool.cc:224] Handling call
0709 13:19:17.749414 (+1792249us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54005d07d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:17.749561 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3486706432}
I20260709 13:19:17.754609 18328 consensus_queue.cc:1243] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:17.746649 18500 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.793843 14375 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:17.740687 18076 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.775589 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:17.897888 14369 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:17.899003 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:17.900548 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:17.801229 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:17.783573 18294 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:17.798208 18476 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.808679 18304 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:17.819622 18570 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:17.821105 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:17.820781 18358 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.821715 18509 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.786008 18556 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.740484 18460 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.829692 14378 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
W20260709 13:19:17.924127 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 108970us
I20260709 13:19:17.887298 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.926638 14221 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
W20260709 13:19:17.890556 18555 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:19:17.894395 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.766628 18510 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:17.896692 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:17.742467 17952 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:17.909174 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:17.821632 18330 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:17.912680 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:17.833963 18522 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:17.816984 18361 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:17.800597 18540 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:17.830392 18325 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:17.954332 14304 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:17.940140 14369 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:17.890522 18298 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.923410 18556 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:17.923588 18535 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:19:17.947163 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 123294us
I20260709 13:19:17.810201 18508 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.937358 18450 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.946271 18522 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.913254 18076 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.950958 18361 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:17.822535 18355 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.986946 14370 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:17.952225 18330 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:17.987807 18565 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.988049 18330 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:17.989104 18506 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.975s	user 0.010s	sys 0.004s
I20260709 13:19:17.989652 18548 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.990407 18330 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:17.976153 18508 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.976635 18518 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.979851 18076 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.913522 18476 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:17.981858 18358 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:17.982815 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:17.984951 18426 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:17.986074 18585 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:19:17.985867 18505 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.218s
W20260709 13:19:17.986294 18576 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.233s	user 0.003s	sys 0.000s
I20260709 13:19:17.994455 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:17.981881 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:17.990911 18461 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.977s	user 0.016s	sys 0.013s
I20260709 13:19:18.041945 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:18.106295 14896 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:18.053670 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:18.107177 14372 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:17.956997 18512 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:17.929678 18509 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.065371 14375 raft_consensus.cc:2410] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:19:18.070544 14295 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:19:18.072969 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 139148us
I20260709 13:19:18.111624 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:18.112150 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:18.112452 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:18.114392 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:18.114616 18478 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.115173 18478 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:17.830158 18352 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.115794 18508 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:18.116330 18508 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:18.116588 18416 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.116773 18508 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:18.120074 18358 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:17.994592 18522 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.093600 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:17.982862 18315 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:18.120513 18547 consensus_meta.cc:287] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.046s	user 0.013s	sys 0.017s
I20260709 13:19:18.081358 18592 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.121541 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:18.100194 18540 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.960764 18539 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.096767 18511 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:18.075533 18076 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:18.117617 18478 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:18.138862 18525 consensus_meta.cc:287] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.025s	user 0.019s	sys 0.000s
W20260709 13:19:18.151546 18332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.007s	sys 0.013s
W20260709 13:19:18.152122 18572 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260709 13:19:18.143513 18426 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:18.175109 18426 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.175624 18426 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.126389 18461 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.180495 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.182951 14222 raft_consensus.cc:2410] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:18.192046 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:18.196784 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:18.179324 18332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.007s	sys 0.013s
I20260709 13:19:18.205986 14867 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:18.207623 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:18.147171 18506 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:19:18.140520 18547 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:18.196002 18444 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.741s	user 0.013s	sys 0.000s
W20260709 13:19:18.200345 18435 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.232s	user 0.020s	sys 0.000s
I20260709 13:19:18.217144 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:18.218813 14299 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:18.157480 18076 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:18.160117 18525 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:18.221012 18575 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:19:18.220685 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:18.220805 18444 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.210106 18527 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:18.219897 18429 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.232824 18527 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:18.233382 18527 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.233770 18527 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:18.154835 18592 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:18.236462 14867 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:18.238047 18435 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:18.238300 18592 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:18.238701 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.150028 18540 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.236303 18361 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.246891 14371 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:18.209460 18478 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:18.214395 18246 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:18.251848 14896 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:18.253258 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:18.255402 14376 raft_consensus.cc:2410] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:19:18.256362 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 114756us
W20260709 13:19:18.226099 18504 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.907s	user 0.009s	sys 0.003s
I20260709 13:19:18.259161 14302 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:18.223111 18304 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.257180 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:18.219835 18460 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:18.223309 18510 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:18.264117 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:18.224300 18582 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:18.228502 18509 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:18.271176 18547 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:18.274863 18461 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:18.274926 18502 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.261s	user 0.017s	sys 0.000s
I20260709 13:19:18.277843 18499 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
W20260709 13:19:18.278810 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 945556us
I20260709 13:19:18.266531 18304 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.282232 18419 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.282919 18540 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:18.283006 18304 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:18.286306 18522 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.288419 18429 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:18.289835 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:18.291810 14892 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:18.310505 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:18.313344 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:18.324754 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.323318 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:18.327700 14896 raft_consensus.cc:2410] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:19:18.267933 18548 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:18.288842 18522 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:18.269045 18582 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.340637 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:18.341325 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:18.381980 14894 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:18.286075 18559 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:19:18.386139 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.383601 14372 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:18.388062 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.389567 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.390538 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.331599 18460 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.392076 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 110274us
I20260709 13:19:18.392978 14192 leader_election.cc:400] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12.
I20260709 13:19:18.393314 14192 leader_election.cc:403] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:18.385360 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:18.386201 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 75759.3us
I20260709 13:19:18.394415 14220 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.384444 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.396799 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.397326 14225 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:18.398905 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.334384 18548 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:18.282280 18367 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:19:18.411816 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.326599 18520 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:18.414487 14898 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:18.420791 14224 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:18.421936 14220 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:18.414907 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.415766 14899 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:19:18.417593 14193 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:18.419575 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:18.419575 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.414832 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:18.434571 14226 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:18.423151 14896 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:18.379693 18582 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:18.424546 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:18.440411 14898 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:18.415542 18279 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.426141 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2113) took 1142 ms. Trace:
I20260709 13:19:18.418215 18548 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:18.410678 18473 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:18.434795 14894 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:18.434653 14227 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:18.433864 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:18.430747 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:18.432461 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:18.451407 14220 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:18.437248 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:18.451431 14900 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:18.453581 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:18.428998 18574 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.438283 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:18.439083 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:18.439646 18607 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.433703 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:18.392575 18490 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.420042 18416 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.444126 14229 rpcz_store.cc:276] 0709 13:19:17.283296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.291572 (+  8276us) service_pool.cc:224] Handling call
0709 13:19:17.296217 (+  4645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.296411 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:17.395096 (+ 98685us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.276037 (+880941us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b18003ccdc0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:18.276444 (+   407us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.425635 (+149191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:18.425712 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:18.425805 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.425904 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.426082 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35064,"prepare.queue_time_us":117789,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":93,"raft.queue_time_us":882196,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":46089984,"thread_start_us":217451,"threads_started":3,"wal-append.queue_time_us":255926}
I20260709 13:19:18.446688 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:18.464506 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:18.413178 18460 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:18.526278 14900 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:18.433609 18511 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12.
I20260709 13:19:18.430696 18616 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.370220 18592 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:18.534731 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 70358.1us
I20260709 13:19:18.559662 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:18.447830 18565 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:18.561309 14344 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:18.433395 18487 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:18.538195 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:18.430222 18221 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:19:18.530083 18510 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:18.444538 18450 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.443701 18435 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.476065 18601 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:19:18.484248 18605 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:19:18.510282 18280 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:18.434146 18508 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:18.488423 18509 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:18.427161 18520 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.566359 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:18.566859 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:18.567313 14267 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 3.029s (SENT) [suppressed 17 similar messages]
I20260709 13:19:18.450168 18473 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:18.529425 17952 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.570335 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 123772us
I20260709 13:19:18.651006 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:18.651193 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:18.651672 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:18.541173 18603 raft_consensus.cc:2764] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:18.580286 14270 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:18.452116 18279 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.510705 18343 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:19:18.563854 18565 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.569939 18518 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.702039 18518 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:18.486265 18611 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:19:18.578167 18328 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:18.567056 18444 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:18.533031 18490 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:18.652858 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:18.571317 18361 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:18.534046 18574 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.692719 18563 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:18.582365 18525 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:18.700496 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49590.4us
I20260709 13:19:18.698582 14224 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:18.565620 18592 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:18.682909 18500 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.776s	user 0.008s	sys 0.004s
I20260709 13:19:18.581722 18510 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:18.755889 18598 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:18.754890 18595 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.177s
I20260709 13:19:18.652004 18298 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.753839 18490 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:18.756392 18614 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.579588 18487 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.651206 18473 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:19.043342 18487 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:18.583527 18435 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.773401 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:19.050827 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:18.777872 18590 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:19:18.778486 14899 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:19:19.055943 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:19.056775 14301 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
W20260709 13:19:19.058657 18556 consensus_meta.cc:287] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.089s	user 0.008s	sys 0.004s
I20260709 13:19:19.060463 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:18.743427 18419 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:18.906440 18582 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.705655 18565 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:18.914021 14864 leader_election.cc:336] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.630s (SENT)
I20260709 13:19:19.062103 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:19.063292 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 149309us
W20260709 13:19:18.906107 18609 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.392s	user 0.000s	sys 0.001s
I20260709 13:19:18.594799 18450 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.026494 18304 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:18.902235 18612 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
W20260709 13:19:18.923292 18426 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.747s	user 0.006s	sys 0.010s
W20260709 13:19:19.066638 18618 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:19:18.693718 17952 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.066958 18426 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:18.903128 18246 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:19.001447 18527 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.767s	user 0.015s	sys 0.005s
I20260709 13:19:19.031917 18510 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:19.087916 17952 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.088018 18426 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.032704 18614 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.110071 18614 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:18.558516 18616 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.111068 18435 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:19.111698 18435 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:19.112255 18616 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.043385 18508 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.080363 18304 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.115127 18304 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:18.908573 18563 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.116048 18563 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.000010 18328 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.043511 18298 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.043538 18279 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.047902 18592 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:19.065277 14301 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:18.993520 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1052) took 1034 ms. Trace:
I20260709 13:19:19.015779 18500 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.127348 14897 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:19.126739 18500 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.121714 14369 rpcz_store.cc:276] 0709 13:19:17.958950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.959865 (+   915us) service_pool.cc:224] Handling call
0709 13:19:17.960219 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.128368 (+168149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.128399 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.128953 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.213849 (+ 84896us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:18.213959 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.214070 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.993177 (+779107us) raft_consensus.cc:1685] finished
0709 13:19:18.993207 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.993433 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90420,"raft.queue_time_us":5988,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5457,"thread_start_us":252063,"threads_started":2,"wal-append.queue_time_us":132083}
I20260709 13:19:19.129482 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:19.090103 18246 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.130533 14301 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:19.131575 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:19.132167 18246 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.132700 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:19.121496 18328 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.135210 18298 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.118021 18288 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:19.138422 14301 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:19.143826 18328 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.145372 18520 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.153617 18288 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:19.154620 18288 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.155282 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 772) took 1405 ms. Trace:
I20260709 13:19:19.156002 18288 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.116940 18527 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.158052 18460 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.159057 14898 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 10: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:19.160698 18527 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:19.148192 18582 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:19.059219 18556 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.195354 18450 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:19.203878 18548 consensus_meta.cc:287] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.754s	user 0.009s	sys 0.000s
I20260709 13:19:19.204653 18548 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.252034 18556 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.208695 18563 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.255297 18473 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.319844 18473 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.323907 18563 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.316187 18548 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.328797 18565 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.376364 18565 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.488021 14221 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
W20260709 13:19:19.536401 14374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1046) took 2159 ms (client timeout 1755 ms). Trace:
W20260709 13:19:19.537161 14374 rpcz_store.cc:269] 0709 13:19:17.376918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.377038 (+   120us) service_pool.cc:224] Handling call
0709 13:19:19.521438 (+2144400us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b540025a3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:19.535967 (+ 14529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113687808}
I20260709 13:19:19.607774 14296 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:19.155678 14301 rpcz_store.cc:276] 0709 13:19:17.750350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.154463 (+1404113us) service_pool.cc:224] Handling call
0709 13:19:19.154787 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.154964 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.154991 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.155035 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:19.155065 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.155117 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.155223 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.610754 18279 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:19.632129 14866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.011s	sys 0.022s
W20260709 13:19:19.632799 14866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.011s	sys 0.022s
W20260709 13:19:19.637954 18610 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.029s	sys 0.016s
W20260709 13:19:19.638850 18610 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.029s	sys 0.016s
I20260709 13:19:19.638965 18221 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:19.639706 18221 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:19.671051 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 1.01925e+06us
W20260709 13:19:19.664475 14267 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.008s	sys 0.024s
W20260709 13:19:19.685755 14267 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.009s	sys 0.025s
I20260709 13:19:19.699755 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1030) took 1952 ms. Trace:
I20260709 13:19:19.700819 14301 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:19.688755 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2515) took 1247 ms. Trace:
W20260709 13:19:19.694720 14268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.016s	sys 0.014s
W20260709 13:19:19.702167 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.701731 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 779) took 1629 ms. Trace:
I20260709 13:19:19.708073 14301 rpcz_store.cc:276] 0709 13:19:18.072074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.699420 (+1627346us) service_pool.cc:224] Handling call
0709 13:19:19.700433 (+  1013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.701360 (+   927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.701608 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:19.709630 14268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.017s	sys 0.014s
I20260709 13:19:19.700310 14228 rpcz_store.cc:276] 0709 13:19:17.746994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.747175 (+   181us) service_pool.cc:224] Handling call
0709 13:19:17.754418 (+  7243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.754623 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:17.764711 (+ 10088us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.780754 (+1016043us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b1800327760. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf
0709 13:19:18.890606 (+109852us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.698854 (+808248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.699005 (+   151us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:19.699161 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.699287 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.699548 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1213262,"prepare.queue_time_us":15521,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":3629,"raft.queue_time_us":1312238,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":12334,"spinlock_wait_cycles":38678144,"thread_start_us":185895,"threads_started":2}
I20260709 13:19:19.683641 18221 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.714807 18520 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:19.714823 18221 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:19.725231 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2677) took 2098 ms. Trace:
W20260709 13:19:19.727020 14269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.018s	sys 0.014s
I20260709 13:19:19.726577 14302 rpcz_store.cc:276] 0709 13:19:17.627012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.703214 (+ 76202us) service_pool.cc:224] Handling call
0709 13:19:17.744659 (+ 41445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.261503 (+516844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.724597 (+1463094us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b540022c9d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:19.725000 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182622080}
W20260709 13:19:19.732569 14269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.019s	sys 0.015s
W20260709 13:19:19.739440 14375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1042) took 2364 ms (client timeout 1630 ms). Trace:
W20260709 13:19:19.740070 14375 rpcz_store.cc:269] 0709 13:19:17.375093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.375542 (+   449us) service_pool.cc:224] Handling call
0709 13:19:19.738826 (+2363284us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540004bad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:19.739195 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841623936}
W20260709 13:19:19.743798 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 1.1764e+06us
W20260709 13:19:19.748449 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.747175 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.017s	sys 0.045s
W20260709 13:19:19.750706 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.018s	sys 0.045s
I20260709 13:19:19.702524 14225 rpcz_store.cc:276] 0709 13:19:18.383079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.397861 (+ 14782us) service_pool.cc:224] Handling call
0709 13:19:18.398167 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.398345 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:18.419829 (+ 21484us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.531485 (+111656us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.512160 (+980675us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b180004a8c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:19.551416 (+ 39256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.553350 (+  1934us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:19.603665 (+ 50315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.615787 (+ 12122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.630806 (+ 15019us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1138822,"prepare.queue_time_us":24749,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":2260,"raft.queue_time_us":1071665,"raft.run_cpu_time_us":744,"raft.run_wall_time_us":57347,"spinlock_wait_cycles":10109184,"thread_start_us":108791,"threads_started":1,"wal-append.queue_time_us":181990}
I20260709 13:19:19.760619 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:19.761392 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2609) took 1519 ms. Trace:
I20260709 13:19:19.762744 14302 rpcz_store.cc:276] 0709 13:19:18.242440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.746420 (+1503980us) service_pool.cc:224] Handling call
0709 13:19:19.757545 (+ 11125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.760474 (+  2929us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:19.760515 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.760799 (+   284us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:19.760837 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.760904 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.761300 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:19.752833 18501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.200s	user 0.033s	sys 0.021s
I20260709 13:19:19.763139 18631 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:19:19.766968 18288 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:19.767867 18288 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.772071 14302 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:19.773038 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2678) took 1311 ms. Trace:
W20260709 13:19:19.773264 18568 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 2.353s	user 0.051s	sys 0.125s
I20260709 13:19:19.773478 14302 rpcz_store.cc:276] 0709 13:19:18.461457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.768382 (+1306925us) service_pool.cc:224] Handling call
0709 13:19:19.769078 (+   696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.772699 (+  3621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.772944 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.775972 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2679) took 1314 ms. Trace:
I20260709 13:19:19.776428 14302 rpcz_store.cc:276] 0709 13:19:18.461766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.774651 (+1312885us) service_pool.cc:224] Handling call
0709 13:19:19.775178 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.775576 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.775605 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.775677 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:19.775714 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.775771 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.775896 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.778458 14302 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:19.779238 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2613) took 1249 ms. Trace:
I20260709 13:19:19.779946 14302 rpcz_store.cc:276] 0709 13:19:18.529658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.777558 (+1247900us) service_pool.cc:224] Handling call
0709 13:19:19.778123 (+   565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.778952 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.779183 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:19.773276 14296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 774) took 2022 ms (client timeout 1527 ms). Trace:
W20260709 13:19:19.783712 14864 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.014s	sys 0.018s
W20260709 13:19:19.789767 14864 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.015s	sys 0.018s
W20260709 13:19:19.782472 18501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.294s	user 0.034s	sys 0.021s
I20260709 13:19:19.788605 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1016) took 1361 ms. Trace:
W20260709 13:19:19.786124 14296 rpcz_store.cc:269] 0709 13:19:17.750867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.822709 (+ 71842us) service_pool.cc:224] Handling call
0709 13:19:19.772981 (+1950272us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54003af554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:19.773162 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3648280320}
I20260709 13:19:19.791077 14893 rpcz_store.cc:276] 0709 13:19:18.424210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.759708 (+1335498us) service_pool.cc:224] Handling call
0709 13:19:19.785825 (+ 26117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:19.794019 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.784175 18288 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.793737 18505 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:19.799031 18505 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:19.811134 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 746504us
I20260709 13:19:19.814292 14301 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:19.822340 14370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1049) took 2198 ms (client timeout 1778 ms). Trace:
W20260709 13:19:19.822939 14370 rpcz_store.cc:269] 0709 13:19:17.624137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.626312 (+  2175us) service_pool.cc:224] Handling call
0709 13:19:19.821911 (+2195599us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54000613d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:19.822128 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539409280}
I20260709 13:19:19.826102 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2608) took 1584 ms. Trace:
I20260709 13:19:19.826759 14301 rpcz_store.cc:276] 0709 13:19:18.242156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.735004 (+1492848us) service_pool.cc:224] Handling call
0709 13:19:19.762851 (+ 27847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.825744 (+ 62893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.826005 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.829031 14302 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:19:19.829509 14342 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:19.832053 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:19.833637 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:19.834080 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2686) took 1302 ms. Trace:
I20260709 13:19:19.855309 14302 rpcz_store.cc:276] 0709 13:19:18.531905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.780945 (+1249040us) service_pool.cc:224] Handling call
0709 13:19:19.792329 (+ 11384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.829637 (+ 37308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.833993 (+  4356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:19.834324 18505 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.835229 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:19.844939 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:19.846012 18076 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:19.858174 18262 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:19.858242 18631 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.859557 18631 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:19.859468 18262 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:19.861708 18600 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.630s	user 0.002s	sys 0.035s
I20260709 13:19:19.847937 18354 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:19.872479 18577 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 2.064s	user 0.016s	sys 0.006s
W20260709 13:19:19.875398 18599 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.648s	user 0.010s	sys 0.011s
I20260709 13:19:19.877914 18526 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.878618 18597 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.878993 18526 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:19.847230 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.26693e+06us
I20260709 13:19:19.849550 18288 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:19.864969 18416 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:19.883028 18416 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.887410 18511 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:19.888285 18511 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:19.889009 18526 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.890033 18279 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:19.890772 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 59004.1us
I20260709 13:19:19.891029 18279 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:19.892454 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:19.885685 18574 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.894101 18076 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:19.894639 18076 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.895054 18076 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:19.895459 18511 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.896130 18505 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.897125 18279 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.868759 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 777) took 1887 ms. Trace:
I20260709 13:19:19.869948 18615 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:19.899633 18537 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.899819 14295 rpcz_store.cc:276] 0709 13:19:17.981670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.113470 (+131800us) service_pool.cc:224] Handling call
0709 13:19:19.844534 (+1731064us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:19:19.868687 (+ 24153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16568704}
I20260709 13:19:19.900653 18511 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.901546 18511 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:19.870146 18561 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:19.904187 18511 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.901541 18453 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:19.904549 18561 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.905704 18453 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.907542 18561 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.908388 18478 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:19.908447 18487 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:19.909811 18487 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:19.878546 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:19.862250 14893 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:19.863996 18262 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.878170 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2671) took 2604 ms. Trace:
I20260709 13:19:19.881165 18288 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:19.879647 18597 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:19.884341 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:19.884590 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2605) took 2608 ms. Trace:
I20260709 13:19:19.885031 18636 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:19.886019 18631 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.865979 14900 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:19.893705 18294 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.897034 18505 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.867992 18476 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.900956 18537 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.908526 18561 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.911033 18632 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:19.912199 18453 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.926018 18274 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:19.926689 18636 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:19.931042 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46997.9us
I20260709 13:19:19.927037 18288 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.908397 18501 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:19.934072 18262 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:19.934173 18274 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.934854 18262 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:19.936699 18274 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.936364 18262 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:19.937412 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2666) took 3208 ms. Trace:
I20260709 13:19:19.938288 18632 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:19.941087 18636 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.930974 14192 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:19.929479 18581 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 2.175s	user 0.008s	sys 0.018s
I20260709 13:19:19.949546 18540 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.950467 18540 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.952780 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:19.953209 18540 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:19.953655 14301 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 6: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:19.954087 14894 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:19.954620 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1018) took 1529 ms. Trace:
I20260709 13:19:19.955015 14894 rpcz_store.cc:276] 0709 13:19:18.424718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.537409 (+112691us) service_pool.cc:224] Handling call
0709 13:19:19.878153 (+1340744us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:19:19.954533 (+ 76380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16557952}
I20260709 13:19:19.955574 14226 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:19.949252 18561 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:19.943895 14300 rpcz_store.cc:276] 0709 13:19:16.729306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.811129 (+ 81823us) service_pool.cc:224] Handling call
0709 13:19:17.389769 (+578640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.447387 (+ 57618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.937009 (+2489622us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54000dbbd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:19.937232 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1330053504}
I20260709 13:19:19.909385 18478 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:19.953550 14897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1057) took 2579 ms (client timeout 2964 ms). Trace:
W20260709 13:19:19.941905 14111 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 37975f772fc648329a8acae36d33a345 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 181bbac22422408c87cd13b7fe3008f9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:19:19.971840 14897 rpcz_store.cc:269] 0709 13:19:17.373866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.373980 (+   114us) service_pool.cc:224] Handling call
0709 13:19:19.953163 (+2579183us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54008674d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:19.953363 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3908869504}
I20260709 13:19:19.930295 18587 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:19:19.981101 18274 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:19.983390 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:19.979126 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 73361.2us
I20260709 13:19:19.985368 18487 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:19.985968 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 780) took 1854 ms. Trace:
I20260709 13:19:19.986155 18288 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:19.987131 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:19.987947 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:19.989940 18476 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:19.914921 14303 rpcz_store.cc:276] 0709 13:19:17.273139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.273243 (+   104us) service_pool.cc:224] Handling call
0709 13:19:17.273499 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.273699 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:17.350705 (+ 77006us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.450727 (+1100022us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b1800321b20. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a 00007f8ded096a2a
0709 13:19:18.599716 (+148989us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.811471 (+1211755us) spinlock_profiling.cc:243] Waited 8.44 ms on lock 0x7b1800321b20. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:19.869257 (+ 57786us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.869368 (+   111us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:19.869507 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.869643 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.877961 (+  8318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":753,"prepare.queue_time_us":96493,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":99,"raft.queue_time_us":322221,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":28665,"spinlock_wait_cycles":259410176,"thread_start_us":177114,"threads_started":2,"wal-append.queue_time_us":1687672}
W20260709 13:19:19.991250 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.984027 18540 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:19.997975 18274 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:19.999032 14893 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:19.994644 14299 rpcz_store.cc:276] 0709 13:19:18.119166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.185306 (+ 66140us) service_pool.cc:224] Handling call
0709 13:19:19.942595 (+1757289us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b54003afa54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:19.973932 (+ 31337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28776832}
I20260709 13:19:19.919195 14298 rpcz_store.cc:276] 0709 13:19:17.276134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.276257 (+   123us) service_pool.cc:224] Handling call
0709 13:19:17.276532 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.314568 (+ 38036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.314614 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:17.315231 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.596452 (+281221us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:17.596509 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.596607 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.871374 (+2274767us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:19.883998 (+ 12624us) raft_consensus.cc:1685] finished
0709 13:19:19.884022 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.884404 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70972,"raft.queue_time_us":38814,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":30524,"spinlock_wait_cycles":21048192,"thread_start_us":280888,"threads_started":1,"wal-append.queue_time_us":482970}
I20260709 13:19:20.009632 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.010529 14298 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:20.011693 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.013166 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.023939 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:20.023972 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 45032.9us
I20260709 13:19:20.025548 14897 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:19:20.031850 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:20.033408 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:20.038429 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:20.036379 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:20.041145 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.042356 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:20.042639 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.042783 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.043507 14226 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:20.044889 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.046346 14901 raft_consensus.cc:2410] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:20.046211 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.046983 14228 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:20.045074 14222 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.047660 18597 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:20.049582 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.050313 14296 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:20.051394 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.051836 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:20.052448 18294 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.054886 18274 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:20.056725 14224 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:19:20.007922 18636 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:20.059079 14304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 773) took 2308 ms (client timeout 1999 ms). Trace:
I20260709 13:19:20.059316 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:20.059592 14304 rpcz_store.cc:269] 0709 13:19:17.750622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.912390 (+161768us) service_pool.cc:224] Handling call
0709 13:19:20.056950 (+2144560us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b54003d3bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:20.058831 (+  1881us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40579328}
I20260709 13:19:20.060072 14298 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:20.060918 18615 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:20.061384 14298 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:20.062100 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.063293 18419 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:20.064213 14221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1037) took 1653 ms (client timeout 2023 ms). Trace:
I20260709 13:19:20.064019 18419 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:20.064599 14221 rpcz_store.cc:269] 0709 13:19:18.410326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.414711 (+  4385us) service_pool.cc:224] Handling call
0709 13:19:20.055672 (+1640961us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540026d4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:20.064141 (+  8469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2425032064}
I20260709 13:19:20.065982 14222 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:20.066045 18076 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:20.072149 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 63843.8us
I20260709 13:19:20.184705 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.022440 18416 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:20.213266 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.254431 18636 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:20.256209 18636 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:20.258736 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 190536us
I20260709 13:19:20.260484 18429 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:20.261070 18076 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:20.262887 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 59268.9us
W20260709 13:19:20.270103 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 119386us
I20260709 13:19:20.061384 18615 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:20.024294 18501 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:20.190049 18587 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:20.305950 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.299399 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:20.309738 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.284153 18615 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.314980 14296 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:19:20.320101 18640 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:19:20.325810 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:20.329888 18221 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.008s
I20260709 13:19:20.261113 18429 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:20.330446 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:20.366043 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 47627.3us
I20260709 13:19:20.377393 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:20.375543 18251 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:20.378628 14223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2115) took 3063 ms (client timeout 2793 ms). Trace:
W20260709 13:19:20.379011 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.378898 18251 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:20.379403 14223 rpcz_store.cc:269] 0709 13:19:17.315415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.315826 (+   411us) service_pool.cc:224] Handling call
0709 13:19:20.375806 (+3059980us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54002a1cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:20.378418 (+  2612us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702681984}
I20260709 13:19:20.375607 18476 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:20.366276 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:20.383648 18476 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.344800 18632 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:20.378666 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:20.378805 14899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1015) took 1932 ms (client timeout 1633 ms). Trace:
I20260709 13:19:20.389133 18476 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.392551 18498 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:20.393435 18355 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:20.393831 14377 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:20.395247 18563 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.396075 18563 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:20.397037 18076 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.397653 18076 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:20.382402 18354 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.010s
I20260709 13:19:20.392758 18294 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:20.389843 14899 rpcz_store.cc:269] 0709 13:19:18.423937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.433410 (+  9473us) service_pool.cc:224] Handling call
0709 13:19:20.322440 (+1889030us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54004bfad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:20.356447 (+ 34007us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580325760}
I20260709 13:19:20.363471 18522 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:20.409334 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:20.412568 18478 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:20.417183 18561 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:20.400573 18587 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:20.419106 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:20.419332 18501 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:20.419495 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:20.420673 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:20.422746 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:20.424340 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:20.424988 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:20.359615 18562 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.346s
W20260709 13:19:20.400327 18566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.390s	user 0.014s	sys 0.054s
I20260709 13:19:20.423713 18476 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:20.446358 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:20.447291 18476 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:20.447777 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:20.449913 14375 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.425102 18294 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:20.454186 18294 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:20.455101 14371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2156) took 4726 ms (client timeout 3029 ms). Trace:
W20260709 13:19:20.455564 14371 rpcz_store.cc:269] 0709 13:19:15.728752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.935612 (+206860us) service_pool.cc:224] Handling call
0709 13:19:16.972805 (+1037193us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:19:20.442287 (+3469482us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001b85d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:20.454903 (+ 12616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2937898496}
W20260709 13:19:20.456081 18566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.648s	user 0.015s	sys 0.054s
I20260709 13:19:20.456969 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:20.459227 18505 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:20.465046 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.403285 18076 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:20.408104 18632 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:20.467996 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 58759.9us
I20260709 13:19:20.471726 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:20.480769 14222 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:20.476202 18453 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:20.476325 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:20.477092 14373 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:20.477483 18478 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:20.477679 14220 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:20.478641 14221 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 5.
I20260709 13:19:20.426324 18354 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:20.485882 14372 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.485745 18453 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.419421 18587 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:20.486420 18478 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.502015 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:20.503625 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:20.504068 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:20.504654 14373 raft_consensus.cc:2410] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:19:20.480264 18632 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.502130 18478 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.499087 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:20.498478 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:20.443158 18537 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:20.483419 18540 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.504274 18561 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:20.511754 14893 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:20.393491 18498 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:20.488211 18251 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:20.496042 18453 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:20.505153 18288 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.001s
I20260709 13:19:20.510986 18632 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:20.530225 14370 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:20.535583 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:20.536388 14893 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.536240 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:20.549412 14225 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.487613 18522 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:20.552773 14228 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.544911 14270 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:20.545601 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.518199 18501 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:19:20.560456 14897 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:20.529893 18540 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:20.578287 14370 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:20.578176 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.581489 14220 raft_consensus.cc:2410] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:19:20.555128 18288 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:20.582722 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:20.558079 18563 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:20.592027 14898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1019) took 2162 ms (client timeout 1964 ms). Trace:
I20260709 13:19:20.590510 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:20.592571 14898 rpcz_store.cc:269] 0709 13:19:18.426912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.446437 (+ 19525us) service_pool.cc:224] Handling call
0709 13:19:20.572451 (+2126014us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54007468d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:20.589607 (+ 17156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451502464}
I20260709 13:19:20.571379 14375 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:20.596726 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:20.598191 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58373.9us
W20260709 13:19:20.600680 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 408718us
I20260709 13:19:20.583788 18251 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.572443 18561 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:20.583173 18566 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:20.586476 18597 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:20.622049 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.622893 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:20.613736 18643 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.245s	user 0.002s	sys 0.000s
I20260709 13:19:20.626386 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:20.633859 14896 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:19:20.634536 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 250039us
I20260709 13:19:20.616561 18566 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:20.630110 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:20.601569 18288 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:20.628949 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:20.646140 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.649081 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:20.679664 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.690094 14897 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:20.695433 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 239754us
I20260709 13:19:20.696122 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.698047 14223 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 5.
I20260709 13:19:20.700388 18352 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.697575 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.643301 18251 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:20.723116 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44429us
I20260709 13:19:20.655925 18615 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:20.731516 18659 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:19:20.738273 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:20.740839 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.739038 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.684511 18429 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:19:20.738664 18501 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:20.751914 18501 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:20.753641 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.745741 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:20.756062 18661 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:20.756716 18661 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:20.757928 18587 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.760601 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:20.761759 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 89943.9us
I20260709 13:19:20.754369 14220 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:20.766137 18566 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:20.767297 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:20.767617 18566 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:20.768015 14897 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:19:20.771193 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.771438 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.772526 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.773506 14298 raft_consensus.cc:2410] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:20.774436 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.775615 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.776800 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:20.777484 14299 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.780473 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:20.782294 18419 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:20.785323 18351 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:20.785740 18351 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:20.786720 18351 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:20.787772 18351 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.788815 14299 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:20.793978 18537 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:20.797081 18537 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:20.798082 18482 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:20.798445 18482 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:20.799525 18482 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:20.800242 18499 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:20.800964 18482 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:20.802275 14295 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:19:20.803709 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:20.809942 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:20.810506 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.810714 14229 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:20.811196 14302 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
W20260709 13:19:20.812160 18662 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:19:20.814596 18251 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:20.815932 18663 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:20.793336 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:20.819859 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 54068.6us
I20260709 13:19:20.830221 14296 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:20.743237 18076 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:21.011462 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:20.916718 14893 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
W20260709 13:19:20.890288 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49140.8us
I20260709 13:19:20.843663 14376 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:20.764107 18498 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:20.856864 14371 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:20.864524 14300 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:20.908113 14372 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:21.016503 14225 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
W20260709 13:19:21.030150 14374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.015s	sys 0.031s
W20260709 13:19:20.862823 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 69601.5us
W20260709 13:19:21.031802 14374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.015s	sys 0.031s
W20260709 13:19:21.030853 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.828397 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:20.831836 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:20.925043 14892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1064) took 2749 ms (client timeout 2663 ms). Trace:
I20260709 13:19:20.999065 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:21.042959 14223 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:21.038686 14892 rpcz_store.cc:269] 0709 13:19:17.993923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.994104 (+   181us) service_pool.cc:224] Handling call
0709 13:19:20.688010 (+2693906us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400624b54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:20.743380 (+ 55370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435687296}
I20260709 13:19:21.045125 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.046489 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:21.048882 14228 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:20.931192 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:21.050987 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:20.941874 18487 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:21.059629 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:20.995151 18501 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:21.064545 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 304291us
I20260709 13:19:20.963949 18288 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:21.061501 14372 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:21.014955 18540 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:20.884073 18587 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:20.943845 18615 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:20.920466 18522 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:20.886885 18537 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:21.067165 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 285193us
I20260709 13:19:21.074116 14302 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:21.063491 18632 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.001s
I20260709 13:19:20.942373 18561 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:21.039985 18453 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:21.067528 18636 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.078433 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:21.055249 18661 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:21.080464 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.080892 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:21.059407 18487 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:21.081588 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:21.081903 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:21.082151 14376 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:21.101425 14220 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 5.
W20260709 13:19:21.086386 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.094424 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:21.095103 14222 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:21.101997 14372 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
W20260709 13:19:21.089414 18654 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.432s	user 0.004s	sys 0.000s
I20260709 13:19:21.102242 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:21.108793 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.087838 18537 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.091207 18539 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:21.103744 14378 raft_consensus.cc:2376] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11. Re-sending same reply.
I20260709 13:19:21.111290 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.113039 14372 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:19:21.114046 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.114990 14372 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:21.117745 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:21.115918 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.120383 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.120663 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:21.121372 14375 raft_consensus.cc:2410] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:19:21.121466 14892 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 10: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:21.122252 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.122931 14375 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:21.106949 18540 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.116034 18454 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:21.133343 18454 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:21.134143 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:21.134932 14893 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:21.115126 18487 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:21.135713 14221 raft_consensus.cc:2410] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:21.135922 18487 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.136752 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:21.118629 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:21.138063 14228 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:21.090255 18498 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.132733 14370 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
I20260709 13:19:21.138996 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.112941 18636 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.140813 18328 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.141409 18328 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.123703 18540 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.112577 18539 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.138212 14222 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:19:21.105666 14865 connection.cc:256] RPC call timeout handler was delayed by -1.6751868380001724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 13:19:21.149868 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:21.147344 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:21.150159 14865 connection.cc:256] RPC call timeout handler was delayed by -1.2527191550000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 13:19:21.134341 18454 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:21.149763 14225 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:19:21.151959 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49802.8us
I20260709 13:19:21.095080 18632 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:21.154876 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49727.8us
I20260709 13:19:21.152881 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:21.113095 18537 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.114259 18522 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:21.160532 18672 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:19:21.160972 18645 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:21.151868 18539 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.163199 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:21.159597 18498 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:21.165194 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:21.167446 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.167893 18352 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:21.173547 18328 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:21.221982 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.169842 14227 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:21.176702 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.222957 14370 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:21.178603 18076 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:21.179845 18454 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.180610 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:21.181468 14376 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:21.182119 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:21.162946 18673 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:21.187310 18587 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:21.190833 18478 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.000s
W20260709 13:19:21.267275 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 214605us
I20260709 13:19:21.267562 18478 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.268958 18416 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:21.270120 18478 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:21.270468 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 177296us
I20260709 13:19:21.270958 14222 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:21.271533 14267 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:21.272270 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.272567 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:21.192550 18632 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:21.273984 18562 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:19:21.194480 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.275126 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.275229 18597 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:21.275910 14376 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:21.276499 18597 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:21.276872 18597 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:21.196555 18300 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:21.197991 18658 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 13:19:21.206583 14226 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:21.207953 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:21.209960 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47736.4us
I20260709 13:19:21.211723 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:21.278343 18416 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:21.282733 14227 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:21.213932 14378 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
W20260709 13:19:21.168339 18641 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.807s	user 0.004s	sys 0.000s
I20260709 13:19:21.283977 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:21.285173 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2616) took 1336 ms. Trace:
I20260709 13:19:21.219831 14300 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:21.286819 18649 raft_consensus.cc:3055] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:21.285604 14297 rpcz_store.cc:276] 0709 13:19:19.948422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.949028 (+   606us) service_pool.cc:224] Handling call
0709 13:19:19.949542 (+   514us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:19.950267 (+   725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.950299 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:19.951188 (+   889us) log.cc:844] Serialized 78 byte log entry
0709 13:19:20.058022 (+106834us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:20.412279 (+354257us) log.cc:844] Serialized 14 byte log entry
0709 13:19:20.419973 (+  7694us) log.cc:844] Serialized 14 byte log entry
0709 13:19:20.420188 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.420263 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.165025 (+744762us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b24000d6e98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fde09d 00007f8decc1010e 00007f8decc2788c 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221
0709 13:19:21.284851 (+119826us) raft_consensus.cc:1685] finished
0709 13:19:21.284875 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.285011 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":622364,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":8519,"raft.queue_time_us":9262,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":300,"spinlock_wait_cycles":122033536,"thread_start_us":218258,"threads_started":2,"wal-append.queue_time_us":252347}
I20260709 13:19:21.287258 18649 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:21.141417 18636 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:21.202632 18522 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.288046 18522 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.288209 18649 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.229907 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.219275 18352 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.289388 18649 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.289664 18352 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.289999 18300 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.292299 18300 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:21.292382 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:21.293119 14227 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:21.238009 18503 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:21.294009 18478 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:21.245476 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.294643 18478 raft_consensus.cc:697] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:21.295174 14295 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:21.295740 18478 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.297415 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:21.298743 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.246243 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:21.299820 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:21.300098 14303 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:21.301203 18540 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:21.228783 18076 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.282795 18416 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:21.302167 18557 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:21.302942 18416 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.304232 18416 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.219058 18294 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:21.285193 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.306002 18294 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:21.306250 14378 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:21.306497 18294 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.307525 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:21.308364 14378 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:21.282763 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 119335us
W20260709 13:19:21.309612 18671 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.283s	user 0.004s	sys 0.000s
I20260709 13:19:21.311941 18453 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:21.246649 18498 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:21.251019 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 69005.2us
I20260709 13:19:21.251848 18487 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:21.253201 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1021) took 1451 ms. Trace:
I20260709 13:19:21.276813 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:21.195403 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.277575 14900 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:21.220091 18645 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:21.312623 18566 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.002s
I20260709 13:19:21.534030 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:21.535797 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.275230 18461 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:21.316982 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.536885 18597 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.547793 14303 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:21.364647 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.435917 14297 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:21.270406 18607 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.258101 18673 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:21.539997 18615 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:21.540515 14376 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:21.540872 18487 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.299834 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.541489 14894 rpcz_store.cc:276] 0709 13:19:19.802347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.039614 (+237267us) service_pool.cc:224] Handling call
0709 13:19:20.040104 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.169060 (+128956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.169098 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.283973 (+114875us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.523990 (+240017us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:20.524046 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.584261 (+ 60215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.964752 (+380491us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:21.252765 (+288013us) raft_consensus.cc:1685] finished
0709 13:19:21.252796 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.253098 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94995,"raft.queue_time_us":128869,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":9692,"spinlock_wait_cycles":18057600,"thread_start_us":202770,"threads_started":1,"wal-append.queue_time_us":318360}
I20260709 13:19:21.542615 18667 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
W20260709 13:19:21.444223 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67897.7us
I20260709 13:19:21.481577 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.409698 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.363894 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2171) took 1023 ms. Trace:
W20260709 13:19:21.550240 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.564466 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.408968 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.400876 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:21.373509 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:21.400344 14378 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:21.511943 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.438551 14222 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:21.566033 14298 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 6.
I20260709 13:19:21.538905 18566 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:21.558688 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 258948us
W20260709 13:19:21.572837 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.578579 14224 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:21.557564 14300 raft_consensus.cc:2368] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9.
I20260709 13:19:21.567569 14225 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:21.578742 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.444614 18503 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:21.409226 18482 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.580633 14303 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:21.586632 14369 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:21.585381 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:21.582852 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47139.1us
I20260709 13:19:21.478207 18270 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.584257 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.558456 18453 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:21.588793 14192 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.562618 14374 rpcz_store.cc:276] 0709 13:19:20.340107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.340307 (+   200us) service_pool.cc:224] Handling call
0709 13:19:20.387558 (+ 47251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.033110 (+645552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.033143 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.049170 (+ 16027us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.210913 (+161743us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:21.263972 (+ 53059us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.318218 (+ 54246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.354001 (+ 35783us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.354710 (+   709us) raft_consensus.cc:1685] finished
0709 13:19:21.354727 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.363826 (+  9099us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56253,"prepare.queue_time_us":52811,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":133392,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":21256,"spinlock_wait_cycles":46337280,"thread_start_us":764428,"threads_started":2,"wal-append.queue_time_us":159837}
I20260709 13:19:21.577105 18607 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.591349 18499 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:19:21.593895 18354 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:21.594300 18354 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:21.594507 18607 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:21.595394 18354 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:21.596818 18354 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:21.598084 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:21.580587 18563 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:19:21.572460 18673 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.602486 18537 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.603343 18561 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.603978 18561 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.606698 14302 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:21.607302 18630 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:21.607826 18630 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:21.608361 18351 consensus_meta.cc:287] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.764s	user 0.012s	sys 0.000s
I20260709 13:19:21.545236 18522 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.610678 18522 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:21.611536 18597 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:21.614341 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.591205 18574 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:21.615190 18678 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:19:21.615165 18561 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:21.616664 18630 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:21.618606 14111 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 37975f772fc648329a8acae36d33a345 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 181bbac22422408c87cd13b7fe3008f9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:21.619279 14377 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:21.621944 18270 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:21.596837 14374 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:21.624286 18270 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:21.571959 18487 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:21.630191 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 218211us
I20260709 13:19:21.631385 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.631982 18539 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.580571 18636 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:19:21.635654 18636 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:21.636212 18636 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:21.638095 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 53127.7us
W20260709 13:19:21.639009 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 66896.3us
I20260709 13:19:21.639107 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:21.640844 14342 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.641686 18499 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:21.654194 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.657176 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.654488 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:21.633428 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.584740 18503 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:21.664510 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.665283 18499 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:21.665692 18499 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.666062 18499 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:21.666906 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.667702 14299 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:21.669287 14299 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:21.664572 18674 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:21.664722 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73893.1us
I20260709 13:19:21.674533 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.675594 14302 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:21.662218 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:21.678647 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 91292.7us
W20260709 13:19:21.681435 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 178783us
I20260709 13:19:21.637151 18636 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.376427 18352 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.699230 18352 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:21.700196 14370 raft_consensus.cc:2368] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7.
I20260709 13:19:21.690140 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.692078 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:21.687067 18270 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:21.696802 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:21.707329 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.654934 18453 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:21.689216 18574 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.708285 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:21.711074 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.718544 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:21.660997 18630 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:21.705390 18419 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:21.714767 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:21.722097 14304 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:21.659804 18537 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:21.724519 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.725065 14297 raft_consensus.cc:2410] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:19:21.725745 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:21.728103 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.720191 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.730316 14370 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:19:21.759981 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 80478.8us
I20260709 13:19:21.762146 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.772439 14342 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:21.658352 18482 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.783596 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.786773 14303 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:21.786819 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.787614 14296 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:21.724551 18270 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:21.724736 18355 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:21.709271 18499 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:21.785820 18352 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:21.791275 18352 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.791388 18499 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:21.791690 18352 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.795408 18645 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.797045 18673 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:21.682233 18076 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:21.782241 18682 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.798729 18682 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:21.799556 18076 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:21.717758 18453 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:21.800822 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.803174 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:21.802052 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.677019 18294 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:21.809549 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:21.811182 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:21.814073 18270 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.814803 18352 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.817062 18352 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:21.826082 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 192782us
I20260709 13:19:21.828353 14865 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.829341 18649 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:21.829891 18539 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:21.832079 14342 leader_election.cc:400] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9.
I20260709 13:19:21.832532 14342 leader_election.cc:403] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.725319 18419 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:21.829495 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:21.839145 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:21.825372 18482 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:21.842597 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 179701us
I20260709 13:19:21.844118 14225 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:21.771585 18562 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:21.848919 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 74721.4us
I20260709 13:19:21.782646 18351 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:21.793356 18487 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:21.857093 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 218108us
I20260709 13:19:21.786512 18498 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:21.863288 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 94274.8us
W20260709 13:19:21.866588 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.732946 18461 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:19:21.870671 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.866410 14304 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:21.799647 18682 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.681896 18503 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:21.872080 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.879241 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:21.880101 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.880553 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:21.873984 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 285287us
I20260709 13:19:21.841310 18419 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:21.881259 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:21.882055 14300 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:21.852586 18649 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.853507 18674 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:21.891449 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.886237 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.886301 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:21.891206 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:21.878244 14864 leader_election.cc:336] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.755s (SENT)
I20260709 13:19:21.870257 18615 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:21.897629 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:21.922228 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.923795 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.924321 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:21.865236 18453 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:21.933470 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:21.945030 14302 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.930918 14303 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:21.934492 14342 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:21.934149 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:21.886309 18649 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:21.949925 14370 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:21.882159 18076 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:19:21.925887 18461 consensus_queue.cc:1243] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:21.891232 18630 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:19:21.932359 18503 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:21.965296 18681 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:19:21.965750 18487 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:21.966696 18487 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:21.969599 18693 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:21.970263 18693 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:21.971289 18693 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:21.949291 18351 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:21.972540 18690 raft_consensus.cc:3055] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:21.973057 18690 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:21.959872 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 81681.9us
I20260709 13:19:21.944306 18352 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:21.961594 14222 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.959614 18332 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:21.963979 18566 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:21.956779 18537 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:21.964488 18684 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:19:21.975857 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.991346 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.978353 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.955726 18649 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.979948 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:21.987471 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 95173.6us
I20260709 13:19:21.999380 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.974472 18221 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.998893 14222 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:22.025976 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:22.021716 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:22.030498 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:22.032217 14226 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:22.030378 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:22.034521 14220 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:22.036342 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:22.037191 14228 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.974479 18595 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.241s
W20260709 13:19:22.043846 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 117548us
I20260709 13:19:22.020143 18332 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:22.051558 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:21.974084 18690 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.002487 18566 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:22.053117 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 175803us
W20260709 13:19:22.099830 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 217560us
I20260709 13:19:22.041970 18221 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:22.199285 18695 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:19:22.200271 18221 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:22.200537 18685 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:19:22.201125 14227 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:22.202250 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1068) took 1425 ms. Trace:
W20260709 13:19:22.202769 18699 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:22.202675 14373 rpcz_store.cc:276] 0709 13:19:20.777056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.304739 (+527683us) service_pool.cc:224] Handling call
0709 13:19:21.305093 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.371379 (+ 66286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.371426 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.372018 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.887452 (+515434us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:21.936704 (+ 49252us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.945009 (+  8305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.945112 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.970654 (+ 25542us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b18003e0680. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f522 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:19:22.201921 (+231267us) raft_consensus.cc:1685] finished
0709 13:19:22.202031 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.202188 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80125,"prepare.queue_time_us":45065,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":74511,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":57389,"spinlock_wait_cycles":11830016,"thread_start_us":372794,"threads_started":1,"wal-append.queue_time_us":539765}
I20260709 13:19:22.204245 18454 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:22.204638 18454 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:22.205271 18597 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.002s
I20260709 13:19:22.205581 18454 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.206872 18454 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:22.208645 18419 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:22.210094 14299 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:22.172397 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.211356 14377 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:22.211777 18574 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:22.212752 18698 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:19:22.139001 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.213680 14375 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:22.124114 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:22.052914 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 155324us
I20260709 13:19:22.159881 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:22.130738 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.214517 14220 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
W20260709 13:19:22.104476 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.216171 14376 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:22.157558 14867 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:22.217020 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59571.2us
I20260709 13:19:22.159924 14228 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:22.220402 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.221294 14377 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:22.222570 18566 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:22.222703 18649 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.226610 18649 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:22.217631 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:22.185510 14302 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
W20260709 13:19:22.164283 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 59189us
W20260709 13:19:22.102222 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 101749us
I20260709 13:19:22.170712 18453 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:22.100979 18294 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:22.121034 18332 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:22.228087 18574 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:22.229983 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:22.230556 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:22.064352 18537 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:22.265694 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 51334.7us
I20260709 13:19:22.252954 14193 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:22.266938 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:22.130541 18680 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.271s	user 0.002s	sys 0.000s
I20260709 13:19:22.078537 14370 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
W20260709 13:19:22.240583 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.249125 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:22.181449 18615 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:22.260322 18707 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:22.263265 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.260319 18419 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:22.264170 18557 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:22.264456 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:22.275507 18537 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:22.275781 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.276175 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:22.291286 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:22.245644 18461 raft_consensus.cc:2764] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:22.284175 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.293645 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:22.290309 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.290426 14894 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:22.253847 18574 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:22.267299 18478 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:22.299305 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.297399 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:22.303857 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:22.297646 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:22.306546 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:22.286440 18352 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9.
I20260709 13:19:22.266463 18566 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:19:22.277818 18700 raft_consensus.cc:2764] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:22.292308 18649 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:22.320781 14378 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:22.288712 18690 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:22.313441 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.313624 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.322501 14370 raft_consensus.cc:2410] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:22.314649 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:22.316468 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:22.317384 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:22.318554 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:22.323800 14377 raft_consensus.cc:2376] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10. Re-sending same reply.
W20260709 13:19:22.317337 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50469.1us
I20260709 13:19:22.323285 14373 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:22.325166 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:22.299834 18574 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:22.335916 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:22.336776 14296 raft_consensus.cc:2368] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7.
I20260709 13:19:22.326215 18539 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:22.326550 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.338187 14193 leader_election.cc:400] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7.
I20260709 13:19:22.338646 14193 leader_election.cc:403] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:19:22.338753 18708 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:19:22.300046 18478 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:22.331404 18696 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:19:22.333096 14342 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:22.333290 18673 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:22.328060 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:22.289620 18076 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:19:22.344079 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:22.414533 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 89442.6us
I20260709 13:19:22.415166 14375 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:22.306593 18454 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:22.415408 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:22.401497 14220 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:19:22.427958 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 94925.6us
W20260709 13:19:22.392961 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54950.5us
W20260709 13:19:22.366545 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.391208 14226 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 7: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:22.367237 14894 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:22.345615 14374 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:22.297173 18702 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:22.399621 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:22.405583 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:22.394996 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.397153 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.447687 14897 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:22.397934 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.400712 18691 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:22.317984 18562 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:22.397540 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.453490 14898 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:22.396703 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.454006 14895 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.420465 14303 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 5.
W20260709 13:19:22.376677 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.455725 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.459208 18355 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:22.459697 18355 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:22.460618 18355 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:22.461932 18454 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:22.462049 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56600.5us
W20260709 13:19:22.462838 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.462816 18270 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:22.463531 18270 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:22.454021 14864 leader_election.cc:336] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.778s (SENT)
I20260709 13:19:22.463939 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:22.464434 18270 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.465492 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:22.465745 18607 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:22.466249 18607 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:22.467028 14296 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:22.467113 18607 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.444612 18478 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:22.434072 14893 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:22.298631 18703 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:22.435918 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.476794 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.303288 18537 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:22.299242 18557 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:22.362128 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.344727 14267 connection.cc:256] RPC call timeout handler was delayed by -1.1222016320000421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
I20260709 13:19:22.447600 14901 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:22.393440 18221 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7.
I20260709 13:19:22.394598 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.448184 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:22.386608 18649 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:22.446988 18702 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.488552 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.489238 14894 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:22.489593 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.452555 18566 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:22.338141 18539 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.487182 14193 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:22.491017 14267 leader_election.cc:336] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.551s (SENT)
I20260709 13:19:22.509445 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:22.481709 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:22.496063 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47964.6us
I20260709 13:19:22.504703 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:22.512785 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:22.480264 18355 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:22.479107 18595 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:22.515398 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:22.529685 14296 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:22.525074 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:22.498127 18702 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:22.531687 14303 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:22.491415 18429 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.538614 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.531778 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.541852 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:22.509644 18566 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.545619 18537 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.532490 18562 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:22.550149 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.509717 18630 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.510943 18645 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.513705 18636 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:22.555546 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.399935 18332 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.558840 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:22.609026 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 118036us
I20260709 13:19:22.608065 14897 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:22.529464 18595 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:22.610222 14373 raft_consensus.cc:2368] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7.
I20260709 13:19:22.612327 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.636176 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.554517 18566 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:22.531327 18557 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:22.644183 14301 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:22.646157 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:22.646960 14374 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.559608 18636 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:22.637547 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.654903 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 161321us
W20260709 13:19:22.657470 14192 connection.cc:256] RPC call timeout handler was delayed by -1.0480484790000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 13:19:22.657840 14192 connection.cc:256] RPC call timeout handler was delayed by -1.0111175319998438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 13:19:22.660879 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.655290 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.662258 14897 raft_consensus.cc:2376] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10. Re-sending same reply.
W20260709 13:19:22.668236 14192 leader_election.cc:336] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.551s (SENT)
I20260709 13:19:22.668866 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:22.551129 18429 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.637633 14296 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:22.533018 18503 raft_consensus.cc:2764] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:22.653923 14899 raft_consensus.cc:2410] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:22.653802 14297 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:22.655114 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.509482 18615 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.687366 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:22.612058 18630 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.664963 18636 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.607488 18562 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:22.697291 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.699661 14893 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.673218 18703 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:22.703881 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.677977 18461 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:22.706899 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.708693 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:22.712862 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 44639.1us
I20260709 13:19:22.720870 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.721925 14378 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:22.725811 14896 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
W20260709 13:19:22.729094 14192 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.633s (SENT)
I20260709 13:19:22.635919 18454 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.734426 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.734723 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:22.642031 18645 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.741776 18429 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:22.673966 18574 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:22.744858 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 232155us
I20260709 13:19:22.745879 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:22.674118 18649 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.749806 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:22.750638 14370 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.746500 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:22.753290 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 93647us
W20260709 13:19:22.751667 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 94388.4us
I20260709 13:19:22.755365 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.758261 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:22.760540 14373 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:19:22.762315 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 257677us
W20260709 13:19:22.765498 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 130747us
I20260709 13:19:22.764245 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:22.768250 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:22.769439 14896 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:22.771502 14892 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:22.761549 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55602.2us
I20260709 13:19:22.744246 18673 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:22.780588 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:22.784592 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:22.785553 14222 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:22.789759 14375 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
W20260709 13:19:22.791808 18717 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:19:22.792011 18503 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:22.793709 18429 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:22.794803 18503 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:22.795342 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:22.728103 18595 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:22.821213 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.807768 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:22.807950 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:22.809734 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.810992 14893 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:22.821979 14897 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:22.829651 14374 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:22.779964 18351 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:22.777933 18539 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:22.834470 14192 leader_election.cc:336] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.682s (SENT)
I20260709 13:19:22.835670 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:22.899878 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:22.802101 18503 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:22.910560 18503 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.890307 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:22.912108 14895 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:22.913197 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.914129 14895 raft_consensus.cc:2410] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:19:22.867254 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:22.844822 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.876039 18718 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 13:19:22.890761 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.808749 18221 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.892630 14373 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:22.891851 18351 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:19:22.893739 18562 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:22.891772 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 111255us
W20260709 13:19:22.900074 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 64498.4us
I20260709 13:19:22.864037 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.925890 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:22.926440 14896 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:22.897152 18478 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:22.907397 18574 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:22.907980 18702 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:22.908720 18725 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:19:22.908831 18645 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:22.919761 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 85309.3us
I20260709 13:19:22.866442 18673 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:22.942896 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.921118 14897 raft_consensus.cc:2410] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:19:22.912272 18719 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:19:22.925727 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:22.928730 14227 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:19:22.928642 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 62274.7us
I20260709 13:19:22.898258 18294 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:22.931391 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:22.920346 18720 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:19:22.956236 14221 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:22.933455 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:22.935518 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.936956 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:22.939334 18478 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:22.939945 14898 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:22.940857 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:22.934561 18728 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:22.920480 18703 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:22.948091 14267 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:22.950049 18690 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:22.950687 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:22.931075 18607 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:22.966542 14223 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:22.956529 14374 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:22.937397 18355 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:19:22.959034 14228 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:22.959985 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:22.935659 18503 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.929201 18722 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:22.963052 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.961659 18737 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:22.968091 14341 connection.cc:256] RPC call timeout handler was delayed by -2.4176596230001905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2663s for a response
I20260709 13:19:22.975865 14220 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:22.929035 18221 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:22.977453 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.991771 18294 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.021551 18294 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.000102 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:22.988893 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:22.958083 18574 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:22.995049 18691 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:22.965672 18690 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:23.003499 18730 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:23.023643 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:23.024473 14897 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:23.022369 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:23.034893 18221 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:23.035717 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.035941 18537 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:23.037149 14894 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:23.044440 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:23.008685 18607 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:23.037148 18709 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:23.050382 18716 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:19:23.007527 18454 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:19:23.066004 14897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:23.087056 14897 raft_consensus.cc:606] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.020066 18722 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:23.037961 18690 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:23.044806 18737 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.018662 18557 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:19:23.095953 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.038461 18574 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.052031 18731 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:19:23.042356 18703 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:19:23.068244 18709 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:23.088218 18351 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.142541 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.155401 14299 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:23.103677 18562 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:23.108603 18355 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:23.161015 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 141720us
W20260709 13:19:23.158278 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 125091us
I20260709 13:19:23.204370 14899 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.154706 18709 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:23.107949 18737 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.235760 18737 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:23.211203 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:23.237360 14373 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:23.204064 18607 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.212291 18736 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:23.244184 18736 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:23.212260 18740 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:19:23.213243 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.213971 18738 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.214064 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.246891 14377 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:23.247058 14371 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:23.246811 18738 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.247953 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.248028 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.248670 14377 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:23.249179 18738 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:23.249344 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.215122 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:23.215340 18742 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:19:23.216034 18734 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:19:23.216349 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.217075 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.216028 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.220870 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:23.160368 18649 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:23.229147 18673 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.160123 18562 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:23.160534 18351 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:23.208421 18636 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.250164 14372 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:23.265676 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:23.250954 14369 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:23.251236 14376 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:23.249769 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.251760 18574 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:23.253258 18738 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:23.252440 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:23.253598 18562 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:23.274571 18562 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:23.276098 18566 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.006s
I20260709 13:19:23.276814 18566 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.253068 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.262691 14226 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:23.279850 18737 raft_consensus.cc:2764] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:23.259030 18736 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:23.281726 14895 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
W20260709 13:19:23.282600 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.286660 18738 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:23.287613 18738 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.288224 18738 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:23.292065 18735 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.330s	user 0.001s	sys 0.001s
I20260709 13:19:23.256808 18351 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:23.252833 18294 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:23.279654 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:23.297003 18637 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:23.264322 14896 raft_consensus.cc:2410] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:19:23.300256 14373 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
W20260709 13:19:23.285544 14370 consensus_meta.cc:287] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 13:19:23.301302 14370 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:23.251972 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.302315 18352 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:23.302893 14375 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:23.252231 18702 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:23.304189 18630 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:23.252949 18673 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:23.307698 18673 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:23.297108 14341 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:23.311252 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.312644 18294 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:23.313272 18709 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.314272 18294 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:23.314987 18294 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:23.315649 18709 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:23.315876 18690 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.316097 18294 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.285640 14901 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:23.319363 14901 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:23.320685 14901 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:23.301404 14896 pending_rounds.cc:85] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 5
I20260709 13:19:23.321442 14896 pending_rounds.cc:107] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:19:23.321969 14896 raft_consensus.cc:2889] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:23.320744 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:23.328625 14341 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:23.333256 14901 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.331380 14894 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
W20260709 13:19:23.348039 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.370450 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.371358 14370 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:23.371918 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.372546 14373 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:23.373497 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.374541 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:23.375682 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.376284 14372 raft_consensus.cc:2376] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10. Re-sending same reply.
I20260709 13:19:23.380007 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.376642 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.383373 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.391278 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.392446 14370 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:19:23.392772 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 183568us
I20260709 13:19:23.393424 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:23.393524 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:23.398707 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.400318 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.401142 14376 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:23.402281 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.403693 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.404717 14377 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:23.406939 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.410307 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.411099 14374 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:23.411995 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.399397 14369 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:23.416905 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.297690 18637 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:23.418570 14371 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:23.417506 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 378879us
I20260709 13:19:23.367830 18352 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:23.379473 18736 raft_consensus.cc:2764] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:23.264213 18636 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:23.419456 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.426218 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.279615 18566 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:23.395643 18728 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:23.434103 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 437158us
I20260709 13:19:23.427484 14372 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:23.436686 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:23.438155 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:23.438571 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:23.438786 14371 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:23.438988 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.440465 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:23.440917 18221 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:23.444376 18744 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.283s	user 0.000s	sys 0.002s
I20260709 13:19:23.437484 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:23.430918 14867 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:23.338325 18355 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:23.437371 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55280.3us
I20260709 13:19:23.480125 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:23.488765 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.479638 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:23.491463 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60667us
I20260709 13:19:23.454316 14373 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:23.458793 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:23.442373 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.446882 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:23.491086 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:23.488660 14300 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
W20260709 13:19:23.437418 18419 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.016s	sys 0.005s
W20260709 13:19:23.518846 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 76539.9us
I20260709 13:19:23.519881 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.520414 18738 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:23.521183 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:23.522030 18636 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:23.522575 18636 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:23.523418 18636 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:23.527434 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.485247 18690 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:23.530879 18702 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:23.531405 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 55175.5us
I20260709 13:19:23.441720 18221 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:23.431239 18630 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:23.533082 18630 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.531582 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1094) took 1135 ms. Trace:
I20260709 13:19:23.533625 14899 rpcz_store.cc:276] 0709 13:19:22.396048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.246744 (+850696us) service_pool.cc:224] Handling call
0709 13:19:23.247131 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.247519 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.247549 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.248074 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.397289 (+149215us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:23.397340 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.397429 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.531352 (+133923us) raft_consensus.cc:1685] finished
0709 13:19:23.531371 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.531524 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1222,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":148782,"threads_started":1,"wal-append.queue_time_us":184956}
I20260709 13:19:23.535936 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:23.536376 18755 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:23.536675 14899 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:23.537176 18755 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:23.538966 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:23.539759 14899 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:23.541467 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:23.542436 14296 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:19:23.518072 14295 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:23.542968 14296 pending_rounds.cc:85] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 9
I20260709 13:19:23.543344 14296 pending_rounds.cc:107] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:19:23.543648 14296 raft_consensus.cc:2889] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:23.543891 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:23.544772 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:23.542692 14899 raft_consensus.cc:2410] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:23.546191 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:23.545414 14296 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
W20260709 13:19:23.547351 14267 leader_election.cc:336] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.794s (SENT)
I20260709 13:19:23.547072 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:23.532073 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:23.548112 14901 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:23.548987 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:23.495661 18728 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:23.550418 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:23.551541 14301 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:19:23.494117 18503 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:23.552132 18597 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.552572 18682 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:23.552724 18607 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.554796 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.539109 18566 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:23.559461 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1041) took 1111 ms. Trace:
I20260709 13:19:23.633322 18682 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.633749 14896 rpcz_store.cc:276] 0709 13:19:22.448054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.300673 (+852619us) service_pool.cc:224] Handling call
0709 13:19:23.301157 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.322796 (+ 21639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.322842 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.323352 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.492510 (+169158us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:23.492551 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.492612 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.559218 (+ 66606us) raft_consensus.cc:1685] finished
0709 13:19:23.559238 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.559389 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":168729,"threads_started":1,"wal-append.queue_time_us":234072}
I20260709 13:19:23.635556 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:23.546919 18630 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.549494 14901 raft_consensus.cc:2376] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12. Re-sending same reply.
W20260709 13:19:23.636451 14898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1045) took 1154 ms (client timeout 1500 ms). Trace:
I20260709 13:19:23.565497 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:23.576370 18690 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:19:23.638273 18750 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.567862 14295 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:23.572160 18752 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:23.638860 18750 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.639649 18752 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:23.442319 18637 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:23.640604 18752 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.562600 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:23.636869 14898 rpcz_store.cc:269] 0709 13:19:22.482407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.508909 (+ 26502us) service_pool.cc:224] Handling call
0709 13:19:23.636296 (+1127387us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54005f5854. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:23.636402 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917526400}
I20260709 13:19:23.632193 18607 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:23.635646 14900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1082) took 1374 ms (client timeout 1551 ms). Trace:
W20260709 13:19:23.650941 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 103622us
W20260709 13:19:23.651808 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.637217 14899 raft_consensus.cc:2376] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10. Re-sending same reply.
I20260709 13:19:23.565570 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:23.648923 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:23.650589 14900 rpcz_store.cc:269] 0709 13:19:22.261328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.270453 (+  9125us) service_pool.cc:224] Handling call
0709 13:19:23.635435 (+1364982us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b540030c5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:23.635587 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702372096}
I20260709 13:19:23.606166 18728 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:23.611750 18649 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.683205 14895 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:23.684000 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1051) took 1016 ms. Trace:
I20260709 13:19:23.684443 14895 rpcz_store.cc:276] 0709 13:19:22.667568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.682565 (+1014997us) service_pool.cc:224] Handling call
0709 13:19:23.682858 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.683676 (+   818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.683926 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.657208 18754 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:23.690018 18728 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.626392 18597 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:23.694514 14892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1086) took 1371 ms (client timeout 1794 ms). Trace:
I20260709 13:19:23.675933 18649 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:23.695148 14892 rpcz_store.cc:269] 0709 13:19:22.322621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.326295 (+  3674us) service_pool.cc:224] Handling call
0709 13:19:23.694196 (+1367901us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54005901d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:23.694400 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969467136}
I20260709 13:19:23.697722 14895 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:19:23.703518 18637 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.711210 14895 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.713129 18566 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:23.714974 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2643) took 1936 ms. Trace:
I20260709 13:19:23.715355 14297 rpcz_store.cc:276] 0709 13:19:21.778368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.779112 (+   744us) service_pool.cc:224] Handling call
0709 13:19:23.714793 (+1935681us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400331654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:23.714917 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531346176}
I20260709 13:19:23.723487 14895 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:23.741282 14228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:19:23.741999 14228 raft_consensus.cc:606] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:23.742349 14228 raft_consensus.cc:614] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:23.518020 18419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.019s	sys 0.005s
I20260709 13:19:23.777199 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:23.777838 14222 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:19:23.785996 14111 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 37975f772fc648329a8acae36d33a345 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 181bbac22422408c87cd13b7fe3008f9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:23.799834 14372 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:23.807729 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:23.809361 14304 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:19:23.822036 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:23.826891 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:23.828459 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:23.829322 18709 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.829849 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:23.830927 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:23.831708 18499 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:23.832180 18499 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.832257 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.832573 18499 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:23.833084 18351 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:23.833469 18351 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.833864 18351 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:23.834422 18756 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:23.836697 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:23.780224 18722 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:23.735929 18566 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:23.845003 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 306391us
W20260709 13:19:23.844951 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 312914us
I20260709 13:19:23.846345 14297 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:23.849682 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:23.850524 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:23.823020 14895 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:23.851349 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.849711 14864 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.853828 14192 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.854017 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:23.827867 18751 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:23.856837 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.808923 18754 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:23.872704 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.889410 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:23.838003 18597 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:23.905498 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45604.1us
I20260709 13:19:23.864614 14295 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:23.919415 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 69775.1us
I20260709 13:19:23.932209 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.930472 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1089) took 1027 ms. Trace:
I20260709 13:19:23.838243 18294 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:23.845065 18756 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:23.857475 18703 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:23.861313 18221 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:23.913388 14297 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:23.848115 18738 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:19:23.857405 18730 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:23.850912 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:23.928567 14896 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:23.911487 18687 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.932952 14895 rpcz_store.cc:276] 0709 13:19:22.903005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.851673 (+948668us) service_pool.cc:224] Handling call
0709 13:19:23.851966 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.929102 (+ 77136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.929134 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:23.929596 (+   462us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:23.929638 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.929696 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.930411 (+   715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.933708 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:23.913843 18636 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.862146 18722 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:23.980386 14899 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:23.910072 18702 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:23.902338 14179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49935.2us
I20260709 13:19:23.934648 18352 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:23.946337 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.855170 18076 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:19:23.946561 18499 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.952243 18351 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.993587 18352 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:23.952862 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 798) took 1489 ms. Trace:
I20260709 13:19:23.996426 14299 rpcz_store.cc:276] 0709 13:19:22.463431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.531729 (+ 68298us) service_pool.cc:224] Handling call
0709 13:19:22.546158 (+ 14429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.155990 (+609832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.952581 (+796591us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54001559d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:23.952791 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400622464}
I20260709 13:19:23.953634 18682 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:23.956753 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.857684 18693 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:19:23.962858 18221 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:23.935261 18709 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:23.965216 18566 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:23.966969 18736 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:23.970901 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 120034us
I20260709 13:19:23.919149 18649 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:23.933140 18701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.529s	user 0.004s	sys 0.017s
W20260709 13:19:23.981951 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49829.2us
I20260709 13:19:23.919552 18537 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:23.989063 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:23.991016 14896 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:23.968876 18355 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:23.969954 18730 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:23.981264 18722 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.002755 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1068) took 1350 ms. Trace:
I20260709 13:19:24.072136 18221 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:23.973258 18562 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:23.995046 14125 catalog_manager.cc:5697] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 10. New cstate: current_term: 10 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:19:24.069705 18701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.677s	user 0.005s	sys 0.020s
I20260709 13:19:23.999408 18499 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:23.997372 18352 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:23.974977 18754 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:24.071206 18750 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:24.070065 18537 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:24.535481 18537 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.536527 18709 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:24.072325 18607 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:23.981535 18294 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:23.988186 18636 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.509493 18736 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:24.539707 18636 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:24.323264 14298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.008s
I20260709 13:19:24.540129 18736 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:24.535470 18771 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:19:24.540423 18294 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:24.540719 18736 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.541240 18294 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:24.300973 18731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.011s	sys 0.001s
W20260709 13:19:24.541986 18731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.337s	user 0.011s	sys 0.002s
I20260709 13:19:23.999748 18076 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:24.434908 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 501222us
I20260709 13:19:24.543005 18076 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:23.993690 18332 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.204s
I20260709 13:19:24.436161 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1092) took 1127 ms. Trace:
I20260709 13:19:24.436762 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:24.441733 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.445057 18355 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.449095 18673 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:24.446571 18637 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.719s	user 0.003s	sys 0.033s
W20260709 13:19:24.453030 18746 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.231s	user 0.000s	sys 0.003s
I20260709 13:19:24.544251 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:24.451238 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2728) took 1020 ms. Trace:
W20260709 13:19:24.546936 14298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.001s	sys 0.008s
W20260709 13:19:24.458674 14893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1109) took 1998 ms (client timeout 1718 ms). Trace:
I20260709 13:19:24.463129 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2719) took 2487 ms. Trace:
I20260709 13:19:24.553354 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2726) took 1124 ms. Trace:
I20260709 13:19:24.467835 14895 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:19:24.551579 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 114938us
I20260709 13:19:24.553650 14304 rpcz_store.cc:276] 0709 13:19:21.975591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.975774 (+   183us) service_pool.cc:224] Handling call
0709 13:19:23.716074 (+1740300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:23.809938 (+ 93864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.462881 (+652943us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400331650. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:24.463057 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3973674240}
I20260709 13:19:24.553840 14298 rpcz_store.cc:276] 0709 13:19:23.428982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.429113 (+   131us) service_pool.cc:224] Handling call
0709 13:19:23.442745 (+ 13632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.442958 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:23.759659 (+316701us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.553031 (+793372us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.553081 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:24.553122 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.553191 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.553302 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":268999,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"spinlock_wait_cycles":77827456,"thread_start_us":1109275,"threads_started":2,"wal-append.queue_time_us":717168}
W20260709 13:19:24.553519 14893 rpcz_store.cc:269] 0709 13:19:22.460412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.612048 (+151636us) service_pool.cc:224] Handling call
0709 13:19:24.458417 (+1846369us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b54006bcbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:24.458580 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144940928}
I20260709 13:19:24.472620 18781 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.473274 18783 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:24.480187 18687 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.500s	user 0.005s	sys 0.007s
I20260709 13:19:24.480800 18270 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:24.478576 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:24.482837 18776 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:24.590616 18270 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:24.590813 18776 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:24.591302 18774 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:19:24.593145 18270 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:24.436681 18566 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:24.593478 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:23.973436 18741 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:24.594600 18741 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.594902 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:24.595150 18741 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.597471 18741 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:24.491532 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1091) took 1183 ms. Trace:
I20260709 13:19:24.508670 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:24.584029 18645 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:24.602528 18615 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:24.602982 18615 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:24.603392 18731 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:24.603902 18731 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:24.550352 18673 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:24.604355 18731 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.604118 18615 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:24.507622 14226 rpcz_store.cc:276] 0709 13:19:22.652780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.652921 (+   141us) service_pool.cc:224] Handling call
0709 13:19:22.677601 (+ 24680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.280169 (+602568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.002526 (+722357us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540026cad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:24.002697 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345058560}
I20260709 13:19:24.528385 14223 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:24.525657 14125 catalog_manager.cc:5697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.606134 18673 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:24.509251 18730 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:24.532485 18775 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 13:19:24.537727 18709 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:24.511166 18722 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.552021 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:24.552690 14302 rpcz_store.cc:276] 0709 13:19:23.430215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.430331 (+   116us) service_pool.cc:224] Handling call
0709 13:19:23.433277 (+  2946us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:23.450748 (+ 17471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.450780 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:23.471722 (+ 20942us) log.cc:844] Serialized 52 byte log entry
0709 13:19:23.927296 (+455574us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:24.187986 (+260690us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.448060 (+260074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.448741 (+   681us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.449330 (+   589us) raft_consensus.cc:1685] finished
0709 13:19:24.449449 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.450710 (+  1261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":258176,"prepare.queue_time_us":37286,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":270795,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":14286,"thread_start_us":586436,"threads_started":2,"wal-append.queue_time_us":451713}
I20260709 13:19:24.549168 14896 rpcz_store.cc:276] 0709 13:19:23.308405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.979029 (+670624us) service_pool.cc:224] Handling call
0709 13:19:23.979308 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.063923 (+ 84615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.436083 (+372160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:24.442597 18702 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:24.545362 18630 consensus_meta.cc:287] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.909s	user 0.018s	sys 0.010s
I20260709 13:19:24.582760 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:24.582899 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:19:24.586128 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 107649us
I20260709 13:19:24.587226 18499 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:24.619637 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:24.620154 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:24.620698 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:24.620967 14303 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:24.587172 18783 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.558702 18756 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:24.583900 18687 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:24.589107 18595 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.550079 18355 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.580706 18781 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.563241 18352 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:24.491070 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 502046us
I20260709 13:19:24.652516 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:24.610671 18709 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:24.541348 18736 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:24.603102 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 94536.2us
I20260709 13:19:24.602303 14899 rpcz_store.cc:276] 0709 13:19:23.308131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.973542 (+665411us) service_pool.cc:224] Handling call
0709 13:19:23.980081 (+  6539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.980845 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.491322 (+510477us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b54008674d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:24.491472 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14244736}
I20260709 13:19:24.664261 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:24.665285 18727 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:24.665999 18727 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:24.666673 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.609583 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:24.667058 18727 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:24.548632 18773 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:19:24.614179 18784 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260709 13:19:24.563153 18636 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:24.544057 18076 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.615844 18754 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:24.635176 18649 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.622046 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:24.638809 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:24.675151 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 53177.8us
I20260709 13:19:24.562059 18294 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.593159 18776 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:24.645403 14223 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:24.645468 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:24.645841 14302 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:24.651593 18693 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.624543 18702 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:24.531623 18351 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:24.655159 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:24.624418 18778 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:24.630702 18270 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:24.617424 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1112) took 1182 ms. Trace:
I20260709 13:19:24.705206 14895 rpcz_store.cc:276] 0709 13:19:23.434805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.979318 (+544513us) service_pool.cc:224] Handling call
0709 13:19:24.467449 (+488131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.556535 (+ 89086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.617203 (+ 60668us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54006bcbd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:24.617360 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121886976}
I20260709 13:19:24.641129 18701 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.634837 18566 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:24.677019 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:24.708792 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:24.670435 14125 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 7 to 10, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 10 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.692976 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:24.674830 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:24.671615 18076 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:24.713832 18769 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 13:19:24.714098 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1049) took 2210 ms. Trace:
I20260709 13:19:24.714548 14898 rpcz_store.cc:276] 0709 13:19:22.504136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.666675 (+1162539us) service_pool.cc:224] Handling call
0709 13:19:23.670279 (+  3604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.800202 (+129923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.800234 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.846253 (+ 46019us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.282065 (+435812us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:24.304188 (+ 22123us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.530401 (+226213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.530477 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.531787 (+  1310us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:24.713780 (+181993us) raft_consensus.cc:1685] finished
0709 13:19:24.713907 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.714040 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":225702,"prepare.queue_time_us":31112,"prepare.run_cpu_time_us":9433,"prepare.run_wall_time_us":128736,"raft.queue_time_us":230627,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":28270,"spinlock_wait_cycles":120291968,"thread_start_us":363837,"threads_started":1,"wal-append.queue_time_us":615529}
I20260709 13:19:24.717991 18687 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.652841 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:24.722647 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 69905.1us
I20260709 13:19:24.624742 18630 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.669296 18352 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:24.704666 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:24.695499 18636 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.709981 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:24.706203 18270 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.625358 18221 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:24.724598 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:24.703101 18778 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:24.745641 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:24.746716 14893 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:24.735006 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 278281us
I20260709 13:19:24.696579 18649 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.739300 14898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:24.748914 14898 raft_consensus.cc:606] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:24.749416 14898 raft_consensus.cc:614] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:24.749625 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:24.739605 18752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.014s	sys 0.020s
I20260709 13:19:24.742004 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:24.707018 14303 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:24.756402 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:24.696765 18703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.014s	sys 0.058s
I20260709 13:19:24.752548 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:24.725499 18741 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:24.760648 14227 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:24.703738 18693 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.762921 14899 raft_consensus.cc:2410] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:19:24.778831 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 69059.5us
I20260709 13:19:24.751276 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:24.737476 18270 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:24.782892 14892 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:19:24.746228 18778 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.777031 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:24.754137 18566 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:24.782982 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:24.775400 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:24.722939 18701 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.786418 14895 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:24.813342 18562 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:24.814724 18781 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:24.818725 14893 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:19:24.823727 14893 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:24.831374 18781 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:24.831998 18780 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.830134 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:24.832135 18781 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:24.834422 14893 raft_consensus.cc:606] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
W20260709 13:19:24.762116 18703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.015s	sys 0.058s
I20260709 13:19:24.834841 14893 raft_consensus.cc:614] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:24.834951 18703 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:24.835867 18703 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.790205 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:24.783536 14892 pending_rounds.cc:85] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 7
I20260709 13:19:24.838570 14892 pending_rounds.cc:107] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:19:24.838842 14892 raft_consensus.cc:2889] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:24.722568 18709 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:24.833882 18741 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:24.784144 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:24.837379 18355 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:24.759032 18752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.014s	sys 0.021s
I20260709 13:19:24.859895 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:24.863636 14228 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:19:24.798410 18645 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:24.865558 14900 raft_consensus.cc:2376] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7. Re-sending same reply.
I20260709 13:19:24.832902 18780 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.908265 18780 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:24.892059 18722 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:24.898640 18352 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:24.862730 18574 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:24.900591 18701 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:24.883423 18562 consensus_queue.cc:1175] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" responder_term: 10 status { last_received { term: 10 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 10 index: 6 } }
I20260709 13:19:24.911885 14228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:19:24.924057 14228 raft_consensus.cc:606] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:24.896085 14296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.041s	sys 0.038s
W20260709 13:19:24.924638 14296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.042s	sys 0.039s
I20260709 13:19:24.856703 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1050) took 2190 ms. Trace:
I20260709 13:19:24.929577 14372 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:24.927357 14897 rpcz_store.cc:276] 0709 13:19:22.666559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.681059 (+1014500us) service_pool.cc:224] Handling call
0709 13:19:23.681387 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.681596 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:23.824622 (+143026us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.534746 (+710124us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:24.856159 (+321413us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.856249 (+    90us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:24.856328 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.856433 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.856615 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":354236,"prepare.queue_time_us":143228,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":354802,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":19396,"spinlock_wait_cycles":80054144,"thread_start_us":794965,"threads_started":3,"wal-append.queue_time_us":651477}
I20260709 13:19:24.918395 18682 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.971698 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:24.972587 18615 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.974745 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:24.975442 14373 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:24.979619 18704 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.979880 14375 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:24.980266 18704 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:24.985188 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:24.985931 14371 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.989470 14370 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:24.931320 18645 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.985929 18702 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:24.995870 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:24.926119 18751 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:24.987632 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:24.997534 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:25.001565 14376 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.999439 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:25.002873 14378 raft_consensus.cc:2410] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:25.002779 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:25.003441 14372 raft_consensus.cc:2376] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13. Re-sending same reply.
I20260709 13:19:24.927376 18783 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:25.006152 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:25.007292 14374 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:24.941771 18736 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:24.942670 18709 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:24.994983 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:24.946769 18294 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:24.990906 18682 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.018668 18704 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:25.019297 18270 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:25.021448 18687 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:25.023444 14370 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:25.012055 18751 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:25.057539 14371 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:25.079463 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:25.060304 18783 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.067631 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:25.004150 18595 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:25.034613 14867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.020s	sys 0.023s
W20260709 13:19:25.107141 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 583631us
I20260709 13:19:25.004307 18645 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.115440 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:25.116466 14371 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:25.074416 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:25.075924 18682 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:25.004526 18537 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.124617 14371 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:25.126078 14370 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:25.131990 14371 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:19:25.091970 14376 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:25.059341 18630 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:25.093880 18791 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.096357 18795 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.948995 18781 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:25.106312 18786 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.073800 18730 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.133610 18270 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:25.117472 18783 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.150835 18722 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:25.176139 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.082180 18649 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:25.197919 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 157648us
I20260709 13:19:25.061396 18778 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.016355 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:25.224586 14372 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:25.198676 18790 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:25.226255 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:25.226501 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:25.227209 14303 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.227927 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:25.228523 14301 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:25.229954 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 478726us
I20260709 13:19:25.195674 18352 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.231367 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:25.233727 14302 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
W20260709 13:19:25.217149 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 412723us
I20260709 13:19:25.155227 18595 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:25.237247 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:25.239660 14298 raft_consensus.cc:2410] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:25.106480 18731 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:25.244357 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:25.244902 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.246644 14297 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:25.247323 14224 raft_consensus.cc:2410] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:25.241845 14229 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:25.230517 18703 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.260574 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.251083 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:25.237856 18728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.012s	sys 0.031s
W20260709 13:19:25.254854 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.309363 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 74507.6us
I20260709 13:19:25.312500 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:25.313777 14298 raft_consensus.cc:2410] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:19:25.256963 14303 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
W20260709 13:19:25.257464 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.298703 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.298120 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.216468 18630 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:19:25.240734 18792 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.299314 14228 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.307070 14229 raft_consensus.cc:2393] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:25.313473 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:25.328647 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.340068 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1048) took 2836 ms. Trace:
I20260709 13:19:25.244235 18709 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:25.217664 18791 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:25.317967 18728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.013s	sys 0.031s
W20260709 13:19:25.332573 14344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 1.589s (SENT) [suppressed 66 similar messages]
I20260709 13:19:25.351122 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.298491 18787 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:25.299728 18566 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:25.213999 18795 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.220090 18786 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:25.359720 14225 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
W20260709 13:19:25.362869 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.444620 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:25.363437 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.366016 14894 rpcz_store.cc:276] 0709 13:19:22.503925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.338693 (+834768us) service_pool.cc:224] Handling call
0709 13:19:23.397905 (+ 59212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.398165 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:23.848601 (+450436us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.547899 (+699298us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:24.616570 (+ 68671us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4800240b58. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
0709 13:19:24.941658 (+325088us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.945052 (+  3394us) log.cc:844] Serialized 14 byte log entry
0709 13:19:25.336088 (+391036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:25.336164 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:25.339674 (+  3510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.339797 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.339981 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":325523,"prepare.queue_time_us":408914,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":143,"raft.queue_time_us":757359,"raft.run_cpu_time_us":2428,"raft.run_wall_time_us":80560,"spinlock_wait_cycles":125856256,"thread_start_us":1537494,"threads_started":4,"wal-append.queue_time_us":621025}
I20260709 13:19:25.240938 18352 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.389606 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.242316 18722 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 13:19:25.390537 18076 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.678s	user 0.012s	sys 0.001s
I20260709 13:19:25.240790 18702 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:19:25.252909 18704 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
W20260709 13:19:25.423498 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 61246us
I20260709 13:19:25.308936 18703 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:25.423661 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:25.487253 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:25.487978 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 64401.6us
I20260709 13:19:25.323864 18780 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:25.342182 18741 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:25.250043 18789 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.145s
I20260709 13:19:25.308199 18637 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:25.472695 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 263687us
I20260709 13:19:25.506723 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:25.507576 14898 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:25.475793 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:25.508611 14896 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:25.477171 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.236840 18790 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.479452 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:25.481323 14897 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:19:25.481576 14893 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:25.481593 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:25.484364 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:25.244412 18788 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 13:19:25.484557 14376 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:25.517953 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:25.492890 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:25.518755 14894 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.519217 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:25.436594 18805 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:25.522225 18805 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.385910 18709 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:25.514868 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.526225 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.526806 18709 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:25.527381 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.472693 18796 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:25.547029 18796 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.550791 18709 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:25.552979 18709 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:25.562728 18796 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:25.579000 18805 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:25.668337 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 149134us
I20260709 13:19:25.471892 18728 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.671568 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:25.672209 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:25.672259 14893 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:25.672931 14898 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.674268 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.668462 18682 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.677217 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:25.690012 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 357459us
I20260709 13:19:25.471834 18649 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.204s
I20260709 13:19:25.686690 14224 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
W20260709 13:19:25.691939 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.684115 14896 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
W20260709 13:19:25.694830 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 188528us
I20260709 13:19:25.695792 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:25.701470 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:25.702428 14894 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:25.343830 18792 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:25.707511 18792 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:25.691119 18759 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 13:19:25.715804 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.725097 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.723114 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:25.444694 18787 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:25.719576 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 230119us
I20260709 13:19:25.694979 18805 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:25.762364 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:25.762586 18819 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:25.763324 14302 raft_consensus.cc:2368] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10.
I20260709 13:19:25.763525 18819 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:25.675630 18637 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:25.668337 18780 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.752178 18801 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.979581 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:25.979736 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:25.709249 18796 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.709728 18537 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:25.878407 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 396843us
I20260709 13:19:25.709458 18645 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:25.737573 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 424176us
I20260709 13:19:25.971520 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.740705 18778 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:25.675902 18741 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.769857 18783 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:25.720129 18730 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:25.696732 18682 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:25.686659 18728 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:25.974606 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:26.002648 14268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.004s	sys 0.003s
W20260709 13:19:26.036679 14268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.005s	sys 0.003s
I20260709 13:19:25.994042 14864 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:26.002477 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:25.765287 18727 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:26.045357 14901 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
W20260709 13:19:26.013656 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 312944us
I20260709 13:19:26.014950 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:25.713141 18807 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.305s
I20260709 13:19:26.017364 14898 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
W20260709 13:19:26.070420 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 366013us
I20260709 13:19:26.020499 14896 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:26.021406 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:26.023969 14195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.003s	sys 0.007s
W20260709 13:19:26.072155 14195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.003s	sys 0.007s
I20260709 13:19:26.072227 14376 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:25.971599 18792 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.764293 18819 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.229s
I20260709 13:19:26.038189 14299 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:25.980240 14894 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:26.002315 18595 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:26.054067 14303 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
W20260709 13:19:26.029009 18351 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.002s	sys 0.011s
I20260709 13:19:25.740290 18566 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:26.067723 18797 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.707s	user 0.001s	sys 0.005s
I20260709 13:19:26.014336 18731 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.074165 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:26.075419 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:26.111997 14896 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
W20260709 13:19:26.112573 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.056394 18537 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:26.076205 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:26.077387 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:26.078719 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.119685 14899 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.120613 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:26.078717 14376 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:19:26.085722 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 91749.6us
I20260709 13:19:26.122014 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:26.092075 14371 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:26.092275 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:25.957803 18805 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.108634 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:26.051239 18645 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:19:26.003353 18796 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.111997 14372 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:26.126091 14370 raft_consensus.cc:2368] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:19:26.125944 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:26.131331 14376 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:19:26.099886 18351 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.003s	sys 0.012s
I20260709 13:19:26.120563 18537 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:26.075883 14301 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.845s	user 0.008s	sys 0.008s
I20260709 13:19:26.165324 14301 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 6.
I20260709 13:19:26.067700 14229 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:26.148201 14267 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:26.105162 18595 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:26.195466 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 47350.7us
W20260709 13:19:26.145674 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46798.2us
I20260709 13:19:26.194995 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:26.204499 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:26.209077 14898 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:26.211885 14898 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:26.092621 18792 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:26.222190 14298 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:26.166422 18709 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:26.227272 14229 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:26.222319 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.228065 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.146363 18649 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:26.243637 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.181171 18791 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.244488 14304 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:26.245066 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:26.251674 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.268611 14894 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:26.247424 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:26.278860 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:26.289149 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:26.289304 14295 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:26.290207 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 76338.9us
I20260709 13:19:26.291195 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:26.296125 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.192417 18804 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:26.289985 14229 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
W20260709 13:19:26.313971 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.315261 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.316393 14298 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:26.245689 18649 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.238843 18822 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:26.226738 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.281805 18819 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:26.213405 18595 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.340072 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:26.347482 14377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.020s	sys 0.071s
I20260709 13:19:26.353744 14225 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:26.297808 18795 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:26.349124 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.352641 18824 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:26.357584 14125 catalog_manager.cc:5697] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 7, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 7 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:19:26.352556 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 356998us
I20260709 13:19:26.318915 18703 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.358229 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:26.348173 18649 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.342478 18847 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:26.350297 18783 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:26.328312 18842 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:26.414804 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 191419us
W20260709 13:19:26.417426 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 71578.4us
W20260709 13:19:26.414327 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 291830us
I20260709 13:19:26.369997 18637 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.352732 18419 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:26.444721 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:26.457299 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:26.459378 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 95183.2us
I20260709 13:19:26.327545 18837 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.429s
I20260709 13:19:26.363590 18824 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.376924 18852 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.361578 18813 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:26.502857 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45789.6us
I20260709 13:19:26.352507 18811 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.445s
W20260709 13:19:26.510136 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 64771.5us
I20260709 13:19:26.422186 18786 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:26.423094 18783 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.423380 18842 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:26.442502 18799 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.547s	user 0.000s	sys 0.005s
I20260709 13:19:26.340226 18537 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.454705 18787 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:26.522646 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:26.516702 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:26.561309 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 44688.5us
I20260709 13:19:26.564054 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:26.565239 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:26.532747 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77269.2us
I20260709 13:19:26.533219 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:26.459887 18419 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:26.349296 18804 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.566692 14193 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:26.568320 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 546944us
I20260709 13:19:26.514714 18824 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.352674 18822 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.526386 18728 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:26.526072 18682 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.569432 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:26.540314 18783 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.569617 14193 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:19:26.578027 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55510.8us
I20260709 13:19:26.590001 14899 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:26.538472 18778 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:19:26.520630 18703 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:19:26.613648 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:26.542794 18842 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.613101 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:26.443190 18847 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:26.575898 18830 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:26.601619 18800 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.400s	user 0.001s	sys 0.000s
I20260709 13:19:26.539953 18730 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 13:19:26.630004 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 336369us
I20260709 13:19:26.569031 18841 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.362s
I20260709 13:19:26.602563 18796 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:26.635187 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3462991190001503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30770000000000003s for a response
I20260709 13:19:26.526986 18852 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:26.620434 18805 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:26.643293 18778 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:26.576390 18843 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.121s
I20260709 13:19:26.663960 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:26.709003 14267 leader_election.cc:400] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:19:26.709385 14267 leader_election.cc:403] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:26.667687 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1084) took 1874 ms. Trace:
W20260709 13:19:26.709374 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45563us
W20260709 13:19:26.666617 18821 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.395s	user 0.001s	sys 0.001s
I20260709 13:19:26.712224 18856 raft_consensus.cc:3055] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:26.675113 18792 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:26.727152 18856 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:26.714612 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:26.725749 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:26.667593 18770 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 2.052s	user 0.007s	sys 0.002s
W20260709 13:19:26.668118 18828 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:19:26.672466 18693 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:26.728243 18856 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.732820 18831 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:19:26.669235 18682 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:19:26.728093 18872 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:26.708516 18595 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:26.655190 18803 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:19:26.729761 18787 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:26.735172 18810 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.735463 18731 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:26.666683 18751 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.552s	user 0.004s	sys 0.014s
I20260709 13:19:26.709523 18805 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:26.780568 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 809) took 3232 ms. Trace:
I20260709 13:19:26.780956 18805 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:26.782045 14378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2413) took 4053 ms (client timeout 3077 ms). Trace:
I20260709 13:19:26.782625 18856 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.782163 18805 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:26.782477 18649 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:26.733556 18615 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.760s	user 0.013s	sys 0.006s
I20260709 13:19:26.664101 18756 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:26.784157 18756 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:26.785048 18649 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.712025 14226 rpcz_store.cc:276] 0709 13:19:24.793140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.794600 (+  1460us) service_pool.cc:224] Handling call
0709 13:19:24.835163 (+ 40563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.835556 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.835589 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:24.836044 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.208253 (+372209us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:25.208312 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.208405 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.667434 (+1459029us) raft_consensus.cc:1685] finished
0709 13:19:26.667466 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.667618 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91603,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":6497,"thread_start_us":371747,"threads_started":1,"wal-append.queue_time_us":1173957}
I20260709 13:19:26.785686 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2445) took 1784 ms. Trace:
W20260709 13:19:26.728165 18858 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:19:26.652257 18813 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.069s
W20260709 13:19:26.668205 18846 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:19:26.667377 18849 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:19:26.666524 18845 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
I20260709 13:19:26.635123 18830 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:26.736615 18637 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:19:26.726838 18778 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:26.752009 18793 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.400s	user 0.000s	sys 0.001s
I20260709 13:19:26.752310 18804 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:26.752750 18864 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:26.758054 18851 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:26.758441 18865 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:19:26.759440 18809 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:19:26.738766 18873 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:26.831527 18873 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:26.673623 18798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.019s	sys 0.003s
I20260709 13:19:26.762606 18872 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:26.766026 18829 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:19:26.767428 18832 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:26.769026 18221 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.769706 18803 consensus_queue.cc:1243] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:19:26.746011 18636 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 2.009s	user 0.015s	sys 0.012s
I20260709 13:19:26.666180 18823 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:26.779501 18731 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.852507 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:26.779677 18810 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.779974 18751 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.780992 14300 rpcz_store.cc:276] 0709 13:19:23.547810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.548592 (+   782us) service_pool.cc:224] Handling call
0709 13:19:23.606918 (+ 58326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.607178 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.607213 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.607753 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.967543 (+359790us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:23.967580 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.967658 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.261892 (+2294234us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:26.762868 (+500976us) raft_consensus.cc:1685] finished
0709 13:19:26.762889 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.780489 (+ 17600us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93277056,"thread_start_us":158272,"threads_started":1,"wal-append.queue_time_us":686201}
I20260709 13:19:26.858659 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:26.859484 18830 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.860129 18852 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:26.738099 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.006s
I20260709 13:19:26.786175 14374 rpcz_store.cc:276] 0709 13:19:24.988498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.115879 (+127381us) service_pool.cc:224] Handling call
0709 13:19:25.116302 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.116786 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.116827 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.146823 (+ 29996us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.464942 (+318119us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:25.465017 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.465115 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.763208 (+1298093us) raft_consensus.cc:1685] finished
0709 13:19:26.763232 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.772419 (+  9187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":161,"thread_start_us":317582,"threads_started":1,"wal-append.queue_time_us":846984}
W20260709 13:19:26.860989 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.000s	sys 0.007s
I20260709 13:19:26.745605 18703 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:26.782509 14378 rpcz_store.cc:269] 0709 13:19:22.728875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.734503 (+  5628us) service_pool.cc:224] Handling call
0709 13:19:26.781813 (+4047310us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b5400334d54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:26.781966 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5209842560}
I20260709 13:19:26.669896 18847 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:26.792472 14897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.004s	sys 0.004s
W20260709 13:19:26.799934 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 231914us
I20260709 13:19:26.749382 18728 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:26.655193 18836 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.405s
I20260709 13:19:26.674906 18419 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:26.808751 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 94198.7us
I20260709 13:19:26.822500 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.829193 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.829586 14295 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:26.830026 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.830868 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.838687 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2443) took 1850 ms. Trace:
I20260709 13:19:26.856160 18810 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.922590 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2555) took 1686 ms. Trace:
I20260709 13:19:26.923426 14301 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:26.925253 14304 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:26.924929 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:19:26.835450 18798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.022s	sys 0.005s
W20260709 13:19:26.926944 14897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.005s	sys 0.008s
I20260709 13:19:26.838377 18872 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.930675 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:26.861286 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 663188us
I20260709 13:19:26.833766 18822 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:26.928073 14267 leader_election.cc:336] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.936s (SENT)
I20260709 13:19:26.928097 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.934069 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:26.934268 14304 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:26.928769 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 815) took 1617 ms. Trace:
I20260709 13:19:26.926276 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:26.907037 18855 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:26.931358 14301 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:26.931705 14865 leader_election.cc:400] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10.
I20260709 13:19:26.936542 14865 leader_election.cc:403] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:26.927484 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:26.923723 14221 rpcz_store.cc:276] 0709 13:19:25.236128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.304107 (+ 67979us) service_pool.cc:224] Handling call
0709 13:19:25.341841 (+ 37734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.727627 (+385786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.727671 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.739267 (+ 11596us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.003447 (+264180us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:26.003521 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.003615 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.909001 (+905386us) raft_consensus.cc:1685] finished
0709 13:19:26.909023 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.922502 (+ 13479us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112319,"raft.queue_time_us":682527,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":28461,"thread_start_us":532759,"threads_started":2,"wal-append.queue_time_us":608359}
I20260709 13:19:26.833747 18873 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:26.862514 18636 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:26.924081 18731 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:26.853212 18801 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.002s
I20260709 13:19:26.936380 14298 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:26.940732 14295 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:26.905308 18787 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:19:26.937637 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:26.836565 18574 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:26.905972 18830 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:26.973901 14125 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:26.908390 18783 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:26.924613 14369 rpcz_store.cc:276] 0709 13:19:24.987887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.988120 (+   233us) service_pool.cc:224] Handling call
0709 13:19:24.988465 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.995122 (+  6657us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:25.316496 (+321374us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.017433 (+700937us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.028648 (+ 11215us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.028794 (+   146us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:26.043681 (+ 14887us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.043908 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.043985 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.838452 (+794467us) raft_consensus.cc:1685] finished
0709 13:19:26.838485 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.838627 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10864,"prepare.queue_time_us":695647,"prepare.run_wall_time_us":3835,"raft.queue_time_us":275022,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":60915,"spinlock_wait_cycles":572556928,"thread_start_us":885764,"threads_started":3,"wal-append.queue_time_us":1239784}
I20260709 13:19:26.935868 14297 rpcz_store.cc:276] 0709 13:19:25.311637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.311778 (+   141us) service_pool.cc:224] Handling call
0709 13:19:25.347526 (+ 35748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.699778 (+352252us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:25.700635 (+   857us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.719735 (+ 19100us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.246065 (+526330us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:26.246262 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.246657 (+   395us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.927023 (+680366us) raft_consensus.cc:1685] finished
0709 13:19:26.927048 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.928710 (+  1662us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":140517,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":107,"thread_start_us":503068,"threads_started":2,"wal-append.queue_time_us":455501}
I20260709 13:19:26.983276 18830 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.984418 18352 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:26.980093 18874 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:26.977991 18574 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.985460 18874 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.985986 18867 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.986655 18867 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.988787 18867 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.989166 18790 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:26.949301 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2439) took 1965 ms. Trace:
I20260709 13:19:26.989873 18687 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:26.990922 18636 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:26.973196 18801 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:26.991322 18636 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:26.992172 18636 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.993441 18636 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:26.822026 18864 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.995273 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:26.995777 18864 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:19:26.941387 18419 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.996529 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2653) took 3143 ms. Trace:
I20260709 13:19:26.999980 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.001014 14221 raft_consensus.cc:2393] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:27.001526 18756 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:26.957864 14223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1085) took 2098 ms (client timeout 1933 ms). Trace:
I20260709 13:19:27.005918 14302 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
W20260709 13:19:27.005986 14223 rpcz_store.cc:269] 0709 13:19:24.859351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.859545 (+   194us) service_pool.cc:224] Handling call
0709 13:19:26.957625 (+2098080us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54001491d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:26.957772 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4431321984}
I20260709 13:19:26.943763 18637 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:26.964900 18847 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:26.944620 18778 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.964967 18876 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:26.943146 18810 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10.
I20260709 13:19:26.973909 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:27.012603 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:26.975236 14220 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:26.980398 18750 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:26.986054 18874 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:26.886562 18851 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:26.989969 14373 rpcz_store.cc:276] 0709 13:19:24.984337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.995395 (+ 11058us) service_pool.cc:224] Handling call
0709 13:19:24.995826 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.996116 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.996157 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.004965 (+  8808us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.342156 (+337191us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:25.342199 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.342269 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.949098 (+1606829us) raft_consensus.cc:1685] finished
0709 13:19:26.949118 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.949244 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":269052,"threads_started":1,"wal-append.queue_time_us":1754446}
I20260709 13:19:26.926258 18703 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.919683 18824 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:26.955991 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2184) took 1649 ms. Trace:
I20260709 13:19:26.996918 14296 rpcz_store.cc:276] 0709 13:19:23.853030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.853155 (+   125us) service_pool.cc:224] Handling call
0709 13:19:23.853429 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.859228 (+  5799us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:23.918740 (+ 59512us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.925246 (+1006506us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.925517 (+   271us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.925621 (+   104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.925654 (+    33us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:24.925697 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.783515 (+1857818us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b4800241ed8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
0709 13:19:26.834979 (+ 51464us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b1800175360. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f522 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:19:26.995076 (+160097us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b1800175360. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f6d2a6 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419
0709 13:19:26.996281 (+  1205us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b54000db6d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:26.996335 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.996470 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1970464,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":113,"raft.queue_time_us":78859,"raft.run_cpu_time_us":5796,"raft.run_wall_time_us":1827017,"spinlock_wait_cycles":126614784,"thread_start_us":976806,"threads_started":1,"wal-append.queue_time_us":949581,"wal-append.run_cpu_time_us":2764,"wal-append.run_wall_time_us":1097796}
W20260709 13:19:27.008725 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:27.008563 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 64048.5us
I20260709 13:19:27.015766 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2167) took 2521 ms. Trace:
I20260709 13:19:27.017223 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:27.054879 14895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1117) took 2313 ms (client timeout 1936 ms). Trace:
W20260709 13:19:27.055495 14895 rpcz_store.cc:269] 0709 13:19:24.741496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.741689 (+   193us) service_pool.cc:224] Handling call
0709 13:19:27.054643 (+2312954us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b5400611054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:27.054806 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69802752}
I20260709 13:19:27.056905 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:27.009393 18566 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.009217 18847 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.010876 18702 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:19:27.067080 18752 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:27.067447 18752 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:27.068182 18752 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.065227 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:27.052320 14227 rpcz_store.cc:276] 0709 13:19:25.306295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.307526 (+  1231us) service_pool.cc:224] Handling call
0709 13:19:25.331400 (+ 23874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.680647 (+349247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.680841 (+   194us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.697186 (+ 16345us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.770680 (+1073494us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b1800423dc0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:19:26.883148 (+112468us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:26.883194 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.883273 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.955663 (+ 72390us) raft_consensus.cc:1685] finished
0709 13:19:26.955686 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.955922 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":275892,"raft.queue_time_us":381203,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":17135,"spinlock_wait_cycles":4282624,"thread_start_us":366952,"threads_started":2,"wal-append.queue_time_us":1224345}
I20260709 13:19:27.058979 18637 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:19:27.069340 18752 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:27.081456 18847 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:27.080482 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:27.080842 18812 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:19:27.072806 18851 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.019735 18806 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:27.070364 18566 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.082006 18833 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:27.072257 18830 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.063632 18704 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:27.075958 14224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2561) took 1806 ms (client timeout 1640 ms). Trace:
W20260709 13:19:27.107920 14224 rpcz_store.cc:269] 0709 13:19:25.269502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.358016 (+ 88514us) service_pool.cc:224] Handling call
0709 13:19:27.075720 (+1717704us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b540026cfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:27.075874 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553259392}
W20260709 13:19:27.078809 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:27.109485 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.112473 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.085832 18727 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:27.018546 18730 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:27.030268 18842 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.025975 14300 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:27.051563 14222 rpcz_store.cc:276] 0709 13:19:24.489065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.489249 (+   184us) service_pool.cc:224] Handling call
0709 13:19:24.507475 (+ 18226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.507703 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:24.529773 (+ 22070us) log.cc:844] Serialized 14 byte log entry
0709 13:19:25.340846 (+811073us) log.cc:844] Serialized 14 byte log entry
0709 13:19:25.681572 (+340726us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.960357 (+1278785us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b1800423ee0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:27.002508 (+ 42151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.002558 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:27.002601 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.002663 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.010080 (+  7417us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150005,"prepare.queue_time_us":111634,"prepare.run_cpu_time_us":159,"prepare.run_wall_time_us":8217,"raft.queue_time_us":982067,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":46866,"spinlock_wait_cycles":21146880,"thread_start_us":1036110,"threads_started":4,"wal-append.queue_time_us":641434}
I20260709 13:19:27.042414 18703 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.117424 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:27.119208 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.120635 14222 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:27.086696 18780 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.099931 18806 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.128290 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:27.125870 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.102892 18751 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.131968 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.132867 14222 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:27.120837 18730 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.079303 18731 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:27.120337 18702 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:27.154105 18702 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:27.156292 18702 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.133890 18796 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.159222 14223 raft_consensus.cc:2410] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:19:27.159566 18844 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.307s	user 0.002s	sys 0.000s
W20260709 13:19:27.162549 14901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1099) took 1718 ms (client timeout 2099 ms). Trace:
I20260709 13:19:27.163053 14893 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:27.163856 18562 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.164364 18562 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.165207 18537 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.166184 14299 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:27.141960 18842 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.143555 18566 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.144353 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:27.145532 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:27.189680 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 129728us
I20260709 13:19:27.149276 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1112) took 1126 ms. Trace:
I20260709 13:19:27.196184 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.126530 18727 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:27.167238 14295 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:27.168144 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.168144 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.168696 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.128863 18806 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.197026 14304 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:27.203945 14223 raft_consensus.cc:2410] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:27.203908 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:27.162957 14901 rpcz_store.cc:269] 0709 13:19:25.444197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.444354 (+   157us) service_pool.cc:224] Handling call
0709 13:19:27.162382 (+1718028us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b540049fa54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:27.162493 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379726592}
I20260709 13:19:27.205375 14222 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:27.205595 14901 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:27.171592 14300 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:27.018711 18750 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.148034 18574 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.163056 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:27.195451 14896 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.196239 14897 rpcz_store.cc:276] 0709 13:19:26.023296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.023517 (+   221us) service_pool.cc:224] Handling call
0709 13:19:26.023875 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.024242 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.024276 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.046168 (+ 21892us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.933235 (+887067us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:26.933283 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.933353 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.147942 (+214589us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b54008677a0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded001dbe 00007f8ded00c930 00007f8ded00c8d8 00007f8ded00c858 00007f8ded00c813 00007f8ded00ba9c 00007f8df2ef7626 00007f8df2ef1dd8 00007f8ded0487cb 00007f8ded04b2c0
0709 13:19:27.148985 (+  1043us) raft_consensus.cc:1685] finished
0709 13:19:27.149006 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.149216 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107923,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":55223,"spinlock_wait_cycles":7271680,"thread_start_us":814566,"threads_started":1,"wal-append.queue_time_us":800569}
I20260709 13:19:27.206884 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.207450 14297 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:27.236614 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.237564 14896 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:27.200616 14298 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:27.201169 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.201406 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1102) took 1754 ms. Trace:
I20260709 13:19:27.121973 18704 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:27.198593 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:27.169221 18730 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.195397 18751 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:27.284006 14895 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:27.197141 18790 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:27.286418 14892 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:27.225739 18798 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.238612 14900 rpcz_store.cc:276] 0709 13:19:25.447406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.447530 (+   124us) service_pool.cc:224] Handling call
0709 13:19:25.447858 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.472000 (+ 24142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.472039 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.476632 (+  4593us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.035696 (+559064us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:26.145405 (+109709us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.196170 (+ 50765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.196244 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.159265 (+963021us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b2400330ff8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fde09d 00007f8decc1010e 00007f8decc2788c 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221
0709 13:19:27.167435 (+  8170us) raft_consensus.cc:1685] finished
0709 13:19:27.201198 (+ 33763us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.201349 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125934,"prepare.queue_time_us":473555,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":559079,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":65180,"spinlock_wait_cycles":48267648,"thread_start_us":403114,"threads_started":2,"wal-append.queue_time_us":1291784}
I20260709 13:19:27.299939 18731 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.373581 18790 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:27.404083 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 154033us
I20260709 13:19:27.404912 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:27.306792 18751 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.411325 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.426615 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.432927 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.453666 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.454548 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.454806 14222 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:27.455495 14298 raft_consensus.cc:2410] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:27.414083 14867 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:27.457617 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.459255 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.462441 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.463160 14295 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 8: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:27.465095 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:27.402323 18857 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.145s
I20260709 13:19:27.466106 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:27.386710 18783 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.414147 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:27.424870 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 226733us
I20260709 13:19:27.371549 18566 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.474287 18878 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:19:27.474997 18872 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:27.494884 14300 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:27.475530 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:27.505281 14228 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:27.476830 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.478773 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:27.411882 18562 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.452937 18754 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:27.494741 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:27.414382 18810 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:19:27.416661 18750 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.503023 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.507834 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:27.464818 18813 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:27.504503 18872 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.516680 14222 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:27.308341 18798 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.518141 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:27.475378 18419 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:19:27.528874 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:27.529780 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:27.531391 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.535064 14270 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:27.507306 18754 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:27.541257 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:27.424119 18824 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.387748 18727 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.492961 18851 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:27.515034 18778 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.548096 14297 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:27.549769 14894 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:27.525518 18872 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.522449 18813 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:27.522447 18702 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.561064 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.532522 18830 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.572916 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:27.571950 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:27.584110 14228 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.513090 18566 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:27.574265 18824 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.560295 18804 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:27.560997 18843 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.544142 18704 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.569772 18813 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:27.548589 18754 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.595057 14228 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:27.602252 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.577174 18574 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:27.602923 14228 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:27.603778 14229 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:27.598604 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:27.609571 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:27.600116 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:27.592937 18887 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:19:27.580895 18790 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:27.602423 18886 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:19:27.596666 18804 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.615700 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.617270 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:27.621066 14900 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
W20260709 13:19:27.621410 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 141294us
W20260709 13:19:27.612592 18889 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:19:27.633476 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:27.619339 18874 consensus_meta.cc:287] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.005s
W20260709 13:19:27.619243 18847 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.532s	user 0.005s	sys 0.007s
W20260709 13:19:27.646395 18703 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 13:19:27.651896 18703 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:27.631807 18804 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.649989 18874 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.619978 18751 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.651074 18847 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.654630 14225 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:19:27.649194 18790 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:27.648123 18890 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:19:27.645705 18741 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:27.675516 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.666752 18790 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.688035 14897 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:19:27.668213 18812 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.675678 18798 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.697854 14897 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:27.693563 18636 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:27.694260 18703 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.719682 18874 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.723694 18566 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.749974 14892 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:27.752504 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1063) took 1184 ms. Trace:
I20260709 13:19:27.717157 18806 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.753410 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1062) took 1186 ms. Trace:
W20260709 13:19:27.753660 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 296877us
I20260709 13:19:27.754381 14899 rpcz_store.cc:276] 0709 13:19:26.567658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.202004 (+634346us) service_pool.cc:224] Handling call
0709 13:19:27.202297 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.202525 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:27.229224 (+ 26699us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.752185 (+522961us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.752233 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:27.752278 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.752338 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.752447 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63290,"prepare.queue_time_us":27052,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":10955,"raft.queue_time_us":40992,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":522580,"threads_started":2,"wal-append.queue_time_us":504760}
I20260709 13:19:27.757748 14893 rpcz_store.cc:276] 0709 13:19:26.567342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.768510 (+201168us) service_pool.cc:224] Handling call
0709 13:19:27.162739 (+394229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.163653 (+   914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.753154 (+589501us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540049fa50. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:27.753324 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905851136}
I20260709 13:19:27.734700 18813 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.775302 18872 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:27.777922 18693 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:27.778234 18847 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.778398 18693 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:27.779459 18806 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.779310 18693 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.779646 18754 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.781980 14295 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:27.782629 18790 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.783315 18351 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:27.784032 18754 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.784765 18351 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:27.785274 18351 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:27.786053 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.34128e+06us
I20260709 13:19:27.787149 18730 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.787489 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:27.789227 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:27.789367 18730 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.811592 14892 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:27.789929 14378 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:27.791049 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.791296 18813 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:19:27.791754 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.815543 14221 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:27.815811 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2442) took 2816 ms. Trace:
W20260709 13:19:27.792336 18828 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.039s	user 0.009s	sys 0.005s
I20260709 13:19:27.824188 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:27.825330 18843 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.825891 18860 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:27.826366 18076 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.827101 18673 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:27.792860 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:27.827839 14369 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:27.827991 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.793742 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.828847 14342 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:27.829192 18896 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:19:27.829417 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.792762 18786 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.830168 18270 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.830681 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.830801 18786 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:27.831619 18892 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:19:27.831873 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:27.797133 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 1.22617e+06us
I20260709 13:19:27.794492 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.833071 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:27.798053 18866 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.800369 14296 raft_consensus.cc:1217] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-9.9]   Dedup: 6.7->[7.8-9.9]
I20260709 13:19:27.830160 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:27.834844 14296 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: [6.7-9.9]
I20260709 13:19:27.833091 14228 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:27.814749 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.810559 18807 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:27.810788 18872 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:27.821244 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.840847 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:27.826941 18076 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.828274 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2438) took 2844 ms. Trace:
I20260709 13:19:27.821554 18804 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:27.802736 14370 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:27.833956 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:27.816164 14377 rpcz_store.cc:276] 0709 13:19:24.987574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.988042 (+   468us) service_pool.cc:224] Handling call
0709 13:19:25.003064 (+ 15022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.003291 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:25.342500 (+339209us) log.cc:844] Serialized 14 byte log entry
0709 13:19:25.693695 (+351195us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.354345 (+660650us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.782537 (+1428192us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b18003514c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:27.782685 (+   148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.792029 (+  9344us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b240037bb48. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fde09d 00007f8decc1010e 00007f8decc2788c 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221
0709 13:19:27.803341 (+ 11312us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:27.803429 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.803561 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.803708 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72769,"prepare.queue_time_us":1058646,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":11408,"raft.queue_time_us":1488759,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":28132,"spinlock_wait_cycles":29160576,"thread_start_us":1269450,"threads_started":3,"wal-append.queue_time_us":915735}
I20260709 13:19:27.799234 18738 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:19:27.842118 14372 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:19:27.838598 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:27.844357 14342 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:27.845119 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:27.878126 18076 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.840487 18866 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:27.846442 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2752) took 1022 ms. Trace:
I20260709 13:19:27.880424 14901 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:27.842756 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:27.884533 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:27.885385 14372 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:27.885409 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46889.1us
I20260709 13:19:27.885824 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:27.879504 14375 rpcz_store.cc:276] 0709 13:19:24.984006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.989885 (+  5879us) service_pool.cc:224] Handling call
0709 13:19:24.990192 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:25.425180 (+434988us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:25.736879 (+311699us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.239311 (+502432us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:26.239998 (+   687us) log.cc:844] Serialized 52 byte log entry
0709 13:19:26.240155 (+   157us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:26.240411 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.951809 (+711398us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b18002d4600. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:27.103578 (+151769us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.827890 (+724312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.828054 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.828097 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:27.828109 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.828225 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2172881,"prepare.queue_time_us":549490,"prepare.run_cpu_time_us":200,"prepare.run_wall_time_us":6086,"raft.queue_time_us":2478291,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":6089,"spinlock_wait_cycles":14264064,"thread_start_us":1029988,"threads_started":4,"wal-append.queue_time_us":690268}
I20260709 13:19:27.887212 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:27.888429 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:27.889071 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:27.830826 18898 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:19:27.767136 18703 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:19:27.892011 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:27.883912 14299 rpcz_store.cc:276] 0709 13:19:26.823621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.830588 (+  6967us) service_pool.cc:224] Handling call
0709 13:19:27.846212 (+1015624us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54000dd4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:27.846372 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547114368}
I20260709 13:19:27.894359 14892 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:27.898679 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.899580 14303 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:27.894395 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:27.895780 14342 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:27.879657 18693 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:27.846820 18722 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.841542 18673 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:27.876015 18756 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:27.902788 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:27.834623 18850 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:27.902839 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:27.945627 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:27.952973 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:27.892513 18294 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.893659 18076 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:27.954916 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 54080.7us
W20260709 13:19:27.956365 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 53661us
I20260709 13:19:27.966220 14372 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:27.973698 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:27.984923 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:27.987331 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:27.956670 14303 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:27.956818 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 54058.1us
I20260709 13:19:27.897037 18842 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:27.998988 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:28.003221 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:28.004122 14375 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.010515 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:27.950410 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:27.946391 18499 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:27.949481 18673 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.902022 18270 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:19:27.948004 18776 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:27.902544 18789 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:19:27.988364 14901 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
W20260709 13:19:28.053574 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.093868 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 78825us
I20260709 13:19:28.127605 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:28.146627 14224 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:28.148361 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:28.149194 14224 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:27.965075 18902 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:19:28.161500 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:27.966580 18908 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:28.190644 14372 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.192458 14299 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:28.195276 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 101670us
I20260709 13:19:27.960022 18595 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:27.984086 18780 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:28.240890 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:28.241925 14300 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:27.946537 18883 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:27.897382 18566 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:19:27.957908 18905 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.974535 18574 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:28.093820 18673 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:28.139374 18355 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:28.278033 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:28.140882 18776 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.140048 18786 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:28.269587 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.987406 18352 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:28.295324 14375 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:28.233644 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1139) took 1252 ms. Trace:
I20260709 13:19:28.319355 14895 rpcz_store.cc:276] 0709 13:19:26.981308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.064951 (+ 83643us) service_pool.cc:224] Handling call
0709 13:19:28.233432 (+1168481us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54004c0ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:28.233572 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491598592}
I20260709 13:19:28.300586 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:28.321660 14304 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:28.099274 18837 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:28.305630 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 62727.3us
I20260709 13:19:28.260174 14303 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:28.310231 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2181) took 3555 ms. Trace:
I20260709 13:19:28.256718 14372 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:27.901657 18351 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:28.322748 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:28.330247 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:28.335844 14304 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:27.972733 18728 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.307s
I20260709 13:19:27.965242 18847 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.345s
I20260709 13:19:28.277377 18780 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:28.290827 18731 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:28.425239 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2677) took 1254 ms. Trace:
I20260709 13:19:28.342561 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:28.282351 18883 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.290990 18839 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:28.344098 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:28.329850 14220 rpcz_store.cc:276] 0709 13:19:24.754714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.754964 (+   250us) service_pool.cc:224] Handling call
0709 13:19:24.785275 (+ 30311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.014048 (+2228773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.238179 (+1224131us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54001496d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:28.310154 (+ 71975us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5035975552}
W20260709 13:19:28.345582 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 346699us
I20260709 13:19:28.242846 18842 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:19:28.315696 18355 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.458822 18355 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.459017 18703 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.459556 18703 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:28.350057 14302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2753) took 1510 ms (client timeout 1500 ms). Trace:
I20260709 13:19:27.996836 18850 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:28.340731 18837 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:28.464406 14302 rpcz_store.cc:269] 0709 13:19:26.840100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.840225 (+   125us) service_pool.cc:224] Handling call
0709 13:19:28.349819 (+1509594us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400154ad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:28.349972 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249874688}
I20260709 13:19:28.465605 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:28.466753 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:28.466862 18837 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:28.467481 14302 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:28.353864 14228 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:19:28.468780 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:28.355139 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:28.420936 14304 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:28.469586 14372 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:28.469946 14299 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:28.470439 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:28.467640 18837 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:19:28.299710 18574 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:28.472038 18574 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:28.472994 18910 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 13:19:28.473083 18574 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.318934 18776 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:28.474092 18907 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.519s	user 0.001s	sys 0.000s
W20260709 13:19:28.475003 18909 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.520s	user 0.000s	sys 0.000s
I20260709 13:19:28.476824 18804 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:28.425912 14301 rpcz_store.cc:276] 0709 13:19:27.170500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.170619 (+   119us) service_pool.cc:224] Handling call
0709 13:19:27.170932 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:27.305552 (+134620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.305583 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:27.404386 (+ 98803us) log.cc:844] Serialized 52 byte log entry
0709 13:19:27.635166 (+230780us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:27.635224 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.796895 (+161671us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540020ab54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:27.796947 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.424690 (+627743us) raft_consensus.cc:1685] finished
0709 13:19:28.424719 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.425144 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":283,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":62553,"spinlock_wait_cycles":308569984,"thread_start_us":167892,"threads_started":1,"wal-append.queue_time_us":232586}
I20260709 13:19:27.663892 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:28.479740 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 283553us
I20260709 13:19:28.448488 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1142) took 1347 ms. Trace:
I20260709 13:19:28.326639 18682 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:28.494031 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 301876us
I20260709 13:19:28.321761 18352 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:28.495468 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.482148 14900 rpcz_store.cc:276] 0709 13:19:27.101372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.621861 (+520489us) service_pool.cc:224] Handling call
0709 13:19:27.622284 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:27.622684 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.622723 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:27.647420 (+ 24697us) log.cc:844] Serialized 52 byte log entry
0709 13:19:27.751564 (+104144us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:27.760303 (+  8739us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.760577 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.760650 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.794702 (+ 34052us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b18003a6f60. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:19:28.422337 (+627635us) raft_consensus.cc:1685] finished
0709 13:19:28.448164 (+ 25827us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.448401 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10196,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":26498,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":234,"spinlock_wait_cycles":2462976,"thread_start_us":80739,"threads_started":1,"wal-append.queue_time_us":142873}
I20260709 13:19:28.441445 14125 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 8 to 9, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 9 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:28.457125 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:28.503548 14303 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:28.489639 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:28.530800 14125 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:19:28.550267 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 53963.9us
W20260709 13:19:28.550968 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57318.2us
I20260709 13:19:28.347074 18913 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:28.422413 18731 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:28.434942 18839 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:28.567672 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:28.532725 14125 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 2 to 7, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 7 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:28.573053 14125 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:28.574621 14125 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.434453 18883 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:28.593927 14373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.011s	sys 0.017s
W20260709 13:19:28.594580 14373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.011s	sys 0.017s
I20260709 13:19:28.602758 14125 catalog_manager.cc:5697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:28.604867 14125 catalog_manager.cc:5697] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:28.609022 14303 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:28.513281 18682 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.308832 18905 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:28.552364 18722 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.512974 18352 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:28.637434 14111 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 37975f772fc648329a8acae36d33a345 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 181bbac22422408c87cd13b7fe3008f9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:28.577528 18790 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.665354 18913 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:28.639599 18703 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:28.666499 18682 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.688830 18913 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:28.720355 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 824) took 1308 ms. Trace:
I20260709 13:19:28.731062 14298 rpcz_store.cc:276] 0709 13:19:27.412036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.468051 (+ 56015us) service_pool.cc:224] Handling call
0709 13:19:27.798568 (+330517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.798817 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.798853 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.799314 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.946135 (+146821us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:27.946194 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.947830 (+  1636us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.357880 (+410050us) raft_consensus.cc:1685] finished
0709 13:19:28.357903 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.690394 (+332491us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54000dcfd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:28.720287 (+ 29893us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668843776,"thread_start_us":145617,"threads_started":1,"wal-append.queue_time_us":556582}
W20260709 13:19:28.722576 18918 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.301s	user 0.001s	sys 0.001s
I20260709 13:19:28.701756 18833 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.630141 18780 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:28.783216 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 461674us
W20260709 13:19:28.776986 18076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.049s	sys 0.062s
I20260709 13:19:28.757030 18866 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:28.791042 14344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.012s	sys 0.035s
I20260709 13:19:28.767334 18833 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.707641 18790 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:28.765591 18850 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:28.795097 14344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.012s	sys 0.035s
W20260709 13:19:28.800856 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 850442us
I20260709 13:19:28.804347 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:28.814993 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:28.793159 18780 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.786021 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:28.790190 18873 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:19:28.829877 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 43921.2us
W20260709 13:19:28.833627 14300 consensus_meta.cc:287] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.000s
I20260709 13:19:28.836994 14300 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:28.840116 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:28.804612 18537 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.639s	user 0.012s	sys 0.004s
I20260709 13:19:28.845855 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:28.806391 18866 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:28.854820 14125 catalog_manager.cc:5697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 11, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 11 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:28.798012 18076 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:28.847131 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:28.858182 18786 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:28.862555 18925 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:28.863272 18925 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:28.726910 18839 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:28.864971 18839 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:28.866106 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2194) took 1434 ms. Trace:
I20260709 13:19:28.866539 14225 rpcz_store.cc:276] 0709 13:19:27.431940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.432053 (+   113us) service_pool.cc:224] Handling call
0709 13:19:27.467927 (+ 35874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.657482 (+189555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.865815 (+1208333us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540033d454. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:28.866040 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428801280}
W20260709 13:19:28.867202 18921 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:19:28.868744 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1151) took 1041 ms. Trace:
I20260709 13:19:28.870272 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:28.869184 14892 rpcz_store.cc:276] 0709 13:19:27.827198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.898915 (+ 71717us) service_pool.cc:224] Handling call
0709 13:19:27.899279 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.948900 (+ 49621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.948930 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.951241 (+  2311us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.339137 (+387896us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:28.339316 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.339464 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.868482 (+529018us) raft_consensus.cc:1685] finished
0709 13:19:28.868509 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.868672 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49094,"raft.queue_time_us":49226,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":216308,"threads_started":1,"wal-append.queue_time_us":670639}
I20260709 13:19:28.872153 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1059) took 2305 ms. Trace:
I20260709 13:19:28.872565 14898 rpcz_store.cc:276] 0709 13:19:26.566551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.638256 (+ 71705us) service_pool.cc:224] Handling call
0709 13:19:27.058537 (+420281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.058957 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.058986 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.065367 (+  6381us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.121244 (+ 55877us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:27.130746 (+  9502us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.133128 (+  2382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.133251 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.722514 (+589263us) raft_consensus.cc:1685] finished
0709 13:19:27.722534 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.871940 (+1149406us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b5400611050. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:28.872068 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2111,"prepare.queue_time_us":9298,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2909,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":21971,"spinlock_wait_cycles":918233856,"thread_start_us":55514,"threads_started":1,"wal-append.queue_time_us":129397,"wal-append.run_cpu_time_us":11078,"wal-append.run_wall_time_us":1548566}
I20260709 13:19:28.875399 18926 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:28.875706 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.875909 18926 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:28.876291 18926 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.832756 18790 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:28.877710 18917 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:19:28.879861 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2237) took 1091 ms. Trace:
I20260709 13:19:28.887331 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:19:28.861069 14127 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37096 (request call id 354) took 29642 ms (client timeout 15000 ms). Trace:
I20260709 13:19:28.800642 18913 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:28.888978 18913 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.891371 18860 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.891903 18860 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:28.830053 18850 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:28.888108 14127 rpcz_store.cc:269] 0709 13:18:59.138391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.142418 (+  4027us) service_pool.cc:224] Handling call
0709 13:19:17.077416 (+17934998us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b5400151ea8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1fdc9b4 00007f8df0ac03dc 00007f8df0a81e0b 00007f8df0a81be4 00007f8df2f822d1 00007f8df2f82b2f 00007f8df2e41d4b 00007f8df2f49c3e 00007f8df140a2a4 00007f8df140a232
0709 13:19:28.769122 (+11691706us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:17.737287 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:17.807148 (+ 69861us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:17.807186 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:19:17.807204 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:17.808740 (+  1536us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:17.808823 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:17.808854 (+    31us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:19:17.821941 (+ 13087us) tablet.cc:701] Row locks acquired
0709 13:19:17.821965 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:19:17.822130 (+   165us) write_op.cc:270] Start()
0709 13:19:17.822275 (+   145us) write_op.cc:276] Timestamp: P: 1783603157822077 usec, L: 0
0709 13:19:17.822297 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:18.078379 (+256082us) log.cc:844] Serialized 6366 byte log entry
0709 13:19:18.529267 (+450888us) op_driver.cc:464] REPLICATION: finished
0709 13:19:19.683830 (+1154563us) write_op.cc:301] APPLY: starting
0709 13:19:19.688669 (+  4839us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:20.465958 (+777289us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:20.481364 (+ 15406us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:21.541365 (+1060001us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:21.577493 (+ 36128us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:19:21.586278 (+  8785us) write_op.cc:312] APPLY: finished
0709 13:19:21.790446 (+204168us) log.cc:844] Serialized 148 byte log entry
0709 13:19:21.957113 (+166667us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:22.042580 (+ 85467us) write_op.cc:454] Released schema lock
0709 13:19:22.050873 (+  8293us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:22.155667 (+104794us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:22.155710 (+    43us) write_op.cc:454] Released schema lock
0709 13:19:22.330769 (+175059us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
Metrics: {"mutex_wait_us":74414,"reported_tablets":46,"spinlock_wait_cycles":60461952,"child_traces":[["op",{"apply.queue_time_us":1146995,"apply.run_cpu_time_us":68165,"apply.run_wall_time_us":2447172,"cfile_cache_hit":62,"cfile_cache_hit_bytes":64821,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":75256,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":9,"num_ops":16,"prepare.queue_time_us":392307,"prepare.run_cpu_time_us":23300,"prepare.run_wall_time_us":531723,"raft.queue_time_us":176173,"raft.run_cpu_time_us":47641,"raft.run_wall_time_us":1189935,"replication_time_us":641591,"spinlock_wait_cycles":6929152,"thread_start_us":1555302,"threads_started":5,"wal-append.queue_time_us":553380,"wal-append.run_cpu_time_us":67546,"wal-append.run_wall_time_us":2443821}]]}
W20260709 13:19:28.856352 14224 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.705s	user 0.008s	sys 0.000s
I20260709 13:19:28.844154 18873 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:28.893589 14224 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:28.893981 18873 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:28.893623 18866 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:28.894845 18873 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:28.895550 18866 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:28.896097 18873 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:28.887653 18905 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:28.833146 18804 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:28.880313 14373 rpcz_store.cc:276] 0709 13:19:27.788611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.788731 (+   120us) service_pool.cc:224] Handling call
0709 13:19:27.789046 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.789447 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:27.879852 (+ 90405us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.674820 (+794968us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.699009 (+ 24189us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.699275 (+   266us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:28.699329 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.699429 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.879606 (+180177us) raft_consensus.cc:1685] finished
0709 13:19:28.879634 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.879791 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69612,"prepare.queue_time_us":169088,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":217199,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":10617,"thread_start_us":754678,"threads_started":2,"wal-append.queue_time_us":784399}
I20260709 13:19:28.877524 14867 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:28.856352 14125 catalog_manager.cc:5697] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 6, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 6 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.908480 18872 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:28.939478 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62004us
I20260709 13:19:28.919909 14224 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:28.925926 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:28.985668 14225 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:28.859243 18813 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:28.987849 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47296.7us
I20260709 13:19:28.918977 14125 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:29.007936 14125 catalog_manager.cc:5697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:29.011718 14125 catalog_manager.cc:5697] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:28.912274 18850 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:28.924914 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:29.064255 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.083868 18795 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.134644 14125 catalog_manager.cc:5697] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:28.934778 18872 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:29.139112 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2683) took 1886 ms. Trace:
I20260709 13:19:29.139714 14296 rpcz_store.cc:276] 0709 13:19:27.252474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.455934 (+203460us) service_pool.cc:224] Handling call
0709 13:19:27.456395 (+   461us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:27.835402 (+379007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.138727 (+1303325us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54000fd2d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:29.139032 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790474112}
W20260709 13:19:29.096788 14341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.005s	sys 0.021s
W20260709 13:19:29.097043 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.011s	sys 0.008s
W20260709 13:19:29.086756 18355 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.000s
I20260709 13:19:29.063346 18905 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:29.064067 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72397.3us
I20260709 13:19:29.110049 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:29.112821 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.141829 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:29.142175 14341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.006s	sys 0.021s
W20260709 13:19:29.142382 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.012s	sys 0.008s
I20260709 13:19:29.164593 14867 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:29.189824 14223 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:29.183718 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.190788 18796 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:29.184302 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.185938 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:29.184891 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.192564 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.165246 14220 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.190842 14373 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:29.194406 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.186380 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:29.195626 14372 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:29.186703 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:29.176191 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.186757 14225 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:29.197983 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:29.141804 18499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.018s	sys 0.064s
I20260709 13:19:29.136637 18850 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.199301 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.241596 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.063498 18813 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.204629 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.205252 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:29.243000 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.191504 18796 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.296370 14372 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
W20260709 13:19:29.201587 18499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.019s	sys 0.064s
I20260709 13:19:29.299717 14377 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:29.202157 18792 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:29.298079 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:29.163187 18905 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:29.199894 18838 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:29.245512 18595 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.006s	sys 0.028s
I20260709 13:19:29.202797 18537 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:29.287588 18703 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.302860 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.347802 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:29.349205 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:29.351323 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.162132 18795 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.134517 18076 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.202435 18927 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:29.247717 18850 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:29.297302 18789 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.315868 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:29.176826 18822 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.004s	sys 0.019s
I20260709 13:19:29.258572 14373 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:29.247967 18738 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:29.321161 14220 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
W20260709 13:19:29.322125 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.010s	sys 0.030s
I20260709 13:19:29.181558 18355 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:29.287014 18929 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:29.351699 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:29.308718 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 450224us
I20260709 13:19:29.404011 14372 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:29.307318 18792 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.301251 18499 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:29.356527 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:29.316618 18776 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.842s	user 0.018s	sys 0.000s
W20260709 13:19:29.321945 18834 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.016s	sys 0.021s
W20260709 13:19:29.363335 18722 consensus_meta.cc:287] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.687s	user 0.017s	sys 0.003s
I20260709 13:19:29.193332 18854 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
W20260709 13:19:29.345175 18673 consensus_meta.cc:287] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.016s	user 0.011s	sys 0.011s
I20260709 13:19:29.353183 18537 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.308712 18905 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.387217 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:29.392014 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.010s	sys 0.030s
W20260709 13:19:29.364117 18693 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.414s	user 0.007s	sys 0.012s
I20260709 13:19:29.396862 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:29.350821 18838 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:29.430321 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1067) took 2374 ms. Trace:
W20260709 13:19:29.363804 18574 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.890s	user 0.005s	sys 0.006s
W20260709 13:19:29.405340 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.430727 14894 rpcz_store.cc:276] 0709 13:19:27.055450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.258136 (+202686us) service_pool.cc:224] Handling call
0709 13:19:27.307940 (+ 49804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.563485 (+255545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.430084 (+1866599us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400268ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:29.430262 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555158784}
W20260709 13:19:29.312449 18595 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.007s	sys 0.028s
W20260709 13:19:29.391808 18822 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.006s	sys 0.022s
I20260709 13:19:29.412963 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.442773 14372 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:29.354260 18703 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:29.420677 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.345013 18872 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.357551 18804 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:29.455143 14229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2195) took 2022 ms (client timeout 1896 ms). Trace:
I20260709 13:19:29.313369 18935 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.426597 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 914328us
W20260709 13:19:29.428726 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.438591 14227 raft_consensus.cc:1813] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Handling vote request from an unknown peer 181bbac22422408c87cd13b7fe3008f9
W20260709 13:19:29.417140 18834 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.017s	sys 0.022s
I20260709 13:19:29.453485 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.454536 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:29.459553 14296 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:29.423112 18722 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:29.465201 14227 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:29.376652 18927 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:29.455583 14229 rpcz_store.cc:269] 0709 13:19:27.432292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.432635 (+   343us) service_pool.cc:224] Handling call
0709 13:19:29.454957 (+2022322us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400149bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:29.455073 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390821632}
I20260709 13:19:29.390636 18789 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.467491 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:29.465519 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.473345 18352 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.786s	user 0.000s	sys 0.010s
I20260709 13:19:29.403438 18738 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.438422 18595 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:29.514180 14373 raft_consensus.cc:2376] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11. Re-sending same reply.
I20260709 13:19:29.474248 18934 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:29.476179 18947 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:29.421444 18776 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:29.479068 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:29.490391 14226 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.009s
I20260709 13:19:29.486837 18574 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.429529 18673 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.523289 18947 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:29.419691 18929 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.542184 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:29.523823 14226 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:29.544667 14372 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:29.489151 18951 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.533674 18595 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.525962 18934 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:29.485311 18935 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:29.513867 18352 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:29.515221 18938 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.158s
I20260709 13:19:29.656103 14370 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:29.681465 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.817353 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 420589us
W20260709 13:19:29.628836 14227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2581) took 1836 ms (client timeout 2099 ms). Trace:
W20260709 13:19:29.818310 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.012763 14227 rpcz_store.cc:269] 0709 13:19:27.792381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.827717 (+ 35336us) service_pool.cc:224] Handling call
0709 13:19:29.562372 (+1734655us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400052154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:29.628726 (+ 66354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3702578432}
I20260709 13:19:29.987886 18792 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:30.014168 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.707576 14376 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:29.544000 18947 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.016780 14300 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:29.945397 18932 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.018244 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:30.018364 18932 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:30.020009 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:29.966923 18905 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.000s
I20260709 13:19:30.021338 18905 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:29.901029 14344 leader_election.cc:336] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 2.099s (SENT)
I20260709 13:19:30.034219 14344 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:29.544932 14226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2190) took 2135 ms (client timeout 2112 ms). Trace:
I20260709 13:19:30.012786 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:30.035207 14226 rpcz_store.cc:269] 0709 13:19:27.409583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.409710 (+   127us) service_pool.cc:224] Handling call
0709 13:19:28.870091 (+1460381us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:19:29.544864 (+674773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2360064}
I20260709 13:19:30.036033 18812 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:30.036731 18812 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:30.037817 18812 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.051750 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:30.052917 18630 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:30.054217 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:30.055295 18630 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:30.055940 18630 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:29.555783 18804 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.057036 18630 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.024546 18905 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:30.064283 18935 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:30.068862 18936 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.601594 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.522130 18738 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.069561 18936 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:29.550490 18778 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:30.070801 18778 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:30.071738 18778 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.072360 18936 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.073220 14301 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:19:30.074427 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 173441us
I20260709 13:19:30.075141 14301 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:30.075522 18938 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:30.076289 18938 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:30.076900 14301 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:30.079028 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.068866 14193 connection.cc:256] RPC call timeout handler was delayed by -1.4658910059999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:19:30.087182 14193 connection.cc:256] RPC call timeout handler was delayed by -1.4456462630000715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:19:30.104030 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49921.9us
I20260709 13:19:30.108960 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:30.110061 14301 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:30.112823 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:30.113708 14301 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:30.114974 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:30.126986 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:30.128321 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:30.130162 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:30.132121 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:30.133360 14224 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.132118 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:30.134303 14229 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:30.135643 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:30.136705 14225 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:30.139171 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:30.140193 14220 raft_consensus.cc:2410] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:30.128014 14301 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:30.142663 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:30.144243 14229 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:30.146134 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:30.002427 18780 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.174s	user 0.009s	sys 0.014s
I20260709 13:19:30.148440 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:30.158142 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:30.159914 14222 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.160041 14899 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 6.
W20260709 13:19:29.627713 18939 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:19:30.150104 14193 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:29.521560 18796 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:29.890309 18860 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.998s	user 0.012s	sys 0.011s
I20260709 13:19:29.522320 18795 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:30.121773 18905 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:30.118623 18811 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.010s	sys 0.019s
I20260709 13:19:29.538324 18952 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:29.562176 18838 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:30.119076 18854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.019s	sys 0.005s
I20260709 13:19:30.077044 18938 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:29.552942 18851 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:29.541293 18837 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:29.554888 18537 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:30.174466 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:30.174463 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:30.175465 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:30.174814 14226 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:30.178349 14224 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
W20260709 13:19:30.178858 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.024s	sys 0.015s
W20260709 13:19:30.178970 14267 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.000s	sys 0.012s
I20260709 13:19:30.125573 18935 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.116477 18738 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:30.116161 18927 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:30.125367 18419 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:30.196761 14894 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:30.140579 18703 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:30.175513 18873 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.279s	user 0.012s	sys 0.001s
I20260709 13:19:30.171183 18778 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:30.186863 18833 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.374s	user 0.008s	sys 0.003s
W20260709 13:19:30.186002 18811 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.011s	sys 0.019s
I20260709 13:19:30.230727 14372 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:29.540872 18574 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:30.178603 18822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.000s	sys 0.010s
W20260709 13:19:30.326258 18822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.000s	sys 0.012s
W20260709 13:19:30.185395 18937 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.006s	sys 0.005s
W20260709 13:19:30.327865 18937 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.007s	sys 0.005s
W20260709 13:19:30.178817 18836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.004s	sys 0.007s
I20260709 13:19:30.185105 18780 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:29.538081 18499 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:30.229408 18854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.019s	sys 0.012s
W20260709 13:19:30.314338 18682 consensus_meta.cc:287] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.567s	user 0.006s	sys 0.016s
W20260709 13:19:30.305179 18850 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.913s	user 0.003s	sys 0.003s
W20260709 13:19:30.229295 18790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.002s	sys 0.011s
I20260709 13:19:30.196595 18905 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:30.332170 18836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.005s	sys 0.008s
I20260709 13:19:30.274982 18776 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:30.311474 18419 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.227111 18817 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:30.205667 18952 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:30.323508 18911 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.873s	user 0.006s	sys 0.009s
I20260709 13:19:30.323939 18833 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:30.313519 18636 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:30.310105 18843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.009s	sys 0.099s
W20260709 13:19:30.305182 18926 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.428s	user 0.009s	sys 0.011s
I20260709 13:19:30.146196 18951 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:30.229555 18866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.000s	sys 0.012s
I20260709 13:19:30.306277 18738 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:30.459239 18843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.077s	user 0.010s	sys 0.100s
W20260709 13:19:30.463460 18866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.000s	sys 0.018s
W20260709 13:19:30.492417 18946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.004s	sys 0.023s
I20260709 13:19:30.430929 18850 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:30.505754 18839 consensus_meta.cc:287] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.640s	user 0.006s	sys 0.015s
W20260709 13:19:30.521159 18946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.004s	sys 0.023s
I20260709 13:19:30.468231 18926 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.459240 18817 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:30.184779 18796 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:19:30.234441 18851 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.300208 18935 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:30.427474 18790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.006s	sys 0.014s
I20260709 13:19:30.367509 18780 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:30.583900 18780 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.547216 18905 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.594691 18780 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:30.559799 18973 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:19:30.560971 18955 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:19:30.580618 18913 consensus_meta.cc:287] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.691s	user 0.010s	sys 0.004s
I20260709 13:19:30.581017 18935 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.582401 18952 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:30.583069 18851 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.277432 18837 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.604122 18837 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:30.592401 18883 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.920s	user 0.020s	sys 0.000s
I20260709 13:19:30.177157 18860 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:30.605110 18883 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:30.606892 18860 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:30.607750 18883 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:30.612740 18951 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.604125 18780 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.621470 18926 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.616851 18929 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.623919 18850 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.628774 18833 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:30.629896 18938 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:30.632455 18817 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:30.637610 18947 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.006s
I20260709 13:19:30.639549 18947 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.644259 18947 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:30.173215 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:30.696475 14221 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:30.197194 14222 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:30.740399 14375 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 13:19:30.742726 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 569417us
W20260709 13:19:30.699174 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.700655 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.276772 14267 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.000s	sys 0.015s
I20260709 13:19:30.746183 18780 raft_consensus.cc:2764] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:19:30.746941 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 1.31494e+06us
I20260709 13:19:30.748373 18851 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:30.277000 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.024s	sys 0.023s
I20260709 13:19:30.749589 18851 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.752689 14270 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:30.707438 14227 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:30.754120 18738 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:30.708804 14303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.011s	sys 0.002s
W20260709 13:19:30.755316 14303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.012s	sys 0.002s
I20260709 13:19:30.717016 14377 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:30.716840 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1116) took 1518 ms. Trace:
I20260709 13:19:30.758536 14369 rpcz_store.cc:276] 0709 13:19:29.198280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.198393 (+   113us) service_pool.cc:224] Handling call
0709 13:19:29.198675 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.299157 (+100482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.299187 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:29.304825 (+  5638us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.760959 (+456134us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:29.761017 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.761118 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.716122 (+955004us) raft_consensus.cc:1685] finished
0709 13:19:30.716182 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.716541 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100081,"raft.queue_time_us":108372,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":41452,"thread_start_us":393519,"threads_started":1,"wal-append.queue_time_us":990721}
I20260709 13:19:30.760618 18934 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:30.758174 18837 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.764377 18837 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:30.767922 18905 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:30.768545 18905 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:30.717166 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:30.718513 14378 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:30.770308 18905 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.772119 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1113) took 1578 ms. Trace:
I20260709 13:19:30.772624 14378 rpcz_store.cc:276] 0709 13:19:29.194076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.194185 (+   109us) service_pool.cc:224] Handling call
0709 13:19:30.771762 (+1577577us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002ec054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:30.771984 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3501851904}
I20260709 13:19:30.773065 18905 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:30.721446 14374 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
W20260709 13:19:30.767904 18912 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 2.340s	user 0.018s	sys 0.016s
I20260709 13:19:30.774857 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1109) took 1589 ms. Trace:
I20260709 13:19:30.775236 14374 rpcz_store.cc:276] 0709 13:19:29.185173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.186455 (+  1282us) service_pool.cc:224] Handling call
0709 13:19:30.774626 (+1588171us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540025a3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:30.774802 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3504245632}
I20260709 13:19:30.776402 18807 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.776778 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2686) took 3213 ms. Trace:
I20260709 13:19:30.777343 18807 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.777309 14297 rpcz_store.cc:276] 0709 13:19:27.563419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.574183 (+ 10764us) service_pool.cc:224] Handling call
0709 13:19:27.577018 (+  2835us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:27.748843 (+171825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.748882 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:27.751271 (+  2389us) log.cc:844] Serialized 52 byte log entry
0709 13:19:27.891400 (+140129us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:27.947230 (+ 55830us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.947547 (+   317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.947646 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.766587 (+2818941us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:30.776170 (+  9583us) raft_consensus.cc:1685] finished
0709 13:19:30.776336 (+   166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.776573 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57773,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":12023,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":12409,"spinlock_wait_cycles":66871552,"thread_start_us":283433,"threads_started":2,"wal-append.queue_time_us":393397}
I20260709 13:19:30.779841 18351 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:30.722824 18574 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:30.723618 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1068) took 3194 ms. Trace:
I20260709 13:19:30.229647 18731 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:30.307173 18537 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.801409 18537 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:30.802064 18537 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.803326 18673 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.459035 18636 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:30.430461 18682 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.809768 18900 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:30.810500 18867 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:30.811102 18867 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:30.811028 18900 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.812417 18682 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.726315 18419 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.727797 18352 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:30.815109 18947 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:30.747186 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.816229 18947 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.748282 18780 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:30.818430 18780 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:30.819927 18919 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 2.356s	user 0.019s	sys 0.030s
I20260709 13:19:30.707027 14300 raft_consensus.cc:2410] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:19:30.753063 18851 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:30.701745 14125 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.223s	user 0.020s	sys 0.012s
I20260709 13:19:30.704959 14296 raft_consensus.cc:2410] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:19:30.753659 18951 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:30.753908 18926 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.749224 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:30.745258 14193 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:30.776784 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:30.773558 14192 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.966s (SENT) [suppressed 33 similar messages]
W20260709 13:19:30.799732 14370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1118) took 1595 ms (client timeout 2019 ms). Trace:
W20260709 13:19:30.824743 14125 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.346s	user 0.021s	sys 0.012s
W20260709 13:19:30.826323 14370 rpcz_store.cc:269] 0709 13:19:29.204613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.205043 (+   430us) service_pool.cc:224] Handling call
0709 13:19:30.799266 (+1594223us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54001b85d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:30.799548 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715993984}
I20260709 13:19:30.832307 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:30.838171 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2252) took 2369 ms. Trace:
I20260709 13:19:30.838774 14375 rpcz_store.cc:276] 0709 13:19:28.465827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.470997 (+  5170us) service_pool.cc:224] Handling call
0709 13:19:28.471290 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.741069 (+2269779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.825412 (+ 84343us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54001b9c54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:30.835363 (+  9951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5198781696}
I20260709 13:19:30.812816 18867 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:30.851186 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 102275us
I20260709 13:19:30.831954 18807 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:30.858212 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 113355us
I20260709 13:19:30.862892 14374 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:30.861999 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:30.864933 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:30.825452 18951 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:30.866338 14374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2457) took 1480 ms (client timeout 1919 ms). Trace:
I20260709 13:19:30.789012 14897 rpcz_store.cc:276] 0709 13:19:27.529448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.715820 (+186372us) service_pool.cc:224] Handling call
0709 13:19:27.716493 (+   673us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:27.733547 (+ 17054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.733596 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:27.737188 (+  3592us) log.cc:844] Serialized 52 byte log entry
0709 13:19:27.897558 (+160370us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:27.897624 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.897736 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.322775 (+2425039us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:30.722684 (+399909us) raft_consensus.cc:1685] finished
0709 13:19:30.722727 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.723294 (+   567us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14443,"raft.queue_time_us":9406,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3606,"spinlock_wait_cycles":67774208,"thread_start_us":135852,"threads_started":1,"wal-append.queue_time_us":491185}
W20260709 13:19:30.870836 14374 rpcz_store.cc:269] 0709 13:19:29.383417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.776334 (+1392917us) service_pool.cc:224] Handling call
0709 13:19:30.864103 (+ 87769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:30.873598 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:30.874573 14894 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:30.875267 18951 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.875748 18731 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:30.875948 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.000s	sys 0.008s
W20260709 13:19:30.876386 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.001s	sys 0.008s
W20260709 13:19:30.876847 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 734246us
W20260709 13:19:30.878485 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 126163us
I20260709 13:19:30.879622 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:30.879910 18867 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.881161 18951 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:30.882212 18951 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:30.867583 18922 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:30.894369 18922 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:30.893819 18951 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:30.895855 18922 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.902560 18932 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:30.902961 18922 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:30.903338 14377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2254) took 1497 ms (client timeout 1652 ms). Trace:
I20260709 13:19:30.904175 14369 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
W20260709 13:19:30.906246 14370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1131) took 1530 ms (client timeout 1974 ms). Trace:
W20260709 13:19:30.906890 14370 rpcz_store.cc:269] 0709 13:19:29.376061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.839401 (+1463340us) service_pool.cc:224] Handling call
0709 13:19:30.906154 (+ 66753us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:30.903916 14377 rpcz_store.cc:269] 0709 13:19:29.406128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.467165 (+ 61037us) service_pool.cc:224] Handling call
0709 13:19:30.903087 (+1435922us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540004c4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:30.903266 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2822777088}
W20260709 13:19:30.909626 14378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2454) took 1527 ms (client timeout 1943 ms). Trace:
W20260709 13:19:30.911769 14369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2462) took 1514 ms (client timeout 1825 ms). Trace:
W20260709 13:19:30.915932 14369 rpcz_store.cc:269] 0709 13:19:29.392489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.761706 (+1369217us) service_pool.cc:224] Handling call
0709 13:19:30.906626 (+144920us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:30.915581 14378 rpcz_store.cc:269] 0709 13:19:29.382489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.828622 (+1446133us) service_pool.cc:224] Handling call
0709 13:19:30.909535 (+ 80913us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:30.918977 18857 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:30.920928 14899 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:30.922107 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 51324.4us
I20260709 13:19:30.922845 18813 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:30.919024 14229 consensus_meta.cc:287] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.760s	user 0.014s	sys 0.001s
I20260709 13:19:30.923434 18872 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.924715 14229 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:30.903606 18932 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:30.926509 18932 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:30.927738 14898 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:30.928191 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:30.929203 14900 raft_consensus.cc:2410] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:19:30.929016 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:30.930042 14896 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:30.930820 14892 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:30.932407 14898 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:30.932274 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:30.932786 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:30.933228 14895 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:30.933540 14369 raft_consensus.cc:2368] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10.
I20260709 13:19:30.933990 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2449) took 1556 ms. Trace:
I20260709 13:19:30.934329 14369 rpcz_store.cc:276] 0709 13:19:29.377233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.932466 (+1555233us) service_pool.cc:224] Handling call
0709 13:19:30.933913 (+  1447us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:30.935473 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:30.935660 18932 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:30.938632 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:30.939476 14375 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
W20260709 13:19:30.940099 14375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2455) took 1557 ms (client timeout 1975 ms). Trace:
W20260709 13:19:30.940621 14375 rpcz_store.cc:269] 0709 13:19:29.382790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.905225 (+1522435us) service_pool.cc:224] Handling call
0709 13:19:30.940033 (+ 34808us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:30.866241 18851 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.941924 18940 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.942595 14896 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:30.938797 18950 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.467s	user 0.011s	sys 0.032s
I20260709 13:19:30.940689 18837 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:30.944496 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 72708.8us
I20260709 13:19:30.923583 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:30.942055 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:30.959825 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:30.963828 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:30.865044 18926 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:30.969638 14370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2468) took 1497 ms (client timeout 1966 ms). Trace:
W20260709 13:19:30.970253 14370 rpcz_store.cc:269] 0709 13:19:29.467840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.911504 (+1443664us) service_pool.cc:224] Handling call
0709 13:19:30.964750 (+ 53246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:30.933683 18789 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:30.979910 14374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2450) took 1602 ms (client timeout 2000 ms). Trace:
W20260709 13:19:30.980562 14374 rpcz_store.cc:269] 0709 13:19:29.377540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.871411 (+1493871us) service_pool.cc:224] Handling call
0709 13:19:30.979812 (+108401us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:30.982735 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 59376us
I20260709 13:19:30.981228 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:30.949359 18807 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:19:31.001456 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.002161 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:31.002432 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.003504 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.004037 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:30.950026 18857 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:30.988587 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:31.008632 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:31.005685 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.016001 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.016666 18355 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:31.017208 14374 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:31.017882 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1134) took 1640 ms. Trace:
I20260709 13:19:31.018249 14374 rpcz_store.cc:276] 0709 13:19:29.376971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.011034 (+1634063us) service_pool.cc:224] Handling call
0709 13:19:31.017690 (+  6656us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:31.018633 18953 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.053s	user 0.004s	sys 0.012s
I20260709 13:19:31.019189 14227 raft_consensus.cc:2410] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:31.019474 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.020833 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.018671 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.023536 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.023690 14193 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:31.013743 18813 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:31.025033 18727 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:31.027768 18857 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.028225 18947 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:31.028602 18834 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:31.029008 14899 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.029757 18419 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:31.032500 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:31.038239 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:31.039863 14373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1129) took 1664 ms (client timeout 1503 ms). Trace:
I20260709 13:19:31.016206 14221 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.037456 18780 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:31.043591 18851 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:31.047650 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2473) took 1028 ms. Trace:
I20260709 13:19:31.064548 14374 rpcz_store.cc:276] 0709 13:19:30.019336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.019089 (+999753us) service_pool.cc:224] Handling call
0709 13:19:31.047570 (+ 28481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:30.980719 18900 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:31.053468 14226 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:31.027654 18926 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:31.059852 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.043879 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.074086 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.057617 14373 rpcz_store.cc:269] 0709 13:19:29.375303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.386963 (+ 11660us) service_pool.cc:224] Handling call
0709 13:19:31.039338 (+1652375us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b540027a6d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:31.039588 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201781504}
I20260709 13:19:31.066258 14220 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
W20260709 13:19:31.069015 14371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.017s	sys 0.020s
I20260709 13:19:31.053712 18813 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:31.078027 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54563.1us
I20260709 13:19:31.062130 14375 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:31.073153 14377 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:31.084167 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2471) took 1065 ms. Trace:
I20260709 13:19:31.084659 14377 rpcz_store.cc:276] 0709 13:19:30.018568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.962161 (+943593us) service_pool.cc:224] Handling call
0709 13:19:31.084082 (+121921us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.085930 18419 consensus_queue.cc:1243] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:31.087196 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2476) took 1066 ms. Trace:
I20260709 13:19:31.087716 14375 rpcz_store.cc:276] 0709 13:19:30.020403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.941639 (+921236us) service_pool.cc:224] Handling call
0709 13:19:31.087130 (+145491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.088763 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.086014 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.091781 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:31.092967 18727 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:31.092978 18834 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:31.094990 18834 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:31.095994 14371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.365s	user 0.018s	sys 0.020s
I20260709 13:19:31.102537 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.103585 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1133) took 1727 ms. Trace:
I20260709 13:19:31.103956 14373 rpcz_store.cc:276] 0709 13:19:29.376667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.102061 (+1725394us) service_pool.cc:224] Handling call
0709 13:19:31.103513 (+  1452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.090883 14377 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:31.105207 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:31.106138 14370 raft_consensus.cc:2376] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11. Re-sending same reply.
I20260709 13:19:31.106787 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2472) took 1087 ms. Trace:
I20260709 13:19:31.106855 18857 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:31.081610 18830 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.027637 18756 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:19:31.107218 14370 rpcz_store.cc:276] 0709 13:19:30.018949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.991682 (+972733us) service_pool.cc:224] Handling call
0709 13:19:31.106726 (+115044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.106753 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2470) took 1088 ms. Trace:
I20260709 13:19:31.107914 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.116159 14375 raft_consensus.cc:2368] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10.
I20260709 13:19:31.115398 14377 rpcz_store.cc:276] 0709 13:19:30.018123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.085578 (+1067455us) service_pool.cc:224] Handling call
0709 13:19:31.106267 (+ 20689us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:31.116096 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 342694us
I20260709 13:19:31.120676 14369 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
W20260709 13:19:31.121491 14369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2451) took 1743 ms (client timeout 2201 ms). Trace:
W20260709 13:19:31.121961 14369 rpcz_store.cc:269] 0709 13:19:29.379359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.935130 (+1555771us) service_pool.cc:224] Handling call
0709 13:19:31.121409 (+186279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.123090 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.072775 18837 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:31.140431 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2474) took 1120 ms. Trace:
I20260709 13:19:31.145212 14374 rpcz_store.cc:276] 0709 13:19:30.019691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.069600 (+1049909us) service_pool.cc:224] Handling call
0709 13:19:31.140331 (+ 70731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.140098 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2477) took 1119 ms. Trace:
I20260709 13:19:31.146294 14375 rpcz_store.cc:276] 0709 13:19:30.020758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.088458 (+1067700us) service_pool.cc:224] Handling call
0709 13:19:31.140022 (+ 51564us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:31.139122 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.110405 14372 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:31.140817 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2478) took 1098 ms. Trace:
I20260709 13:19:31.148283 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.150262 14373 rpcz_store.cc:276] 0709 13:19:30.021127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.104826 (+1083699us) service_pool.cc:224] Handling call
0709 13:19:31.119636 (+ 14810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.115060 18352 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:31.115753 18830 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.153568 14378 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.166910 14377 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:31.167050 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:31.169142 14377 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:19:31.140142 18756 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:31.173938 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.177631 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2461) took 1785 ms. Trace:
I20260709 13:19:31.178073 14377 rpcz_store.cc:276] 0709 13:19:29.384566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.168206 (+1783640us) service_pool.cc:224] Handling call
0709 13:19:31.168763 (+   557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.169682 (+   919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.170350 (+   668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.148767 18940 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.181363 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:31.148523 18851 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.169961 18780 raft_consensus.cc:2764] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:31.151264 18837 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:31.182802 14376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1128) took 1693 ms (client timeout 1695 ms). Trace:
W20260709 13:19:31.189580 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 97979us
I20260709 13:19:31.188874 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:31.193444 14369 raft_consensus.cc:2368] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14.
I20260709 13:19:31.195837 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2464) took 1787 ms. Trace:
I20260709 13:19:31.196202 14369 rpcz_store.cc:276] 0709 13:19:29.408948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.143788 (+1734840us) service_pool.cc:224] Handling call
0709 13:19:31.195762 (+ 51974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.155748 18900 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.197985 14899 raft_consensus.cc:2410] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:19:31.198988 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2469) took 1678 ms. Trace:
I20260709 13:19:31.201699 14374 rpcz_store.cc:276] 0709 13:19:29.520754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.151688 (+1630934us) service_pool.cc:224] Handling call
0709 13:19:31.198931 (+ 47243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.173234 18830 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.174775 18756 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:31.205149 14370 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:31.208879 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2467) took 1762 ms. Trace:
I20260709 13:19:31.209324 14370 rpcz_store.cc:276] 0709 13:19:29.446736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.124170 (+1677434us) service_pool.cc:224] Handling call
0709 13:19:31.208789 (+ 84619us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:31.198328 14376 rpcz_store.cc:269] 0709 13:19:29.351997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.356213 (+  4216us) service_pool.cc:224] Handling call
0709 13:19:31.045011 (+1688798us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54002599d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:31.045221 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683330944}
I20260709 13:19:31.212289 14375 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:31.180923 18951 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.212996 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 186600us
I20260709 13:19:31.238154 14894 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:31.270104 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:31.217921 14374 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:31.220402 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.219952 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 839) took 1177 ms. Trace:
W20260709 13:19:31.230146 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 221912us
I20260709 13:19:31.371441 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1119) took 2071 ms. Trace:
W20260709 13:19:31.253963 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79775.6us
I20260709 13:19:31.371917 14375 rpcz_store.cc:276] 0709 13:19:29.204920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.152969 (+1948049us) service_pool.cc:224] Handling call
0709 13:19:31.209489 (+ 56520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.276073 (+ 66584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.276333 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.219425 14377 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:31.224628 14298 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:31.227315 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:31.256357 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:31.274500 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.377230 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.257622 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2255) took 1851 ms. Trace:
W20260709 13:19:31.262032 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 237929us
I20260709 13:19:31.324415 14221 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:31.255908 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:31.249907 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.223335 14299 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:31.369895 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1111) took 2178 ms. Trace:
W20260709 13:19:31.260771 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51046.8us
I20260709 13:19:31.200713 18837 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.222348 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.391078 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2463) took 1998 ms. Trace:
I20260709 13:19:31.398480 14377 rpcz_store.cc:276] 0709 13:19:29.392814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.188659 (+1795845us) service_pool.cc:224] Handling call
0709 13:19:31.219182 (+ 30523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.373199 (+154017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.390982 (+ 17783us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.387231 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2465) took 1953 ms. Trace:
W20260709 13:19:31.232560 18989 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:19:31.230305 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:31.225342 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.379707 14369 rpcz_store.cc:276] 0709 13:19:29.406469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.207125 (+1800656us) service_pool.cc:224] Handling call
0709 13:19:31.256857 (+ 49732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.257168 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.257205 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:31.257285 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:31.257338 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.257406 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.257534 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.229408 18419 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:31.406122 14374 rpcz_store.cc:276] 0709 13:19:29.415672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.206780 (+1791108us) service_pool.cc:224] Handling call
0709 13:19:31.217262 (+ 10482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.368764 (+151502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.369094 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.255535 18813 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:31.412791 14301 raft_consensus.cc:2410] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:19:31.409291 14372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2458) took 2025 ms (client timeout 1730 ms). Trace:
I20260709 13:19:31.219539 18807 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:31.423336 14376 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:31.423621 18807 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:31.424185 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2479) took 1402 ms. Trace:
I20260709 13:19:31.424628 14376 rpcz_store.cc:276] 0709 13:19:30.021502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.381243 (+1359741us) service_pool.cc:224] Handling call
0709 13:19:31.423018 (+ 41775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.423906 (+   888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.424123 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:31.425901 18636 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.004s
W20260709 13:19:31.415354 14372 rpcz_store.cc:269] 0709 13:19:29.383745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.716182 (+1332437us) service_pool.cc:224] Handling call
0709 13:19:31.405137 (+688955us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54000618d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:31.409213 (+  4076us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781599616}
I20260709 13:19:31.231194 18352 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.383458 14371 rpcz_store.cc:276] 0709 13:19:29.191286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.192230 (+   944us) service_pool.cc:224] Handling call
0709 13:19:29.192599 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:29.247312 (+ 54713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.247357 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:29.248143 (+   786us) log.cc:844] Serialized 52 byte log entry
0709 13:19:29.378441 (+130298us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:29.731045 (+352604us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.937517 (+1206472us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:31.096823 (+159306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.096968 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.199059 (+102091us) raft_consensus.cc:1685] finished
0709 13:19:31.204175 (+  5116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.369818 (+165643us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63463,"prepare.queue_time_us":116559,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":203127,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":54287,"spinlock_wait_cycles":30827008,"thread_start_us":1767537,"threads_started":3,"wal-append.queue_time_us":176497}
I20260709 13:19:31.368134 14295 rpcz_store.cc:276] 0709 13:19:30.015243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.015375 (+   132us) service_pool.cc:224] Handling call
0709 13:19:30.015696 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.702628 (+686932us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:30.836319 (+133691us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.063248 (+226929us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:31.063312 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:31.063394 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.180690 (+117296us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54003d3bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:31.180737 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.192682 (+ 11945us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13313,"prepare.queue_time_us":373180,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":5821,"raft.queue_time_us":29414,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"spinlock_wait_cycles":1577616256,"thread_start_us":316843,"threads_started":2,"wal-append.queue_time_us":332126}
I20260709 13:19:31.431558 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:31.432206 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:31.432855 14896 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:31.433327 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:31.434955 14300 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:31.436124 18778 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.436748 18778 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.425184 18807 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.439085 18807 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:31.443209 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 216177us
I20260709 13:19:31.444496 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:31.445915 18952 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:31.446553 18952 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:31.447602 18952 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:31.448910 14221 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:31.450199 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.450836 14377 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:31.412103 18851 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.452903 18851 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:31.230791 18843 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.417026 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.422260 14373 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:31.422447 18419 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:31.203186 18940 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.466109 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:31.392385 18951 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.458137 14900 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:31.467031 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.465396 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2459) took 2079 ms. Trace:
I20260709 13:19:31.470911 14373 rpcz_store.cc:276] 0709 13:19:29.384038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.154434 (+1770396us) service_pool.cc:224] Handling call
0709 13:19:31.381439 (+227005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.463011 (+ 81572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.463289 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.220055 18537 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.238869 18900 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.218672 18756 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:31.486744 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.426416 18636 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.481086 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.492867 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:31.485006 14297 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 6.
I20260709 13:19:31.494048 14894 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:31.496145 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.476452 18857 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:31.499183 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.500490 14896 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
W20260709 13:19:31.506856 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61098.8us
I20260709 13:19:31.537387 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:31.545806 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.546351 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.546674 14222 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:31.547434 14223 raft_consensus.cc:2410] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:31.550191 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:31.550956 14221 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:31.551498 18636 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:31.554001 18993 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:19:31.554637 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:31.555776 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2480) took 1534 ms. Trace:
I20260709 13:19:31.556702 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:31.556542 14375 rpcz_store.cc:276] 0709 13:19:30.226216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.386886 (+1160670us) service_pool.cc:224] Handling call
0709 13:19:31.499621 (+112735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.555198 (+ 55577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.555243 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:31.555323 (+    80us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:31.555421 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.555522 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.555700 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:31.557955 14226 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:31.559711 18419 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:31.567145 18940 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:31.569365 18951 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:31.576216 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.541563 14301 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:31.555886 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.577901 14300 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 7.
I20260709 13:19:31.557610 14227 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:19:31.582185 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80953.6us
I20260709 13:19:31.591028 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:31.591890 14299 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:31.592943 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 52263.4us
I20260709 13:19:31.581616 18352 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:31.565518 18294 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:31.598167 18294 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:31.598709 18903 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:31.599766 18951 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:31.600167 18951 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:31.579365 18857 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:31.612002 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.498158 18843 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:31.623653 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:31.619055 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.589643 18419 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.631678 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:31.634796 18419 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:31.635317 14901 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:19:31.635664 14192 leader_election.cc:336] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.676s (SENT)
I20260709 13:19:31.636170 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:31.636858 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:31.637558 14192 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.730s (SENT)
I20260709 13:19:31.637712 18419 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:31.638093 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:31.638634 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:31.638928 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:31.639297 14896 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:31.638621 18419 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:31.641415 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:31.643062 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.646889 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:31.647728 14896 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:31.648629 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:31.649348 14892 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 7.
I20260709 13:19:31.650261 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:31.653029 18834 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:31.644114 14229 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:31.625597 18756 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:31.664999 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:31.685521 14899 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
W20260709 13:19:31.657042 18922 consensus_meta.cc:287] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.745s	user 0.004s	sys 0.008s
I20260709 13:19:31.687630 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.629851 18294 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:31.691967 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:31.698393 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 60894.3us
W20260709 13:19:31.700698 14192 leader_election.cc:336] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 3.077s (SENT)
I20260709 13:19:31.702347 18857 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:31.710525 14378 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.004s
I20260709 13:19:31.721092 14378 raft_consensus.cc:2410] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:31.715188 18952 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:31.694154 18537 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:31.738623 14221 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:31.739161 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.740754 14300 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
W20260709 13:19:31.741904 14378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2466) took 2293 ms (client timeout 2168 ms). Trace:
W20260709 13:19:31.742610 14378 rpcz_store.cc:269] 0709 13:19:29.428841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.031993 (+1603152us) service_pool.cc:224] Handling call
0709 13:19:31.721867 (+689874us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:31.745400 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 100302us
I20260709 13:19:31.723097 18789 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.743038 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 163443us
I20260709 13:19:31.746191 14298 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:31.658761 18951 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.748711 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:31.760737 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.744957 18952 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:31.761909 14300 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:31.762743 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:31.758951 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 274226us
W20260709 13:19:31.806265 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.813968 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 189909us
W20260709 13:19:31.786566 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51707.8us
I20260709 13:19:31.880628 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:31.882462 14226 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:31.814159 14302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.014s	sys 0.042s
I20260709 13:19:31.869655 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.828866 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:31.859331 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 324548us
W20260709 13:19:31.883052 14302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.019s	sys 0.046s
I20260709 13:19:31.831655 14221 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:31.885838 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:31.845564 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.835242 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.757599 18900 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:31.803290 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.890941 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2475) took 1867 ms. Trace:
I20260709 13:19:31.793493 18922 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:31.831967 18951 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.895026 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.892567 14295 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:31.887482 18843 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:31.897900 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:31.898936 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.898491 14295 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.891497 18682 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.903859 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:31.753670 18789 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:31.906385 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.907375 18294 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:31.915318 14298 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.911824 14226 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:31.912520 19005 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:31.919627 14295 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:31.794636 18830 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:31.798792 18837 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:31.913141 18922 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:31.915889 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.822449 18872 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:19:31.908695 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:31.922694 14221 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:31.912918 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:31.923177 14297 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:31.914362 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:31.906761 14864 connection.cc:256] RPC call timeout handler was delayed by -1.2388577610001903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 13:19:31.924731 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:31.891402 14370 rpcz_store.cc:276] 0709 13:19:30.020043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.232279 (+1212236us) service_pool.cc:224] Handling call
0709 13:19:31.232949 (+   670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.233473 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:31.542834 (+309361us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.887132 (+344298us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:31.887181 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:31.887230 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.887302 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.887405 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":473815,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3350,"raft.queue_time_us":2722,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":3367,"thread_start_us":555118,"threads_started":2}
I20260709 13:19:31.914261 18940 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:31.934044 14300 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
W20260709 13:19:31.925540 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 99687.9us
I20260709 13:19:31.932094 14867 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:31.936309 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:31.943764 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:31.944571 14220 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 8: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:31.937372 14295 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.945708 14221 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:31.927986 18294 consensus_queue.cc:1243] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:31.950222 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:31.944514 18682 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.952836 18419 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:31.955055 18419 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.955582 18419 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.956926 18905 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:31.957396 18905 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.960950 18351 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:19:31.966614 14299 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:31.970623 18780 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:31.973500 18786 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:31.974180 18786 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:31.975169 18786 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:31.978693 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:31.980074 18419 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:31.980674 14303 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:19:31.981074 14303 pending_rounds.cc:85] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 11
I20260709 13:19:31.981340 14303 pending_rounds.cc:107] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:19:31.927968 18851 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:19:31.947263 19006 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:31.958259 19002 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.946198 18940 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:31.990176 14297 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:19:31.990024 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.988377 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.987357 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.991041 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.995767 14377 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:31.986706 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:31.990664 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:31.997394 14373 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
W20260709 13:19:31.997465 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.981745 14303 raft_consensus.cc:2889] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:31.999498 14298 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:31.994745 14297 pending_rounds.cc:85] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 11
I20260709 13:19:31.990038 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:31.957762 18905 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:32.004519 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.983320 19001 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:32.008869 14297 pending_rounds.cc:107] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:19:32.009460 14297 raft_consensus.cc:2889] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:32.009948 14304 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:31.935928 18922 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:32.018508 14378 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:32.009696 14375 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:32.014456 14302 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:31.985140 18682 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:32.012481 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:31.990468 18352 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:31.981839 19003 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:32.025414 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.013316 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:32.027707 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:32.034511 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.031680 14193 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:32.029455 14298 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:31.986706 19002 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.038607 18837 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:32.040002 18731 consensus_meta.cc:287] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.164s	user 0.008s	sys 0.008s
I20260709 13:19:32.040478 19002 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:32.040772 18778 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:32.027616 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:32.045130 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:32.047482 14372 raft_consensus.cc:2410] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:19:32.050124 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:32.051920 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 44289.1us
W20260709 13:19:32.055269 18807 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.003s
W20260709 13:19:32.056140 14192 leader_election.cc:336] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.559s (SENT)
I20260709 13:19:32.056610 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:32.013708 18851 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:32.058065 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:32.058436 18851 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:32.057745 14192 leader_election.cc:336] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.718s (SENT)
I20260709 13:19:32.058898 18851 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.035542 18352 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:32.071723 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 63882.3us
I20260709 13:19:32.073112 14227 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:32.071630 18352 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.034165 19003 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.080454 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:32.077016 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:32.079210 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:32.085114 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:32.046392 18843 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.087658 14900 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:31.986243 19006 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.064419 18834 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:32.064045 18780 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:32.100049 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:32.066236 18731 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.101033 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:32.093772 19005 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:32.117005 14372 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:32.117295 14894 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:19:32.111006 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 198200us
W20260709 13:19:32.114403 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 90830.1us
W20260709 13:19:32.115152 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 189752us
I20260709 13:19:32.121173 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:32.092298 19003 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.020443 18952 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.123976 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:32.097419 18834 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.046101 18940 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:32.131598 14895 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:32.083926 18872 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:32.130261 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:32.135848 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 78118.8us
I20260709 13:19:32.143822 19006 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:32.144958 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:32.138427 18780 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:32.146209 18780 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.146572 18780 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.131502 18830 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:32.146469 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:32.116550 19005 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:32.094666 18843 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:32.130684 18807 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:32.161900 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:32.164853 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:32.139308 18834 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.134634 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:32.196789 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 264781us
I20260709 13:19:32.206962 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:32.209862 14220 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:32.199093 14270 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:32.199074 14295 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:32.212670 14302 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:32.158543 18830 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:32.247663 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48643.1us
I20260709 13:19:32.215595 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:32.253239 14304 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:32.204254 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:32.251892 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:32.258875 14270 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:32.190296 18807 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:32.152920 18731 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:32.198160 14867 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:32.254873 14192 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.730s (SENT)
W20260709 13:19:32.264204 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66181.3us
I20260709 13:19:32.200537 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:32.265276 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 64852.7us
I20260709 13:19:32.273936 14867 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:32.216507 18352 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:32.271193 14297 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
W20260709 13:19:32.294673 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.263185 18756 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:32.263386 18857 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:32.303774 18926 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:32.268819 18951 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:32.275449 18947 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:32.197067 18682 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:19:32.308043 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:32.266047 18807 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.265760 18830 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:32.263280 18419 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:32.337692 14864 connection.cc:256] RPC call timeout handler was delayed by -1.0276703560000442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32430000000000003s for a response
I20260709 13:19:32.274379 18537 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:32.373319 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 219489us
W20260709 13:19:32.322862 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 195987us
I20260709 13:19:32.264333 19008 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:32.300675 19006 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.373628 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:32.311272 18756 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.378629 14342 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:32.275193 18813 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:32.385747 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:32.378386 18951 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:32.321846 18731 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.381534 18789 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:32.321767 19005 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.392607 18922 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:19:32.412858 19005 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.382151 18419 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.381664 18294 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:32.384431 19006 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:32.386133 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 191415us
W20260709 13:19:32.386777 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 183447us
I20260709 13:19:32.312884 18857 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:32.378113 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:32.393015 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:32.426177 14221 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:32.387575 14900 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:32.322113 18900 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:32.322701 18947 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:32.404070 14227 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:32.376158 18537 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:32.408149 18731 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:32.387837 18756 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:32.417168 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:32.419986 14220 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:19:32.420437 14193 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:32.418426 14223 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:32.439306 14901 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:32.440070 19008 consensus_queue.cc:1059] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:32.425180 19006 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:32.444242 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.444416 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 70060.6us
I20260709 13:19:32.453644 14228 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:19:32.457993 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 156571us
I20260709 13:19:32.464367 18843 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:32.437175 18786 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:32.437124 18857 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.459321 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:32.470727 14192 leader_election.cc:336] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.943s (SENT)
I20260709 13:19:32.426281 18294 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:32.441069 18947 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.443663 18537 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.451809 18900 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:32.508829 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:32.509474 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50285.7us
W20260709 13:19:32.477180 19017 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:19:32.519188 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 68961.4us
W20260709 13:19:32.553776 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50667.1us
I20260709 13:19:32.554783 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:32.522727 18294 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.473316 18952 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:32.471207 19015 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.465952 19008 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:32.466332 19009 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:32.508023 18813 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.546823 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:32.489213 18778 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:19:32.482676 18830 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:32.545756 19014 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.131s	user 0.004s	sys 0.000s
I20260709 13:19:32.465802 19027 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:32.472970 19010 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:19:32.516007 19032 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.552368 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2705) took 1105 ms. Trace:
I20260709 13:19:32.426065 18419 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:32.611630 18905 consensus_meta.cc:287] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.002s
W20260709 13:19:32.556974 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.559659 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:32.566857 14303 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:32.549758 19002 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:32.614156 19002 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:32.589702 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:32.615594 14302 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:32.615204 19002 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.590884 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:32.553764 18837 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:32.617961 19034 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.618631 19034 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:32.621676 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 153114us
W20260709 13:19:32.622560 14192 leader_election.cc:336] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.000s (SENT)
I20260709 13:19:32.622972 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:32.566231 18952 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:32.602561 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:32.608609 14299 rpcz_store.cc:276] 0709 13:19:31.447340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.967336 (+519996us) service_pool.cc:224] Handling call
0709 13:19:31.967567 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.015060 (+ 47493us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:32.299518 (+284458us) log.cc:844] Serialized 14 byte log entry
0709 13:19:32.551122 (+251604us) log.cc:844] Serialized 14 byte log entry
0709 13:19:32.552032 (+   910us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:32.552094 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:32.552136 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.552202 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.552312 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":341370,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":475,"spinlock_wait_cycles":8740992,"thread_start_us":386276,"threads_started":2}
W20260709 13:19:32.624114 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 174675us
I20260709 13:19:32.608028 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:32.612164 18905 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:32.601001 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46340.2us
I20260709 13:19:32.632723 19029 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:32.632860 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:32.633417 19009 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:32.610335 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.588929 18351 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:32.474180 18951 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.578330 19008 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:32.630086 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 138729us
W20260709 13:19:32.624862 19017 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:32.644069 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:32.645155 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:32.633908 19009 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:32.637060 14901 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:32.621150 19034 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:32.630895 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2706) took 1183 ms. Trace:
I20260709 13:19:32.652280 18294 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.652858 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:32.653110 18786 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:32.633699 19029 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:32.657938 18351 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:32.658624 18351 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:32.659781 18351 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.662099 19009 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:32.663689 19003 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.525s	user 0.004s	sys 0.006s
I20260709 13:19:32.664263 19003 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.653615 18786 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:32.648808 19032 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.666735 18786 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.668490 19032 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:32.642505 19008 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.643185 18807 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.589202 19015 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:32.639617 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 305303us
I20260709 13:19:32.612179 18419 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:32.651011 18900 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.636637 18789 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:32.566147 18780 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:32.630507 18778 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:32.672873 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:32.673679 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 70446us
I20260709 13:19:32.652601 14301 rpcz_store.cc:276] 0709 13:19:31.447652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.975197 (+527545us) service_pool.cc:224] Handling call
0709 13:19:31.975577 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.975992 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.976019 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.976550 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:19:32.156620 (+180070us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:32.156679 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.156788 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:32.530963 (+374175us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:32.624015 (+ 93052us) raft_consensus.cc:1685] finished
0709 13:19:32.624047 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.630814 (+  6767us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9346,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":27114240,"thread_start_us":179640,"threads_started":1,"wal-append.queue_time_us":323673}
I20260709 13:19:32.673638 18952 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:32.604624 18813 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.683768 14221 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:32.649468 18926 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.660051 18537 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.726990 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:32.724499 19030 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:32.726958 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:32.730278 14220 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:32.735272 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:32.736737 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:32.734459 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 134869us
I20260709 13:19:32.729833 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:32.690392 18778 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:32.776240 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:32.682183 18789 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:32.760455 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 208802us
I20260709 13:19:32.779181 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:32.780346 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 107572us
I20260709 13:19:32.780989 14342 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:32.781736 14220 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
W20260709 13:19:32.759757 18851 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.003s
I20260709 13:19:32.738802 18952 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:32.737901 18926 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:32.805635 14223 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:32.775067 19012 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:32.808324 14225 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:32.806180 14867 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:32.761023 18922 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:32.815410 18807 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:32.816931 19036 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:32.822723 18537 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:32.825438 18778 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.849674 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:32.850747 14221 raft_consensus.cc:2368] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11.
W20260709 13:19:32.826090 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 203566us
I20260709 13:19:32.826735 19015 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:32.827790 18905 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:32.834429 19039 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:19:32.897313 14227 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:32.898140 19047 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:32.898681 19047 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.828193 18780 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:32.830828 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.778775 18789 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.908154 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:32.808681 19008 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.810954 18352 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.891969 14228 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:32.740648 18857 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.810997 18926 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:32.889688 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51004.1us
W20260709 13:19:32.920406 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.804666 19030 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:32.899070 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 390391us
I20260709 13:19:32.905802 14221 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:19:32.906559 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 125613us
I20260709 13:19:32.907701 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:32.813836 19012 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:32.912169 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:32.912431 19006 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.810590 18851 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.913589 18786 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:32.917608 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:32.923122 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:32.908670 19047 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:32.925068 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.925945 19049 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:32.944075 19049 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:32.929440 18857 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:32.945063 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:32.835218 18756 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:32.929975 18352 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.938280 14372 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:32.939476 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:32.945749 14370 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 7.
I20260709 13:19:32.955441 18786 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:32.957201 14229 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:32.947425 18756 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:32.958215 18851 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:32.947801 14227 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
W20260709 13:19:32.959215 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 154031us
I20260709 13:19:32.959787 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:32.961097 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.962795 18294 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:32.963501 19038 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.963294 18294 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.964193 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:32.964057 19038 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:32.965016 19022 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:32.965473 19022 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.965508 18294 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:32.966007 19022 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:32.968114 19027 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.914570 19003 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:32.945113 19049 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:32.950423 18857 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:32.970880 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:32.949389 18352 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:33.008930 14227 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:32.971455 19006 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:32.976959 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:32.991679 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49636.3us
I20260709 13:19:32.969623 18813 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:32.901486 19032 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:19:33.000272 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 65473.3us
I20260709 13:19:33.017045 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:32.914353 19009 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:32.938498 19012 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.004508 14220 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:19:32.974807 18834 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.000s
I20260709 13:19:33.010627 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:32.957463 18926 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.001057 19027 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.027626 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.028964 19043 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:19:32.973253 19050 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:19:33.030932 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.015834 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:32.931392 19030 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:33.008574 18294 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.020332 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.031916 19030 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.032042 18294 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:33.033039 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.033695 14369 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:33.034646 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.034793 18294 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:33.015765 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.021711 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.035806 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:33.035821 14372 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:33.036955 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.029126 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.004055 18857 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:33.065016 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.047379 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.074474 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:33.074764 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:33.079237 14375 raft_consensus.cc:2393] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 13: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:33.074975 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:33.046937 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:33.076956 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.070001 14373 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
W20260709 13:19:33.081593 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.051131 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.037663 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.032333 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:33.003580 18789 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:33.072309 14303 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:33.084167 14376 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:33.072911 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:33.074038 14299 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:33.041385 14192 leader_election.cc:400] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10.
I20260709 13:19:33.031980 14378 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 10: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:33.086131 14192 leader_election.cc:403] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:33.082247 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.082573 14228 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:33.037611 14369 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:33.080287 14302 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
W20260709 13:19:33.088726 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.090651 14377 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:33.089818 14342 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:33.093127 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.092972 14301 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:33.095997 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:33.098706 19049 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:33.099371 19049 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.100307 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.100890 14371 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:33.099807 19049 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.102620 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.103130 19034 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.103947 18789 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:33.079859 18857 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.104699 14370 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:33.040485 18926 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:33.105268 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:33.106290 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:33.114603 14374 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.115190 14302 raft_consensus.cc:2410] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:33.109596 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:33.111035 14378 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:33.111543 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:33.111608 14300 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:33.112586 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.117525 14227 raft_consensus.cc:2410] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:33.145231 14376 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:33.080173 18352 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:19:33.113305 19038 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:33.146266 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 105146us
I20260709 13:19:33.043948 19047 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.156196 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.096824 18922 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:19:33.086203 18786 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:19:33.159217 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.149132 19027 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.092376 19005 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 13:19:33.150660 18947 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.004s
I20260709 13:19:33.150686 14373 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:33.146904 19056 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10.
I20260709 13:19:33.155496 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:33.152061 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:33.089299 18294 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:19:33.053084 18834 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.154326 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:33.166572 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 115554us
I20260709 13:19:33.179927 14227 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:33.157549 14376 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:33.073729 19030 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.183424 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:33.176481 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 86740.3us
I20260709 13:19:33.188519 14372 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:33.188501 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.187315 14378 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.190034 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:33.190661 19002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.009s	sys 0.009s
W20260709 13:19:33.191136 19002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.009s	sys 0.010s
I20260709 13:19:33.192032 14376 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.203346 19034 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:19:33.204818 19034 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:33.205248 19034 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:33.206244 19034 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:33.210392 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 58406.7us
I20260709 13:19:33.206177 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:33.211215 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.211984 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:33.207548 19034 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.212642 14373 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:33.213605 19032 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:33.219097 19023 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.597s	user 0.005s	sys 0.005s
I20260709 13:19:33.220490 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1092) took 1160 ms. Trace:
I20260709 13:19:33.220880 14897 rpcz_store.cc:276] 0709 13:19:32.060401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.065762 (+  5361us) service_pool.cc:224] Handling call
0709 13:19:32.090278 (+ 24516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.112858 (+ 22580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.112891 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:32.123101 (+ 10210us) log.cc:844] Serialized 26 byte log entry
0709 13:19:32.284202 (+161101us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:32.284553 (+   351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.290833 (+  6280us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.218475 (+927642us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:33.220120 (+  1645us) raft_consensus.cc:1685] finished
0709 13:19:33.220148 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.220398 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12829,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":7508,"spinlock_wait_cycles":13065600,"thread_start_us":114084,"threads_started":1,"wal-append.queue_time_us":470393}
I20260709 13:19:33.246037 14223 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:33.250011 19047 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:33.250576 19030 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:33.251541 14900 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:33.184876 18807 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.247725 14226 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:33.224715 14378 raft_consensus.cc:2410] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 13:19:33.228557 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.248046 14376 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:33.254010 14374 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:33.255328 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:33.221884 19054 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:33.257987 14901 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:33.242853 18940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.028s
I20260709 13:19:33.260517 19027 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:33.262704 18857 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:33.263854 19009 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:33.246680 19056 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:19:33.266749 19002 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:33.267189 18834 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:33.267727 18851 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:33.268384 18780 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:33.307204 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.307716 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.245479 18786 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:33.308892 18786 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.259392 19012 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.309321 18786 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.271771 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:33.310467 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50819.9us
I20260709 13:19:33.311635 14341 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:33.312521 19060 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:33.312978 14341 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:33.313890 19060 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:33.314538 19060 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.314965 19002 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.315482 19002 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.257244 18419 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:19:33.276058 19022 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.279373 19034 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:33.280329 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:33.285105 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 79008.3us
I20260709 13:19:33.207573 19049 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:33.290424 14220 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: [10.12-10.12]
I20260709 13:19:33.221511 19032 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.306313 18857 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:33.185355 18947 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.319378 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.320502 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.304450 14267 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:33.302007 18940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.000s	sys 0.029s
I20260709 13:19:33.342303 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:33.343158 19039 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:33.343389 18947 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:33.343952 19039 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:33.344367 19039 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.344739 19039 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.346845 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:33.348922 18778 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.350409 14864 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.352334 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:33.354331 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 74104.2us
I20260709 13:19:33.322938 18419 consensus_queue.cc:1243] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:33.326864 19012 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:33.334316 14227 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.332880 19050 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:19:33.337947 18756 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:33.354606 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.320041 19056 consensus_queue.cc:1243] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:33.359159 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2230) took 1226 ms. Trace:
I20260709 13:19:33.323635 14225 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
W20260709 13:19:33.366062 18986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.017s	sys 0.002s
I20260709 13:19:33.303560 19027 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.344596 19034 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:33.354022 19013 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:33.390363 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 43600.5us
W20260709 13:19:33.406824 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 74794.3us
I20260709 13:19:33.399025 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.385950 18807 raft_consensus.cc:2764] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:33.451408 14344 leader_election.cc:400] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11.
I20260709 13:19:33.451835 14344 leader_election.cc:403] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:33.407510 19043 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:33.425328 18986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.018s	sys 0.002s
I20260709 13:19:33.428936 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:33.433681 19030 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:33.419025 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 65233.3us
I20260709 13:19:33.439570 14371 raft_consensus.cc:2368] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13.
I20260709 13:19:33.435995 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:33.435705 19034 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:33.425086 18834 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.424969 18636 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.385972 19032 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:33.395408 18951 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:33.423436 14220 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.455955 14372 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:33.421483 14229 rpcz_store.cc:276] 0709 13:19:32.133122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.133645 (+   523us) service_pool.cc:224] Handling call
0709 13:19:32.146125 (+ 12480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.957739 (+811614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.358743 (+401004us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54002774d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:33.359024 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864830336}
I20260709 13:19:33.459623 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:33.461336 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:33.427656 18830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.062s	sys 0.074s
I20260709 13:19:33.465111 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:33.463182 19043 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.441632 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:33.488332 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:33.510684 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:33.511253 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 46239.1us
I20260709 13:19:33.502681 14296 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.424407 18537 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
W20260709 13:19:33.504649 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.463214 18843 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.507483 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 69711.5us
I20260709 13:19:33.425799 18294 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:19:33.513517 14229 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:33.438840 19050 consensus_queue.cc:1243] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:33.441452 14300 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:33.516908 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:33.519951 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.520113 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:33.505170 18830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.062s	sys 0.074s
I20260709 13:19:33.522444 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:33.463078 18922 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:33.522773 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 81219.4us
I20260709 13:19:33.527365 19008 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:33.527859 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.528949 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.530395 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:33.531342 14303 raft_consensus.cc:2393] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 7: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:33.531875 19006 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:33.533957 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:33.536857 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:33.537158 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:33.539311 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:33.539597 14341 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.540246 14899 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:33.540891 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:33.526458 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.510233 18947 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:33.509083 19060 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.539331 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:33.549430 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:33.545730 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 109650us
I20260709 13:19:33.513950 19043 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.463032 19027 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.541508 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:33.517031 18294 consensus_queue.cc:1243] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:33.518584 18419 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.551746 14222 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:33.519012 18857 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:33.516175 19012 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.552224 14229 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:33.552316 14897 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:33.502703 18834 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.541137 18837 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:33.512291 18636 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:33.552995 14192 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.825s (SENT)
I20260709 13:19:33.525527 18789 raft_consensus.cc:2764] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:33.591987 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:33.593962 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 77143.5us
I20260709 13:19:33.546681 18947 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:33.594666 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 76595.4us
I20260709 13:19:33.603273 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:33.606253 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:33.610242 19045 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:33.610710 19045 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:33.611690 19045 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:33.592371 14225 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:19:33.613692 14303 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:33.617437 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 77925.2us
I20260709 13:19:33.540472 18351 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:19:33.523885 18843 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.565554 19005 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.557837 18857 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:33.617748 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:33.548626 18352 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:19:33.565026 18922 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:33.634722 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:33.564245 19011 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:33.618345 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:33.642371 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.551543 19002 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.590135 18837 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:33.646672 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.606724 18682 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:33.659789 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.660959 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.650707 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.663043 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:33.654805 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:33.616726 18951 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:33.667339 14370 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:33.670066 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:33.670768 14897 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:33.637454 18731 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:33.638213 18857 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.691689 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:33.696401 14900 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:33.693415 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:33.697325 14377 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.640980 18922 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:33.645540 19037 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:33.698557 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:33.700006 14371 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:19:33.649046 19045 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.702438 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:33.708343 14375 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:33.713161 14899 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:33.713310 14900 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.606069 18419 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:33.666671 19008 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:33.709353 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:33.714335 14901 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:33.715159 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:33.634047 19050 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:19:33.691049 19022 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:33.692488 18537 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:33.565198 19034 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.712517 14371 pending_rounds.cc:85] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 9
I20260709 13:19:33.672065 18951 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.723134 14897 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:33.698868 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:33.710860 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 157893us
I20260709 13:19:33.727912 14894 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:33.733588 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:33.698519 19049 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:33.708544 18922 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.720860 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:33.736250 14371 pending_rounds.cc:107] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:19:33.660043 18926 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:19:33.646082 19005 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.719163 19009 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:33.783349 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 59025.7us
W20260709 13:19:33.737666 14192 leader_election.cc:336] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.919s (SENT)
I20260709 13:19:33.737082 14228 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:33.653216 19011 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:33.784291 19074 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:33.710505 18947 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:33.803664 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 184740us
I20260709 13:19:33.878755 14296 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:33.829874 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:33.821942 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.808369 14371 raft_consensus.cc:2889] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:33.882140 14227 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:33.884123 14220 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:33.884704 14895 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:33.729830 19079 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:33.896371 14867 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:33.889097 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:33.902607 14304 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.738956 18951 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:33.803117 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:33.842214 19054 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:33.905452 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.890806 14897 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:33.783406 19008 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:33.811214 18352 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:33.899103 19039 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.554s	user 0.006s	sys 0.010s
W20260709 13:19:33.947291 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 260476us
I20260709 13:19:33.957728 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:33.948572 14296 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:33.811343 18537 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:33.960572 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:33.950953 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.889510 18851 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:33.888471 18682 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:33.929629 19006 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:33.964869 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 227210us
I20260709 13:19:33.947140 18352 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.929752 19056 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.889449 18872 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.979163 14300 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:33.933751 19034 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:33.983413 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.985883 14192 leader_election.cc:336] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.975s (SENT)
I20260709 13:19:33.998798 14192 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:34.000052 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:33.960592 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.000770 14894 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:33.989056 19071 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:33.988828 18851 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:33.989627 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:33.990461 19006 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:34.002947 19080 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:34.004386 19067 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.380s	user 0.000s	sys 0.004s
I20260709 13:19:34.006556 14893 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:34.007030 18851 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:34.007120 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 59918.9us
I20260709 13:19:34.008000 18851 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:34.008041 14864 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:33.990049 18682 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.009057 19030 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:34.010358 19082 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:19:34.011338 19027 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:33.990070 18537 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.018402 18636 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:33.976661 18843 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.019578 19005 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:33.900260 18940 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:19:34.020678 18940 consensus_queue.cc:1243] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:33.965564 19032 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:34.009471 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:33.950100 19049 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:33.960948 19009 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 13:19:34.037916 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 230743us
I20260709 13:19:33.996268 18352 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:33.961177 19039 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:34.044803 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.045779 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.022343 19071 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:34.055414 19079 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:34.056017 19079 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:34.056273 18951 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:34.057147 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 47756.2us
I20260709 13:19:34.057268 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:34.057947 14864 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:34.058472 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.058636 18951 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.044247 19022 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:34.059626 19022 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.059979 19022 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:34.060487 19022 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.060717 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:34.062135 14901 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:34.029498 18843 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:34.062913 18843 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:34.064283 18843 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.068089 14297 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:34.069458 19039 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:34.051697 19038 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:19:34.071614 18947 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:34.075131 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1133) took 1737 ms. Trace:
I20260709 13:19:34.060007 14892 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:34.073189 19043 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.081568 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:34.064095 19012 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11.
I20260709 13:19:34.080947 14222 rpcz_store.cc:276] 0709 13:19:32.337243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.374707 (+ 37464us) service_pool.cc:224] Handling call
0709 13:19:32.387036 (+ 12329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.557653 (+1170617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.074844 (+517191us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540026ded4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:34.075062 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2678018944}
I20260709 13:19:34.083943 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:34.034075 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 379329us
I20260709 13:19:34.086061 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:34.086256 19003 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:34.086652 19003 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:34.085487 19071 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:34.087637 19003 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.089061 19003 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:34.091053 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.091307 18837 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:34.092605 18837 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.102090 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:34.103144 14304 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:34.104015 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:34.104808 14296 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:34.052716 19002 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:34.106597 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:34.033967 18952 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:19:34.053334 18834 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.104574 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:34.109318 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58220.9us
I20260709 13:19:34.003216 19006 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.156981 14304 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:19:34.158033 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 72053.1us
I20260709 13:19:34.031513 18872 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:34.157680 18786 consensus_meta.cc:287] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.848s	user 0.011s	sys 0.003s
I20260709 13:19:34.173162 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:34.173360 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:34.172317 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 67807.1us
W20260709 13:19:34.181360 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 200923us
I20260709 13:19:34.111101 18830 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:34.156980 19012 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:34.225858 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 172951us
I20260709 13:19:34.171142 18636 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:34.228897 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 51793.5us
I20260709 13:19:34.176730 19049 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:34.178761 18834 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.177237 19039 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:34.230648 18778 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.881s	user 0.004s	sys 0.010s
W20260709 13:19:34.230688 18857 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.509s	user 0.005s	sys 0.005s
I20260709 13:19:34.257531 14224 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:19:34.258631 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 89944.8us
W20260709 13:19:34.255744 14377 consensus_meta.cc:287] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
W20260709 13:19:34.265858 14900 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:19:34.265604 14377 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:34.266466 14900 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:34.222589 18830 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:34.277064 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:34.277983 14896 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:34.282303 14296 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:19:34.283632 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:34.109517 19079 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:34.301580 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:34.302275 14372 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:34.292719 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:34.239827 19049 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:34.256363 19011 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:34.240116 19086 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.309234 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:34.318462 14301 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:34.318526 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:34.224526 18786 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.301337 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:34.313340 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:34.323144 14375 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:34.323288 14370 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:34.297219 14377 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
W20260709 13:19:34.316794 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 232929us
I20260709 13:19:34.291633 19090 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:34.291921 19050 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.292421 18830 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.356060 14373 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:34.236527 18351 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:19:34.240550 19083 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
W20260709 13:19:34.347720 18922 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
W20260709 13:19:34.331575 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72082.4us
I20260709 13:19:34.326267 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:34.357093 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:34.312789 19030 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:34.235056 19012 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.275249 18636 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:19:34.360090 14372 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:34.295943 18778 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:19:34.315034 19002 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:34.311743 19049 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:34.280664 19085 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:19:34.400019 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:34.277995 18857 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:34.372947 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46773us
I20260709 13:19:34.374070 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.416069 14900 raft_consensus.cc:2376] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14. Re-sending same reply.
I20260709 13:19:34.375574 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.376245 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:34.361913 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:34.289916 19039 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.424829 14892 raft_consensus.cc:2410] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:19:34.419950 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:34.387982 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 133593us
I20260709 13:19:34.294039 19094 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:19:34.387351 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:34.430828 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 207133us
I20260709 13:19:34.432113 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:34.400019 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:34.418951 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 194656us
I20260709 13:19:34.420719 14893 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:34.433883 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.435762 14900 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:34.434166 14193 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:34.441643 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:34.445257 14378 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
W20260709 13:19:34.442736 14192 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.966s (SENT)
I20260709 13:19:34.455443 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:34.462971 14897 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:34.464417 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 44622.3us
I20260709 13:19:34.465161 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:34.466377 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.359903 19050 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.476253 14303 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:34.477198 14228 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.000s
I20260709 13:19:34.486024 14897 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:34.486094 14228 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
W20260709 13:19:34.488817 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54719.4us
I20260709 13:19:34.485430 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.490350 14893 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:34.423883 19096 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:34.493300 14228 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:34.396173 18731 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:19:34.331252 19086 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.494899 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:34.496497 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:34.502583 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 70545.7us
I20260709 13:19:34.388012 18922 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.502990 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:34.463567 19043 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:34.491461 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:34.504878 14341 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:34.515306 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:34.520165 14222 raft_consensus.cc:1813] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Handling vote request from an unknown peer 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:34.477854 19006 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.523561 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:34.526793 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:34.531757 14222 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:34.504055 18778 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:34.533985 14371 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:34.514652 19008 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:34.536985 19103 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:34.537190 19095 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.537631 19092 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:34.537927 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 95207.2us
W20260709 13:19:34.538854 19099 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:19:34.439570 18834 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:19:34.542452 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:34.514176 19080 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:34.566180 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 204391us
I20260709 13:19:34.535434 18872 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.490952 19090 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:34.523860 19096 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:34.584820 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.597671 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.576045 19005 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:34.587697 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:34.575770 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:34.567413 19103 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:34.577992 14192 leader_election.cc:336] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.052s (SENT)
W20260709 13:19:34.603433 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 138309us
I20260709 13:19:34.609709 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:34.584052 19091 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.354s	user 0.000s	sys 0.002s
I20260709 13:19:34.605198 14370 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:34.575591 18778 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:34.619009 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.523533 19030 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:34.668789 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 155440us
W20260709 13:19:34.625674 19034 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.005s
W20260709 13:19:34.670475 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 92533.5us
I20260709 13:19:34.675438 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:34.612763 18786 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:34.671149 14192 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.168s (SENT)
I20260709 13:19:34.679832 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:34.599026 19008 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:19:34.614315 19080 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:34.586040 19092 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:34.679208 19099 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:19:34.669273 19085 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.677654 19095 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:34.677369 19012 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.708285 19118 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:34.712136 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 169755us
I20260709 13:19:34.712679 19104 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:34.713023 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:34.691287 18807 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:34.717412 14370 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:34.713615 19027 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:34.713297 19104 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:34.693351 18857 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:34.697620 18731 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:34.740489 18731 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:34.741554 19109 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:19:34.742461 19098 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:19:34.742699 18731 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.743608 19080 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:34.744863 19104 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:34.746359 19086 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:34.749275 18947 consensus_meta.cc:287] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.000s
I20260709 13:19:34.750098 14898 raft_consensus.cc:2410] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 11 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 13:19:34.708686 19090 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:34.752223 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1101) took 1055 ms. Trace:
I20260709 13:19:34.752604 14898 rpcz_store.cc:276] 0709 13:19:33.696642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.696884 (+   242us) service_pool.cc:224] Handling call
0709 13:19:34.751999 (+1055115us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b54003dac54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:34.752138 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2161949440}
W20260709 13:19:34.729760 19077 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:19:34.730611 19123 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:34.731215 19087 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:34.731945 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1152) took 1237 ms. Trace:
I20260709 13:19:34.732510 19108 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:34.733318 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 47856.2us
I20260709 13:19:34.776978 14375 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:34.777499 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:34.728482 18872 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:19:34.734570 19093 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.734445 19027 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:34.735512 19101 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 13:19:34.736274 19111 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 13:19:34.737221 19114 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:19:34.737150 19049 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.739061 19092 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.756506 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2621) took 1116 ms. Trace:
I20260709 13:19:34.807721 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:34.806747 14229 rpcz_store.cc:276] 0709 13:19:33.640166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.640345 (+   179us) service_pool.cc:224] Handling call
0709 13:19:33.640673 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.641046 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.641079 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.650461 (+  9382us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.029589 (+379128us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:34.029629 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.029697 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:34.756273 (+726576us) raft_consensus.cc:1685] finished
0709 13:19:34.756299 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.756449 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":648,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9030,"thread_start_us":300160,"threads_started":1,"wal-append.queue_time_us":402850}
I20260709 13:19:34.808354 14375 raft_consensus.cc:2376] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11. Re-sending same reply.
I20260709 13:19:34.687108 19089 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.220s
I20260709 13:19:34.778693 14224 rpcz_store.cc:276] 0709 13:19:33.494805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.497888 (+  3083us) service_pool.cc:224] Handling call
0709 13:19:33.498239 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.258032 (+759793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.731665 (+473633us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b540019afd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:34.731879 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745290496}
W20260709 13:19:34.782452 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 69550.6us
I20260709 13:19:34.725111 19105 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:34.797683 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 210054us
I20260709 13:19:34.799602 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:34.820562 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:34.756385 19005 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:34.727043 19106 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:34.781643 19022 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.000s
I20260709 13:19:34.690024 18778 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.810853 14301 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:34.813261 14341 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:34.776084 19087 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:34.826612 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49213.6us
W20260709 13:19:34.823360 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.801146 19102 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.706393 19085 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:34.833738 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:34.838752 14375 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:34.840651 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:34.816308 19032 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:34.842916 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:34.845536 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:34.848272 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:34.823109 19050 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.706455 19103 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.861738 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:34.861864 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:34.828500 19105 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:34.827383 19089 consensus_queue.cc:1243] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:34.860826 14897 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:34.869612 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.834059 19095 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:34.837940 19102 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:34.871209 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.872850 19117 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:34.873713 19121 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:19:34.873605 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:34.876670 14898 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:34.850921 19032 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.822570 19108 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.856518 18636 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:34.883023 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.906724 14901 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:34.915375 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 67007.2us
I20260709 13:19:34.923039 18872 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:34.923321 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:34.780709 19123 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.836601 19022 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.930696 14893 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:34.941965 19126 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:19:34.878724 19102 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.877763 19092 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:19:34.926131 19032 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:34.943317 18636 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:34.973992 18636 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.975136 19123 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:34.975630 19003 consensus_meta.cc:287] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.003s
W20260709 13:19:34.976500 18837 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.883s	user 0.011s	sys 0.004s
I20260709 13:19:34.924036 19103 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:34.946835 18352 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.868s	user 0.011s	sys 0.001s
I20260709 13:19:34.977548 18352 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.978724 19022 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:34.979637 18352 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.979769 19049 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.980906 14372 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:34.837037 19106 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.971705 19105 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:34.951457 19132 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:34.985108 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:34.948729 18872 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:34.994906 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 167570us
I20260709 13:19:34.996263 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:34.998577 18872 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:34.999922 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.002899 19027 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.930766 19087 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.015901 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:35.019012 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:35.006871 19106 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:34.992369 18952 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:35.008889 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:35.014032 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.021868 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:34.996821 18537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.003s	sys 0.007s
I20260709 13:19:35.053463 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:35.059731 18857 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:35.060447 19050 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:35.061560 18922 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.064544 19129 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:35.066866 18419 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:35.067039 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 58272.3us
I20260709 13:19:35.055595 18951 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:35.067869 18951 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:35.068281 18951 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.055514 19130 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:35.069975 19022 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.071520 19085 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:35.074656 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:35.075446 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:35.079952 14369 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.070626 19090 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:35.054842 18731 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:35.070289 19130 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:35.055629 18952 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:35.086340 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:35.087781 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:35.088852 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 227100us
I20260709 13:19:35.090842 14375 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:35.092934 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:35.094446 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:35.088085 19085 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.091144 18952 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:35.090229 19130 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.091862 19050 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:35.100246 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:35.117616 14371 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:35.100298 14375 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:35.099490 19027 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:35.095445 18419 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:19:35.098951 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:35.119650 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:35.119809 19027 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.120512 19131 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:35.121254 19118 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:35.121481 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:35.122864 18636 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:35.121656 19108 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:35.127826 14369 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:35.123410 18636 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.131239 18636 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.117208 19050 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:35.096525 19090 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:35.136152 19050 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.114612 19085 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.132490 19108 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:35.189321 19056 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:35.189724 18851 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:35.141983 19115 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:35.190217 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:35.208261 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46064.3us
I20260709 13:19:35.123884 19106 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:35.195758 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:35.195676 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:35.192337 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:35.204973 14344 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:35.206835 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.219331 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:35.221010 14221 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:35.220925 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:35.222285 14894 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:35.224035 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:35.224112 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.224313 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.215950 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:35.224728 14228 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.224895 14225 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
W20260709 13:19:35.208159 18830 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.005s
W20260709 13:19:35.209844 19045 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.485s	user 0.009s	sys 0.009s
I20260709 13:19:35.225195 14303 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:35.201431 18778 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.201161 19092 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.202152 18419 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:35.229044 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:35.207693 19056 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:35.216779 19095 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:35.207719 19108 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.262503 14228 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:35.263656 19126 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:35.264096 19106 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:35.264633 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:35.265275 18951 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.226917 19050 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:35.231459 18922 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:19:35.214596 19115 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.225375 19132 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.281163 14225 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.266729 18419 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:35.238962 19097 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.750s	user 0.002s	sys 0.000s
I20260709 13:19:35.233744 19079 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:35.301126 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 184073us
I20260709 13:19:35.277014 19095 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.219333 18952 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.217159 19080 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:19:35.224447 18851 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.312147 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:35.281589 19126 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:35.253582 18830 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.297384 19115 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.285341 19037 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:19:35.277657 18636 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.286712 19106 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.276389 19092 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.279004 18778 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.354753 14222 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:35.326526 19118 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:35.324533 19126 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.323094 19039 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.319890 19095 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:35.379720 19088 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:35.342707 18834 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:35.371892 18789 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.381968 19039 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:35.382086 18834 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.382675 19039 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.383173 19039 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.383581 18851 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:35.280182 19056 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.384341 18834 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:35.384805 19056 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:35.386812 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.388619 18952 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.392360 18830 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.392715 19095 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.394227 19032 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.396525 19032 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:35.398339 19095 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.399982 14224 raft_consensus.cc:2410] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:35.382244 18789 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.403389 14225 raft_consensus.cc:2410] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:35.404220 18789 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.405087 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.406005 14227 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:35.412581 19039 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.415187 19039 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.416297 18419 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.405189 19102 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.419227 19102 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:35.419381 18636 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.425834 18778 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:35.428247 19069 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.737s	user 0.003s	sys 0.003s
I20260709 13:19:35.430295 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1147) took 2148 ms. Trace:
I20260709 13:19:35.430776 14226 rpcz_store.cc:276] 0709 13:19:33.281744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.301710 (+ 19966us) service_pool.cc:224] Handling call
0709 13:19:33.306195 (+  4485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.321437 (+ 15242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.321487 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.329015 (+  7528us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.507367 (+178352us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:33.507420 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.507489 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.427484 (+1919995us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:35.429883 (+  2399us) raft_consensus.cc:1685] finished
0709 13:19:35.429913 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.430198 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14701,"raft.queue_time_us":21883,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13394,"spinlock_wait_cycles":19856256,"thread_start_us":87311,"threads_started":1,"wal-append.queue_time_us":195173}
I20260709 13:19:35.433344 19118 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.434898 14229 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:35.399047 18951 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.433187 19126 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.442528 14370 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:19:35.474656 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.491255 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.500002 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 187943us
I20260709 13:19:35.502944 19085 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:35.500448 18807 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:35.502242 19022 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:35.487149 19115 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.535295 14374 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:19:35.499732 19130 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.541064 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2507) took 1216 ms. Trace:
I20260709 13:19:35.522940 18807 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:35.544629 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:35.554001 14378 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:35.552805 14374 rpcz_store.cc:276] 0709 13:19:34.319855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.525932 (+1206077us) service_pool.cc:224] Handling call
0709 13:19:35.535015 (+  9083us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:35.535779 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.536006 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:35.528504 19022 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.573185 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:35.574995 14378 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.571709 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:35.575717 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:35.549418 19080 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.549109 19115 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.577021 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:35.582903 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:35.584492 19080 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.588591 19080 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:35.589089 19080 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.591086 19045 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:35.591554 19045 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:35.594715 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:35.604167 14301 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:19:35.605355 19100 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.142s	user 0.003s	sys 0.000s
I20260709 13:19:35.606163 19092 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.607244 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:35.608052 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2738) took 1117 ms. Trace:
I20260709 13:19:35.608687 14371 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:35.592443 19045 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:35.607370 14899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1107) took 1579 ms (client timeout 1950 ms). Trace:
I20260709 13:19:35.609683 19045 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:35.609956 14899 rpcz_store.cc:269] 0709 13:19:34.027916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.028095 (+   179us) service_pool.cc:224] Handling call
0709 13:19:35.607158 (+1579063us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54004a06d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:35.607299 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412810496}
I20260709 13:19:35.610773 19022 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:35.623826 14192 leader_election.cc:336] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.600s (SENT)
I20260709 13:19:35.624439 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:35.579113 19005 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.626988 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:35.608475 14298 rpcz_store.cc:276] 0709 13:19:34.491076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.602874 (+111798us) service_pool.cc:224] Handling call
0709 13:19:34.603325 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.603610 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.603645 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:35.147864 (+544219us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b2c00000e98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb985a11 00007f8deb995372 00007f8ded0c7a01 00007f8ded08c43a 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2
0709 13:19:35.214952 (+ 67088us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.437293 (+222341us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:35.437356 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.437449 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.607733 (+170284us) raft_consensus.cc:1685] finished
0709 13:19:35.607753 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.607989 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4320128,"thread_start_us":180451,"threads_started":1,"wal-append.queue_time_us":287359}
I20260709 13:19:35.628412 19115 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:35.628612 18951 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:19:35.634766 19092 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:35.634816 18778 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:35.636744 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2505) took 1318 ms. Trace:
I20260709 13:19:35.637166 14376 rpcz_store.cc:276] 0709 13:19:34.318567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.318686 (+   119us) service_pool.cc:224] Handling call
0709 13:19:34.318997 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.356255 (+ 37258us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:34.378313 (+ 22058us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.077021 (+698708us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b1800399a60. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a 00007f8ded096a2a
0709 13:19:35.280253 (+203232us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:35.280807 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.281020 (+   213us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:35.281347 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.291562 (+ 10215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.291808 (+   246us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.636513 (+344705us) raft_consensus.cc:1685] finished
0709 13:19:35.636539 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.636682 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10125,"prepare.queue_time_us":58221,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":2564,"raft.queue_time_us":43903,"raft.run_cpu_time_us":435,"raft.run_wall_time_us":33120,"spinlock_wait_cycles":4347776,"thread_start_us":202948,"threads_started":1,"wal-append.queue_time_us":1135063}
I20260709 13:19:35.634821 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:35.579511 19090 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:35.579711 19165 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:35.647487 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:35.649096 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:35.595742 19009 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.589536 19080 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.651062 19130 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.666805 14378 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:35.627451 18807 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.676859 18807 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.655095 19115 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:35.682389 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:35.682641 19115 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.642581 19106 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.686844 19090 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.683104 14374 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.652223 19165 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:35.695818 19165 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.697943 19126 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.664232 19009 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.703444 19039 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:35.704124 19039 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.708408 14374 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:35.669032 19083 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:35.668869 19132 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:35.710696 14374 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:35.646862 19005 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.714730 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.715564 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:35.715655 14227 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:35.718516 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:35.719101 14227 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.721257 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2724) took 2128 ms. Trace:
I20260709 13:19:35.721604 14297 rpcz_store.cc:276] 0709 13:19:33.593017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.605531 (+ 12514us) service_pool.cc:224] Handling call
0709 13:19:33.605863 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.068531 (+462668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.721057 (+1652526us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54000dc5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:35.721212 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062564736}
I20260709 13:19:35.722121 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:35.730017 19002 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:35.723168 18872 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:35.713593 19083 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.732770 18872 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.733767 19039 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:35.727636 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:35.728209 18778 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:35.735257 14372 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:19:35.735543 18778 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.736035 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:35.736680 14377 raft_consensus.cc:2376] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14. Re-sending same reply.
W20260709 13:19:35.737155 14377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2508) took 1401 ms (client timeout 1600 ms). Trace:
I20260709 13:19:35.722960 19174 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.733178 19083 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:35.738322 19174 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:35.740536 19174 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:35.728601 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.744232 14220 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:35.728379 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:35.724391 14221 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:35.737524 14377 rpcz_store.cc:269] 0709 13:19:34.336217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.735761 (+1399544us) service_pool.cc:224] Handling call
0709 13:19:35.737098 (+  1337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:35.751770 14221 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:35.729748 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.757568 14223 raft_consensus.cc:2410] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:35.758262 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.773382 14221 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:35.757561 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:35.779031 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:35.729499 19005 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.737643 18778 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:35.735028 18872 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.785539 14227 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:35.793551 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.753520 19108 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.811805 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.812379 19108 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:35.813385 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.733170 19050 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:19:35.814472 14225 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:35.815373 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.816359 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:35.816855 14225 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:35.817822 14225 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:35.791939 19118 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:35.819698 14227 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:35.791453 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:35.771826 19092 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:35.870604 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.905032 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 113647us
I20260709 13:19:35.917120 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:35.787498 19039 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:19:35.921154 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:35.921710 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.922307 14227 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:35.929025 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.827812 19118 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:35.908898 19092 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.912860 19050 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:35.941545 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:35.942700 14225 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.919811 19167 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:35.955806 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:35.956741 14227 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:35.960477 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1153) took 1087 ms. Trace:
I20260709 13:19:35.985584 18843 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:35.985750 14223 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:35.966809 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:19:35.975226 14192 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.950s (SENT) [suppressed 21 similar messages]
I20260709 13:19:35.976281 19118 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:35.983680 14377 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:35.937704 19092 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:35.997916 14297 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:19:35.984498 14895 rpcz_store.cc:276] 0709 13:19:34.872639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.946244 (+ 73605us) service_pool.cc:224] Handling call
0709 13:19:34.948868 (+  2624us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:34.949264 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:34.982400 (+ 33136us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.743705 (+761305us) spinlock_profiling.cc:243] Waited 954 us on lock 0x7b18003f8740. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:19:35.743910 (+   205us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.759396 (+ 15486us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:35.781775 (+ 22379us) log.cc:844] Serialized 52 byte log entry
0709 13:19:35.781960 (+   185us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:35.787846 (+  5886us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.788158 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.792699 (+  4541us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.960201 (+167502us) raft_consensus.cc:1685] finished
0709 13:19:35.960227 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.960403 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22851,"prepare.queue_time_us":33963,"raft.queue_time_us":30178,"raft.run_cpu_time_us":538,"raft.run_wall_time_us":44085,"spinlock_wait_cycles":7716992,"thread_start_us":65597,"threads_started":1,"wal-append.queue_time_us":85151}
I20260709 13:19:35.995474 14227 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:35.992808 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:36.002439 14302 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:35.949283 19050 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:36.008497 14270 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:36.008663 14226 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:36.015509 14225 raft_consensus.cc:2410] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:36.014864 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:36.018564 19028 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:36.019014 19028 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.019075 14226 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:36.019374 19028 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.020988 14300 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:36.021833 19085 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.021878 14226 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:36.022480 19085 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.023535 19167 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:36.015291 19005 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:19:36.024426 19005 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:36.024824 19005 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:36.025120 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:36.026165 19130 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:36.025820 19005 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.026640 19130 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.027144 19130 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.027220 19005 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:36.032055 14228 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:36.034703 19167 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:36.038844 18843 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:36.006472 19115 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:19:36.039304 18843 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:36.040241 18843 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.040498 19123 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:36.041613 18843 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.041664 19028 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.047856 14369 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:36.008288 19129 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:36.052322 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.059432 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.060961 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.010108 19159 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:19:36.011019 19039 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:19:36.014396 18789 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:19:36.059101 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:36.134713 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 159508us
I20260709 13:19:36.157421 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.084102 14895 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:36.163897 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.085774 19134 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:36.084589 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1173) took 2027 ms. Trace:
I20260709 13:19:36.159222 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.165306 14894 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:36.159142 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.090560 14222 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:36.160477 19085 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:36.158370 14901 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:36.073561 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 873) took 1454 ms. Trace:
I20260709 13:19:36.163972 14900 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:36.156280 14892 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:36.044288 19028 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:36.167968 14295 rpcz_store.cc:276] 0709 13:19:34.619110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.739839 (+120729us) service_pool.cc:224] Handling call
0709 13:19:34.740157 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.982894 (+242737us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:35.000608 (+ 17714us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.313357 (+312749us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.499854 (+186497us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.499914 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:35.499958 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.073151 (+573193us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54000dbbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:36.073239 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.073465 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7652,"prepare.queue_time_us":24900,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":93,"raft.queue_time_us":136880,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"spinlock_wait_cycles":497745152,"thread_start_us":497777,"threads_started":2,"wal-append.queue_time_us":494284}
I20260709 13:19:36.169624 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.169760 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.170198 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.181993 14901 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:36.171577 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.182900 14894 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.166792 14896 rpcz_store.cc:276] 0709 13:19:34.057347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.059262 (+  1915us) service_pool.cc:224] Handling call
0709 13:19:34.268120 (+208858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.280986 (+ 12866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.084369 (+1803383us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540049fa50. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:36.084526 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479564672}
I20260709 13:19:36.055809 19129 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:36.119344 19155 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:36.191244 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:36.191869 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 199163us
I20260709 13:19:36.192858 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.084461 19083 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.192070 14899 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.193527 14900 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.088384 19165 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.167064 18789 consensus_queue.cc:1243] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:36.167459 19134 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:36.162828 19184 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:36.209710 14899 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:36.230253 14894 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:36.279928 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.280856 14894 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:36.311710 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.092770 19130 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.191807 19129 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:36.200842 18537 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.087133 19050 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.341130 14900 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:36.202757 19155 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.344282 19155 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:36.344678 19092 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.349339 19071 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.350652 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:36.355064 19130 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:36.332036 18537 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.365028 18537 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:36.368026 14901 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:36.369733 19092 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:36.378744 19165 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:36.380842 19145 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.291s	user 0.002s	sys 0.001s
I20260709 13:19:36.345423 19134 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.383458 19134 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.388375 19083 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:36.369577 18537 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:19:36.393023 19087 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.401932 18537 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.402684 18537 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.406700 18537 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:36.409943 18537 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:36.412318 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 250489us
W20260709 13:19:36.412217 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 213531us
I20260709 13:19:36.430682 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:36.441416 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:36.446560 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2506) took 2127 ms. Trace:
I20260709 13:19:36.447009 14373 rpcz_store.cc:276] 0709 13:19:34.319515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.319656 (+   141us) service_pool.cc:224] Handling call
0709 13:19:34.347424 (+ 27768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.356571 (+  9147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.446274 (+2089703us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b54001b9ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:36.446493 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19289856}
I20260709 13:19:36.444479 19039 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:19:36.459733 19196 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:36.461522 19196 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:36.462114 19196 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.429579 18857 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:36.465667 19196 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:36.465629 18857 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.468248 18857 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:36.470038 19194 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:36.471136 19194 consensus_queue.cc:1243] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:36.445662 18951 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.451258 19165 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:36.451292 19118 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:19:36.429564 18537 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.413534 19129 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.477947 19184 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:36.500031 19086 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:36.499589 19184 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.500541 19086 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:36.501438 19086 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.510675 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:36.491281 19107 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.509383 19199 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:36.509220 19050 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:36.541108 18537 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:36.545209 19009 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:36.535029 19107 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.547214 19129 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:36.549230 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:36.582201 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.554291 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 43707.8us
I20260709 13:19:36.491073 19093 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:36.509471 19105 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:36.512899 19194 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.543896 19199 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.537953 19156 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.544011 19050 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.633447 19102 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.592792 18537 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:36.634032 19102 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.634387 18537 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:36.599587 19086 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.636502 19156 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.638620 18682 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:36.639140 18682 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:36.639228 14298 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:19:36.638754 19156 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:36.641588 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:36.639999 18682 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.631467 19090 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.643539 19102 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:36.678618 19155 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.690081 19127 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:36.702040 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 162284us
I20260709 13:19:36.629647 19105 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.641346 19194 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.703179 19009 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.713815 18682 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.703557 19127 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.631398 19093 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:36.729550 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 131892us
I20260709 13:19:36.698247 19090 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.741478 19090 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:36.736261 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:36.749243 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:36.703787 19155 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:36.737684 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 89369.1us
I20260709 13:19:36.722784 19156 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:36.730015 19127 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:36.754547 19090 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:36.758409 19090 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:36.759371 19090 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.733407 19107 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:36.765586 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.766322 14901 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:36.728895 19009 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.770220 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.770470 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.757222 19129 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:36.773301 14864 leader_election.cc:336] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.702s (SENT)
I20260709 13:19:36.774600 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:36.757561 19156 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.775429 18837 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:36.775848 18837 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:36.776209 18837 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.777143 19156 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:36.768231 19206 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.781613 19206 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.782482 14898 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:36.783975 19206 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:36.783711 18837 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.786418 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.787118 14895 raft_consensus.cc:2376] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12. Re-sending same reply.
I20260709 13:19:36.787343 19027 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:36.789537 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.790138 14894 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:36.794410 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:36.802218 19201 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 13:19:36.803985 19202 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:19:36.797364 19087 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:36.813436 19087 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:36.813875 19087 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:36.818501 14229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2628) took 1612 ms (client timeout 2046 ms). Trace:
I20260709 13:19:36.819244 19105 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:36.821148 19093 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:36.791312 19129 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:36.818975 14229 rpcz_store.cc:269] 0709 13:19:35.206343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.206515 (+   172us) service_pool.cc:224] Handling call
0709 13:19:36.818267 (+1611752us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54002760d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:36.818413 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498734848}
I20260709 13:19:36.822683 19129 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.826758 19194 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:36.827502 19050 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:36.796705 19156 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:19:36.829061 19009 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:36.831771 18951 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:36.832789 19080 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:36.833443 18926 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:36.833864 18926 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:36.834762 18926 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.843431 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.844226 14894 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:36.847489 14298 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:36.848835 14302 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:36.848851 14301 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:36.849645 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:36.850600 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.851341 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.851539 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.852006 14303 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
W20260709 13:19:36.852452 14224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2627) took 1657 ms (client timeout 2181 ms). Trace:
W20260709 13:19:36.852779 14224 rpcz_store.cc:269] 0709 13:19:35.195443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.195565 (+   122us) service_pool.cc:224] Handling call
0709 13:19:36.852254 (+1656689us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540033ed54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:36.852383 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425276672}
I20260709 13:19:36.855983 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.856434 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.857393 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.857653 14895 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:36.858108 14301 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:36.859440 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.859781 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:36.860149 14296 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:36.860069 14299 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:36.860347 14295 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.860983 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.861666 14298 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:36.862192 14303 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:19:36.863011 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.863835 14298 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:36.864598 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:36.854653 18843 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.867138 18843 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.868059 19199 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:36.869177 18843 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:36.870136 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.870286 18926 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.870721 14894 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:36.871163 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.874871 19127 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.877238 19127 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:36.878259 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:36.879122 14372 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:19:36.879537 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:36.880995 14373 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:19:36.882215 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:36.883009 14375 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 10: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:36.883560 19196 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:36.883929 19196 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:36.884846 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:36.885778 14296 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:36.886127 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.869644 19087 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.857297 19156 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:36.886984 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.887466 19156 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.887010 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.884886 19196 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:36.890547 19196 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.890957 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:36.891204 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:36.891796 14301 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:36.892669 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.891815 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.894542 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.895869 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.896569 14901 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:36.887765 14298 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:36.899240 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.901118 14304 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:36.902462 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.902971 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.904927 14892 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:36.905278 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.909698 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.862668 18837 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:36.912245 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:36.916009 14895 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.917018 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.922780 19080 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:36.923403 19080 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.926214 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:36.926895 14297 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:36.929481 14301 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:36.918547 19009 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.944491 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2263) took 1219 ms. Trace:
I20260709 13:19:36.948318 19131 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:36.947919 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.945019 14220 rpcz_store.cc:276] 0709 13:19:35.725198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.744948 (+ 19750us) service_pool.cc:224] Handling call
0709 13:19:36.090914 (+345966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.091120 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.091148 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:36.091194 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:36.091230 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.091289 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.944263 (+852974us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54002a17d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:36.944417 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734305024}
I20260709 13:19:36.948758 19131 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:36.938345 19022 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:19:36.914376 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:36.949148 19134 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:36.943243 18922 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.949216 18352 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.973238 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:19:36.972967 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 44279us
I20260709 13:19:36.972234 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2645) took 1151 ms. Trace:
W20260709 13:19:36.958814 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.958178 19022 consensus_queue.cc:1243] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:36.978662 14223 rpcz_store.cc:276] 0709 13:19:35.821316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.993010 (+171694us) service_pool.cc:224] Handling call
0709 13:19:35.993378 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.993630 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:36.009367 (+ 15737us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.950994 (+941627us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b18004c6ba0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:36.971890 (+ 20896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:36.971940 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:36.971985 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.972049 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.972174 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2103,"prepare.queue_time_us":16439,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"spinlock_wait_cycles":2359680}
I20260709 13:19:36.986009 18872 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.986502 18778 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.994848 14270 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:37.003412 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:37.009454 14297 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:36.986353 18922 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.048074 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:37.048828 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 45710.9us
W20260709 13:19:37.049942 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55232us
I20260709 13:19:36.986884 19108 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.003938 14295 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:37.019248 14299 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:37.070979 14303 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:36.985041 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:36.927186 19127 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:19:37.025252 14296 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:19:36.933547 19080 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:36.941931 18951 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:37.061138 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50448.2us
I20260709 13:19:37.048225 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:37.071919 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 86954.3us
I20260709 13:19:36.913290 14894 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:36.943039 19086 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.911849 19129 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:37.076972 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:36.943131 19009 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.075248 19011 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:37.086251 18807 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:37.087388 19080 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:37.091061 19106 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.075498 18778 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:37.104620 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54195.2us
W20260709 13:19:37.106446 14864 leader_election.cc:336] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.019s (SENT)
I20260709 13:19:37.080698 19108 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.111140 19086 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:36.987910 19134 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.103735 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:37.150527 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46884.9us
I20260709 13:19:37.112886 14193 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:37.119922 14300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2808) took 2828 ms (client timeout 2913 ms). Trace:
I20260709 13:19:37.123049 14899 raft_consensus.cc:2410] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:37.080034 19194 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:36.916796 19087 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:37.131719 19106 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.148160 18778 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:37.148581 19127 consensus_queue.cc:1243] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:37.076967 19032 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:19:37.053617 18537 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:19:37.112054 19129 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.099776 18922 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:37.151463 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:37.212036 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 105673us
I20260709 13:19:37.043512 18352 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:37.153105 14300 rpcz_store.cc:269] 0709 13:19:34.281738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.283305 (+  1567us) service_pool.cc:224] Handling call
0709 13:19:37.110050 (+2826745us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54000db6d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:37.110260 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3993111296}
I20260709 13:19:37.069970 18872 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.190030 14895 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:37.114970 19156 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:36.958186 19131 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:37.207453 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.228991 14221 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:37.111737 19187 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:19:37.175769 19185 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:37.162608 19027 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:37.176803 19155 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:37.226936 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 75545.5us
I20260709 13:19:37.118227 18951 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.236565 14229 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:37.230782 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.237450 14223 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:37.235394 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:37.220862 14864 leader_election.cc:336] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 2.056s (SENT)
I20260709 13:19:37.238399 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:37.177301 19194 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.238801 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.239959 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.223162 19129 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:37.131114 18807 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.240443 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.248720 14229 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 7.
I20260709 13:19:37.150345 19080 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.224072 18537 consensus_queue.cc:1243] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:37.238797 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:37.264354 14866 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.208.190:37027, user_credentials={real_user=slave}} blocked reactor thread for 57657.7us
I20260709 13:19:37.265663 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.265763 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:37.232479 18922 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:37.267576 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:37.228516 19173 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:37.228271 19022 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:37.245373 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.245362 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.274266 14374 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:37.244794 14377 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:37.218146 19127 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:37.234457 19032 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:37.241499 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.235010 19185 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.269883 14373 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:37.270083 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.294119 14369 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:37.224939 18778 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:19:37.277338 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.295166 14221 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:37.278134 14223 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:37.296077 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:37.280225 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.298482 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.248942 19193 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:37.281179 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:37.283545 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.300621 14375 raft_consensus.cc:2410] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:19:37.284547 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:37.285462 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.285658 19218 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.286936 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.303527 14229 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 12: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:37.287271 14220 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:37.239701 19187 consensus_queue.cc:1243] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:37.288985 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.270809 19173 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:37.291270 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.245616 19194 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.311101 18951 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:37.312064 19218 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.305709 14300 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:37.314110 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:37.315236 19218 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:37.316155 19218 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:37.316730 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:37.317752 14221 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:37.316802 19218 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:37.308964 19173 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.297894 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:37.332705 14303 raft_consensus.cc:2410] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:19:37.303288 14372 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:37.333984 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:37.324240 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 103416us
I20260709 13:19:37.329258 14227 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:37.335059 14220 raft_consensus.cc:2368] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13.
I20260709 13:19:37.332600 14899 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:37.366801 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:37.367269 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:37.368062 14222 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:37.273824 19022 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:37.288584 19127 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:37.249142 19196 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:19:37.304173 19185 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.371439 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:37.298274 19087 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:37.296960 19199 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:37.293846 19102 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:37.293479 19032 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.292845 19011 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:37.375176 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:37.381384 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 132136us
W20260709 13:19:37.407524 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 294704us
I20260709 13:19:37.408303 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.409080 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:37.410130 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.412206 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.412842 14372 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:37.413038 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.413340 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:37.413872 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:37.414371 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:37.414630 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.414918 14892 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:37.415217 14372 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.415644 14225 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:37.415947 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:37.417081 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.417630 14225 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:37.418074 14374 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:37.419226 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.419987 14374 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:37.421157 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.381309 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:37.383428 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.394596 14221 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:37.423300 14220 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:19:37.430716 14374 raft_consensus.cc:2368] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9.
W20260709 13:19:37.432412 14192 connection.cc:256] RPC call timeout handler was delayed by -1.2430871099998058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.238s for a response
I20260709 13:19:37.273576 18922 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.438549 14376 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:37.440825 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.443420 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:37.443887 14375 raft_consensus.cc:2410] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:19:37.444496 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.445314 14374 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.438853 14377 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:37.440995 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.447211 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.441742 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:37.448452 14221 raft_consensus.cc:2410] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:37.441972 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.442447 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:37.449595 14223 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:19:37.377050 19123 raft_consensus.cc:2764] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:19:37.452076 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:37.452247 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.460162 14221 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:37.454005 14229 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:37.460505 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.456635 14372 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:37.460708 14370 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:37.461755 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.378647 19199 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.458534 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.465317 14371 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:37.465777 14378 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.462980 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.463060 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.321844 19218 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.463718 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.468818 14894 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:37.385732 19102 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:37.406724 19032 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.475423 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:37.484220 14899 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:37.475517 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.397607 19087 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:37.478888 14893 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:37.485276 14220 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:37.485841 14222 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:19:37.491127 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.497838 14221 raft_consensus.cc:2368] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13.
I20260709 13:19:37.438835 19213 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:37.499445 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.498153 14193 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:37.514909 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:37.474694 19199 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.490127 14374 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:37.526221 14378 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:37.522063 14227 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
W20260709 13:19:37.531322 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:37.536486 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.538390 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.542061 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.501593 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.544358 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.539228 14220 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:37.444591 19011 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.492235 19102 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.554940 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:37.555001 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 146002us
I20260709 13:19:37.501163 19227 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.561915 14371 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:37.516472 19213 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:37.563073 19213 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.501965 19086 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:37.501281 19215 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:37.498540 19134 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:37.512524 19108 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:37.498613 19009 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:37.501062 19123 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:37.570575 19080 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:37.571668 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.577693 14369 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:37.573921 14893 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:37.553735 18778 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.579546 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.580345 14378 raft_consensus.cc:2376] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8. Re-sending same reply.
I20260709 13:19:37.582115 19108 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:37.582605 19108 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:37.583424 19108 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.584735 19108 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:37.584906 19197 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:37.585426 19197 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:37.586413 19197 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.587548 19197 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.588020 19131 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.592459 18872 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:37.592926 18926 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.722s	user 0.004s	sys 0.009s
I20260709 13:19:37.598014 19215 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:37.599097 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:37.602172 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:37.604643 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.605221 14221 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
I20260709 13:19:37.606024 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.606257 14371 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:37.569648 18352 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:37.609934 14192 connection.cc:256] RPC call timeout handler was delayed by -1.046679081000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:19:37.606041 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:37.613564 14221 raft_consensus.cc:2376] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10. Re-sending same reply.
I20260709 13:19:37.614776 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.616071 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.566792 19106 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:37.617386 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.619251 14227 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:37.623027 14270 leader_election.cc:400] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13.
I20260709 13:19:37.612093 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:37.566726 19227 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.623075 19205 consensus_queue.cc:1059] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:37.577193 19134 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.602665 19086 raft_consensus.cc:2764] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:37.630679 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:37.632103 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 167800us
W20260709 13:19:37.624591 19216 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:19:37.628361 19222 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:37.601209 18807 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:37.641824 14371 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:19:37.642484 14378 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:37.649482 14371 pending_rounds.cc:85] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 7
I20260709 13:19:37.649895 14371 pending_rounds.cc:107] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:19:37.640555 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:37.650172 14371 raft_consensus.cc:2889] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:37.650776 19117 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:37.650981 18537 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:37.651340 19117 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:37.652493 19117 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.653681 19011 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:37.647902 18352 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:37.654788 18352 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.655434 18922 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:37.655973 19105 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:37.656340 19105 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:37.657218 19105 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.658444 19105 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.659761 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:37.660497 14373 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:37.660874 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:37.661662 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.662005 18837 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:37.662662 18837 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:37.662792 19027 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:37.663287 19027 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.663761 18837 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.665884 19231 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:19:37.666793 19231 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:37.667167 19231 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:37.667970 19231 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.669056 19231 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:37.657423 18352 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:37.671371 19227 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:37.672421 14270 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:37.633600 18926 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:19:37.666018 19071 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:37.674628 19071 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:37.675843 19071 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.678210 19221 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:37.680763 18926 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:37.630752 14370 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:37.645934 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:37.682578 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:37.684165 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.644404 14222 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.582163 18778 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.684921 14370 raft_consensus.cc:2376] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9. Re-sending same reply.
I20260709 13:19:37.684906 14270 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:37.689677 14270 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:37.691870 14892 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:37.602290 19123 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.695060 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:37.631778 19193 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:19:37.699700 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:37.700443 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.701103 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.701184 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.702600 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:37.704002 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.752656 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:37.753356 14375 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:37.753901 14892 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
W20260709 13:19:37.754468 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.740630 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.757220 14373 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:37.697279 14893 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:37.760483 14372 raft_consensus.cc:2376] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9. Re-sending same reply.
I20260709 13:19:37.761920 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.762545 14378 raft_consensus.cc:2376] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11. Re-sending same reply.
W20260709 13:19:37.754408 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 51891.8us
I20260709 13:19:37.764992 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:37.681290 18926 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:37.766762 14371 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:37.599157 19215 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.766891 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:37.641053 19134 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.689358 19011 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:37.688169 19222 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:37.770918 14369 raft_consensus.cc:2368] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9.
I20260709 13:19:37.688810 19107 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:37.633664 19087 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.774210 14223 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:19:37.696761 18951 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:37.769768 19230 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:37.782660 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:37.687666 18537 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:19:37.771529 18926 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.696517 18857 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:37.813896 19227 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:37.795614 14192 leader_election.cc:336] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.677s (SENT)
W20260709 13:19:37.818696 14192 leader_election.cc:336] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.954s (SENT)
I20260709 13:19:37.819242 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:37.820211 19224 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:37.823328 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:37.799633 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:37.826061 14341 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:37.827000 19231 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:37.802362 14377 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:37.827895 19227 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:37.828610 19213 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:37.786060 19011 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.750811 19032 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.798749 19230 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:37.832918 19123 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:37.834722 19102 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:37.838560 19194 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.002s
I20260709 13:19:37.839883 18778 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:37.847914 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:37.843199 19222 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.851022 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:37.851300 19022 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.854246 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:37.855227 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:38.303658 19022 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:38.303719 14300 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:38.305078 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:37.856752 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.306599 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.307664 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.308645 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:37.860671 14297 pending_rounds.cc:85] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 6
I20260709 13:19:38.292325 19227 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.310075 14297 pending_rounds.cc:107] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:19:38.310431 14297 raft_consensus.cc:2889] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.310401 19227 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:37.861917 14301 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:38.312441 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:37.863022 14302 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:19:38.157001 14225 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:38.157651 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.158670 19213 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:38.053597 14224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.007s	sys 0.018s
W20260709 13:19:38.314520 14224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.011s	sys 0.018s
I20260709 13:19:38.315286 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1169) took 1083 ms. Trace:
I20260709 13:19:38.315415 19193 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:37.959071 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 394060us
I20260709 13:19:38.316105 19193 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.316579 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:38.159418 18872 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:38.317973 19239 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:38.318071 19219 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:38.318648 19239 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:38.318790 19219 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.319643 19239 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.309623 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.160104 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:37.894745 19194 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.315668 14224 rpcz_store.cc:276] 0709 13:19:37.231487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.231611 (+   124us) service_pool.cc:224] Handling call
0709 13:19:37.231907 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.379603 (+147696us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:37.379683 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:37.380738 (+  1055us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.314921 (+934183us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:38.314970 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.315052 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.315100 (+    48us) raft_consensus.cc:1685] finished
0709 13:19:38.315113 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.315229 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":336759,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":31352,"thread_start_us":998336,"threads_started":2,"wal-append.queue_time_us":726207}
W20260709 13:19:38.323060 19129 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.055s	user 0.014s	sys 0.014s
I20260709 13:19:38.161396 19237 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:37.891181 19230 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:38.161041 19173 consensus_meta.cc:287] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.790s	user 0.008s	sys 0.012s
I20260709 13:19:38.323750 19129 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.324237 19173 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:38.163055 19108 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.011s
W20260709 13:19:38.133879 14900 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.000s	sys 0.015s
I20260709 13:19:38.323890 19237 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:38.326241 14304 raft_consensus.cc:2368] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14.
W20260709 13:19:38.132622 14343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.000s	sys 0.014s
W20260709 13:19:38.326829 14343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.000s	sys 0.015s
I20260709 13:19:38.327069 14223 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 8.
W20260709 13:19:38.327850 19217 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.119s	user 0.001s	sys 0.001s
I20260709 13:19:38.155671 14901 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:38.329387 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1162) took 2383 ms. Trace:
I20260709 13:19:38.329739 14369 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:38.164539 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.329985 14226 rpcz_store.cc:276] 0709 13:19:35.946377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.044370 (+ 97993us) service_pool.cc:224] Handling call
0709 13:19:36.058979 (+ 14609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:36.972678 (+913699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.972724 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:36.973242 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:19:37.149546 (+176304us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:37.149591 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.149662 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.327231 (+1177569us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:38.329086 (+  1855us) raft_consensus.cc:1685] finished
0709 13:19:38.329109 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.329322 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":913243,"raft.queue_time_us":926488,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":181892992,"thread_start_us":66695,"threads_started":1,"wal-append.queue_time_us":96234}
I20260709 13:19:38.332528 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:38.165297 19131 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.014s
W20260709 13:19:38.169456 19027 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.009s
I20260709 13:19:37.855845 19224 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:37.831470 18926 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:38.172083 19032 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:38.172884 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1205) took 1330 ms. Trace:
W20260709 13:19:38.150681 19185 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.013s
I20260709 13:19:38.360975 19185 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.362432 14378 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:38.363803 19185 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:38.154362 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.151809 14299 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:38.036729 14193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.026s	sys 0.027s
W20260709 13:19:38.365569 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 867438us
I20260709 13:19:38.352437 19231 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.344635 18872 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.366894 19173 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:38.343571 19108 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:38.367993 14374 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:19:38.358210 19223 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:38.369230 19223 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.369587 19223 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.157529 19134 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:37.786520 19199 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.370263 18926 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:38.371589 19199 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:37.882319 19011 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.372283 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:38.372865 14378 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:38.169637 14229 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:38.155062 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.374627 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:38.376528 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:38.292393 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.378114 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:38.378782 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.359211 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:38.379235 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:38.296211 18537 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:38.380235 18537 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.359582 19071 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.381842 19071 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.382968 18537 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:38.383489 14892 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:19:38.302560 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.378819 14373 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:38.385217 19231 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:38.386693 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:38.381287 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:38.387604 14226 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.389027 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:38.300803 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.323207 14896 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:38.329334 19187 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:38.154145 14303 raft_consensus.cc:1217] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-10.10]   Dedup: 6.7->[7.8-10.10]
W20260709 13:19:38.166071 19197 consensus_meta.cc:287] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.578s	user 0.005s	sys 0.015s
W20260709 13:19:38.325979 14900 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.000s	sys 0.015s
I20260709 13:19:38.333753 14301 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:38.353423 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 502428us
I20260709 13:19:38.358112 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:38.394398 14372 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:38.394173 14341 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:38.373652 14375 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:38.395138 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:38.379565 14371 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:38.395907 14229 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.359637 19027 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.384037 19214 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:38.406849 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:38.407528 14899 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:19:38.407938 14899 pending_rounds.cc:85] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 8
I20260709 13:19:38.408157 14899 pending_rounds.cc:107] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:19:38.408396 14899 raft_consensus.cc:2889] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:38.409659 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54905.5us
I20260709 13:19:38.408249 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:38.414772 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:38.415649 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:38.414410 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:38.418673 14375 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 8: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:38.392573 18537 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.390091 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:38.428236 14222 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:19:38.211879 14220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.006s	sys 0.012s
W20260709 13:19:38.429342 14220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.007s	sys 0.020s
W20260709 13:19:38.355298 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 195301us
I20260709 13:19:38.396651 19218 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:38.300904 19210 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.153s	user 0.017s	sys 0.006s
I20260709 13:19:38.391212 14224 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:19:38.440263 14224 pending_rounds.cc:85] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 5
I20260709 13:19:38.392238 14303 pending_rounds.cc:85] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 7
I20260709 13:19:38.440793 14303 pending_rounds.cc:107] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:19:38.441092 14303 raft_consensus.cc:2889] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.391947 19187 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:38.323880 19194 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:38.396982 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.397526 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:38.446005 14223 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:38.359163 14898 rpcz_store.cc:276] 0709 13:19:36.842683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.842794 (+   111us) service_pool.cc:224] Handling call
0709 13:19:36.854333 (+ 11539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:36.854689 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.854709 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:36.855108 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:19:37.214968 (+359860us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b18001bfac0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:19:37.634521 (+419553us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:37.634581 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.635102 (+   521us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.172566 (+537464us) raft_consensus.cc:1685] finished
0709 13:19:38.172589 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.172822 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5610,"spinlock_wait_cycles":55022848,"thread_start_us":419294,"threads_started":1,"wal-append.queue_time_us":1298774}
I20260709 13:19:38.402160 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1197) took 1633 ms. Trace:
I20260709 13:19:38.450950 14900 rpcz_store.cc:276] 0709 13:19:36.768862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.768996 (+   134us) service_pool.cc:224] Handling call
0709 13:19:36.769337 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:36.769700 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.769729 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:36.871321 (+101592us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b180047db80. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f557 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:19:36.892522 (+ 21201us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b2c0010c018. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb985a11 00007f8deb995372 00007f8ded0c7a01 00007f8ded08c43a 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2
0709 13:19:36.919854 (+ 27332us) log.cc:844] Serialized 52 byte log entry
0709 13:19:37.257305 (+337451us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:38.393834 (+1136529us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.401386 (+  7552us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.401711 (+   325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.401839 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.401882 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:38.401900 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.402086 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":398024,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":6355,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":14843,"spinlock_wait_cycles":62764800,"thread_start_us":1336535,"threads_started":2,"wal-append.queue_time_us":420825}
I20260709 13:19:38.325943 19129 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:38.406298 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:38.454690 14374 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.440802 18537 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.456995 19219 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:38.443323 19215 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:19:38.427646 19214 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:38.459327 19214 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:38.463142 14374 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:38.425366 19193 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:38.436262 14229 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:38.402707 19196 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:38.460855 19214 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.486079 18537 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:38.477285 19244 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:19:38.490442 19237 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:38.493566 19205 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:38.494141 19205 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:38.495211 19205 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.514475 19102 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:38.534840 19230 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.441265 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:38.538136 14370 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 13: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:38.440593 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:38.413812 19134 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:38.538669 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:38.450380 18926 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:38.539516 18926 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:38.540036 18926 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.540495 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:38.467746 14223 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:38.467931 19127 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.563560 19127 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:38.565927 19215 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:38.566416 19215 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.566771 19215 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:38.565927 18872 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:38.571720 19230 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:38.572445 19218 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.573832 19218 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.575920 19218 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:38.471230 19209 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.240s	user 0.003s	sys 0.001s
I20260709 13:19:38.423192 14372 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:38.578439 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.475875 19187 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.441656 19173 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:38.521133 19027 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:38.444541 19213 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:19:38.438007 19123 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:38.522624 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1202) took 1681 ms. Trace:
I20260709 13:19:38.525187 14371 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:19:38.440627 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47931.3us
I20260709 13:19:38.527611 14222 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:38.531122 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.615043 14301 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:38.615134 19123 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:38.534220 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2658) took 1071 ms. Trace:
I20260709 13:19:38.616178 14225 rpcz_store.cc:276] 0709 13:19:37.463199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.463456 (+   257us) service_pool.cc:224] Handling call
0709 13:19:38.498462 (+1035006us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b540011fdd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:38.534137 (+ 35675us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585236864}
I20260709 13:19:38.536756 19227 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:38.616849 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:38.440632 14224 pending_rounds.cc:107] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 12.6
W20260709 13:19:38.543082 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 102563us
I20260709 13:19:38.617393 19123 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:38.556666 14228 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:38.390012 14378 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:19:38.576676 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:38.360273 19105 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.584071 14226 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:38.543709 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:38.617815 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:38.519976 19205 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:38.617425 14224 raft_consensus.cc:2889] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.617710 14867 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:38.625921 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:38.626724 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:38.626890 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:38.627213 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:38.628297 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:38.612751 14897 rpcz_store.cc:276] 0709 13:19:36.841614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.842021 (+   407us) service_pool.cc:224] Handling call
0709 13:19:36.842363 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:36.844469 (+  2106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.844501 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:36.854109 (+  9608us) log.cc:844] Serialized 26 byte log entry
0709 13:19:37.171758 (+317649us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:37.171821 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.171927 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.180465 (+1008538us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:38.522359 (+341894us) raft_consensus.cc:1685] finished
0709 13:19:38.522382 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.522564 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":96,"spinlock_wait_cycles":321196800,"thread_start_us":297460,"threads_started":1,"wal-append.queue_time_us":282402}
I20260709 13:19:38.624823 14867 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:38.608762 19117 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.642880 14894 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:38.643649 14900 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:38.644749 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 250644us
I20260709 13:19:38.645512 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:38.648991 14898 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:38.618292 19187 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.651525 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:38.665093 14897 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:38.618177 18837 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.632862 18872 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:38.635627 18537 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:38.635197 19193 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:38.642059 19197 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:38.676328 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.685388 14296 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
W20260709 13:19:38.632901 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.676622 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 231511us
W20260709 13:19:38.670500 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 263748us
I20260709 13:19:38.689877 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:38.691262 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:38.668927 19227 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:38.672319 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:38.705924 14300 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.682428 14225 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:38.669442 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:38.682960 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.683897 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:38.708590 14222 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:38.708784 14302 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:38.710188 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.710354 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:38.711313 14302 raft_consensus.cc:2410] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:38.669188 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:38.693059 14344 leader_election.cc:400] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13.
I20260709 13:19:38.712015 14344 leader_election.cc:403] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:38.712100 14228 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:38.713028 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:38.714114 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:38.714295 19224 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:38.714982 19224 consensus_queue.cc:1243] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:38.696085 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:38.715963 14296 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 12: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:38.716874 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.703514 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:38.718225 14295 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:38.675676 18872 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.730027 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:38.636025 19105 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.724131 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:38.736997 14296 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:38.729240 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:38.730834 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:38.732021 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:38.738354 14894 raft_consensus.cc:2410] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:19:38.732486 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:38.729240 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.740056 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:38.743012 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 358247us
I20260709 13:19:38.738763 14225 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:38.733446 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.732203 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:38.741724 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:38.745963 14223 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:38.745052 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:38.702907 19173 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:38.746956 14228 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:38.747424 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:38.748030 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:38.745645 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:38.748978 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:38.715690 19218 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:38.757463 14270 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:38.762315 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:38.763545 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:38.764120 14895 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:38.753254 14193 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:38.668727 19117 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.715965 19254 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.716081 19193 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:38.760196 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 49952.2us
I20260709 13:19:38.736169 18872 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:38.779788 14295 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:38.736143 19253 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:38.787477 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.744966 19123 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.745404 19235 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:38.798410 14864 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.578s (SENT)
I20260709 13:19:38.799085 14864 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:38.750072 19134 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:38.749655 19230 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.740796 19257 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13.
I20260709 13:19:38.679195 18837 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.725164 19237 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:19:38.811864 19251 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.514s	user 0.002s	sys 0.002s
W20260709 13:19:38.822662 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 129739us
I20260709 13:19:38.887765 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:38.830869 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 67410.4us
I20260709 13:19:38.774922 19027 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:38.734793 19213 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:19:38.778070 19231 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:38.821185 14299 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:38.814416 19239 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:38.913836 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1177) took 1215 ms. Trace:
I20260709 13:19:38.914199 14369 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:38.914393 14370 rpcz_store.cc:276] 0709 13:19:37.698106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.698257 (+   151us) service_pool.cc:224] Handling call
0709 13:19:38.913538 (+1215281us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b5400060ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:38.913737 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1775460736}
I20260709 13:19:38.890887 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:38.894533 19274 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.895938 19222 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:38.813884 19214 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:38.867967 19197 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:38.887082 19129 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:38.890075 19102 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.903208 19134 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.888777 14344 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:38.912415 19213 consensus_queue.cc:1243] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 10.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:19:38.943202 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54506.2us
I20260709 13:19:38.944442 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:38.920610 14299 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:38.785384 19199 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 13:19:38.902158 14295 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:38.877367 19261 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:38.871592 19230 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.782018 19254 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:38.904035 18537 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:38.832912 18926 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:38.958266 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 67438.8us
W20260709 13:19:38.984586 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 114692us
W20260709 13:19:39.004659 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 227697us
I20260709 13:19:38.831759 19123 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:39.033599 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.030682 19134 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.036742 19134 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:38.923959 19214 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.041852 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.025929 19102 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:38.945640 19193 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:39.055035 19255 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.304s	user 0.000s	sys 0.000s
I20260709 13:19:39.055709 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.057061 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.054406 18537 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.057710 14370 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:39.060475 19197 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.062480 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:38.819500 19253 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.063819 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.066567 14302 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:39.071094 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.026350 19129 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:39.079948 14304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2749) took 2175 ms (client timeout 1829 ms). Trace:
I20260709 13:19:39.033242 19239 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:38.920753 19260 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 13:19:39.030462 19263 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:39.048626 19214 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.042085 19271 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:38.932185 19222 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:39.085812 14304 rpcz_store.cc:269] 0709 13:19:36.904824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.904999 (+   175us) service_pool.cc:224] Handling call
0709 13:19:39.072085 (+2167086us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001f7a54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:39.079866 (+  7781us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3254153984}
I20260709 13:19:39.108332 19237 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:39.054507 19259 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
W20260709 13:19:39.138190 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 375993us
I20260709 13:19:39.026146 19274 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.166s
I20260709 13:19:39.113531 19271 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:39.153275 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:39.088507 19284 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.151597 19129 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:39.149053 19223 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.779s	user 0.009s	sys 0.003s
I20260709 13:19:39.137964 19237 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:39.220662 19237 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.153509 19235 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.221647 19235 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:39.223208 19215 consensus_meta.cc:287] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
I20260709 13:19:39.223722 19215 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.224220 19235 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:39.144166 19094 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:39.228936 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.144677 19105 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.252455 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.253345 14371 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:39.254401 14300 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:19:39.254824 14300 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:39.256994 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:39.258376 14341 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:39.261236 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:39.254933 19249 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.956s	user 0.005s	sys 0.009s
I20260709 13:19:39.175045 19271 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:39.250962 19285 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:19:39.279083 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:39.272850 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.283535 14371 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:39.272833 19127 consensus_meta.cc:287] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.709s	user 0.012s	sys 0.000s
I20260709 13:19:39.294917 18926 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.277653 19230 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:39.296270 19253 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:39.298223 19291 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:39.299935 19011 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.000s
I20260709 13:19:39.300472 19011 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.301896 14298 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 9: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:39.257637 14898 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:39.269387 19117 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:39.288106 19123 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:39.288509 19288 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:19:39.289585 19199 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:39.306032 19199 consensus_queue.cc:1243] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:39.306255 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.307083 14377 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
W20260709 13:19:39.308198 19205 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.673s	user 0.003s	sys 0.008s
I20260709 13:19:39.308466 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 890) took 1450 ms. Trace:
I20260709 13:19:39.309528 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:39.310750 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:39.311802 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:39.312608 19230 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.314107 19293 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.249886 19223 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:39.314855 19293 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.315548 19293 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:39.315927 19293 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.316287 19293 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:39.316543 19223 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:39.317565 14374 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:39.292865 19222 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.308849 14303 rpcz_store.cc:276] 0709 13:19:37.858196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.880553 (+ 22357us) service_pool.cc:224] Handling call
0709 13:19:38.153911 (+273358us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:19:38.673988 (+520077us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:38.717044 (+ 43056us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.138278 (+421234us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:39.142243 (+  3965us) log.cc:844] Serialized 78 byte log entry
0709 13:19:39.142377 (+   134us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.142413 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.142477 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.308261 (+165784us) raft_consensus.cc:1685] finished
0709 13:19:39.308280 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.308413 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48555,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":456,"raft.queue_time_us":154117,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":597594,"threads_started":2,"wal-append.queue_time_us":563369}
W20260709 13:19:39.320341 19250 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.020s	user 0.007s	sys 0.004s
W20260709 13:19:39.321834 19265 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260709 13:19:39.321851 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1182) took 1623 ms. Trace:
I20260709 13:19:39.302632 19254 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.322377 14221 rpcz_store.cc:276] 0709 13:19:37.698598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.700984 (+  2386us) service_pool.cc:224] Handling call
0709 13:19:37.701289 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:37.728481 (+ 27192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.728528 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:37.768720 (+ 40192us) log.cc:844] Serialized 52 byte log entry
0709 13:19:38.186499 (+417779us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:38.186563 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.186670 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.281022 (+1094352us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:39.321466 (+ 40444us) raft_consensus.cc:1685] finished
0709 13:19:39.321504 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.321766 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26530,"raft.queue_time_us":26739,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":30398,"spinlock_wait_cycles":100188928,"thread_start_us":345934,"threads_started":1,"wal-append.queue_time_us":488701}
W20260709 13:19:39.323767 19252 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.595s	user 0.000s	sys 0.002s
I20260709 13:19:39.307955 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:39.291774 18837 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:39.307425 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:39.286695 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:39.325407 14897 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:39.324766 19264 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
W20260709 13:19:39.326373 19187 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.000s
I20260709 13:19:39.327143 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:39.327338 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.327801 14898 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:39.328001 14369 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:39.329770 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.330467 14369 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:39.331283 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.331984 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.332245 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.332803 14369 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
W20260709 13:19:39.333328 14901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1117) took 1921 ms (client timeout 2011 ms). Trace:
I20260709 13:19:39.333583 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:39.335213 19273 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
I20260709 13:19:39.335359 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.335793 19011 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:39.336421 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.334293 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:39.299860 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.337882 14371 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:39.339707 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.341480 19215 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:39.342023 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.342756 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.343200 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.343561 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:39.343874 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.344252 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.344460 14372 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:39.344789 14371 raft_consensus.cc:2376] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11. Re-sending same reply.
I20260709 13:19:39.345009 14895 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:39.345253 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.346443 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:39.290040 19248 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.990s	user 0.003s	sys 0.000s
I20260709 13:19:39.345096 14893 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:39.348798 14895 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:19:39.333724 14901 rpcz_store.cc:269] 0709 13:19:37.411928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.413111 (+  1183us) service_pool.cc:224] Handling call
0709 13:19:39.333177 (+1920066us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b5400602054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:39.333280 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143069568}
I20260709 13:19:39.348096 14898 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:19:39.353941 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:39.345639 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.356102 14369 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:39.361325 14369 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:39.363902 14369 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:39.364888 14371 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:39.368796 14897 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:39.370440 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:39.357366 19271 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.376945 19271 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.378443 19205 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.383044 19205 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.384167 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.379263 19187 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.386279 19187 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.387885 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.388692 19187 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:19:39.389912 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:39.380863 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.381749 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f44936b303148f4848621766631d925"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:39.353013 19261 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:39.358244 19134 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:39.373024 19212 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.103s	user 0.016s	sys 0.028s
W20260709 13:19:39.397701 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 370296us
I20260709 13:19:39.385512 19205 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.368402 19230 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:39.412209 14867 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:39.419109 14304 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:39.393280 14894 raft_consensus.cc:606] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:39.427286 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:39.391448 19127 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:39.402097 19173 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
W20260709 13:19:39.410740 19212 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.139s	user 0.017s	sys 0.029s
I20260709 13:19:39.450928 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:39.371793 19263 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:19:39.453233 14225 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
W20260709 13:19:39.453235 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 423266us
I20260709 13:19:39.373430 19223 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:19:39.463972 14377 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:39.423064 19271 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.460459 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:39.450516 19205 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:39.468842 19278 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.199s	user 0.001s	sys 0.001s
I20260709 13:19:39.471122 19214 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:39.471825 14298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2754) took 1604 ms (client timeout 1561 ms). Trace:
W20260709 13:19:39.472337 14298 rpcz_store.cc:269] 0709 13:19:37.867116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.156996 (+289880us) service_pool.cc:224] Handling call
0709 13:19:39.471517 (+1314521us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b54001a09d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:39.471719 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2270894848}
I20260709 13:19:39.452484 19215 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.474202 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1216) took 1093 ms. Trace:
I20260709 13:19:39.474150 19215 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:39.474643 14899 rpcz_store.cc:276] 0709 13:19:38.380344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.380799 (+   455us) service_pool.cc:224] Handling call
0709 13:19:38.381094 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.415079 (+ 33985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.473944 (+1058865us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b54005d07d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:39.474141 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44149120}
I20260709 13:19:39.476414 19215 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.477299 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.477870 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:39.478035 14371 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:39.479137 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.479187 19011 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:19:39.480279 14125 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36074 (request call id 215) took 17515 ms (client timeout 15000 ms). Trace:
I20260709 13:19:39.481182 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:39.481640 14897 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:39.481739 14901 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:39.483808 14895 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
W20260709 13:19:39.484913 14267 connection.cc:256] RPC call timeout handler was delayed by -1.1934863730000416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
I20260709 13:19:39.486979 14376 raft_consensus.cc:2368] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11.
I20260709 13:19:39.487890 19290 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.488404 19290 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.489046 14371 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:39.490705 19290 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:39.498342 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.499258 14371 raft_consensus.cc:2393] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:39.500195 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.501261 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:39.502767 19215 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:39.503610 19224 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:39.504050 19224 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:39.479214 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:39.506740 14369 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:39.509006 14301 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:39.504908 19224 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.509927 19224 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:39.511639 19237 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:39.512048 19237 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:39.512887 19237 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.514207 19237 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:39.514559 19295 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:39.516319 19294 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:19:39.517203 19215 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:39.455468 19222 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:39.521631 19222 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:39.460500 19127 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:39.526496 19127 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.461310 19272 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:39.530732 19272 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.531225 19272 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:39.535717 19246 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.235s	user 0.000s	sys 0.012s
I20260709 13:19:39.545255 14301 raft_consensus.cc:1217] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Deduplicated request from leader. Original: 10.10->[11.11-11.11]   Dedup: 11.11->[]
I20260709 13:19:39.545778 14301 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:39.546139 14901 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:39.546042 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.548199 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.548825 14371 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:19:39.550166 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.550458 19194 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:39.550765 14371 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:39.550921 19194 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:39.551802 19194 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.552343 14304 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:39.552804 19194 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.553874 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.554226 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:39.553336 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:39.556332 14302 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.556721 14298 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:39.558732 14301 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:19:39.560060 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 55756.9us
I20260709 13:19:39.562167 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:39.562837 14225 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:39.563701 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:39.564263 14221 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.566334 19258 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.566418 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.566968 19258 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.568310 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.569706 14299 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:39.574416 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.585225 19261 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:39.586872 19268 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.690s	user 0.003s	sys 0.000s
I20260709 13:19:39.589460 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 891) took 1731 ms. Trace:
I20260709 13:19:39.590437 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2336) took 1216 ms. Trace:
I20260709 13:19:39.590852 14373 rpcz_store.cc:276] 0709 13:19:38.373767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.589605 (+1215838us) service_pool.cc:224] Handling call
0709 13:19:39.589968 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.590139 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.590164 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.590203 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:39.590238 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.590288 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.590385 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.453990 19173 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:39.595724 14896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1211) took 2318 ms (client timeout 1937 ms). Trace:
W20260709 13:19:39.596191 14896 rpcz_store.cc:269] 0709 13:19:37.279014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.280788 (+  1774us) service_pool.cc:224] Handling call
0709 13:19:39.595462 (+2314674us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54006bcbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:39.595622 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2352990592}
I20260709 13:19:39.600863 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:39.601255 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2339) took 1098 ms. Trace:
I20260709 13:19:39.605401 14374 rpcz_store.cc:276] 0709 13:19:38.503161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.543411 (+ 40250us) service_pool.cc:224] Handling call
0709 13:19:39.600990 (+1057579us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54003c3cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:39.601170 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1600585600}
I20260709 13:19:39.549510 19102 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.473560 19214 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:39.615082 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.601593 14229 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:39.616824 19027 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.617381 19027 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:39.618104 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2335) took 1244 ms. Trace:
I20260709 13:19:39.618551 14376 rpcz_store.cc:276] 0709 13:19:38.373508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.331746 (+958238us) service_pool.cc:224] Handling call
0709 13:19:39.617901 (+286155us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54003c32d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:39.618047 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354768128}
I20260709 13:19:39.619964 19215 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:39.622028 19215 consensus_queue.cc:1243] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:39.639752 19222 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.642405 19271 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.643677 19284 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:39.644115 19284 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:39.645059 19284 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.646860 19284 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.651889 19071 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:39.602411 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 44467.7us
I20260709 13:19:39.602914 19257 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:39.655392 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:39.656417 19257 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.656801 19293 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.658437 14372 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:39.664975 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:39.666090 14222 raft_consensus.cc:2410] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:19:39.668054 14302 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:39.657088 19257 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:39.675171 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:39.589849 14297 rpcz_store.cc:276] 0709 13:19:37.858554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.859980 (+  1426us) service_pool.cc:224] Handling call
0709 13:19:37.860420 (+   440us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:38.614923 (+754503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.614954 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:38.618875 (+  3921us) log.cc:844] Serialized 52 byte log entry
0709 13:19:38.777365 (+158490us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:38.819094 (+ 41729us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.904993 (+ 85899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.905067 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.586263 (+681196us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:39.589148 (+  2885us) raft_consensus.cc:1685] finished
0709 13:19:39.589242 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.589398 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85860,"prepare.queue_time_us":41947,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":346779,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":29965,"spinlock_wait_cycles":61551488,"thread_start_us":431236,"threads_started":2,"wal-append.queue_time_us":260840}
I20260709 13:19:39.679775 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2344) took 1156 ms. Trace:
I20260709 13:19:39.680261 14372 rpcz_store.cc:276] 0709 13:19:38.523789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.354835 (+831046us) service_pool.cc:224] Handling call
0709 13:19:39.355185 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.658860 (+303675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.679517 (+ 20657us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54001b9c54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:39.679704 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696906496}
W20260709 13:19:39.668653 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51873.8us
I20260709 13:19:39.669835 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.682026 14299 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
W20260709 13:19:39.480649 14125 rpcz_store.cc:269] 0709 13:19:21.964481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.968938 (+  4457us) service_pool.cc:224] Handling call
0709 13:19:39.480135 (+17511197us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:30.509277 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:30.577379 (+ 68102us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:30.577450 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:19:30.577478 (+    28us) tablet.cc:662] Decoding operations
0709 13:19:30.597589 (+ 20111us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:30.597710 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:30.597749 (+    39us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:19:30.599585 (+  1836us) tablet.cc:701] Row locks acquired
0709 13:19:30.599646 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:19:30.599871 (+   225us) write_op.cc:270] Start()
0709 13:19:30.600064 (+   193us) write_op.cc:276] Timestamp: P: 1783603170599778 usec, L: 0
0709 13:19:30.600089 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:19:30.601004 (+   915us) log.cc:844] Serialized 7226 byte log entry
0709 13:19:30.656625 (+ 55621us) op_driver.cc:464] REPLICATION: finished
0709 13:19:30.881352 (+224727us) write_op.cc:301] APPLY: starting
0709 13:19:30.881543 (+   191us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:32.177876 (+1296333us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:32.178040 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:32.613773 (+435733us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:32.614284 (+   511us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:19:32.614361 (+    77us) write_op.cc:312] APPLY: finished
0709 13:19:32.615000 (+   639us) log.cc:844] Serialized 164 byte log entry
0709 13:19:33.250619 (+635619us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8de9f820ac 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b
0709 13:19:33.504688 (+254069us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:33.564338 (+ 59650us) write_op.cc:454] Released schema lock
0709 13:19:33.605948 (+ 41610us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:33.734155 (+128207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:33.739238 (+  5083us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3837451,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":224268,"apply.run_cpu_time_us":68393,"apply.run_wall_time_us":2818517,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79403,"num_ops":18,"prepare.queue_time_us":959276,"prepare.run_cpu_time_us":8347,"prepare.run_wall_time_us":192318,"raft.queue_time_us":2232,"raft.run_cpu_time_us":28495,"raft.run_wall_time_us":251836,"replication_time_us":56386,"spinlock_wait_cycles":32823424,"thread_start_us":2462314,"threads_started":5,"wal-append.queue_time_us":921312,"wal-append.run_cpu_time_us":6547,"wal-append.run_wall_time_us":2127252}]]}
I20260709 13:19:39.670059 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:39.672221 14296 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:39.684938 14370 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:39.653417 19027 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.701223 14123 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:39.717730 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:39.673195 14369 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
W20260709 13:19:39.675369 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 216715us
W20260709 13:19:39.654036 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 93329.3us
I20260709 13:19:39.677424 19214 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 13:19:39.719835 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 256678us
I20260709 13:19:39.686784 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:39.732537 14225 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:39.734316 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:39.687397 19239 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:39.678674 19071 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:19:39.689159 19257 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:39.743299 14221 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:39.690760 19271 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.691432 14228 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:39.691921 19087 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:39.777851 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57350.9us
W20260709 13:19:39.696743 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 236356us
I20260709 13:19:39.779467 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:39.696638 19292 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:39.696969 19205 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:39.698824 19258 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:39.684299 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:39.791965 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:39.732887 14867 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:39.792508 14901 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:39.743644 14123 catalog_manager.cc:5697] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 2 to 9, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 9 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:39.741137 19094 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:39.792625 14894 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.689944 19231 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.776055 19160 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.800244 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:39.748085 19257 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:39.777920 19239 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:39.810875 14901 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 12: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:39.801448 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68640.5us
I20260709 13:19:39.817411 14900 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:39.777958 19087 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:39.819875 19087 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.823963 19257 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:39.802193 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:39.825253 19257 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.791318 19197 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:19:39.826727 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:39.826992 19197 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:39.827382 19197 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:39.827768 19197 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.828451 19022 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:39.828998 19022 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:39.829919 19022 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.830051 14123 catalog_manager.cc:5697] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.832248 14123 catalog_manager.cc:5697] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:39.794799 19094 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.794781 19185 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:39.834129 19094 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:39.834551 19185 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.810292 19231 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.836735 19185 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:39.740376 19027 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:19:39.833473 19274 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:19:39.837972 19187 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:39.838415 19239 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:39.839373 14864 leader_election.cc:400] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9.
I20260709 13:19:39.839932 14864 leader_election.cc:403] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:19:39.798173 19205 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:39.842933 14901 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:39.846000 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:39.847213 14864 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:39.852133 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.853370 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:39.854418 14901 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:39.839171 19027 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:39.855297 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:39.858858 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:39.859258 14900 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:39.859495 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:39.855381 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:39.860113 14892 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:39.860456 14894 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:39.860724 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:39.837625 19231 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:39.838498 19187 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.803311 19108 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:39.864620 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.842963 19291 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:39.874464 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 388855us
I20260709 13:19:39.876063 14901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:39.841744 19302 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:39.880004 14267 connection.cc:256] RPC call timeout handler was delayed by -1.0855043139999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
W20260709 13:19:39.857769 19250 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:39.850282 19102 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9.
I20260709 13:19:39.858767 19274 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:39.905179 14224 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:39.905285 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.906057 14377 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:39.862291 19263 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:39.881868 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:39.911484 14369 raft_consensus.cc:2368] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13.
I20260709 13:19:39.882684 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:39.912586 14370 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:39.883780 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:39.884924 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.914278 14376 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
W20260709 13:19:39.888528 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.916733 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:39.893172 14892 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:19:39.897404 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:39.902515 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:39.858117 19293 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:39.877242 14123 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 5 to 7, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 7 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:39.909876 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.919533 14226 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:39.920046 14226 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:39.924682 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.925441 14302 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:39.926337 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:39.910015 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 173499us
I20260709 13:19:39.874643 19187 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:39.914552 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:39.928507 14297 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:39.929561 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:39.876567 19027 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:39.879629 19199 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:39.878396 19235 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.843142 19160 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.931555 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:39.874987 19108 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:39.940086 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.943523 14342 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:39.944696 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:39.944624 14123 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 7 to 8, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 8 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:39.898456 19271 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.946453 14228 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:39.957553 14304 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:39.920984 14226 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.973693 14226 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:39.973863 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.974525 14376 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:19:39.967700 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:39.948196 18872 consensus_meta.cc:287] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.120s	user 0.007s	sys 0.007s
I20260709 13:19:39.985622 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:39.921528 18857 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:19:39.989243 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.896106 19291 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.945135 19302 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:39.998078 14901 raft_consensus.cc:606] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:40.005764 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 321503us
I20260709 13:19:40.007489 14193 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:39.983319 19290 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:40.004107 14901 raft_consensus.cc:614] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:40.004164 14374 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:40.014698 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:39.968647 19235 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.983192 19199 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:39.984844 19293 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:39.931807 19263 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.020144 14123 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 5 to 6, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 6 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:39.945933 19193 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:19:39.994764 18857 consensus_queue.cc:1243] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:40.029665 14369 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:39.940743 19205 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:39.958693 19260 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:19:39.984061 19294 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:19:39.989748 18872 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.030906 19293 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.988026 19271 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.041572 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:40.035379 14226 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:40.041509 14123 catalog_manager.cc:5697] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 7 to 8, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 8 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:19:40.040421 14376 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:40.012550 19282 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:19:39.994352 18837 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:19:40.030721 14372 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:40.045848 19231 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:40.075671 14892 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:40.070318 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.077477 14864 leader_election.cc:400] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13.
I20260709 13:19:40.077809 14864 leader_election.cc:403] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:40.078783 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:40.055521 19237 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:40.052184 19293 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.076036 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.052405 19185 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:40.085549 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:40.069613 19299 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:19:40.094375 19193 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:40.094811 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:40.095021 19193 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:40.095680 19193 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.097246 19292 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.103433 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:40.108002 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 178537us
I20260709 13:19:40.069434 19173 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:40.081527 19160 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:40.037945 19027 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.088589 19105 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13.
I20260709 13:19:40.087109 19296 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.127876 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.170910 14123 catalog_manager.cc:5697] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.111647 19318 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 13:19:40.179610 19313 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:19:40.180172 19301 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:40.181222 19312 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:19:40.118518 14192 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.075314 19199 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.083639 19134 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:40.093852 19185 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:40.162922 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 151824us
I20260709 13:19:40.107553 19314 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:40.178182 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50407.6us
I20260709 13:19:40.252404 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:40.180825 14123 catalog_manager.cc:5697] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:40.183619 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 65155.9us
I20260709 13:19:40.084151 19231 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.093441 19237 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:40.397058 14370 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 8.
I20260709 13:19:40.087039 19302 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.111840 19102 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:40.182672 19284 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.006s
W20260709 13:19:40.182348 19311 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:19:40.161387 19173 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.169921 19296 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.262441 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.310029 14221 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:40.182324 19318 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:40.257513 19305 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 13:19:40.314606 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 238637us
W20260709 13:19:40.406757 19319 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:19:40.432915 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:40.346976 19197 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.001s
W20260709 13:19:40.348033 19224 consensus_meta.cc:287] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.838s	user 0.006s	sys 0.005s
I20260709 13:19:40.315996 14224 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:40.434134 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.351905 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:40.435685 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:40.436487 14228 raft_consensus.cc:2410] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:40.436393 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:40.109565 19127 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:40.353268 14220 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:40.350701 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:40.363200 14123 catalog_manager.cc:5697] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 4 to 8, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 8 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:40.371304 19316 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:19:40.165907 19193 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.445834 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:40.446043 19231 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:40.447625 19193 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.373706 19271 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.376791 19108 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.448101 14220 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:19:40.378299 18872 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:40.257161 19134 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.410560 19296 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.455613 19134 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:40.444442 19223 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 13:19:40.456810 19087 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.000s
I20260709 13:19:40.409584 19291 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:40.409037 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 146704us
I20260709 13:19:40.409387 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:40.274866 19094 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.356428 19314 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.397339 19237 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.408288 19102 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.345369 19327 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:40.438318 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:40.460659 19194 consensus_meta.cc:287] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.905s	user 0.011s	sys 0.003s
I20260709 13:19:40.438172 19212 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:40.444449 19320 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:19:40.444689 19318 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:40.445060 19272 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.913s	user 0.011s	sys 0.001s
I20260709 13:19:40.444587 19218 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:40.440409 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:40.453130 14220 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:40.395083 19185 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:40.466107 19314 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:40.460906 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:40.462605 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:40.463912 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:40.428992 19027 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.466773 19134 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:19:40.469084 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:40.491065 19257 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.001s
I20260709 13:19:40.440074 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:40.477712 19187 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.005s
I20260709 13:19:40.478075 19102 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.479305 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2314) took 1799 ms. Trace:
I20260709 13:19:40.509181 19187 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.510027 14226 rpcz_store.cc:276] 0709 13:19:38.680161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.680315 (+   154us) service_pool.cc:224] Handling call
0709 13:19:38.692482 (+ 12167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.057506 (+1365024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.479040 (+421534us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540026ded4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:40.479237 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2821507456}
I20260709 13:19:40.470798 14224 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:40.457242 19087 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.462955 19193 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.457957 19263 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:40.498457 14901 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
I20260709 13:19:40.498507 14376 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
W20260709 13:19:40.499593 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59248.1us
I20260709 13:19:40.503556 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:40.438284 19302 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:19:40.469383 19127 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:40.507756 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2304) took 2806 ms. Trace:
I20260709 13:19:40.448881 19197 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.520364 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:40.501093 19335 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.508276 19327 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:40.516880 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:40.516804 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:40.523308 14229 raft_consensus.cc:2410] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:40.512569 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:40.516031 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:40.521150 14227 rpcz_store.cc:276] 0709 13:19:37.700872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.771886 (+ 71014us) service_pool.cc:224] Handling call
0709 13:19:37.772648 (+   762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.789569 (+ 16921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.789614 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:37.809032 (+ 19418us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.346451 (+1537419us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b180033c880. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:19:39.803056 (+456605us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:39.803113 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.803233 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.495365 (+692132us) raft_consensus.cc:1685] finished
0709 13:19:40.495387 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.507683 (+ 12296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":13816,"spinlock_wait_cycles":121694080,"thread_start_us":456368,"threads_started":1,"wal-append.queue_time_us":2097937}
I20260709 13:19:40.529668 14378 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.514420 19193 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.501530 19314 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.528488 14296 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:40.528625 14373 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:19:40.530023 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.532884 14901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:40.533507 14901 raft_consensus.cc:606] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.534008 14901 raft_consensus.cc:614] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:40.491530 19212 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.534945 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:40.535411 14228 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:40.535792 14228 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:40.536244 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:40.495256 19272 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.536517 14228 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.533483 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.518483 19027 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.557510 14225 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.607400 14228 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.607427 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:40.608189 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 74771.2us
I20260709 13:19:40.602838 14378 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:19:40.609090 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:40.521684 19102 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:40.652715 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:40.534587 19193 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.556694 19187 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:19:40.538305 19257 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:40.649457 19094 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.659067 19336 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:40.535167 19222 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:40.652578 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 43558.3us
W20260709 13:19:40.560839 19325 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:19:40.653437 19341 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:40.555260 19185 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:40.656276 19212 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.553678 19173 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:40.538398 19334 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.537293 19223 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.135s
I20260709 13:19:40.677613 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.609390 19224 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.605957 19291 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:40.679196 14898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:40.710556 14898 raft_consensus.cc:606] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:40.710188 19291 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.710908 14898 raft_consensus.cc:614] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:40.712316 19087 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.712613 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:19:40.538046 19237 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.669171 19215 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.673883 19274 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:40.714512 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:40.714910 19274 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:40.715534 19291 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:40.715863 19274 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.717180 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:40.718019 19334 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.721261 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:40.723474 14193 leader_election.cc:336] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Timed out: RequestConsensusVote RPC to 127.12.208.130:44127 timed out after 1.829s (SENT)
I20260709 13:19:40.723839 14228 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:19:40.673130 19257 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:40.682878 19222 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:40.685384 19336 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:40.732111 19322 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
I20260709 13:19:40.733122 19336 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:40.734586 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1178) took 1130 ms. Trace:
W20260709 13:19:40.735450 19333 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.365s	user 0.004s	sys 0.004s
I20260709 13:19:40.736014 19237 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.736536 19237 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.688649 19185 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.709183 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:40.723965 14193 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:40.705061 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.724639 14228 pending_rounds.cc:85] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 6
I20260709 13:19:40.741374 14228 pending_rounds.cc:107] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:19:40.707127 19197 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.734968 14896 rpcz_store.cc:276] 0709 13:19:39.604717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.606258 (+  1541us) service_pool.cc:224] Handling call
0709 13:19:39.606532 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.701003 (+ 94471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.701061 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.701674 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.905388 (+203714us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b1800400c00. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:19:40.080796 (+175408us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:40.080836 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.080900 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.734284 (+653384us) raft_consensus.cc:1685] finished
0709 13:19:40.734308 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.734527 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94027,"raft.queue_time_us":95173,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7144,"spinlock_wait_cycles":39225216,"thread_start_us":175225,"threads_started":1,"wal-append.queue_time_us":630856}
I20260709 13:19:40.546622 19318 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.726605 14225 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:40.742301 19215 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.560063 19127 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.724732 19027 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.729022 19257 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.751375 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:40.751698 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 46724.4us
I20260709 13:19:40.738742 19222 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.739476 19327 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.720182 19334 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:40.752887 19212 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.699635 19341 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:40.760701 19343 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:19:40.765105 14226 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:40.766806 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.768114 19296 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:40.770344 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.771142 19323 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.588s	user 0.000s	sys 0.003s
W20260709 13:19:40.804273 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 284350us
W20260709 13:19:40.775878 19330 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
I20260709 13:19:40.806546 19272 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:40.807967 19326 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.626s	user 0.003s	sys 0.000s
I20260709 13:19:40.750324 19185 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.809921 19223 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.810482 19223 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.812636 19223 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:40.756090 19215 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.814174 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1179) took 1209 ms. Trace:
I20260709 13:19:40.815704 19215 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:40.799223 19102 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:40.814689 14893 rpcz_store.cc:276] 0709 13:19:39.605067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.606171 (+  1104us) service_pool.cc:224] Handling call
0709 13:19:39.606533 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.778220 (+171687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.778266 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.778866 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.900610 (+121744us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b1800400de0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:19:40.068067 (+167457us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:40.068107 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.070797 (+  2690us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.807284 (+736487us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:40.813889 (+  6605us) raft_consensus.cc:1685] finished
0709 13:19:40.813924 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.814097 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182833,"raft.queue_time_us":179775,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":6337,"spinlock_wait_cycles":13412992,"thread_start_us":167271,"threads_started":1,"wal-append.queue_time_us":387264}
I20260709 13:19:40.816551 19102 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:40.817036 19102 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:40.821286 19293 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.001s
I20260709 13:19:40.821873 19293 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.785718 19291 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.750262 14228 raft_consensus.cc:2889] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:40.753022 19224 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.753494 19237 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.800999 19341 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.759418 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.828027 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:40.829136 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:40.837129 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:40.847069 14228 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:40.847143 14372 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.855319 14228 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:19:40.859073 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:40.859712 14220 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:40.861501 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 102161us
I20260709 13:19:40.861860 14372 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:40.862859 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:40.864918 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:40.870187 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:40.870975 14901 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:40.882697 14220 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:40.884532 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:40.889350 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:40.889976 14228 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.891639 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 908) took 1501 ms. Trace:
I20260709 13:19:40.892035 14303 rpcz_store.cc:276] 0709 13:19:39.390100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.390228 (+   128us) service_pool.cc:224] Handling call
0709 13:19:39.390500 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.584532 (+194032us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:39.844022 (+259490us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.845201 (+  1179us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.852496 (+  7295us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.852656 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.852699 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:39.852740 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.476658 (+623918us) spinlock_profiling.cc:243] Waited 8.46 ms on lock 0x7b4800241ed8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
0709 13:19:40.766529 (+289871us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b18004ec640. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f522 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:19:40.891422 (+124893us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000fd2d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:40.891468 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.891585 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6957,"prepare.queue_time_us":793822,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":2813,"raft.queue_time_us":1273,"raft.run_cpu_time_us":9860,"raft.run_wall_time_us":638671,"spinlock_wait_cycles":472705408,"thread_start_us":258987,"threads_started":1}
I20260709 13:19:40.839782 19291 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.897078 19291 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:40.839569 19334 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:19:40.874362 19237 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.870162 19212 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.887420 19196 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:40.874585 19224 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.901549 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:40.844569 19102 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.906879 14228 raft_consensus.cc:2410] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:40.912042 19196 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:40.914175 19196 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.924984 19296 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.928596 19102 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.934419 19293 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:40.909658 18872 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:19:40.935290 19235 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:40.935902 18872 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:40.936357 18872 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:40.937492 19332 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.568s	user 0.002s	sys 0.000s
I20260709 13:19:40.939445 19257 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.906407 19215 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:19:40.937196 18872 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.945554 18872 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:40.945696 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1198) took 1033 ms. Trace:
I20260709 13:19:40.946106 14369 rpcz_store.cc:276] 0709 13:19:39.911980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.916503 (+  4523us) service_pool.cc:224] Handling call
0709 13:19:40.945508 (+1029005us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540034a3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:40.945640 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242393472}
I20260709 13:19:40.948323 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:40.948907 14893 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.951403 19193 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.954124 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:40.954880 14898 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:40.955703 19222 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:40.957731 19348 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:19:40.959827 14372 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:19:40.937541 14295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2764) took 2044 ms (client timeout 1829 ms). Trace:
I20260709 13:19:40.961715 19291 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:40.962386 14295 rpcz_store.cc:269] 0709 13:19:38.893068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.070749 (+177681us) service_pool.cc:224] Handling call
0709 13:19:40.937336 (+1866587us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001f7a54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:40.937473 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2461062016}
I20260709 13:19:40.962699 19291 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.963919 19290 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:40.964201 14370 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:40.964840 19290 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.965386 19291 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:40.966503 19257 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:40.966960 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:40.967581 14372 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.958454 19222 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:40.971264 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:40.971798 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2867) took 1060 ms. Trace:
I20260709 13:19:40.972084 14369 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 9: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:40.972213 14296 rpcz_store.cc:276] 0709 13:19:39.911488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.912697 (+  1209us) service_pool.cc:224] Handling call
0709 13:19:39.913092 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.531695 (+618603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.971558 (+439863us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54000906d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:40.971738 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414780800}
I20260709 13:19:40.953583 19193 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.944000 19185 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:40.977654 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:40.960163 19314 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:40.978516 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:40.979830 14901 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:40.983117 14893 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:40.989656 19185 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.989950 19314 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:40.979975 19205 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:19:40.901616 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:41.041538 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 139834us
I20260709 13:19:41.053527 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.056938 14221 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:41.057192 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:19:41.045843 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 1.06009e+06us
I20260709 13:19:41.051841 14224 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:41.062039 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1198) took 1321 ms. Trace:
I20260709 13:19:41.043848 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:41.062602 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.062582 14222 rpcz_store.cc:276] 0709 13:19:39.740165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.740331 (+   166us) service_pool.cc:224] Handling call
0709 13:19:39.740670 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.740911 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:39.784802 (+ 43891us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.988728 (+203926us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.051697 (+1062969us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b18003b0560. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:41.061222 (+  9525us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:41.061331 (+   109us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:41.061435 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.061570 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.061829 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8770,"prepare.queue_time_us":50635,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":5637,"raft.queue_time_us":140192,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":9983,"spinlock_wait_cycles":6374528,"thread_start_us":198702,"threads_started":2}
I20260709 13:19:41.064937 14295 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:41.059957 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:41.068400 14301 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:41.068866 14301 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:41.070472 14301 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.072576 14301 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:41.080785 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 103662us
I20260709 13:19:41.081894 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:41.088095 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.090585 14341 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:41.092366 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.099997 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:41.092839 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:41.093945 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.101835 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:41.102535 14303 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:41.102713 14229 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.103897 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.104594 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.094784 14298 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:41.095840 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:41.097838 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.106420 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.107623 14297 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:41.108043 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.108778 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.105589 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.109561 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.109719 14300 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:41.111197 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.101526 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:41.114024 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 54335.9us
I20260709 13:19:41.133121 19372 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:41.138079 14901 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:41.141067 18872 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.141070 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:41.162165 19237 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.163064 19237 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.164018 18837 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:41.167289 19194 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.167956 18951 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:41.168383 19194 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.170183 19205 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.170495 19173 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:41.170991 19205 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.178170 19218 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.178655 19369 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:41.179466 19218 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.183079 14300 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:41.184429 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.186233 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.186858 19094 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:41.188241 19094 consensus_queue.cc:1243] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:41.192982 19027 raft_consensus.cc:2764] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:19:41.193801 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:41.186278 14302 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.180022 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:41.220515 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:41.225106 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:41.229933 14301 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:41.225138 14304 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:19:41.235395 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.235261 19087 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:19:41.217167 19071 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:41.237970 19071 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.238946 19218 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:41.239888 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.240551 14304 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:41.241494 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:41.242504 14304 raft_consensus.cc:2368] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14.
I20260709 13:19:41.243332 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.243641 19224 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:41.244242 19337 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.800s	user 0.003s	sys 0.001s
I20260709 13:19:41.244577 19291 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:41.245071 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.245689 19293 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:41.246224 19293 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.246578 19293 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:41.247519 14302 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:41.244539 19224 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.249926 19215 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:41.250588 19215 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:41.251394 19224 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:41.252007 19215 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.254349 19302 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.254990 19334 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:41.255082 19302 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.255759 14298 pending_rounds.cc:85] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 7
I20260709 13:19:41.256129 14298 pending_rounds.cc:107] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:19:41.237999 19222 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:41.256474 14298 raft_consensus.cc:2889] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:41.256915 19222 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.259230 19342 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:40.985056 19193 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.279s
I20260709 13:19:41.260108 19222 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:41.259871 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:41.268949 14229 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:41.263226 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:41.257493 19302 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:41.283898 19237 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:41.286201 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 172643us
W20260709 13:19:41.283375 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 169374us
I20260709 13:19:41.299525 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.287943 19205 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:41.331050 19302 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:41.335438 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 75865.9us
I20260709 13:19:41.335772 19302 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.338155 19223 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:41.338865 19223 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.339350 19223 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.340204 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:41.341732 19231 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:41.343094 19231 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:41.343612 19231 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:41.346630 19371 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.061s	user 0.001s	sys 0.001s
I20260709 13:19:41.346882 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.350463 19374 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:41.351655 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116837us
W20260709 13:19:41.331694 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 230305us
I20260709 13:19:41.347271 19302 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:41.367277 14193 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:41.368894 14193 leader_election.cc:400] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14.
I20260709 13:19:41.369362 19374 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.370437 19374 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.371414 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:41.372392 14369 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.373720 19374 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:41.376946 14303 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:19:41.382287 14342 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.384545 14342 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.385768 19127 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:41.387038 19336 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.285710 19291 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.391121 14193 leader_election.cc:403] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:41.407269 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:41.408417 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:41.409229 14370 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:41.411942 19370 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:19:41.413058 19239 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:41.413520 19194 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:41.416316 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 47764.2us
I20260709 13:19:41.420353 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:41.423529 14369 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:41.452050 19369 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:41.452797 19369 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:41.455423 19365 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 13:19:41.457990 19374 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:41.459008 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:41.459923 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:41.461071 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:41.462028 14375 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:41.463258 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:41.464210 14376 raft_consensus.cc:2368] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14.
I20260709 13:19:41.465147 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:41.428581 19027 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14.
I20260709 13:19:41.459949 14369 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:19:41.428192 19239 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:41.474152 14376 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:19:41.475428 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:41.475791 19239 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.480207 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:41.484383 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:41.485713 19237 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:41.487059 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:41.488467 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 48637.2us
I20260709 13:19:41.488862 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:41.475620 19071 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:41.489403 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:41.494021 14226 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:41.463310 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:41.458835 19374 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.504951 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:41.523088 14371 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.524078 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:41.526192 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:41.526963 14892 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.527526 14895 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:41.536862 14375 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
W20260709 13:19:41.538530 14372 consensus_meta.cc:287] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.006s
I20260709 13:19:41.539002 14372 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:41.558774 19378 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.559823 19378 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:41.560344 19336 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.560910 19336 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.560637 19378 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.561304 19336 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.564666 19374 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:41.592666 14220 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:19:41.601888 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.606757 19257 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.607012 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:41.607926 14227 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:41.607662 19257 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.609320 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:41.604888 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 115598us
I20260709 13:19:41.596663 19027 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:41.622872 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:41.605439 19222 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.598552 19231 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.611076 19194 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.653343 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.660307 14228 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:41.660444 19223 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.662540 14378 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:41.666466 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:41.667028 19231 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:41.667861 19231 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:41.668344 19231 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.668861 19231 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.670184 19027 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.672675 14370 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:41.662343 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:41.668419 19379 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:41.689013 14228 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:19:41.710536 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 84960.8us
I20260709 13:19:41.653432 19342 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:41.658221 19194 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:41.722479 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 55072.2us
I20260709 13:19:41.693058 18872 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:41.725741 14371 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:41.726069 14892 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:41.726735 19342 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.753096 19342 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:41.735992 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 73776.5us
W20260709 13:19:41.724783 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 101993us
I20260709 13:19:41.733428 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:41.755637 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.750509 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.713310 19257 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:41.739568 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:41.769378 18872 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:41.769948 18872 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:41.770428 18872 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.772747 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:41.773589 14225 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:41.778345 14897 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:19:41.780000 14192 leader_election.cc:400] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14.
I20260709 13:19:41.780448 18872 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.781222 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.739252 19378 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:41.782227 14898 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:41.781975 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:41.783344 14229 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:41.783866 18872 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:41.786067 19373 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.754472 19291 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:41.762077 19336 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.797334 19336 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:41.798612 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 48310.5us
I20260709 13:19:41.753846 19223 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:41.799762 19386 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:19:41.800347 19369 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.801836 19282 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:41.799806 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.745064 19194 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:41.725677 19239 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.809621 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:41.818488 14229 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.819506 19194 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:41.825768 18872 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:41.833323 14225 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:41.810360 19394 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:19:41.831250 19293 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.007s
I20260709 13:19:41.833324 18872 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:41.840054 18872 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:41.840826 14865 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.841212 19302 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:41.850878 19272 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:41.855719 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 74593.6us
I20260709 13:19:41.827597 19239 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:41.861763 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 149892us
I20260709 13:19:41.857551 19369 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:41.869743 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:41.873006 19375 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.529s	user 0.000s	sys 0.003s
I20260709 13:19:41.877736 14229 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:41.879199 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1205) took 1825 ms. Trace:
I20260709 13:19:41.879927 19334 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:41.864733 19222 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.881539 19222 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.879683 14377 rpcz_store.cc:276] 0709 13:19:40.054168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.054380 (+   212us) service_pool.cc:224] Handling call
0709 13:19:40.054718 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:40.055065 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:40.896263 (+841198us) spinlock_profiling.cc:243] Waited 950 us on lock 0x7b1800350ce0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:19:41.159003 (+262740us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.295937 (+136934us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:41.374137 (+ 78200us) log.cc:844] Serialized 26 byte log entry
0709 13:19:41.374319 (+   182us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:41.374727 (+   408us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.374961 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.375100 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.872253 (+497153us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:41.878765 (+  6512us) raft_consensus.cc:1685] finished
0709 13:19:41.878797 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.878983 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":640360,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":9324,"raft.queue_time_us":8848,"raft.run_cpu_time_us":525,"raft.run_wall_time_us":2332,"spinlock_wait_cycles":38512256,"thread_start_us":376788,"threads_started":2,"wal-append.queue_time_us":183991}
I20260709 13:19:41.885339 18872 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.849665 19293 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.889509 19173 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:41.891165 19173 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:41.892158 19173 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.887708 19336 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 13:19:41.895030 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54422.8us
I20260709 13:19:41.893695 19173 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:41.900753 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2868) took 1988 ms. Trace:
I20260709 13:19:41.901265 14299 rpcz_store.cc:276] 0709 13:19:39.911848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.913369 (+  1521us) service_pool.cc:224] Handling call
0709 13:19:39.913758 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:39.941963 (+ 28205us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:40.273409 (+331446us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.957191 (+683782us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:40.963580 (+  6389us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b180048e9e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8df0f6058f 00007f8de9f9f571 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd
0709 13:19:40.967715 (+  4135us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:40.969080 (+  1365us) log.cc:844] Serialized 52 byte log entry
0709 13:19:40.969230 (+   150us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:41.304999 (+335769us) log.cc:844] Serialized 14 byte log entry
0709 13:19:41.900153 (+595154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.900275 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.900364 (+    89us) raft_consensus.cc:1685] finished
0709 13:19:41.900382 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.900542 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":828229,"prepare.queue_time_us":417272,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":103,"raft.queue_time_us":271270,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":9765,"spinlock_wait_cycles":20482432,"thread_start_us":921435,"threads_started":3,"wal-append.queue_time_us":374374}
I20260709 13:19:41.903554 19011 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:41.904866 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 550093us
W20260709 13:19:41.907037 19381 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
W20260709 13:19:41.901407 19382 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.460s	user 0.002s	sys 0.000s
I20260709 13:19:41.910473 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.918215 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.919587 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:41.904929 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 529924us
I20260709 13:19:41.918015 18837 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:41.921521 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:41.923998 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:41.923614 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:41.925561 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:41.934005 19027 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:41.936239 18837 consensus_queue.cc:1243] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:41.945840 14298 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:41.909372 19011 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:19:41.954648 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:41.955462 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:41.953831 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 103366us
I20260709 13:19:41.955343 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:41.965763 19399 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:19:41.965896 19377 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:41.966621 19377 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:41.959861 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:41.968977 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 71834.7us
I20260709 13:19:41.938390 19302 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:19:41.973629 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:41.959816 19094 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:41.976300 19094 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:41.976966 14900 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:41.977464 19318 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:41.977370 19094 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.978098 19193 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:41.979071 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1203) took 1947 ms. Trace:
I20260709 13:19:41.979024 19193 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:41.979637 14374 rpcz_store.cc:276] 0709 13:19:40.031936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.032443 (+   507us) service_pool.cc:224] Handling call
0709 13:19:40.063629 (+ 31186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:40.070009 (+  6380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.070040 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:40.070580 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.399332 (+328752us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:40.399391 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.399491 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.243185 (+843694us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:41.292697 (+ 49512us) raft_consensus.cc:1685] finished
0709 13:19:41.292734 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.978716 (+685982us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b540028c650. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:41.978873 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1949,"raft.queue_time_us":7191,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5579,"spinlock_wait_cycles":81056896,"thread_start_us":306276,"threads_started":1,"wal-append.queue_time_us":361593}
I20260709 13:19:41.971668 19377 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:41.982779 19377 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:41.984417 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.977628 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:41.971992 19156 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:19:41.960143 19194 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:41.987457 19194 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:41.975816 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:41.988472 19194 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.989137 19224 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:41.989754 19224 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:41.991590 19224 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:41.992224 19027 raft_consensus.cc:2955] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Committing config change with OpId 10.8: config changed from index 3 to 8, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:41.985594 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:41.957129 19173 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.010668 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:42.011585 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 102634us
I20260709 13:19:42.016712 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:42.017225 14220 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:42.024235 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:42.017829 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:42.018560 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:42.047724 14301 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:42.015432 19394 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.052830 19222 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:42.090808 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73092.7us
W20260709 13:19:42.094162 19335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.010s	sys 0.043s
I20260709 13:19:42.094295 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:42.090529 19394 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:42.095785 19394 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.088042 19282 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:19:42.096782 19282 consensus_queue.cc:1243] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:19:42.094799 19335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.010s	sys 0.043s
I20260709 13:19:42.097980 19263 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:42.102162 19376 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:42.102828 19376 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:42.102916 19263 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:42.103982 19376 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:42.104087 19263 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:42.107048 19239 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:42.108067 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:42.034833 19369 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.071283 19272 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.026535 14295 raft_consensus.cc:2955] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 3 to 8, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:42.081744 18872 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:42.116233 19272 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:42.118885 19272 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:42.119590 14867 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:42.120999 19282 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:42.112768 19400 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:19:42.122974 19282 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:42.123772 19282 consensus_queue.cc:1243] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:42.127189 19231 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:42.044087 19196 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:42.085130 19215 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:42.024698 19342 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:42.112663 19239 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:42.114841 19369 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.169602 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:42.174257 14895 raft_consensus.cc:2410] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:19:42.146876 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:42.174917 14900 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:42.171030 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:42.172679 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:42.187561 14897 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 9: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:42.134604 19196 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:42.158613 19293 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:42.179994 19369 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.172402 19239 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:42.202076 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 56961.8us
I20260709 13:19:42.202527 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:42.211325 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 229040us
I20260709 13:19:42.220584 14220 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:42.221392 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 74028.5us
I20260709 13:19:42.221690 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:42.205989 19342 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:42.204116 19239 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:42.213961 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:42.225329 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 132255us
I20260709 13:19:42.226926 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:42.189911 19215 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:42.235719 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:42.251754 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:42.227798 19193 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:42.254061 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:42.254385 19193 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.254935 19193 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.255283 19193 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.232800 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:42.225401 19335 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.260807 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:42.267225 19402 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:19:42.269053 19263 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.269662 19263 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:42.270552 19231 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:42.267302 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:42.271945 19263 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:42.277499 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:42.305899 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 78783.3us
I20260709 13:19:42.306046 14341 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:42.270467 19405 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:19:42.316896 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 65631.4us
I20260709 13:19:42.227576 19272 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:19:42.313866 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:42.319025 14223 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.319479 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:42.321293 14301 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:42.325875 14226 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
W20260709 13:19:42.340057 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.317865 19402 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.260365 18872 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:19:42.348062 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:42.328583 19222 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:42.395279 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 163504us
I20260709 13:19:42.339766 19263 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.318574 19335 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:42.450886 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 174380us
I20260709 13:19:42.457665 18537 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:42.458395 19336 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:42.461881 19376 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:42.462584 19411 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:42.468483 19394 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:42.470111 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:42.267273 19196 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:42.499944 14223 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:42.503713 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:42.389987 19318 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.138s
I20260709 13:19:42.558499 14229 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:42.559846 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 67506.5us
I20260709 13:19:42.574827 14229 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: [10.12-12.13]
W20260709 13:19:42.576831 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.493127 19402 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:42.565683 19011 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:42.552016 19222 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:42.562903 19411 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:42.597656 14229 pending_rounds.cc:85] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 9
I20260709 13:19:42.599844 14229 pending_rounds.cc:107] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:19:42.581640 19196 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.600203 14229 raft_consensus.cc:2889] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:42.604394 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 106084us
I20260709 13:19:42.592134 19011 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.566264 19336 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:42.614931 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 264922us
I20260709 13:19:42.613054 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:42.616920 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:42.571246 19263 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:42.646225 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 176249us
W20260709 13:19:42.647200 14295 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.004s
W20260709 13:19:42.647687 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.626376 19011 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.617662 19342 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:42.642746 19071 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:42.649104 19215 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:42.676867 19218 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.697163 19218 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.681555 19071 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:42.646292 19222 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:42.678025 19376 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:42.714268 19071 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.656921 19231 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 13:19:42.699589 19418 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
W20260709 13:19:42.729120 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 75151.8us
W20260709 13:19:42.733193 19417 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 13:19:42.698511 19218 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.733378 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:42.732751 19423 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:19:42.765249 19436 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:42.734155 19335 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:42.790122 19282 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.009s	sys 0.009s
W20260709 13:19:42.807224 19383 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:19:42.777781 19394 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:42.837146 19027 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.735s	user 0.001s	sys 0.016s
I20260709 13:19:42.813933 19342 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:42.838702 19427 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:19:42.841323 19336 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:42.730041 19411 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:42.842909 19425 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:19:42.846431 19193 consensus_meta.cc:287] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.004s
I20260709 13:19:42.846936 19193 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:42.774257 19430 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:42.820456 19376 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:42.825237 19263 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:42.826241 19432 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:19:42.829352 19426 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 13:19:42.852733 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.855504 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.009s	sys 0.001s
I20260709 13:19:42.859334 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:42.859493 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.009s	sys 0.001s
W20260709 13:19:42.860217 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 596069us
I20260709 13:19:42.837571 19402 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:42.863359 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:42.860142 14895 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:42.871183 19434 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.849013 19335 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:42.841346 19222 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:42.878360 14894 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:19:42.878597 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 261724us
I20260709 13:19:42.882969 14225 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:42.886948 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:42.871735 19442 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:19:42.871829 19434 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:42.874751 19335 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:42.818835 19436 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:42.902256 19335 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.904968 14225 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:42.890350 19318 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:42.889331 19419 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:42.908653 14220 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.677s	user 0.001s	sys 0.010s
I20260709 13:19:42.909552 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:42.909816 14220 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
W20260709 13:19:42.913671 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 273876us
I20260709 13:19:42.910283 14374 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:42.864044 19430 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:42.942144 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55305.5us
I20260709 13:19:42.943612 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:42.906397 19222 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:42.963452 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:42.964075 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:42.957674 19415 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:19:42.967293 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:42.964172 14377 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:42.968971 14371 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
I20260709 13:19:42.970510 14220 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: [11.8-13.9]
W20260709 13:19:43.014144 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 54326us
I20260709 13:19:43.015995 14900 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:43.021523 19430 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:43.023202 14222 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:43.023738 19193 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:43.024452 19394 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:43.024494 14222 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:43.025072 19394 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.024770 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:43.026567 19434 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:43.027278 19394 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:43.029287 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:43.030115 19434 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:43.029835 19071 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.031970 19071 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:42.946408 19419 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.033937 19434 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:43.034673 19434 consensus_queue.cc:1243] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:19:43.019748 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 147791us
I20260709 13:19:43.035063 19430 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:43.035430 19419 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:43.035478 19430 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:42.952569 19318 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.033560 19218 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:43.036628 19430 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.037647 19318 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:43.038503 19430 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:43.045531 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.038563 19218 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:43.052541 19218 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.053171 19218 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.055725 19218 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:43.063334 14377 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:43.077898 19327 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:43.095207 19422 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.463s	user 0.003s	sys 0.000s
I20260709 13:19:43.096482 19341 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:43.096954 19341 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:43.097764 19341 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.099251 19341 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:43.111147 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.114105 19102 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:43.114843 19102 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.117645 19436 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:43.118770 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:43.120759 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 395825us
I20260709 13:19:43.120990 19160 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:43.121903 14267 leader_election.cc:400] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11.
W20260709 13:19:43.111223 19239 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.003s
I20260709 13:19:43.124326 19239 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:43.126030 19156 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:43.127051 19156 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:43.127399 19156 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:43.128444 14899 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:19:43.128968 14901 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:19:43.129743 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:43.129987 19374 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:43.130380 14301 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:43.131176 14378 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:43.013101 19222 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:43.130725 19374 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:43.132097 19222 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:43.132618 19222 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.128434 19156 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.119063 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2790) took 1108 ms. Trace:
I20260709 13:19:43.134138 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.154920 14301 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:43.155498 14900 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:43.155660 19156 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.156172 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.157441 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:43.154405 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:43.160596 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.119926 14221 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:43.164317 14227 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:43.166697 14371 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:43.162359 14295 rpcz_store.cc:276] 0709 13:19:42.010391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.014234 (+  3843us) service_pool.cc:224] Handling call
0709 13:19:42.024476 (+ 10242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.026399 (+  1923us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:42.647815 (+621416us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.684703 (+ 36888us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.111894 (+427191us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b1800338c80. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8df0f6058f 00007f8de9f9f571 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd
0709 13:19:43.118500 (+  6606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.118563 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:43.118621 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.118686 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.118810 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":451961,"prepare.queue_time_us":35164,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":435287,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":5483,"spinlock_wait_cycles":6932736}
I20260709 13:19:43.174332 14377 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:43.178243 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.176369 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:19:43.227838 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.231099 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:43.234951 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58679.9us
I20260709 13:19:43.235735 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:43.236523 14370 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:43.242448 14369 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:19:43.244127 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 70735.8us
I20260709 13:19:43.245884 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.162163 19374 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:43.248960 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.253904 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:43.255251 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.170329 19160 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:43.251093 19436 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:43.278363 19102 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:43.252600 19193 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.306844 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:43.345578 14300 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.256156 19334 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:43.312311 14296 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:43.314320 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.318768 14299 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:43.347031 14299 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:43.257411 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 78263us
I20260709 13:19:43.349758 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.350296 14896 raft_consensus.cc:2410] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:19:43.246879 19094 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.245826 19218 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:43.353217 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:43.355773 19436 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:43.355957 19334 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:43.323871 19011 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.002s
I20260709 13:19:43.358915 19239 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:43.358501 14900 raft_consensus.cc:2955] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 3 to 8, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:43.366245 14299 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.360939 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:43.361761 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:43.363227 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.378208 14377 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.363106 19193 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.364698 14371 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:43.350461 14901 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
W20260709 13:19:43.342033 19369 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.130s	user 0.012s	sys 0.001s
I20260709 13:19:43.369261 14298 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:43.377233 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:43.382584 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.382872 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:43.401134 14299 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:43.403980 14267 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.937s (SENT) [suppressed 34 similar messages]
I20260709 13:19:43.364293 19027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53822 (request call id 103) took 18029 ms. Trace:
I20260709 13:19:43.406165 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:43.406313 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.406858 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:43.406165 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:43.415858 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.415634 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.421510 14901 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:43.413764 14376 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
W20260709 13:19:43.426295 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49131.8us
I20260709 13:19:43.427299 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:43.427726 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:43.426504 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:43.429307 14369 raft_consensus.cc:2368] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 15.
I20260709 13:19:43.431820 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:43.433161 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.372716 19094 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.445261 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:43.446312 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:43.446519 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 421767us
I20260709 13:19:43.343184 19160 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:43.450641 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.463558 14372 pending_rounds.cc:85] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 3
I20260709 13:19:43.464069 14372 pending_rounds.cc:107] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:43.464365 14372 raft_consensus.cc:2889] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:43.465221 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:43.445060 19452 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:19:43.382853 19011 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.412346 19302 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:19:43.453047 19239 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.476258 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:43.408792 19369 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.442260 19293 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:43.409044 19218 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:43.478545 14302 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:43.445713 19173 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:43.484550 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:43.485705 19456 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:19:43.519276 14300 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:43.494108 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:43.496199 19160 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:43.498919 19196 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.894s	user 0.010s	sys 0.002s
I20260709 13:19:43.499359 19094 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:43.499614 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:43.500888 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:43.529711 14369 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 10: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:43.471530 19334 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.504185 18837 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:43.506922 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:43.508592 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:43.473903 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 69971us
I20260709 13:19:43.519691 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:43.523607 19443 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:43.524544 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:43.527227 14304 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:19:43.530069 14376 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:43.534826 14898 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.543047 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:43.520860 19457 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:19:43.542338 14373 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:43.526777 19428 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.557564 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.575160 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.560266 18837 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:43.560675 19369 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:43.561352 19218 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:43.562556 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.563089 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:43.563727 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.551658 19342 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:43.564617 19443 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:43.564960 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.565964 18872 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.568418 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:43.569701 14221 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:43.574195 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:43.575488 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:43.575992 14895 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:43.539021 19223 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:43.576433 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:43.611905 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:43.612663 18872 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.613272 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:43.586290 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 233180us
I20260709 13:19:43.614743 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:43.614982 18872 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:43.410176 19027 rpcz_store.cc:276] 0709 13:19:25.219976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.221064 (+  1088us) service_pool.cc:224] Handling call
0709 13:19:25.350963 (+129899us) log.cc:844] Serialized 508 byte log entry
0709 13:19:26.904333 (+1553370us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b58003005d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff6090 00007f8decfe643c 00007f8decfecd53 00007f8decfeccd9 00007f8decfecc69 00007f8decfecc31 00007f8decfebdfd 000000000038f354 000000000038f199 00007f8de9f9f475 00007f8de9fa17c1
0709 13:19:43.238062 (+16333729us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112819,"raft.queue_time_us":1067961,"raft.run_cpu_time_us":2770,"raft.run_wall_time_us":846175,"spinlock_wait_cycles":111869824,"thread_start_us":648798,"threads_started":2}
I20260709 13:19:43.616991 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:43.617520 19318 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:43.617980 19215 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:43.618871 19318 consensus_queue.cc:1059] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:43.619735 19318 consensus_queue.cc:1243] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:43.620232 19318 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:43.620373 19215 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:43.620682 19318 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:43.620894 19215 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:43.621233 19318 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:43.583940 14299 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:19:43.592401 19443 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:43.590833 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:43.630024 14227 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:43.593387 19369 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:43.593956 14376 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:43.595319 19237 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:43.597855 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:43.722537 14374 raft_consensus.cc:2368] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15.
I20260709 13:19:43.598214 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:43.598913 19194 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:43.599499 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:43.759832 14225 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.600481 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:43.601559 19193 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:43.602921 19011 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:43.602984 19102 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:43.603834 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:43.604545 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:43.832412 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.520018 19372 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:19:43.606328 14377 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:43.585345 19428 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.585043 19205 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:19:43.622246 14299 pending_rounds.cc:85] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 10
I20260709 13:19:43.847591 14299 pending_rounds.cc:107] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:19:43.847890 14299 raft_consensus.cc:2889] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:43.592875 19459 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:19:43.636085 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.642762 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:43.682289 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 49294.9us
I20260709 13:19:43.726981 19223 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:43.837241 19335 consensus_meta.cc:287] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.924s	user 0.013s	sys 0.000s
W20260709 13:19:43.611856 19430 consensus_meta.cc:287] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.001s
I20260709 13:19:43.762714 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.588661 19442 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.255s
W20260709 13:19:43.589464 19435 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.694s	user 0.004s	sys 0.001s
W20260709 13:19:43.826797 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.481649 19436 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:43.579876 18837 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:43.556576 19196 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.173s
I20260709 13:19:43.837720 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:43.896212 14228 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.589138 19342 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:43.632285 19443 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
I20260709 13:19:43.843032 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.623826 19222 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:43.647861 19369 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:43.830140 19160 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.855356 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.826805 19327 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.827426 19413 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.831358 19302 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:43.631639 19215 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.884461 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:43.915320 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.831694 19460 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:43.883065 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:43.890781 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:43.918262 14892 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.844702 19237 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.883404 19223 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.905153 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:43.906827 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.908375 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:43.718794 14898 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:19:43.851317 14896 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:43.916695 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:43.892254 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:43.903101 19342 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.920010 14224 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:43.849057 19156 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:43.889544 19335 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.951718 14374 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:43.908259 18872 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:43.895102 18837 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:43.951035 14894 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:43.951880 14298 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:43.963811 14225 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:19:43.972085 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:44.007077 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:44.018920 14299 raft_consensus.cc:1813] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Handling vote request from an unknown peer 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:44.019723 14299 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:43.910457 19369 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:44.032058 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:44.052429 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1159) took 1166 ms. Trace:
I20260709 13:19:44.016727 14222 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:44.058218 14296 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:19:44.058753 14296 pending_rounds.cc:85] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 12
I20260709 13:19:44.059037 14296 pending_rounds.cc:107] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:19:44.059321 14296 raft_consensus.cc:2889] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.038159 14114 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8c137013238f4b1dbae260e32cb316dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:19:43.917230 19327 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:44.081305 19470 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:19:43.964406 19156 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:44.008175 19215 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.917734 19302 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:44.140751 19302 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:44.144007 19449 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.144780 19449 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:43.917778 19413 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:44.146744 19438 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:44.148274 19413 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:44.150681 14226 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:44.084441 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 936) took 1845 ms. Trace:
I20260709 13:19:44.091763 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:44.153986 14892 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:44.092832 19237 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:44.095904 19372 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:44.106050 18872 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:44.117563 18837 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.951319 19293 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260709 13:19:44.120460 19223 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:43.917268 19160 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:44.006788 19224 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:44.125761 14375 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:44.127921 19335 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:43.950676 19460 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:44.053021 14893 rpcz_store.cc:276] 0709 13:19:42.850606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.857141 (+  6535us) service_pool.cc:224] Handling call
0709 13:19:42.877834 (+ 20693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.879378 (+  1544us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:42.879411 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.903160 (+ 23749us) log.cc:844] Serialized 26 byte log entry
0709 13:19:43.018720 (+115560us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:43.018769 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.018848 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.016330 (+997482us) raft_consensus.cc:1685] finished
0709 13:19:44.016351 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.016482 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5412,"raft.queue_time_us":24690,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4345,"thread_start_us":64892,"threads_started":1,"wal-append.queue_time_us":519223}
W20260709 13:19:44.083722 14114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 180208us
W20260709 13:19:44.174863 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 332483us
I20260709 13:19:44.153049 14303 rpcz_store.cc:276] 0709 13:19:42.239031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.239255 (+   224us) service_pool.cc:224] Handling call
0709 13:19:42.256361 (+ 17106us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:42.259471 (+  3110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.259501 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:42.318286 (+ 58785us) log.cc:844] Serialized 52 byte log entry
0709 13:19:42.598553 (+280267us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:42.598616 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.599444 (+   828us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.083267 (+483823us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b4800241ed8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
0709 13:19:43.570490 (+487223us) spinlock_profiling.cc:243] Waited 948 us on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:44.084130 (+513640us) raft_consensus.cc:1685] finished
0709 13:19:44.084161 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.084365 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38329,"raft.queue_time_us":3111,"raft.run_cpu_time_us":4008,"raft.run_wall_time_us":821553,"spinlock_wait_cycles":19487744,"thread_start_us":197660,"threads_started":1,"wal-append.queue_time_us":532609}
I20260709 13:19:44.190327 14377 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:44.083122 19327 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:44.083214 19156 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:44.405860 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.413635 14228 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 13:19:44.424245 19491 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:44.424744 14228 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:44.424954 19491 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:44.361482 19484 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:19:44.231132 14296 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:19:44.191532 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.070s	sys 0.118s
W20260709 13:19:44.428133 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.073s	sys 0.130s
W20260709 13:19:44.428442 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 907263us
W20260709 13:19:44.235948 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 337055us
W20260709 13:19:44.185856 14267 connection.cc:256] RPC call timeout handler was delayed by -2.071461958999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:19:44.441216 14267 connection.cc:256] RPC call timeout handler was delayed by -2.0003619589999744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 13:19:44.441677 14267 connection.cc:256] RPC call timeout handler was delayed by -1.8464619589999529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 13:19:44.442103 14267 connection.cc:256] RPC call timeout handler was delayed by -1.8419619589999456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 13:19:44.442551 14267 connection.cc:256] RPC call timeout handler was delayed by -1.0076619589999609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29340000000000005s for a response
W20260709 13:19:44.286886 19239 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.000s
I20260709 13:19:44.445912 14303 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:19:44.447182 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 415189us
I20260709 13:19:44.413323 19222 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:44.437752 19419 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:44.432928 19443 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.005s	sys 0.010s
I20260709 13:19:44.449505 14298 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:44.459254 14298 pending_rounds.cc:85] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 5
I20260709 13:19:44.459568 14298 pending_rounds.cc:107] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:19:44.459820 14298 raft_consensus.cc:2889] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.183058 19428 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:44.455186 14377 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:19:44.457129 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:44.462177 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:44.437974 19327 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:44.442279 18872 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:44.493950 14375 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:44.495515 14377 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:44.438503 19377 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:19:44.449921 19239 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:44.499035 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.501268 14221 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:44.503180 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2566) took 1008 ms. Trace:
I20260709 13:19:44.509936 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:44.442705 19224 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:44.506597 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:44.456969 19413 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:44.493165 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:44.523494 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.523979 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.459185 19443 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.005s	sys 0.010s
I20260709 13:19:44.493224 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:44.510156 14375 rpcz_store.cc:276] 0709 13:19:43.494634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.493378 (+998744us) service_pool.cc:224] Handling call
0709 13:19:44.493724 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.502773 (+  9049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.503097 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:44.456712 19027 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:44.510970 14303 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:44.521349 14892 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.447242 19011 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:19:44.465564 19156 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:44.535730 19443 consensus_queue.cc:1243] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:44.536585 14377 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:44.541923 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1234) took 1026 ms. Trace:
W20260709 13:19:44.542881 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49763.4us
I20260709 13:19:44.543574 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:44.542390 14377 rpcz_store.cc:276] 0709 13:19:43.515633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.536060 (+1020427us) service_pool.cc:224] Handling call
0709 13:19:44.536394 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.541628 (+  5234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.541864 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:44.536480 19239 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.539682 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2910) took 1176 ms. Trace:
I20260709 13:19:44.547310 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:44.549278 14374 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:19:44.552893 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2569) took 1057 ms. Trace:
I20260709 13:19:44.552426 14299 rpcz_store.cc:276] 0709 13:19:43.362986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.020476 (+657490us) service_pool.cc:224] Handling call
0709 13:19:44.056345 (+ 35869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.056618 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:44.078233 (+ 21615us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.537491 (+459258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:44.537546 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:44.537592 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.537668 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.539605 (+  1937us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22750,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"thread_start_us":403910,"threads_started":2}
W20260709 13:19:44.584488 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 132601us
W20260709 13:19:44.589046 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45540.9us
I20260709 13:19:44.474156 19419 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:44.516093 19327 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:44.598536 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51321.6us
I20260709 13:19:44.189476 19372 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:44.536677 19486 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.228s
I20260709 13:19:45.074513 14375 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: [10.11-12.12]
I20260709 13:19:44.600055 14342 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:45.076721 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2369) took 1504 ms. Trace:
W20260709 13:19:45.076974 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 476958us
W20260709 13:19:44.606132 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.614773 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:45.035527 14220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.006s	sys 0.007s
W20260709 13:19:45.079901 14220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.006s	sys 0.007s
I20260709 13:19:44.553592 14374 rpcz_store.cc:276] 0709 13:19:43.495482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.853804 (+358322us) service_pool.cc:224] Handling call
0709 13:19:44.552827 (+699023us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:44.599565 14377 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:45.077195 14375 rpcz_store.cc:276] 0709 13:19:43.572495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.547726 (+975231us) service_pool.cc:224] Handling call
0709 13:19:45.071868 (+524142us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:45.076409 (+  4541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.076658 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:45.081732 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2368) took 1509 ms. Trace:
I20260709 13:19:45.082000 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1171) took 1177 ms. Trace:
I20260709 13:19:45.082383 14377 rpcz_store.cc:276] 0709 13:19:43.572210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.544471 (+972261us) service_pool.cc:224] Handling call
0709 13:19:44.599356 (+ 54885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.081437 (+482081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.081665 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:44.634698 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:45.084776 14378 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.165s	user 0.015s	sys 0.002s
I20260709 13:19:45.085253 14378 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:44.610562 14892 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
W20260709 13:19:45.072687 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.075519 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:45.090040 14378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2366) took 1518 ms (client timeout 1931 ms). Trace:
I20260709 13:19:44.536514 19293 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.104265 14375 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:45.100970 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2737) took 1501 ms. Trace:
W20260709 13:19:45.104646 14193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.004s	sys 0.011s
W20260709 13:19:45.106921 14193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.004s	sys 0.011s
W20260709 13:19:45.098507 14378 rpcz_store.cc:269] 0709 13:19:43.571567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.877247 (+305680us) service_pool.cc:224] Handling call
0709 13:19:45.089938 (+1212691us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:45.110401 14304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.000s	sys 0.016s
I20260709 13:19:45.082577 14895 rpcz_store.cc:276] 0709 13:19:43.904314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.904456 (+   142us) service_pool.cc:224] Handling call
0709 13:19:43.915042 (+ 10586us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:43.922375 (+  7333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.922412 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:44.039188 (+116776us) log.cc:844] Serialized 52 byte log entry
0709 13:19:44.422582 (+383394us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:44.422628 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.422706 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.764738 (+342032us) raft_consensus.cc:1685] finished
0709 13:19:44.764773 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.081919 (+317146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35856,"raft.queue_time_us":167,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":50453,"thread_start_us":295453,"threads_started":1,"wal-append.queue_time_us":620860}
I20260709 13:19:45.111322 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2371) took 1538 ms. Trace:
I20260709 13:19:45.111855 14375 rpcz_store.cc:276] 0709 13:19:43.573048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.103722 (+1530674us) service_pool.cc:224] Handling call
0709 13:19:45.104085 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.111042 (+  6957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.111268 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:44.629597 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:45.113319 14375 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:45.118733 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2375) took 1518 ms. Trace:
I20260709 13:19:45.119215 14375 rpcz_store.cc:276] 0709 13:19:43.600621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.112832 (+1512211us) service_pool.cc:224] Handling call
0709 13:19:45.113138 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.118364 (+  5226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.118674 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:45.120936 14374 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:44.704766 19318 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.083s	user 0.008s	sys 0.003s
I20260709 13:19:45.120936 14375 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:19:44.699859 19215 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.002s
W20260709 13:19:44.707459 19500 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:45.259899 14221 raft_consensus.cc:2410] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:19:45.264103 14192 connection.cc:256] RPC call timeout handler was delayed by -1.0928039989998979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
I20260709 13:19:45.126546 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2372) took 1553 ms. Trace:
I20260709 13:19:45.266137 14377 rpcz_store.cc:276] 0709 13:19:43.573359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.101958 (+1528599us) service_pool.cc:224] Handling call
0709 13:19:45.126015 (+ 24057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.126205 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.126232 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.126278 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:45.126313 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.126371 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.126490 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:45.128090 14369 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:45.267908 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2370) took 1695 ms. Trace:
I20260709 13:19:44.598670 18872 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:44.751441 19369 consensus_meta.cc:287] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.003s
I20260709 13:19:44.559298 19495 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:44.548928 19413 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:44.614353 19482 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:44.635005 19237 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:45.156600 14370 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:45.276983 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:45.483090 14892 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:45.086555 19011 consensus_queue.cc:1243] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:19:45.493235 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.494179 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.268321 14369 rpcz_store.cc:276] 0709 13:19:43.572790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.101518 (+1528728us) service_pool.cc:224] Handling call
0709 13:19:45.127856 (+ 26338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.267560 (+139704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.267837 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:44.707935 19160 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:44.614826 19327 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:45.071600 19449 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:45.585470 14344 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.038s	sys 0.054s
W20260709 13:19:45.588066 14344 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.038s	sys 0.056s
I20260709 13:19:44.615242 19491 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:45.270294 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2376) took 1520 ms. Trace:
I20260709 13:19:45.596055 14374 rpcz_store.cc:276] 0709 13:19:43.601038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.120119 (+1519081us) service_pool.cc:224] Handling call
0709 13:19:45.120794 (+   675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.121359 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.121543 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:45.099080 19419 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:45.118844 19222 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:45.485109 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2373) took 1911 ms. Trace:
I20260709 13:19:45.499958 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1235) took 1515 ms. Trace:
I20260709 13:19:45.604943 19327 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:45.605182 14375 rpcz_store.cc:276] 0709 13:19:43.606718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.120323 (+1513605us) service_pool.cc:224] Handling call
0709 13:19:45.120618 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.122150 (+  1532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.122350 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:45.256635 19486 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:44.598938 19027 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:45.491880 19334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.930s	user 0.047s	sys 0.161s
I20260709 13:19:45.299542 19215 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.599048 19239 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:44.669654 19485 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.939s
I20260709 13:19:44.964979 19502 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.646s
I20260709 13:19:45.567513 19460 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:45.570626 14377 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:45.463819 19495 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:45.275672 19429 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.370s
W20260709 13:19:45.588428 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 684902us
W20260709 13:19:45.589506 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.577198 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.595120 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.004s	sys 0.073s
W20260709 13:19:45.598763 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 984026us
I20260709 13:19:45.256898 19318 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:44.669495 19487 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.890s
I20260709 13:19:45.516290 19011 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:45.293305 19293 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:45.552320 19237 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:45.559566 19482 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.112s
W20260709 13:19:45.673899 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.007s	sys 0.073s
W20260709 13:19:45.674283 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 583183us
I20260709 13:19:45.675223 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:45.612087 19509 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:45.676369 19223 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:45.676674 19509 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:45.677838 19223 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:45.678294 19223 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.678643 19223 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.680292 19293 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:45.682085 14378 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:45.621182 19314 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:45.683279 19215 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:45.684237 19314 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:45.685658 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:45.611747 19486 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:45.685691 19215 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:45.467967 19369 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:45.498282 18872 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:45.611083 19500 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:19:45.618046 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:45.723394 14899 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
W20260709 13:19:45.618702 14226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2734) took 2015 ms (client timeout 2224 ms). Trace:
I20260709 13:19:45.606454 19449 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:19:45.633527 19506 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.688252 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1236) took 2080 ms. Trace:
I20260709 13:19:45.742233 14377 rpcz_store.cc:276] 0709 13:19:43.607548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.504314 (+1896766us) service_pool.cc:224] Handling call
0709 13:19:45.570132 (+ 65818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.687872 (+117740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.688120 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:45.632191 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.604596 14370 rpcz_store.cc:276] 0709 13:19:43.573669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.095984 (+1522315us) service_pool.cc:224] Handling call
0709 13:19:45.156256 (+ 60272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.482384 (+326128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.485025 (+  2641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:45.634373 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2743) took 1188 ms. Trace:
I20260709 13:19:45.746678 14225 rpcz_store.cc:276] 0709 13:19:44.446218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.446337 (+   119us) service_pool.cc:224] Handling call
0709 13:19:44.446603 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.546969 (+100366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:44.547000 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:44.547046 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:44.547079 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.634046 (+1086967us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b540026cfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:45.634120 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.634302 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230345472}
I20260709 13:19:45.665200 19413 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:45.673369 19372 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:45.604002 19224 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:45.615625 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2355) took 1157 ms. Trace:
I20260709 13:19:45.605556 19327 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:45.686626 19487 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:19:45.721014 19507 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:45.761322 14222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1236) took 2160 ms (client timeout 1695 ms). Trace:
W20260709 13:19:45.761982 14222 rpcz_store.cc:269] 0709 13:19:43.594689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.597893 (+  3204us) service_pool.cc:224] Handling call
0709 13:19:45.755080 (+2157187us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54002bd9d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:45.755231 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675108096}
W20260709 13:19:45.716311 14373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2564) took 2222 ms (client timeout 2228 ms). Trace:
W20260709 13:19:45.656538 19499 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.348s	user 0.000s	sys 0.000s
I20260709 13:19:45.612402 19071 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:45.724656 14226 rpcz_store.cc:269] 0709 13:19:43.598410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.603578 (+  5168us) service_pool.cc:224] Handling call
0709 13:19:45.613480 (+2009902us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b5400276fd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:45.613634 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":731284224}
I20260709 13:19:45.616716 19222 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:45.731935 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 44291.6us
I20260709 13:19:45.687453 19486 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:45.772581 19486 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.772704 14222 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:45.773382 19411 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:45.689329 19334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.127s	user 0.047s	sys 0.166s
I20260709 13:19:45.621070 19494 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.735597 19369 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:45.850302 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:45.742340 19506 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:45.748256 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:45.867558 14225 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:45.639166 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2364) took 2161 ms. Trace:
I20260709 13:19:45.751616 14229 rpcz_store.cc:276] 0709 13:19:44.458706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.604090 (+1145384us) service_pool.cc:224] Handling call
0709 13:19:45.614977 (+ 10887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.615202 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.615242 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.615298 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:45.615346 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.615427 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.615556 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:45.621068 19027 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:45.758572 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:45.763216 14373 rpcz_store.cc:269] 0709 13:19:43.494041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.517072 (+ 23031us) service_pool.cc:224] Handling call
0709 13:19:45.716049 (+2198977us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b540028bc54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:45.716192 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23413504}
I20260709 13:19:45.698782 19495 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:45.754766 19156 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.199s	user 0.011s	sys 0.003s
W20260709 13:19:45.749995 18837 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.323s	user 0.004s	sys 0.008s
I20260709 13:19:45.773778 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2356) took 1314 ms. Trace:
I20260709 13:19:45.880872 14222 rpcz_store.cc:276] 0709 13:19:44.459483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.772056 (+1312573us) service_pool.cc:224] Handling call
0709 13:19:45.772511 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.773449 (+   938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.773702 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:45.774813 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:45.882311 14226 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:45.775163 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2350) took 2753 ms. Trace:
I20260709 13:19:45.883615 14224 rpcz_store.cc:276] 0709 13:19:43.021759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.024867 (+  3108us) service_pool.cc:224] Handling call
0709 13:19:43.025136 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.951164 (+926028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.774888 (+1823724us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540033cf54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:45.775073 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057480448}
W20260709 13:19:45.775988 14376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2572) took 2279 ms (client timeout 1656 ms). Trace:
I20260709 13:19:45.772761 19222 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:45.627331 19510 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:19:45.778585 14302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 947) took 2540 ms (client timeout 1710 ms). Trace:
I20260709 13:19:45.788230 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2374) took 2188 ms. Trace:
I20260709 13:19:45.892925 14378 rpcz_store.cc:276] 0709 13:19:43.600160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.109926 (+1509766us) service_pool.cc:224] Handling call
0709 13:19:45.114169 (+  4243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.682761 (+568592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.787868 (+105107us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54003c37d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:45.788135 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1305385344}
W20260709 13:19:45.795646 14221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2744) took 1330 ms (client timeout 1735 ms). Trace:
I20260709 13:19:45.796768 19173 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:45.891953 14302 rpcz_store.cc:269] 0709 13:19:43.237902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.237989 (+    87us) service_pool.cc:224] Handling call
0709 13:19:45.778330 (+2540341us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54001f7f54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:45.778459 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512064896}
W20260709 13:19:45.881531 19342 consensus_meta.cc:287] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.865s	user 0.015s	sys 0.000s
W20260709 13:19:45.894491 14221 rpcz_store.cc:269] 0709 13:19:44.465405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.550730 (+ 85325us) service_pool.cc:224] Handling call
0709 13:19:45.795294 (+1244564us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002760d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:45.795550 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336867712}
I20260709 13:19:45.803406 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1165) took 2454 ms. Trace:
I20260709 13:19:45.823879 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2908) took 2461 ms. Trace:
I20260709 13:19:45.829767 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2742) took 1384 ms. Trace:
I20260709 13:19:45.932251 14228 rpcz_store.cc:276] 0709 13:19:44.445651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.445923 (+   272us) service_pool.cc:224] Handling call
0709 13:19:45.755461 (+1309538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.755729 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.755768 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.755841 (+    73us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:45.755885 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.755958 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.829439 (+ 73481us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002bd9d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:45.829668 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2976553728}
I20260709 13:19:45.105214 14220 rpcz_store.cc:276] 0709 13:19:43.599262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.623113 (+ 23851us) service_pool.cc:224] Handling call
0709 13:19:43.623418 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.623637 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:44.187861 (+564224us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.100427 (+912566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.100510 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:45.100582 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.100681 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.100858 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":228957,"prepare.queue_time_us":820264,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":5349,"raft.queue_time_us":22429,"thread_start_us":1213938,"threads_started":2}
I20260709 13:19:45.856514 19503 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:45.857740 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:45.934967 14892 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
W20260709 13:19:45.859930 19473 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.962s	user 0.020s	sys 0.024s
I20260709 13:19:45.861508 14227 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:45.863302 19327 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:45.865554 19318 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:45.872009 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:45.867988 14371 rpcz_store.cc:276] 0709 13:19:43.479769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.497866 (+ 18097us) service_pool.cc:224] Handling call
0709 13:19:43.498200 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.552034 (+ 53834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.552055 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.558147 (+  6092us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.015139 (+456992us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:44.164396 (+149257us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.164852 (+   456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.638674 (+1473822us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b540025a3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:45.638743 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.638807 (+    64us) raft_consensus.cc:1685] finished
0709 13:19:45.638917 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.639066 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":173119,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":202,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":16524,"spinlock_wait_cycles":104549120,"thread_start_us":164536,"threads_started":1,"wal-append.queue_time_us":477550,"wal-append.run_cpu_time_us":12430,"wal-append.run_wall_time_us":1296598}
I20260709 13:19:45.761843 19507 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:45.753623 19237 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.007670 19237 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:46.010188 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.012706 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:45.885143 14376 rpcz_store.cc:269] 0709 13:19:43.496350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.542835 (+ 46485us) service_pool.cc:224] Handling call
0709 13:19:45.775767 (+2232932us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b54000b9854. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:45.775895 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11107584}
I20260709 13:19:45.889561 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:45.844905 19411 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:45.915715 19173 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:45.842912 19071 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:45.909904 19156 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:45.928990 14900 rpcz_store.cc:276] 0709 13:19:43.349086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.349216 (+   130us) service_pool.cc:224] Handling call
0709 13:19:43.358115 (+  8899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.358375 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:43.514753 (+156378us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.053257 (+538504us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.802581 (+1749324us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b1800364420. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:45.802790 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.802933 (+   143us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:45.802997 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.803090 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.803285 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19942,"prepare.queue_time_us":477724,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":1752417,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":4151,"spinlock_wait_cycles":12083456,"thread_start_us":531842,"threads_started":2,"wal-append.queue_time_us":546949,"wal-append.run_cpu_time_us":1812,"wal-append.run_wall_time_us":1039700}
I20260709 13:19:46.016283 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:45.982739 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.983897 14865 connection.cc:256] RPC call timeout handler was delayed by -1.3227054740000312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:19:45.969048 19428 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.001101 19341 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:45.951615 19027 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:45.937142 19503 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:46.013521 14222 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
W20260709 13:19:45.953761 19499 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:45.916107 19438 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.931201 14298 rpcz_store.cc:276] 0709 13:19:43.362473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.040674 (+678201us) service_pool.cc:224] Handling call
0709 13:19:44.041070 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.460389 (+419319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.823478 (+1363089us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b540020ab54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:45.823773 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938390272}
W20260709 13:19:46.025665 14304 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.023s	sys 0.024s
W20260709 13:19:46.046556 14304 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.024s	sys 0.024s
W20260709 13:19:46.025739 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 153857us
W20260709 13:19:46.027809 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 177645us
I20260709 13:19:46.047533 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:46.032903 14227 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:46.033560 14193 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.019s	sys 0.031s
W20260709 13:19:46.049145 14193 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.019s	sys 0.031s
W20260709 13:19:46.049537 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 786163us
I20260709 13:19:46.029174 19302 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:45.980470 19460 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.021483 19205 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.014978 19196 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:46.038388 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.053225 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 952) took 2589 ms. Trace:
W20260709 13:19:46.033762 14865 connection.cc:256] RPC call timeout handler was delayed by -1.0626054740000654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 13:19:46.050822 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.050554 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:46.054072 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.026023 19512 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:19:46.056044 14302 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:45.938313 19342 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.042683 19258 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:46.056490 14304 rpcz_store.cc:276] 0709 13:19:43.464358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.150749 (+686391us) service_pool.cc:224] Handling call
0709 13:19:44.151083 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.151309 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:44.175850 (+ 24541us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.047485 (+1871635us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.051094 (+  3609us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:46.051142 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:46.051186 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.051309 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.053168 (+  1859us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53740,"prepare.queue_time_us":32753,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":447633,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8701,"thread_start_us":1813781,"threads_started":3,"wal-append.queue_time_us":1485962}
I20260709 13:19:46.078457 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:46.039280 19502 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:19:46.086198 14302 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:46.044761 19314 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:46.038553 19486 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:19:46.089221 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.101805 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:46.102456 14304 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:46.102880 14222 raft_consensus.cc:2410] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:19:46.103152 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.102947 14304 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:46.040671 19341 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.038938 19428 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.067109 19205 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:46.114497 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.073503 19258 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:46.150166 14369 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.074s	sys 0.184s
W20260709 13:19:46.162607 14369 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.075s	sys 0.185s
I20260709 13:19:46.052742 19480 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 13:19:46.167572 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.022s	sys 0.106s
I20260709 13:19:46.091213 19494 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.045392 19027 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:46.168977 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.022s	sys 0.106s
I20260709 13:19:46.090303 19509 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:46.067040 19460 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:46.196058 14295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.004s	sys 0.016s
W20260709 13:19:46.215796 14295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.005s	sys 0.016s
I20260709 13:19:46.073738 19196 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.106173 18872 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:46.223672 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2898) took 2988 ms. Trace:
I20260709 13:19:46.105583 19517 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:46.224210 14343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.020s	sys 0.027s
W20260709 13:19:46.248725 14343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.021s	sys 0.027s
I20260709 13:19:46.053094 19438 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.254611 14228 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:46.166826 19258 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.151466 19506 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:46.166533 18837 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:46.089887 19512 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:19:46.441835 18837 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:46.404683 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:46.256219 14304 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.442713 14304 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.443017 18837 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.444285 18837 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:46.444629 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.257061 14221 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
W20260709 13:19:46.279640 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 206634us
I20260709 13:19:46.442711 14227 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:46.426227 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.163430 19503 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.402545 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:46.225855 14297 rpcz_store.cc:276] 0709 13:19:43.203912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.239115 (+ 35203us) service_pool.cc:224] Handling call
0709 13:19:43.304067 (+ 64952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.307299 (+  3232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.307346 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.324191 (+ 16845us) log.cc:844] Serialized 26 byte log entry
0709 13:19:43.531010 (+206819us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:43.586419 (+ 55409us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.586863 (+   444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.587040 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.859324 (+2272284us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:46.168711 (+309387us) raft_consensus.cc:1685] finished
0709 13:19:46.191865 (+ 23154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.192044 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47637,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":8805,"raft.run_cpu_time_us":434,"raft.run_wall_time_us":104184,"spinlock_wait_cycles":9207552,"thread_start_us":117040,"threads_started":1,"wal-append.queue_time_us":457046}
I20260709 13:19:46.450941 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.107308 19173 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.396440 19205 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:46.394799 19428 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:46.398434 19460 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:46.073388 19411 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:46.403707 14301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.012s	sys 0.010s
W20260709 13:19:46.457993 14301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.012s	sys 0.010s
I20260709 13:19:46.406709 19302 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:46.397217 19341 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:46.411880 19094 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:46.412958 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 189729us
I20260709 13:19:46.413913 19222 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:46.414140 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:46.414803 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.473232 14300 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:46.415022 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:46.474334 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 59387.5us
I20260709 13:19:46.475286 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:46.415274 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2745) took 1877 ms. Trace:
I20260709 13:19:46.415355 19027 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:46.417052 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.417397 19438 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:46.398576 19529 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:46.419780 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.421036 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:46.408088 14372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.011s	sys 0.017s
W20260709 13:19:46.485401 14372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.012s	sys 0.017s
I20260709 13:19:46.217595 19485 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:46.105633 19223 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.288453 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:46.514467 14228 raft_consensus.cc:2410] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:19:46.224346 19318 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:46.407646 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 359525us
W20260709 13:19:46.422993 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 365265us
I20260709 13:19:46.058655 19507 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.247257 19314 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.480690 19094 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:46.223762 19215 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.430018 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.527218 14295 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 8.
I20260709 13:19:46.486604 19411 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:46.414101 19495 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.003s
I20260709 13:19:46.426959 19449 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.435479 19517 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:46.436240 19218 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.437074 19334 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:46.437162 19532 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:46.437906 19134 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:46.438419 19374 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:46.164548 19239 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:46.452507 14225 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:46.451720 14297 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:46.644207 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.449676 14224 raft_consensus.cc:2376] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10. Re-sending same reply.
I20260709 13:19:46.455823 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:46.479187 14223 rpcz_store.cc:276] 0709 13:19:44.537774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.798204 (+1260430us) service_pool.cc:224] Handling call
0709 13:19:45.798720 (+   516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.799264 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.799312 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.799952 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.219344 (+419392us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:46.219381 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.219444 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.410334 (+190890us) raft_consensus.cc:1685] finished
0709 13:19:46.410362 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.415207 (+  4845us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4950,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":131,"thread_start_us":418918,"threads_started":1,"wal-append.queue_time_us":599968}
W20260709 13:19:46.472579 19436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.020s	user 0.029s	sys 0.030s
I20260709 13:19:46.487841 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.646548 14300 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:46.492293 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:46.493746 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:46.647714 14900 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:46.496009 14895 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:46.497536 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.506647 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:46.507254 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:46.649760 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.507911 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:46.508083 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:46.508898 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:46.652184 14898 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.509665 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:46.510272 19027 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:46.511853 19302 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:46.589912 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 104909us
I20260709 13:19:46.482275 19503 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:46.677942 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 190177us
I20260709 13:19:46.678136 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:46.521067 14867 connection.cc:256] RPC call timeout handler was delayed by -1.2655703460000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:19:46.523041 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.483677 19520 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:46.394362 19071 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:46.514930 19485 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.524946 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.682094 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.530004 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:46.530592 14304 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:19:46.550124 14228 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
W20260709 13:19:46.585939 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.586689 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.586705 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.589874 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.639334 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.545814 19318 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.653544 14896 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.545581 19530 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.655174 14899 raft_consensus.cc:2410] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:46.655287 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:46.655970 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.656769 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.657480 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:46.640564 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 157960us
I20260709 13:19:46.778465 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1237) took 3170 ms. Trace:
I20260709 13:19:46.497426 19529 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.665261 19094 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:46.667104 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 154684us
W20260709 13:19:46.663652 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 190987us
W20260709 13:19:46.583209 19526 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:46.585134 19507 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.542786 19215 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.711138 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.588157 19218 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:46.697124 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.683920 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.678746 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:46.660439 19436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.216s	user 0.030s	sys 0.030s
I20260709 13:19:46.547648 19342 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:46.715045 19293 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:46.536195 19460 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 13:19:46.715364 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:46.716058 14304 pending_rounds.cc:85] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 11
I20260709 13:19:46.717639 14373 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:46.778501 19071 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.712677 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2362) took 3286 ms. Trace:
I20260709 13:19:46.727087 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:46.769615 14303 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:46.546880 19205 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.126s
I20260709 13:19:46.838406 14898 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:46.660326 19374 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.642445 19134 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:46.782516 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.848789 14222 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:46.779170 14369 rpcz_store.cc:276] 0709 13:19:43.608258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.512632 (+1904374us) service_pool.cc:224] Handling call
0709 13:19:45.566719 (+ 54087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.566966 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:46.163042 (+596076us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.777998 (+614956us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:46.778068 (+    70us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:46.778131 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.778224 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.778383 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":287199,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":106440,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":52302,"thread_start_us":1210105,"threads_started":3,"wal-append.queue_time_us":379957}
I20260709 13:19:46.807945 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:46.809405 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:46.809805 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.814498 14298 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:19:46.681779 19520 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:46.820648 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.826435 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 147763us
W20260709 13:19:46.850780 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 157372us
I20260709 13:19:46.550621 19449 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.547511 19495 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.713974 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:46.590667 19334 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.831553 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:46.832602 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.773699 19512 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.638916 19532 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.834105 14304 pending_rounds.cc:107] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:19:46.535702 19314 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.772513 14375 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 10: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:46.840616 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.899765 14295 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:46.842336 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.716149 14228 pending_rounds.cc:85] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 7
I20260709 13:19:46.845613 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.846498 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.850446 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:46.852809 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 322876us
I20260709 13:19:46.851466 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:46.853552 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.828081 19466 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.834641 14372 rpcz_store.cc:276] 0709 13:19:43.426054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.426612 (+   558us) service_pool.cc:224] Handling call
0709 13:19:43.445572 (+ 18960us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:43.490571 (+ 44999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.490600 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:43.491231 (+   631us) log.cc:844] Serialized 78 byte log entry
0709 13:19:43.853806 (+362575us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:45.784479 (+1930673us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b180028ff60. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf
0709 13:19:45.784693 (+   214us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.854083 (+ 69390us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b180028ff60. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f522 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:19:46.676599 (+822516us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.712315 (+ 35716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.712398 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.712443 (+    45us) raft_consensus.cc:1685] finished
0709 13:19:46.712457 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.712616 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57082,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":2653,"raft.queue_time_us":189123,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":33134,"spinlock_wait_cycles":27812480,"thread_start_us":1352628,"threads_started":4,"wal-append.queue_time_us":1083354,"wal-append.run_cpu_time_us":2581,"wal-append.run_wall_time_us":1174771}
I20260709 13:19:46.867909 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:46.864658 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 55312.8us
I20260709 13:19:46.878108 14224 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:46.879515 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.886919 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.886617 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.895485 14304 raft_consensus.cc:2889] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:46.855043 19520 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:46.851223 19094 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.923462 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.901013 14374 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:19:46.924165 14371 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:46.901167 14228 pending_rounds.cc:107] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:19:46.924829 14228 raft_consensus.cc:2889] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:46.907963 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.904676 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:46.912832 14193 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:46.913681 14369 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:46.913951 14378 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:46.854553 19027 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:46.914732 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 958) took 1014 ms. Trace:
I20260709 13:19:46.930198 14304 rpcz_store.cc:276] 0709 13:19:45.899825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.074290 (+174465us) service_pool.cc:224] Handling call
0709 13:19:46.102332 (+ 28042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:46.914508 (+812176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.914679 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:46.921367 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.931748 14295 raft_consensus.cc:2410] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 14 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:19:46.914197 14303 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
W20260709 13:19:46.922540 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.839377 19293 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.848148 19071 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.933192 14227 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:46.946671 19559 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:46.837803 19537 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:19:46.950816 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:46.812425 19530 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:46.929690 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:46.955912 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:46.959614 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:46.899948 19553 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:46.915453 19547 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:46.916152 19011 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.946539 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2799) took 3334 ms. Trace:
W20260709 13:19:46.972494 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 69835.7us
I20260709 13:19:46.978371 14894 raft_consensus.cc:2410] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 14 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
W20260709 13:19:46.973663 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 120033us
I20260709 13:19:46.976045 14370 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:46.991901 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 276600us
W20260709 13:19:46.991211 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 104126us
I20260709 13:19:46.962100 19160 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:19:46.993870 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.950436 19559 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:46.899596 19512 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.851893 19517 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:46.977116 14296 rpcz_store.cc:276] 0709 13:19:43.611773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.439516 (+827743us) service_pool.cc:224] Handling call
0709 13:19:44.439903 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.440116 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:44.449378 (+  9262us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.442329 (+1992951us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b18000cdcc0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a 00007f8ded096a2a
0709 13:19:46.851791 (+409462us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.946158 (+ 94367us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:46.946220 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:46.946273 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.946335 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.946474 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16478,"prepare.queue_time_us":147544,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":7590,"raft.queue_time_us":58727,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":34623,"spinlock_wait_cycles":5284608,"thread_start_us":464750,"threads_started":3}
I20260709 13:19:46.969208 19553 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:46.976763 19341 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:46.907364 19466 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.006770 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:47.003039 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.978268 19237 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:46.973577 19547 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:47.008481 14295 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:46.968685 19460 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:19:47.013962 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:47.003554 19536 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:19:47.011932 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:46.996397 19160 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:47.016196 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:46.998898 19223 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.016515 14303 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:19:47.009706 19533 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 13:19:47.021822 14304 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.026921 19485 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.027086 19156 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:47.027379 19545 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:47.027802 19554 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:47.030501 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.039028 19532 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:47.039018 19502 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:47.006102 19549 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:47.039981 19258 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.002s
I20260709 13:19:47.040356 19551 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:47.028695 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 70844.7us
W20260709 13:19:47.073262 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 61656.3us
I20260709 13:19:47.006705 19553 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.995664 19535 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:19:47.043136 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77625.4us
I20260709 13:19:47.048395 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:47.048615 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.080425 14296 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:47.015913 19547 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.040758 19546 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:47.073840 19218 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:47.045996 18837 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.002s
I20260709 13:19:47.028664 19341 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:47.031890 19318 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.010252 19237 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:47.052467 19554 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:47.058656 19215 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:47.074683 19534 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 13:19:47.100705 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 456754us
I20260709 13:19:47.058970 19502 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:47.164932 19502 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.166167 19502 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.168833 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1243) took 1154 ms. Trace:
I20260709 13:19:47.012595 19027 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:47.073500 19376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.001s	sys 0.003s
I20260709 13:19:47.103581 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:47.104246 14304 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:47.064946 19549 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:47.080017 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:47.062352 19529 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:47.021768 19541 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:47.114480 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:47.114886 14896 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
W20260709 13:19:47.101598 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 387689us
I20260709 13:19:47.105885 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:47.115751 14370 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:47.118108 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1213) took 3610 ms. Trace:
I20260709 13:19:47.072989 19548 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:47.056372 19545 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.125463 19433 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.132629 19466 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.119524 19558 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.096321 19239 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:47.191000 19485 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:47.080823 19560 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:47.112538 19374 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.157043 19428 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:47.226899 19428 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:47.227674 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2899) took 3953 ms. Trace:
I20260709 13:19:47.227793 19428 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.229238 19428 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:47.228142 14301 rpcz_store.cc:276] 0709 13:19:43.274303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.314795 (+ 40492us) service_pool.cc:224] Handling call
0709 13:19:45.781945 (+2467150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.845533 (+ 63588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.845564 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.846088 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.458870 (+612782us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:46.485847 (+ 26977us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.486087 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.486161 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.486200 (+    39us) raft_consensus.cc:1685] finished
0709 13:19:46.486210 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.227473 (+741263us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b54001f7f50. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:47.227615 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71043,"prepare.queue_time_us":27619,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":88732,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7185,"spinlock_wait_cycles":5695043200,"thread_start_us":604671,"threads_started":1,"wal-append.queue_time_us":545701}
I20260709 13:19:47.192101 19071 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.075492 19258 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.173197 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:47.175151 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.247200 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.144646 19237 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.125882 19341 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:47.190394 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:47.249396 14296 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:47.250352 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:47.251400 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:47.195637 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 114089us
I20260709 13:19:47.186801 14897 rpcz_store.cc:276] 0709 13:19:43.507891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.655387 (+147496us) service_pool.cc:224] Handling call
0709 13:19:43.834327 (+178940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.850959 (+ 16632us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:44.389136 (+538177us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.803615 (+1414479us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.804144 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.804323 (+   179us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:45.804366 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.109933 (+1305567us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b54007e7054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:47.110018 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.110064 (+    46us) raft_consensus.cc:1685] finished
0709 13:19:47.117873 (+  7809us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.118042 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1298267,"prepare.queue_time_us":477635,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":1298669,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":30444,"spinlock_wait_cycles":15710080,"thread_start_us":556988,"threads_started":2,"wal-append.queue_time_us":616939}
I20260709 13:19:47.194876 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:47.152205 19554 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:47.194525 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80146.2us
I20260709 13:19:47.078060 19160 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.078883 19551 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.119798 19528 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:19:47.100406 19205 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.184370 19549 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:47.225246 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 145863us
I20260709 13:19:47.225970 19571 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:47.169271 14221 rpcz_store.cc:276] 0709 13:19:46.014464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.036097 (+ 21633us) service_pool.cc:224] Handling call
0709 13:19:47.168644 (+1132547us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002765d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:47.168767 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480315264}
I20260709 13:19:47.230357 19520 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.232736 19530 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:47.195140 19541 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.234020 19512 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.209085 19529 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:47.278106 19529 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:47.278760 19529 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.233860 19558 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.283097 19545 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:47.283484 19558 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:47.286674 19540 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.152s	user 0.000s	sys 0.003s
I20260709 13:19:47.234627 19239 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.289327 19239 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.271718 19561 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:47.290148 19561 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:47.290583 19561 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.235361 19560 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.291728 19560 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.272158 19205 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.236642 19553 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.239638 19449 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.190824 19314 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.295262 19205 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.296460 19134 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.276144 19571 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:47.298290 19571 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.193586 19548 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:47.300320 19548 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.300635 19555 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:47.301118 19555 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:47.301632 19341 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.301986 19555 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.302781 19341 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.303380 19555 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.075182 19559 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.305953 19492 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:47.306509 19559 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:47.309268 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.243958 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:47.111553 19546 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:47.337029 19546 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.270730 19160 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.340765 19258 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.300845 19520 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:47.248329 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 75242.2us
W20260709 13:19:47.255225 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60467.5us
I20260709 13:19:47.258773 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:47.261075 14302 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
W20260709 13:19:47.267500 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.347720 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 89030us
W20260709 13:19:47.348970 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.269877 14299 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:47.246961 19485 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:47.350785 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:47.208228 19433 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.261359 19542 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:47.261253 19071 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.276007 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:47.349409 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:47.346930 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:47.354172 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:47.365031 14301 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:47.367446 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:47.368414 14228 raft_consensus.cc:2410] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:19:47.369035 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.371943 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:47.374217 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:47.295279 19553 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.377553 14376 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:19:47.383463 19541 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:47.383615 19196 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.391331 19551 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:47.395390 19503 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.619s	user 0.003s	sys 0.006s
I20260709 13:19:47.397987 19433 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.366860 19258 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.354624 19520 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:47.371853 19542 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:47.376089 19205 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:47.410923 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:47.450591 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 78771.7us
I20260709 13:19:47.453737 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:47.404197 14220 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:19:47.467451 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 193679us
I20260709 13:19:47.468305 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:47.471760 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:47.472723 14301 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:47.495551 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:47.495625 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 493977us
I20260709 13:19:47.357200 19485 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:47.505168 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.451836 19537 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:47.478513 19411 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.935s	user 0.013s	sys 0.000s
I20260709 13:19:47.369498 19071 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.389567 19548 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.506995 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:47.496861 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:47.509737 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:47.469218 19520 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:47.512629 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.513283 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.469489 19205 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:47.521911 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:47.526690 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.527595 14372 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
W20260709 13:19:47.529068 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.470446 19532 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:19:47.504067 19503 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:47.551239 14267 connection.cc:256] RPC call timeout handler was delayed by -3.0239080840001407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 13:19:47.551717 14267 connection.cc:256] RPC call timeout handler was delayed by -2.9834080840000752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:19:47.546804 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:47.548210 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.549252 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.536834 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:47.516660 19520 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:47.552037 14267 connection.cc:256] RPC call timeout handler was delayed by -2.9204080840002007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
W20260709 13:19:47.557504 14267 connection.cc:256] RPC call timeout handler was delayed by -2.8430080840000755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 13:19:47.557916 14267 connection.cc:256] RPC call timeout handler was delayed by -2.7170080840000992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260709 13:19:47.558131 14372 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [13.8-14.9]
W20260709 13:19:47.558518 14267 connection.cc:256] RPC call timeout handler was delayed by -2.6729080840000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 13:19:47.558847 14267 connection.cc:256] RPC call timeout handler was delayed by -2.6594080840000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
I20260709 13:19:47.558882 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.560547 14894 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 14: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:47.560444 14899 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.523516 19258 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.494521 19546 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.520699 19205 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.557711 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.525940 19506 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:47.537077 19509 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:47.570727 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:47.541328 19173 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.572741 14898 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:47.583492 14304 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:19:47.555089 19532 consensus_queue.cc:1243] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:47.590221 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.594888 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2807) took 1157 ms. Trace:
I20260709 13:19:47.596985 14298 rpcz_store.cc:276] 0709 13:19:46.419448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.419564 (+   116us) service_pool.cc:224] Handling call
0709 13:19:47.576770 (+1157206us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400154ad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:47.576914 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757208832}
I20260709 13:19:47.530578 19512 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:19:47.559754 19487 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:47.604015 14225 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:47.606003 14298 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:47.608698 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:47.615365 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 44695.2us
I20260709 13:19:47.573340 19506 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.584005 19509 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:47.680711 19509 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:47.685563 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 179517us
I20260709 13:19:47.679903 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.596282 19503 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.687073 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:47.689826 19578 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:19:47.693370 19535 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:47.694002 19535 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.696527 19535 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:47.690336 19302 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.697403 19587 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
I20260709 13:19:47.697546 19302 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.689985 14898 raft_consensus.cc:2410] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:19:47.580883 19574 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:47.713276 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.693097 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.700230 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2588) took 1117 ms. Trace:
I20260709 13:19:47.726490 14373 rpcz_store.cc:276] 0709 13:19:46.582671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.910232 (+327561us) service_pool.cc:224] Handling call
0709 13:19:46.910723 (+   491us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:46.971284 (+ 60561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.971330 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:46.972148 (+   818us) log.cc:844] Serialized 52 byte log entry
0709 13:19:47.180937 (+208789us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:47.181057 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.181192 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.699991 (+518799us) raft_consensus.cc:1685] finished
0709 13:19:47.700013 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.700164 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138248,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":192,"thread_start_us":247131,"threads_started":2,"wal-append.queue_time_us":304846}
W20260709 13:19:47.730787 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 113387us
I20260709 13:19:47.714010 19506 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.733260 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:47.738451 14898 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:19:47.627781 19487 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.594122 19542 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.748404 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:47.728386 19574 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.752154 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.679128 19554 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.753331 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.759586 14900 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: [11.11-12.12]
I20260709 13:19:47.745229 19560 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.764199 14374 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:47.758272 19507 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.935s	user 0.012s	sys 0.000s
I20260709 13:19:47.756613 19372 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:47.769543 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.771145 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.757812 19574 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.761675 19548 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.771989 14373 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:47.775799 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.780122 19487 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.778723 14374 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:47.787047 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.788919 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:47.770828 19372 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:47.787261 19071 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.794335 19372 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.795316 19560 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.796721 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.797437 14378 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:19:47.798342 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:47.798858 14378 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.806531 14378 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:47.807837 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:47.807991 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.810850 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:47.761260 19237 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:47.814061 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.814792 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:47.816493 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:47.800689 19561 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.001s
I20260709 13:19:47.766969 19529 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.818395 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.820804 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.820050 19532 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.823458 19444 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.821630 19535 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:47.823586 19532 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.827553 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.823032 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:47.831581 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.824283 19535 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:47.833913 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:47.835281 19535 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.833244 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.836467 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.837653 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.838279 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:47.839383 14373 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.838596 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.840639 14898 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:47.817834 19560 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:19:47.818334 19546 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.820765 19071 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:47.848014 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.824095 19444 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:47.849849 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.830338 19532 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:47.839839 19559 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.002s
I20260709 13:19:47.853018 14900 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:47.859215 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:47.822742 19561 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:47.862694 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 85466.5us
I20260709 13:19:47.875759 14375 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:47.878772 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.880215 19506 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:47.881428 19160 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.542s	user 0.000s	sys 0.007s
I20260709 13:19:47.883592 19334 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:47.885165 19341 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 13:19:47.885613 19134 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.886289 19134 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.890525 14296 raft_consensus.cc:2410] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:19:47.847959 19537 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:47.891414 19537 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:47.892413 19537 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.896873 19529 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:47.899309 19485 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.901242 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:47.903052 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:47.903327 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.904078 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.906299 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2927) took 1454 ms. Trace:
I20260709 13:19:47.906401 19520 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.906805 14297 rpcz_store.cc:276] 0709 13:19:46.451922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.956165 (+504243us) service_pool.cc:224] Handling call
0709 13:19:47.577039 (+620874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.577231 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.577258 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:47.577302 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:47.577343 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.577400 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.906122 (+328722us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b5400154ad0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:47.906237 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427218176}
I20260709 13:19:47.908324 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:47.908965 14295 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.912746 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:47.914526 19495 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.916164 14377 raft_consensus.cc:2410] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:19:47.914671 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.919633 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.920313 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.920734 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.920630 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:47.922688 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.923133 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:47.926470 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.925491 14373 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:47.927937 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:47.930190 14295 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:19:47.932814 14267 leader_election.cc:400] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15.
I20260709 13:19:47.933230 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.936352 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:47.938419 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:47.939881 14375 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.941733 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:47.943727 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:47.878786 19549 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.000s
I20260709 13:19:47.986747 19549 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.989338 19549 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.933024 19548 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.991395 14300 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:47.991745 19548 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:47.992545 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.993283 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2821) took 1446 ms. Trace:
I20260709 13:19:47.994257 19554 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.995872 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:47.948128 19160 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.996608 14296 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.996735 19160 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.993645 14300 rpcz_store.cc:276] 0709 13:19:46.547354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.840255 (+292901us) service_pool.cc:224] Handling call
0709 13:19:47.993063 (+1152808us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001a09d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:47.993217 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506004736}
I20260709 13:19:47.999023 19160 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:47.999105 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:48.000661 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:48.001425 14300 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:48.001713 19444 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:47.946374 19495 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:48.002130 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:48.002724 19495 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:48.003013 14300 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:48.003213 19495 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:47.946190 19569 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:19:48.010296 14193 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:47.968148 19532 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.011850 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2366) took 1562 ms. Trace:
I20260709 13:19:48.012323 14227 rpcz_store.cc:276] 0709 13:19:46.449332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.585410 (+136078us) service_pool.cc:224] Handling call
0709 13:19:46.659297 (+ 73887us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.947777 (+288480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.011596 (+1063819us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54003359d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:48.011788 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629320448}
I20260709 13:19:48.023162 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2923) took 1577 ms. Trace:
I20260709 13:19:48.023670 14303 rpcz_store.cc:276] 0709 13:19:46.450711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.932343 (+481632us) service_pool.cc:224] Handling call
0709 13:19:46.953738 (+ 21395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.023025 (+ 69287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.022904 (+999879us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b540022ced4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:48.023097 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143648512}
I20260709 13:19:48.024924 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:48.026335 14302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2803) took 1617 ms (client timeout 1596 ms). Trace:
W20260709 13:19:48.026782 14302 rpcz_store.cc:269] 0709 13:19:46.409407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.409652 (+   245us) service_pool.cc:224] Handling call
0709 13:19:48.026161 (+1616509us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54003d95d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:48.026270 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534308736}
I20260709 13:19:48.027956 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:48.028431 19532 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:48.028658 14302 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:48.027717 14296 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:48.030153 19071 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.030750 19071 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.032879 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:48.033147 19071 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:48.033565 14893 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:48.034523 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:48.035082 14893 raft_consensus.cc:2376] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15. Re-sending same reply.
I20260709 13:19:48.036144 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:48.013677 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.038156 14227 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
W20260709 13:19:48.037374 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 93724us
I20260709 13:19:48.025592 14303 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:48.029672 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:48.047482 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:48.048336 14900 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
W20260709 13:19:47.947988 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.948845 14297 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:47.941329 19512 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.952797 19237 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:47.953675 19589 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:19:47.877543 19509 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.957760 19503 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:47.959817 19574 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.961053 19205 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.962383 19302 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:47.962481 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:47.966609 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:47.968096 19372 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:47.970337 14220 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:48.087332 14899 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:47.971673 19561 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:47.979521 19502 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.813s	user 0.010s	sys 0.002s
I20260709 13:19:48.100677 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2751) took 1879 ms. Trace:
I20260709 13:19:48.101120 14222 rpcz_store.cc:276] 0709 13:19:46.220950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.524348 (+303398us) service_pool.cc:224] Handling call
0709 13:19:46.550433 (+ 26085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:46.849212 (+298779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.100385 (+1251173us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b540033de54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:48.100614 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685358976}
I20260709 13:19:48.102566 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.103794 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:47.980397 19428 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.751s	user 0.012s	sys 0.000s
I20260709 13:19:48.039299 14893 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:48.111824 14896 raft_consensus.cc:2410] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:19:48.112604 14370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2578) took 1556 ms (client timeout 1596 ms). Trace:
W20260709 13:19:48.113225 14370 rpcz_store.cc:269] 0709 13:19:46.556634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.586632 (+ 29998us) service_pool.cc:224] Handling call
0709 13:19:48.112374 (+1525742us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400258fd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:48.112528 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454643072}
I20260709 13:19:48.055426 19512 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:48.062041 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51834.1us
I20260709 13:19:48.171406 14374 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:48.059695 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:48.071024 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:48.052690 19547 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.909s	user 0.004s	sys 0.008s
I20260709 13:19:48.072782 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:48.177597 14900 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 10: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:47.977317 19535 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.039157 19485 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:48.091540 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:48.092935 14228 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:48.055816 19487 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:48.094604 19548 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:48.087272 19506 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:48.096221 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.196846 14224 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:48.194947 14898 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:48.099349 19372 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:48.100028 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.198649 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.109413 19495 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:48.125845 14892 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:48.030882 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:48.203814 14296 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:48.136770 14897 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:48.068697 19554 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:46.853236 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:48.141963 19411 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:48.137491 14299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2808) took 1717 ms (client timeout 1786 ms). Trace:
W20260709 13:19:48.205204 14299 rpcz_store.cc:269] 0709 13:19:46.419715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.677857 (+258142us) service_pool.cc:224] Handling call
0709 13:19:48.114877 (+1437020us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54000fd2d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:48.137427 (+ 22550us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1349747584}
I20260709 13:19:48.142807 14222 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:48.143342 14302 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.056875 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:48.152842 14300 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:19:48.212370 14300 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:48.166066 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:48.166097 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.168974 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:48.178354 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:48.216943 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50949.4us
I20260709 13:19:48.217989 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:48.188030 14192 connection.cc:256] RPC call timeout handler was delayed by -1.062325550000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 13:19:48.220317 14192 connection.cc:256] RPC call timeout handler was delayed by -1.0092255500001102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:19:48.090360 19569 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.202396 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.142261 14895 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:48.218925 14295 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:19:48.224486 14295 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:19:48.225040 14295 pending_rounds.cc:85] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 8
I20260709 13:19:48.225440 14295 pending_rounds.cc:107] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:19:48.225862 14295 raft_consensus.cc:2889] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:48.229557 14299 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:48.238178 14894 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:48.239367 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 179750us
I20260709 13:19:48.235191 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:48.243021 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 64726.7us
I20260709 13:19:48.244128 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:48.247478 14898 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:48.249979 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:48.250733 14896 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.253422 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:48.256965 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 200150us
I20260709 13:19:48.258905 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:48.262812 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:48.263219 14225 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:48.263605 14901 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:48.267278 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:48.269865 14303 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:48.233407 19566 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:48.234150 19438 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:48.233946 19539 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:48.183945 19547 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.275853 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:48.277076 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:48.278276 14192 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:48.285377 14896 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:19:48.266855 19560 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:19:48.229102 19554 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:48.229419 19411 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:48.296953 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:48.234297 19569 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:48.287056 19544 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:48.287977 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:48.266898 19553 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:48.301873 14295 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.274420 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:48.292591 14299 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
W20260709 13:19:48.262925 19580 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:19:48.294888 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:48.295042 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:48.286893 19394 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:48.292033 14897 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:48.263187 19593 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.262353 19561 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:48.267632 19173 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:48.321383 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:48.301596 14227 raft_consensus.cc:1217] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.8->[8.9-11.11]   Dedup: 8.9->[9.10-11.11]
I20260709 13:19:48.322398 14227 pending_rounds.cc:85] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 9
I20260709 13:19:48.288772 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.322757 14227 pending_rounds.cc:107] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:19:48.323149 14227 raft_consensus.cc:2889] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:48.275897 14302 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:48.230705 19485 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:48.309482 14229 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:48.321585 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:48.273940 19517 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.326388 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:48.267418 19480 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:19:48.271628 19011 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:19:48.267263 19543 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:19:48.298552 19554 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.300536 19566 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:48.340529 19134 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:48.361488 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.368398 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.306371 19553 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.363232 19507 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:48.350793 14295 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:48.365036 19495 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:48.302665 19506 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.340962 19549 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:48.320986 19509 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:48.376024 14901 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:48.310845 19487 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:48.374451 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:48.344061 19559 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:48.366452 19512 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:48.329485 19574 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:48.340286 19502 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:48.327991 19444 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:48.366344 19205 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:48.344436 19561 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:48.391040 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:48.373754 19553 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:48.392169 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 324076us
W20260709 13:19:48.412115 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.341777 19517 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:48.388432 19559 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:48.449744 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.450948 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:48.452113 14901 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.341369 19593 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.440294 19512 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.461283 14370 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:48.465358 14223 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:48.440896 19487 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.436851 19444 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:48.470484 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:48.456193 19559 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:48.478335 14341 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.483705 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:48.484421 14370 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:48.479809 14897 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:48.485435 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.486070 14376 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.486784 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.460457 19574 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:48.487419 14371 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.487964 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.483067 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.488775 14223 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:48.473608 19444 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:48.497088 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 164054us
I20260709 13:19:48.498157 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.500697 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.494488 19544 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.489190 19480 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.499198 19574 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:48.506263 19594 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:19:48.506436 19574 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:48.489970 19547 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:48.510378 19596 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:19:48.515903 14901 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:48.517467 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.515311 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:48.521942 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.524319 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:48.525681 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.529052 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.529407 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.532269 14341 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.478176 19512 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.524147 19547 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.527778 19549 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:48.535964 19593 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:48.537413 19517 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:48.546018 19544 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:48.547535 19599 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:48.477185 19487 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:48.577145 19485 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:48.551088 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:48.551548 14371 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:48.514456 19561 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.572155 14223 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:48.577006 19549 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:48.524988 19571 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.557570 14376 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:48.576906 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:48.476653 19566 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:48.548782 19587 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:48.530390 19574 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.595983 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.588395 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:19:48.586563 19586 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.868s	user 0.006s	sys 0.000s
I20260709 13:19:48.560647 19569 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:48.572374 19394 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:48.589419 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:48.592772 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 415862us
W20260709 13:19:48.581652 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 214158us
W20260709 13:19:48.603856 14193 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.130:44127 timed out after 1.786s (SENT) [suppressed 27 similar messages]
I20260709 13:19:48.599524 14341 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:48.602144 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.606506 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.608117 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:48.609189 14192 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.511s (SENT)
I20260709 13:19:48.609369 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:48.610177 14901 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:48.610409 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.591339 19549 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.615474 19520 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:48.602099 19544 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:48.618021 19571 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:48.618400 19544 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:48.618683 19571 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:48.618921 19544 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:48.619215 19571 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.605331 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:48.602990 19134 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.622124 19569 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:48.623432 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.623855 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.624186 14223 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:48.624538 14227 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:19:48.601614 19506 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:48.627493 19506 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:48.627863 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:48.589742 19509 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:48.629163 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:48.630733 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:48.639228 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:48.640389 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.647149 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:48.647735 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2767) took 1241 ms. Trace:
I20260709 13:19:48.651551 19134 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:48.654253 19134 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:48.654744 19134 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.656050 19574 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:48.656488 19574 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:48.656870 19574 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:48.660142 19601 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:19:48.651743 19394 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:48.662169 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1240) took 1288 ms. Trace:
I20260709 13:19:48.662814 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:48.665020 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:48.665534 19487 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:48.662596 14369 rpcz_store.cc:276] 0709 13:19:47.373431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.373614 (+   183us) service_pool.cc:224] Handling call
0709 13:19:47.385331 (+ 11717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.385710 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.385742 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.386226 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.544394 (+158168us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:47.544438 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.544509 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.106644 (+562135us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:48.586267 (+479623us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b240037bab8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fde09d 00007f8decc1010e 00007f8decc2788c 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221
0709 13:19:48.661944 (+ 75677us) raft_consensus.cc:1685] finished
0709 13:19:48.661965 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.662112 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9759,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":108,"spinlock_wait_cycles":91346944,"thread_start_us":157731,"threads_started":1,"wal-append.queue_time_us":207514}
I20260709 13:19:48.676152 19512 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:48.677577 19480 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:48.638641 19509 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:48.654372 19603 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:48.679520 19509 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.679520 14341 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.659826 19559 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:48.627931 19506 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:48.683367 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:48.650262 14226 rpcz_store.cc:276] 0709 13:19:47.406462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.466255 (+ 59793us) service_pool.cc:224] Handling call
0709 13:19:47.466658 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:47.467029 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.467071 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:48.117947 (+650876us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b2c000edf88. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb985a11 00007f8deb995372 00007f8ded0c7a01 00007f8ded08c43a 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2
0709 13:19:48.170679 (+ 52732us) log.cc:844] Serialized 52 byte log entry
0709 13:19:48.523412 (+352733us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:48.523451 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.523547 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:48.630257 (+106710us) raft_consensus.cc:1685] finished
0709 13:19:48.630285 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:48.647648 (+ 17363us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":414,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":12909,"spinlock_wait_cycles":21332864,"thread_start_us":280757,"threads_started":1,"wal-append.queue_time_us":393516}
I20260709 13:19:48.682749 19502 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:48.685894 19480 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:48.683377 19593 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.685122 19487 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:48.686949 19593 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.687556 19487 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.649410 19215 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:48.687955 19487 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.683109 19558 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:48.641034 19569 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:48.689204 19593 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:48.669507 19520 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:48.690868 19520 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.691308 19520 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.694780 19480 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:48.695353 19480 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:48.695803 19444 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:48.696259 19480 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.258179 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:48.700157 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 442008us
I20260709 13:19:48.700695 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:48.701524 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:48.699445 19559 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:48.706250 19394 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:48.710580 19444 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:48.714123 19572 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:48.714166 19593 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.714489 19553 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.689321 19569 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:48.720428 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:48.721647 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.722573 14226 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:48.722975 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.724889 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.725564 14223 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:48.689139 19554 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.728327 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:48.732736 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 93588.9us
I20260709 13:19:48.729301 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:48.733590 14193 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:48.734696 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.728658 14220 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:48.729980 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:48.719686 19593 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:48.739290 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:48.741624 14373 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:19:48.730875 14371 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:48.737376 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:48.746315 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.748090 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.749418 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:48.750291 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.751216 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.751983 14372 raft_consensus.cc:2376] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16. Re-sending same reply.
I20260709 13:19:48.752084 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:48.756814 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:48.693172 19134 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.760154 14375 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:48.762810 14224 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:48.767726 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.770882 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.834715 19160 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:48.836268 19134 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:48.836717 19554 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:48.837222 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 76613.1us
W20260709 13:19:48.837849 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 104335us
I20260709 13:19:48.837981 19623 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:48.841631 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:48.842422 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.842664 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:48.844352 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:48.732718 19572 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:48.846361 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.845242 14295 raft_consensus.cc:2410] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:48.850713 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:48.851478 14892 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.736187 19558 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:48.738765 19485 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.875095 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:48.882117 14901 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:48.763139 19444 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:48.874622 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:48.759652 19561 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:48.886869 14898 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [12.11-14.12]
I20260709 13:19:48.757701 19507 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.887380 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.763468 19613 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.738056 19541 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.142s
I20260709 13:19:48.850607 19572 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.849939 19160 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.757867 19612 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.138s
I20260709 13:19:48.842013 19205 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:19:48.880134 19560 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.874934 19532 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:19:48.894362 14297 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:19:48.895695 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:48.973984 14901 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:48.974936 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:48.893725 14892 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:48.976554 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:48.926651 14303 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:19:48.908231 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:48.950292 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.968478 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:48.939487 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.950893 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:48.971196 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:48.985205 14220 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:48.983186 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 128845us
I20260709 13:19:48.982959 14270 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:48.988590 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:48.980485 14375 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:48.994040 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:48.993319 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.998432 14224 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:19:48.998694 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:48.998435 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:49.010473 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:49.011396 14297 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:19:48.997740 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 158630us
I20260709 13:19:49.105947 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:49.106529 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 127533us
I20260709 13:19:49.106669 14304 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:49.107630 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:49.108826 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:49.111114 14221 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:48.999536 14223 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:49.111116 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:49.117093 14304 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:19:49.118227 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:49.118521 14899 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:49.118836 14300 raft_consensus.cc:2376] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11. Re-sending same reply.
I20260709 13:19:48.947296 14125 catalog_manager.cc:5697] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:49.124261 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:49.120590 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116229us
I20260709 13:19:49.126137 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1231) took 1313 ms. Trace:
I20260709 13:19:48.933041 19547 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.132128 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:48.894582 19561 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:49.090166 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:48.993611 19612 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:48.915704 19215 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:49.126528 14894 rpcz_store.cc:276] 0709 13:19:47.805710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.878507 (+ 72797us) service_pool.cc:224] Handling call
0709 13:19:49.118110 (+1239603us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400268ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:49.119125 (+  1015us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820162304}
I20260709 13:19:48.926334 19572 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.976605 19566 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.905113 19444 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:48.927628 19623 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:48.906289 19553 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:48.990226 19512 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.133299 19503 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.142581 14372 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:19:48.914801 19571 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.143128 19593 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:49.143831 14220 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:19:48.999230 19502 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:49.149247 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:49.122443 19537 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:48.931324 19160 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:49.111073 19372 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:19:48.910673 19549 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.913686 19574 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.149931 19215 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:48.935109 19560 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:48.916813 19506 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.153568 14894 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:49.196555 14295 raft_consensus.cc:2410] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:49.153415 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.141757 19561 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.120144 19485 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:49.185020 14300 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:49.145179 19612 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.130777 14304 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:49.170346 19620 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 13:19:48.952785 19558 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:49.191964 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:49.198230 19595 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:49.222152 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:49.184541 19503 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:49.198853 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 108817us
W20260709 13:19:49.201807 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48599.4us
I20260709 13:19:49.182503 19537 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:49.184087 19502 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:49.215924 14378 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:49.193688 19618 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
W20260709 13:19:49.216253 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 84215.7us
I20260709 13:19:49.217628 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2773) took 1244 ms. Trace:
I20260709 13:19:49.198431 19634 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:49.228353 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.234244 14225 rpcz_store.cc:276] 0709 13:19:47.972786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.031621 (+ 58835us) service_pool.cc:224] Handling call
0709 13:19:48.032006 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.268818 (+236812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.217395 (+948577us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540026cfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:49.217562 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531317120}
I20260709 13:19:49.215499 19512 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:49.215123 19627 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:49.220156 19612 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.240157 14378 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:49.241488 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:49.219269 19631 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:49.188850 19629 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:19:49.223475 19619 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:19:49.283012 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 133835us
I20260709 13:19:49.235884 19623 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.240949 19634 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:49.271075 19509 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.002s
I20260709 13:19:49.244904 19630 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:49.278718 19544 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.000s
I20260709 13:19:49.235117 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:49.218070 19485 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:49.285681 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:49.229821 19502 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.243963 19595 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:49.304131 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 69176.5us
W20260709 13:19:49.288180 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 445807us
I20260709 13:19:49.287050 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:49.249332 19503 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:49.277709 14297 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:19:49.284677 19629 consensus_queue.cc:1243] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:19:49.356320 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50976.9us
I20260709 13:19:49.252446 19027 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:19:49.299518 19547 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:49.293208 19634 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:49.373968 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:49.242551 19444 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:49.385414 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 103348us
I20260709 13:19:49.350503 19635 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:49.350257 19641 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:49.244390 19593 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.298823 19509 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:49.283842 19631 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.264122 19512 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.390547 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:49.399901 19595 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.401207 19372 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:49.402071 19560 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:49.403007 19506 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:49.406044 19571 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:49.406283 19134 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:49.411509 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 124503us
I20260709 13:19:49.247285 19537 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.348320 19544 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.432982 19160 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:49.438119 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47785.7us
I20260709 13:19:49.412644 19641 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:49.470026 19619 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:49.431001 19372 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.479764 19027 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.471664 14227 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:49.482040 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.441228 19549 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:49.469303 19560 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:49.470500 19625 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:49.485350 19641 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:49.466331 19630 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:49.488968 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:49.475028 19134 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:49.490082 14224 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:19:49.490280 19626 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:19:49.491618 19487 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.803s	user 0.009s	sys 0.003s
I20260709 13:19:49.491914 19509 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:49.493976 19544 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:49.410991 19653 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:19:49.494433 19560 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:49.495579 19512 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:49.497012 19631 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:49.528120 19535 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:49.514027 19659 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:49.529093 19542 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:49.531432 19542 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:49.531481 19561 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.532402 19542 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:49.522874 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:49.500618 19502 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:49.503649 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:49.470095 19574 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:49.508965 14223 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:49.506462 19635 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:49.510142 19627 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:49.434790 19612 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.542212 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:49.538973 14867 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.497555 19537 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.486423 19372 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:49.515594 14374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1245) took 1934 ms (client timeout 2443 ms). Trace:
W20260709 13:19:49.546168 14374 rpcz_store.cc:269] 0709 13:19:47.581231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.858846 (+277615us) service_pool.cc:224] Handling call
0709 13:19:49.515387 (+1656541us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54003c37d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:49.515537 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588092288}
I20260709 13:19:49.518637 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:49.533581 19542 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.521082 19134 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:49.521265 14302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 974) took 1498 ms (client timeout 1941 ms). Trace:
W20260709 13:19:49.554791 14302 rpcz_store.cc:269] 0709 13:19:48.022722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.029418 (+  6696us) service_pool.cc:224] Handling call
0709 13:19:49.521096 (+1491678us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54003afa54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:49.521208 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236244352}
I20260709 13:19:49.507366 19625 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:49.529852 19480 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:49.556342 19480 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:49.556548 19625 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.557152 19480 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.548652 19549 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:49.543051 19509 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:49.558249 19612 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:49.558740 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:49.517659 19653 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:49.541155 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 167359us
I20260709 13:19:49.520040 19560 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.547794 14224 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:49.549830 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:49.551707 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:49.555447 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.562435 14223 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:19:49.562319 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:49.526264 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2765) took 2153 ms. Trace:
I20260709 13:19:49.529618 19485 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:49.563364 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:49.530781 19293 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:49.562919 14229 rpcz_store.cc:276] 0709 13:19:47.372994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.373186 (+   192us) service_pool.cc:224] Handling call
0709 13:19:47.457106 (+ 83920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.328060 (+870954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.526048 (+1197988us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54002bd9d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:49.526208 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959732992}
I20260709 13:19:49.514449 19215 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.576490 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:49.577253 14229 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.514961 19487 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:49.533665 19561 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:49.562438 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.530251 19659 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:49.568204 19612 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:49.568791 19635 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.558343 19509 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:49.570176 19660 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.564093 19653 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:49.570550 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:49.563912 19549 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:49.570971 19502 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:49.601357 14229 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:49.573498 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:49.558514 19619 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:49.571226 19655 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:19:49.609061 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:49.561064 19640 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.553296 19512 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.529709 19630 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.558374 19480 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.584169 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:49.587867 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.622503 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2760) took 2270 ms. Trace:
I20260709 13:19:49.622957 14221 rpcz_store.cc:276] 0709 13:19:47.351779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.351916 (+   137us) service_pool.cc:224] Handling call
0709 13:19:47.370980 (+ 19064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.120267 (+1749287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.622237 (+501970us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003e0654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:49.622441 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3741161600}
I20260709 13:19:49.564040 19625 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.603816 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:49.604841 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:49.629877 14229 raft_consensus.cc:2410] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:19:49.586876 19652 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.610328 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:49.652137 14900 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:49.653918 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49127.3us
I20260709 13:19:49.613108 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:49.592623 19509 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.651496 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:49.611999 19561 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:49.659720 14229 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:49.609897 19612 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:49.655977 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 68210.1us
I20260709 13:19:49.654424 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 962) took 2671 ms. Trace:
I20260709 13:19:49.661764 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.665259 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:49.666123 14223 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.665915 14301 rpcz_store.cc:276] 0709 13:19:46.982691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.511104 (+528413us) service_pool.cc:224] Handling call
0709 13:19:47.530948 (+ 19844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.593725 (+ 62777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.594405 (+   680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:47.594502 (+    97us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:47.594559 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.654061 (+2059502us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b54003d3bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:49.654129 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.654325 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143716224}
I20260709 13:19:49.670660 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:49.672118 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:49.672880 14897 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.672123 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.677208 14192 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.678336 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.613595 19572 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.658680 19640 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.663836 19663 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:49.682034 19520 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.990s	user 0.012s	sys 0.001s
I20260709 13:19:49.613073 19549 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.676035 19535 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.696301 14901 raft_consensus.cc:2368] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13.
I20260709 13:19:49.703258 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:49.706554 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:49.761894 19664 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:19:49.756508 14221 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:49.760479 19662 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:49.799435 14223 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:19:49.813686 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:49.814472 14223 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.761001 19650 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.762149 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:49.759308 19512 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.682309 19560 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.694600 19520 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:49.759392 19411 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.763723 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:49.684134 19027 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:49.802934 14897 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:49.807713 14893 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 10. Ops: []
I20260709 13:19:49.807818 19647 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:49.610137 19627 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:49.808686 14377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2579) took 3250 ms (client timeout 1511 ms). Trace:
I20260709 13:19:49.809497 14892 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:49.831278 14377 rpcz_store.cc:269] 0709 13:19:46.558367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.586301 (+ 27934us) service_pool.cc:224] Handling call
0709 13:19:49.808473 (+3222172us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002599d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:49.808610 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2615214336}
I20260709 13:19:49.805856 19610 raft_consensus.cc:2764] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:19:49.827266 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:49.824405 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 146126us
I20260709 13:19:49.817564 14894 raft_consensus.cc:606] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:49.696805 19342 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 13:19:49.808686 19071 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:49.802767 19485 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.832870 14225 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:49.844789 14226 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 15: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:49.835310 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.846712 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.851882 14223 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:49.853765 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.841311 19502 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:49.872341 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:49.883121 19502 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:49.884498 19502 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.679843 19653 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.840809 19071 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:49.894912 19071 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.892236 19635 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:49.896605 19654 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:19:49.896608 19635 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.897673 19654 consensus_queue.cc:1243] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:49.852747 19485 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.898321 19654 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:49.898715 19654 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:49.899714 19635 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:49.899868 19485 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:49.899573 19654 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.872712 19610 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:49.683642 19660 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.190s
I20260709 13:19:49.833902 19647 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.868021 19027 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.686769 19656 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.205s
I20260709 13:19:49.872952 19631 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:49.871378 19663 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.869025 19487 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:49.901096 19654 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.871564 19215 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:49.911234 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:49.826069 19512 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.843753 19650 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:19:49.911506 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:49.824465 19612 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:49.930446 19666 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:49.930650 19650 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:49.931371 19650 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:49.905215 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:49.852509 19655 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:19:49.905460 19558 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:49.941345 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.942679 14296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 2945) took 1777 ms (client timeout 2229 ms). Trace:
W20260709 13:19:49.943248 14296 rpcz_store.cc:269] 0709 13:19:48.165602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.234848 (+ 69246us) service_pool.cc:224] Handling call
0709 13:19:49.942425 (+1707577us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54000906d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:49.942602 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1501835520}
I20260709 13:19:49.696669 19659 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.949782 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1192) took 1704 ms. Trace:
I20260709 13:19:49.950418 14899 rpcz_store.cc:276] 0709 13:19:48.245467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.249115 (+  3648us) service_pool.cc:224] Handling call
0709 13:19:49.118265 (+869150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.125689 (+  7424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.949587 (+823898us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b5400268ed0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:49.949724 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1998000896}
W20260709 13:19:49.957144 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.957439 19512 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:49.958254 19572 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:49.968524 19644 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.492s	user 0.003s	sys 0.000s
I20260709 13:19:49.959280 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 2934) took 2689 ms. Trace:
I20260709 13:19:49.969100 14298 rpcz_store.cc:276] 0709 13:19:47.269610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.608202 (+338592us) service_pool.cc:224] Handling call
0709 13:19:47.685277 (+ 77075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.763904 (+ 78627us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:47.841187 (+ 77283us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.183083 (+341896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:48.183154 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:48.183209 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.959030 (+1775821us) spinlock_profiling.cc:243] Waited 78.3 ms on lock 0x7b54001a1154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:49.959081 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.959214 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":205907,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":9068,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"spinlock_wait_cycles":180178176,"thread_start_us":399420,"threads_started":2,"wal-append.queue_time_us":499531,"wal-append.run_cpu_time_us":2029,"wal-append.run_wall_time_us":1163391}
I20260709 13:19:49.960083 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2772) took 1989 ms. Trace:
I20260709 13:19:49.971341 14228 rpcz_store.cc:276] 0709 13:19:47.970988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.972075 (+  1087us) service_pool.cc:224] Handling call
0709 13:19:47.972382 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.194886 (+222504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.959838 (+1764952us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400051c54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:49.960023 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276669824}
I20260709 13:19:49.977210 19173 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:49.978677 19374 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:49.979126 19374 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:49.980010 19374 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:49.984555 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.987263 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.987469 14403 heartbeater.cc:646] Failed to heartbeat to 127.12.208.190:37027 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.208.190:37027 timed out after 15.000s (SENT)
I20260709 13:19:49.987789 19520 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:49.912861 19656 consensus_queue.cc:1243] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:49.989480 19134 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:49.990114 19134 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:49.991575 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2386) took 1362 ms. Trace:
I20260709 13:19:49.992435 19134 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:49.996548 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:49.997272 14369 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:19:49.998471 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.000027 19503 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:50.000458 19503 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:50.002619 14864 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:50.003832 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:50.004093 19637 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.809s	user 0.000s	sys 0.003s
I20260709 13:19:50.004524 14376 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:50.005115 19660 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:50.006182 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.007102 14376 raft_consensus.cc:2410] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:19:50.006791 19660 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:50.010231 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.010910 14376 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:50.013443 14370 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:50.015240 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:50.016038 14893 raft_consensus.cc:2368] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14.
I20260709 13:19:50.017860 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1244) took 2054 ms. Trace:
I20260709 13:19:50.018313 14895 rpcz_store.cc:276] 0709 13:19:47.963821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.099829 (+136008us) service_pool.cc:224] Handling call
0709 13:19:48.100120 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.221853 (+121733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.017606 (+1795753us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b54005f5854. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:50.017778 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52886784}
I20260709 13:19:50.020089 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.020387 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1253) took 1046 ms. Trace:
I20260709 13:19:50.020758 14901 rpcz_store.cc:276] 0709 13:19:48.974031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.974690 (+   659us) service_pool.cc:224] Handling call
0709 13:19:50.020206 (+1045516us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400624b54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:50.020333 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657102592}
I20260709 13:19:50.021914 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:50.022589 14377 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:50.022861 14892 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.024675 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:50.028570 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:49.996585 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1252) took 1024 ms. Trace:
I20260709 13:19:50.031245 19411 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.032341 14375 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:50.017884 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.030542 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:50.001466 19503 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:49.992086 14226 rpcz_store.cc:276] 0709 13:19:48.628824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.732530 (+103706us) service_pool.cc:224] Handling call
0709 13:19:49.991346 (+1258816us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540014a0d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:49.991496 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467286400}
I20260709 13:19:50.034799 19503 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.036042 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2377) took 1489 ms. Trace:
I20260709 13:19:50.036165 19509 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.036466 14227 rpcz_store.cc:276] 0709 13:19:48.546768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.625226 (+ 78458us) service_pool.cc:224] Handling call
0709 13:19:48.625541 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.489073 (+863532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.035802 (+546729us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b5400341554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:50.035979 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875658624}
I20260709 13:19:50.037537 14224 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:50.039219 14377 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
W20260709 13:19:50.039511 19624 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.080s	user 0.002s	sys 0.000s
I20260709 13:19:50.040122 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.041410 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:50.043663 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.046463 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:50.044416 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.047063 14374 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.049067 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:50.049494 14300 pending_rounds.cc:85] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 8
I20260709 13:19:50.049695 14373 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:50.049878 14300 pending_rounds.cc:107] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:19:50.050156 14300 raft_consensus.cc:2889] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.051432 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:50.053326 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 76347us
I20260709 13:19:50.054234 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:50.053403 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:49.918619 19631 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:50.057209 19655 consensus_queue.cc:1243] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:50.058262 19011 raft_consensus.cc:3055] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:50.058682 19011 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:50.059170 19631 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:50.059476 19011 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.060706 19011 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.063768 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:50.065400 14220 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:50.066157 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:50.066857 14304 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:50.068236 14220 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:50.069460 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:50.069772 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:50.031733 14898 rpcz_store.cc:276] 0709 13:19:48.971926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.125976 (+154050us) service_pool.cc:224] Handling call
0709 13:19:49.144615 (+ 18639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.221134 (+ 76519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.221168 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.223445 (+  2277us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.345244 (+121799us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:49.383361 (+ 38117us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.386266 (+  2905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.996205 (+609939us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b54005014d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:49.996255 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.996306 (+    51us) raft_consensus.cc:1685] finished
0709 13:19:49.996392 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.996526 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2587,"prepare.queue_time_us":29794,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2629,"raft.queue_time_us":79661,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":72662,"spinlock_wait_cycles":168005504,"thread_start_us":86348,"threads_started":1,"wal-append.queue_time_us":248247}
I20260709 13:19:50.071090 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:50.071996 14302 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:50.072975 14370 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:50.073596 14220 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:50.054172 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:50.074714 14302 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:50.075402 14374 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:50.077208 14297 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:49.823925 19662 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.080118 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:50.081668 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:50.082618 14220 raft_consensus.cc:2368] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15.
I20260709 13:19:50.082965 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:50.083307 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:50.084498 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:50.085002 14297 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:50.075071 14302 pending_rounds.cc:85] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 5
I20260709 13:19:50.085953 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:50.086122 14302 pending_rounds.cc:107] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:50.086476 14302 raft_consensus.cc:2889] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.090394 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:50.090692 14298 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:19:50.091225 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49910.6us
I20260709 13:19:50.092779 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:50.094259 14270 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:50.100237 14296 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:50.103024 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:50.104056 14221 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:50.104647 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.105221 14301 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.106464 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:50.107429 14303 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:19:50.108074 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 212249us
I20260709 13:19:50.109215 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:50.017556 19647 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:50.112481 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:49.966132 19372 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.126260 14296 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:50.126583 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:50.087924 19293 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:50.154031 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 44902.1us
I20260709 13:19:50.146327 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:50.154296 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:50.154449 14899 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:19:50.155467 14270 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:50.156148 14298 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:50.156445 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:50.154240 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:50.159950 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:50.157923 19509 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:50.163146 14193 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:50.163362 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:50.118072 19631 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:50.168027 14377 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:50.173427 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.163362 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:50.174582 14898 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:50.174877 14893 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:50.176949 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:50.179747 14899 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.130517 19507 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.166739 19645 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:50.158020 19293 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.211548 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:50.194380 14373 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 10. Ops: []
I20260709 13:19:50.181608 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.183941 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:50.130352 19643 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:50.162432 19623 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:50.182250 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:50.186631 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.146016 19655 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.118963 19559 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:19:50.162117 19485 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:50.171906 14370 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:50.163793 19539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.854s	user 0.020s	sys 0.018s
I20260709 13:19:50.215663 19643 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.232614 19643 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.211639 19542 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:19:50.233712 19542 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:50.234769 19621 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:50.235291 19621 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:50.147218 19480 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.002s
I20260709 13:19:50.237979 19655 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:50.230423 19634 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.840s	user 0.005s	sys 0.007s
I20260709 13:19:50.238986 19634 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.240257 19655 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:50.212667 14226 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:50.213527 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.214124 14374 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:50.214747 14301 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:50.185263 19569 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:50.243243 19539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.937s	user 0.021s	sys 0.018s
I20260709 13:19:50.243572 19539 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:50.244509 19539 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.246124 19485 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:50.246979 19485 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:50.180940 19482 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:50.225713 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 43557.8us
I20260709 13:19:50.226310 19656 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:50.227658 19662 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:50.211704 19134 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:19:50.181617 19520 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:19:50.238346 19480 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:50.153124 19487 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:50.290537 14374 pending_rounds.cc:85] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 7
I20260709 13:19:50.291020 14374 pending_rounds.cc:107] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:19:50.291340 14374 raft_consensus.cc:2889] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.162909 19671 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:50.232107 14297 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:19:50.090960 19566 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:50.256969 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:50.299098 14377 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:19:50.299611 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:50.191284 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:50.302896 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.283349 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:50.222755 19293 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.281543 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:50.283120 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 383802us
I20260709 13:19:50.185019 19512 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:19:50.232194 19237 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:50.257508 19625 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.601s	user 0.005s	sys 0.004s
I20260709 13:19:50.237769 19621 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:50.262871 14301 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:50.258677 19071 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.260181 19634 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:50.295394 19559 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:50.310338 19656 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:50.311159 14220 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 13:19:50.288394 19537 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.739s	user 0.008s	sys 0.003s
I20260709 13:19:50.353425 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:50.313428 14377 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:50.313596 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:50.317454 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.317399 14228 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.335086 19613 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:50.286773 19480 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:50.338718 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:50.341572 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 233205us
W20260709 13:19:50.342324 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 238659us
W20260709 13:19:50.306257 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 115088us
I20260709 13:19:50.262676 19661 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:19:50.359515 19613 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:50.366160 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:50.366519 19613 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:50.366770 14372 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:50.257743 19593 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:19:50.370447 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:50.305864 19487 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:50.372334 19487 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:50.310026 18872 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:50.374097 19682 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:50.322423 14270 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:50.336620 19302 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:50.345233 19641 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.004s
I20260709 13:19:50.256002 19482 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:50.365450 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.310602 19566 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:50.379112 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56838.9us
I20260709 13:19:50.380605 14373 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:19:50.351712 14375 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:50.336836 19549 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:19:50.339073 19237 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.386554 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.392989 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:50.377846 19537 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:50.395289 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:50.354982 19559 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.402160 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.377811 19682 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:50.387306 19512 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.409898 14375 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:50.392560 19372 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:50.416265 19653 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.422045 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:50.402750 19678 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:50.385267 19641 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:50.422928 14301 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:50.421485 14372 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:50.389990 19302 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.434432 19566 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:50.439633 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.440361 14376 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:50.429478 14125 catalog_manager.cc:5697] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:50.444088 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:50.444752 14303 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:50.447175 19237 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:50.451382 14895 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.453359 14901 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:50.417873 19632 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.418170 19537 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:50.468487 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.474304 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:50.462642 14867 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:50.475253 14301 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.474535 14304 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:50.478420 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:50.478986 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:50.479957 14900 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:50.425071 19678 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:50.468184 19566 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.420075 19631 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:50.477634 19634 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:50.491946 19642 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.011s	sys 0.002s
I20260709 13:19:50.417491 19480 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:50.500885 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 138399us
I20260709 13:19:50.467866 19593 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:19:50.503683 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 138498us
W20260709 13:19:50.506685 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 142259us
I20260709 13:19:50.504101 14301 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:19:50.474291 19632 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.494899 19560 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:50.432289 19482 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.487226 19428 consensus_queue.cc:1059] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:19:50.503516 19612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.020s	sys 0.009s
W20260709 13:19:50.501466 19642 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.011s	sys 0.002s
I20260709 13:19:50.524747 14301 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:50.499863 19342 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:19:50.537302 14301 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:50.496546 19566 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.503921 19411 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:19:50.525125 19480 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.501891 19647 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:19:50.542160 14371 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:19:50.529381 19612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.020s	sys 0.010s
I20260709 13:19:50.521054 19634 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:50.543923 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:50.551584 19342 consensus_queue.cc:1243] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:50.515880 19643 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:50.540514 19482 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.490866 19682 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:50.562917 19374 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:50.610591 19682 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:50.524011 19537 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.564512 19569 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:50.566825 14898 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:50.652132 14898 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:50.567752 19662 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:50.574736 19692 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:19:50.578239 19689 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:19:50.578630 19634 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:50.579836 19688 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:50.581094 19632 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:50.598419 19502 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:50.666371 19634 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:50.583508 19559 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:50.587347 14295 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:50.558153 19678 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:50.674103 19678 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:50.588982 19566 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:50.589673 19659 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:50.678164 19659 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:50.679242 19659 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.680616 19659 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.590034 19411 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.590780 19293 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:50.555846 19631 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:50.684015 19293 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:50.591537 19302 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:50.685130 19411 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:50.598838 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55015us
I20260709 13:19:50.557339 19647 consensus_queue.cc:1243] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:19:50.599666 14303 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:19:50.583434 19641 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:50.577629 19011 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.000s
I20260709 13:19:50.653020 14898 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.706557 19650 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.707706 19650 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:50.667543 19662 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:50.675629 19507 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:50.546029 14301 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:19:50.713470 19428 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:50.715306 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:50.741133 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:50.742620 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:50.745397 14220 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:50.748919 14227 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:50.756299 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:50.756690 14228 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:50.757192 14224 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:50.675932 19613 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:50.768227 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:50.771889 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:50.749480 19635 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:50.744240 19428 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:50.779078 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.759833 19503 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.000s
I20260709 13:19:50.784400 14302 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:50.757966 19071 raft_consensus.cc:2764] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:19:50.785883 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:50.786476 14893 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.791124 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:50.791807 14900 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 12: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:50.789577 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:50.792891 14901 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:50.793607 14270 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:50.777603 19485 raft_consensus.cc:2764] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:50.777828 19502 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:50.779439 19507 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:19:50.785946 19532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.591s	user 0.000s	sys 0.012s
I20260709 13:19:50.780968 19635 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:50.802743 19532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.610s	user 0.000s	sys 0.012s
I20260709 13:19:50.807464 14378 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
W20260709 13:19:50.807494 19702 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:50.816622 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58440 (request call id 18) took 1154 ms. Trace:
I20260709 13:19:50.817116 14894 rpcz_store.cc:276] 0709 13:19:49.669213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.761982 (+ 92769us) service_pool.cc:224] Handling call
0709 13:19:50.816197 (+1054215us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b54006bcea0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded009520 00007f8ded086652 00007f8df205460a 00007f8deb5da7d4 00007f8deb5da762 00007f8deb5da691 00007f8deb5da60c 00007f8deb5d98c2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:50.816503 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44805376}
I20260709 13:19:50.818090 19428 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.819177 19561 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:50.819468 19428 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:50.819613 19561 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:50.820523 19561 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:50.821517 19561 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.858039 14223 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:50.859803 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:50.862604 14225 pending_rounds.cc:85] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 11
I20260709 13:19:50.863003 14225 pending_rounds.cc:107] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:19:50.863312 14225 raft_consensus.cc:2889] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.863510 14296 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:50.864765 14301 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.865674 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:50.866235 14301 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:19:50.868077 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:50.868718 14303 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:50.870149 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:50.823931 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 424558us
I20260709 13:19:50.826673 19411 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:50.804670 19372 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:50.942889 19372 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:50.943338 19372 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.828934 19699 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:50.829912 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.985848 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.832110 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.987015 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.987474 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.990170 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.991003 14370 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:50.992743 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.993628 14372 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:50.797303 19643 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:50.848176 14224 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:19:50.806697 19642 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:50.852087 19613 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:50.852555 14893 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:50.802044 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:51.020259 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 218276us
I20260709 13:19:51.020490 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:51.021124 14376 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:50.854312 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:50.934777 19302 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.822758 19684 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:50.871954 14341 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:51.031735 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:50.881778 14296 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:50.933722 14228 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:50.936360 14304 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:50.942414 14220 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:50.949864 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:50.958063 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:51.000697 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:50.946107 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88794.4us
I20260709 13:19:51.035929 14222 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:51.036365 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:50.997838 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 166363us
I20260709 13:19:50.787286 19662 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:51.022661 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 168403us
I20260709 13:19:50.866302 14223 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:51.024422 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:51.059815 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:51.027415 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:50.995919 19593 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.036983 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:50.850353 19635 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.002453 19659 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.058478 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:51.081120 14224 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
W20260709 13:19:51.061015 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 189151us
W20260709 13:19:51.081826 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44889.9us
I20260709 13:19:51.082355 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:51.083961 14341 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:51.085355 14341 leader_election.cc:400] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14.
I20260709 13:19:51.040841 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:51.014739 19642 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:51.085719 14341 leader_election.cc:403] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:51.098132 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2613) took 1087 ms. Trace:
I20260709 13:19:51.079442 19558 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:51.090202 19480 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:51.103340 14369 rpcz_store.cc:276] 0709 13:19:50.010824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.040287 (+ 29463us) service_pool.cc:224] Handling call
0709 13:19:50.040582 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.040799 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:50.296495 (+255696us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.818789 (+522294us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b1800457600. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:51.097257 (+278468us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.097500 (+   243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:51.097567 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:51.097745 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.097872 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.098054 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10523,"prepare.queue_time_us":329647,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2989,"raft.queue_time_us":452383,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":9571712,"thread_start_us":586438,"threads_started":3,"wal-append.queue_time_us":133111}
I20260709 13:19:51.058784 19548 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:51.106750 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 603702us
I20260709 13:19:51.087913 19342 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.063251 19643 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:51.108937 14341 leader_election.cc:400] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13.
I20260709 13:19:51.093189 19482 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:51.121345 14341 leader_election.cc:403] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:19:51.204651 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 95904us
W20260709 13:19:51.133548 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.199627 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.105329 19293 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14.
I20260709 13:19:51.058420 19134 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:19:51.216095 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.296898 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.079586 19071 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:19:51.101328 19411 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:51.038455 19612 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:51.347352 14894 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:51.091910 19634 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.116s
I20260709 13:19:51.091066 19659 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.091995 19630 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.257s
I20260709 13:19:51.091849 19539 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 13:19:51.094017 19647 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.257s
W20260709 13:19:51.454648 19537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.008s	sys 0.038s
I20260709 13:19:51.079658 19703 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.297s
I20260709 13:19:51.096692 19610 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.264s
I20260709 13:19:51.203962 19482 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.482676 19482 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:51.475262 19537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.009s	sys 0.038s
W20260709 13:19:51.490470 19708 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 13:19:51.109200 19548 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:51.492746 19548 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.094971 19682 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:51.213033 19444 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.495203 19444 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.108933 19653 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.352s
I20260709 13:19:51.498240 19653 consensus_queue.cc:1243] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:51.498986 19653 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.499517 19653 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.502535 19653 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.503659 19444 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.504410 19444 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:51.504845 19444 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:51.505879 19444 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:51.495213 19682 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.508038 19682 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.510736 19682 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.516619 19630 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:51.517258 19630 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:51.518389 19630 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.520049 19630 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:51.521982 19704 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.718s	user 0.001s	sys 0.000s
I20260709 13:19:51.111613 19619 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.349s
I20260709 13:19:51.454490 19643 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:51.346158 19374 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.262s
I20260709 13:19:51.038936 19302 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.463344 19293 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13.
I20260709 13:19:51.478705 19539 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:51.505610 19650 consensus_meta.cc:287] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.000s
W20260709 13:19:51.394156 19689 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:19:51.391943 19612 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.391443 19631 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:51.586046 19707 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:19:51.585768 19631 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.583302 19539 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.588742 19701 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:51.460654 19411 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:51.589450 19701 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:51.590332 19411 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.590695 19701 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.592474 19701 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:51.203608 19593 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:51.478919 19512 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.066s	user 0.006s	sys 0.005s
I20260709 13:19:51.595101 19512 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:51.596709 19613 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.594693 19593 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:51.597527 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:51.597530 19643 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:51.585021 14229 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:51.600883 14893 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:19:51.601869 19302 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:51.603185 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1272) took 1288 ms. Trace:
W20260709 13:19:51.455027 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.010s	sys 0.042s
I20260709 13:19:51.603858 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:51.594401 19612 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:51.604053 19659 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.604592 14228 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:51.578365 19619 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:51.606251 19619 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:51.607091 14369 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:19:51.607143 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:51.608019 14370 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:51.606187 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:51.609534 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:51.610348 14222 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:51.611435 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:51.578729 19704 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:19:51.597282 19613 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.471531 19642 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.583757 19507 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.615895 19642 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:51.615832 19507 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.619445 19548 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:51.604141 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.010s	sys 0.042s
I20260709 13:19:51.621994 19539 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:51.622273 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 1.11493e+06us
I20260709 13:19:51.622997 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:51.603639 14229 rpcz_store.cc:276] 0709 13:19:50.315018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.315173 (+   155us) service_pool.cc:224] Handling call
0709 13:19:50.315530 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.601145 (+1285615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.602967 (+  1822us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540033ed54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:51.603130 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2918638848}
I20260709 13:19:51.626734 14898 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.627735 19507 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.632011 14228 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:51.633502 19613 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.633940 19548 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:51.624658 19444 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:51.588902 19631 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.607316 19619 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.656275 14370 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:19:51.658506 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:51.669615 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 85870.7us
I20260709 13:19:51.645937 19374 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:51.683386 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:51.684443 14303 raft_consensus.cc:2368] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17.
I20260709 13:19:51.687180 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:51.677445 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:51.683223 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:51.673146 14295 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:51.661653 19619 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:51.688040 14297 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:19:51.682731 19699 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:19:51.646234 19539 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:19:51.571974 19482 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.700858 14299 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:51.707897 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:51.709029 14898 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:51.719724 14369 raft_consensus.cc:2368] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11.
I20260709 13:19:51.688934 19293 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:19:51.724014 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1215) took 1422 ms. Trace:
I20260709 13:19:51.725389 14898 rpcz_store.cc:276] 0709 13:19:50.301607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.301843 (+   236us) service_pool.cc:224] Handling call
0709 13:19:50.302238 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.566719 (+264481us) spinlock_profiling.cc:243] Waited 68.1 ms on lock 0x7b5400883220. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded003dc0 00007f8ded08e1c0 00007f8ded08f231 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c
0709 13:19:51.616533 (+1049814us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b58009920d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8decfe80aa 00007f8ded06a447 00007f8ded082fe7 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4
0709 13:19:51.709646 (+ 93113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.723934 (+ 14288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2249719808}
I20260709 13:19:51.686731 19713 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:19:51.722231 19372 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.778s	user 0.006s	sys 0.006s
W20260709 13:19:51.731801 19661 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:19:51.802736 14374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.040s	sys 0.053s
W20260709 13:19:51.803838 14374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.040s	sys 0.053s
W20260709 13:19:51.806053 14192 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.005s	sys 0.005s
W20260709 13:19:51.806545 14192 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.005s	sys 0.005s
W20260709 13:19:51.807153 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 738543us
W20260709 13:19:51.810050 14193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.009s	sys 0.001s
W20260709 13:19:51.810509 14193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.009s	sys 0.001s
W20260709 13:19:51.810911 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 703209us
I20260709 13:19:51.809675 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:51.814838 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.009s	sys 0.004s
W20260709 13:19:51.815138 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.815451 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.010s	sys 0.005s
W20260709 13:19:51.815274 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 202877us
W20260709 13:19:51.816345 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.817166 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.816370 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 775564us
I20260709 13:19:51.818710 14898 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:51.819725 14865 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:51.821586 19558 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:51.744426 19372 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.823859 19558 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:51.827035 19173 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:51.831409 19293 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:51.831769 19569 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:51.832963 19293 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.833444 19539 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:51.833052 19569 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:51.842176 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.834378 19374 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:51.846549 19342 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:51.846365 19660 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:51.847268 19342 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.847136 19374 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:51.847844 19342 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:51.871556 19723 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:51.872483 19723 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:51.870306 19722 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.876201 19520 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.876507 19722 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.877197 19520 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.877980 19428 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.879168 19428 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.879981 19520 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.880759 19520 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:51.883145 19561 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.946s	user 0.009s	sys 0.003s
I20260709 13:19:51.899101 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:51.902266 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:51.908133 14373 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:51.909657 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:51.910144 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:51.911093 19507 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:51.912900 14375 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: [13.8-15.10]
I20260709 13:19:51.925089 19372 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.926276 19660 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:51.926460 19293 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:51.927448 19660 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.928141 19660 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:51.930735 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.932284 19569 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:51.932859 19631 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:51.934002 19631 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.937932 19613 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.938795 19613 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.940042 19722 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.943262 14373 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:19:51.953892 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:51.958369 14342 leader_election.cc:400] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17.
I20260709 13:19:51.958842 14342 leader_election.cc:403] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:51.959288 19520 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:51.959450 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 96404.1us
I20260709 13:19:51.960125 19520 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:51.961279 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:51.963337 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:51.966542 19723 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:51.963639 19482 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.912597 19507 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:51.970321 19699 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:51.937681 19631 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:51.966601 19560 raft_consensus.cc:3055] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:51.987401 19632 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:51.990161 19293 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:51.995002 19703 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:51.998714 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.016518 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:52.017406 14375 raft_consensus.cc:2376] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14. Re-sending same reply.
I20260709 13:19:51.970433 19710 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:19:52.022471 19302 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:52.023149 19302 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.020426 14226 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:19:52.023638 19302 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.024865 19635 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:52.026729 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.027694 19662 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.030259 19520 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:52.030624 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.030373 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.015302 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:51.986251 19560 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:51.985738 19428 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:52.039808 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:52.044682 14222 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:52.059770 14225 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:52.059973 19560 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.061568 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:52.063490 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 202773us
I20260709 13:19:52.066044 19714 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:52.066582 19714 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:52.067937 19714 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:52.069252 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.071780 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2852) took 1881 ms. Trace:
I20260709 13:19:52.072172 19507 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.074612 19566 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:52.075641 19566 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:52.082157 14270 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:52.069581 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1275) took 1785 ms. Trace:
I20260709 13:19:52.084324 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:52.082962 14374 rpcz_store.cc:276] 0709 13:19:50.284564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.284746 (+   182us) service_pool.cc:224] Handling call
0709 13:19:50.285099 (+   353us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:50.298464 (+ 13365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.298512 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:50.299384 (+   872us) log.cc:844] Serialized 78 byte log entry
0709 13:19:50.468602 (+169218us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:50.492318 (+ 23716us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.805420 (+1313102us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.069163 (+263743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.069266 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.069331 (+    65us) raft_consensus.cc:1685] finished
0709 13:19:52.069344 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.069496 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":542095,"prepare.queue_time_us":53401,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":106,"raft.queue_time_us":1077230,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":1721,"thread_start_us":1146997,"threads_started":3,"wal-append.queue_time_us":385162,"wal-append.run_cpu_time_us":3746,"wal-append.run_wall_time_us":1195037}
I20260709 13:19:52.077286 19566 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:52.086040 19632 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:52.086894 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2407) took 1822 ms. Trace:
I20260709 13:19:52.097235 14221 rpcz_store.cc:276] 0709 13:19:50.264085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.264312 (+   227us) service_pool.cc:224] Handling call
0709 13:19:50.298172 (+ 33860us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.711288 (+413116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.711326 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.711771 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.769165 (+ 57394us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:50.769207 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.077626 (+1308419us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b540033d454. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:52.077701 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.078020 (+   319us) raft_consensus.cc:1685] finished
0709 13:19:52.078044 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.086690 (+  8646us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3169,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":949179648,"thread_start_us":56836,"threads_started":1,"wal-append.queue_time_us":309982}
I20260709 13:19:52.089078 19610 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.104959 14378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2413) took 1918 ms (client timeout 2026 ms). Trace:
I20260709 13:19:52.105490 19610 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.108261 19610 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.104377 19725 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:52.110392 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 149293us
I20260709 13:19:52.104382 19641 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:52.111891 19641 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:52.113336 19713 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:52.113811 19713 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.072222 14302 rpcz_store.cc:276] 0709 13:19:50.190525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.498268 (+307743us) service_pool.cc:224] Handling call
0709 13:19:50.498559 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.784869 (+286310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.071222 (+1286353us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b5400331654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:52.071565 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656853760}
I20260709 13:19:52.114301 19713 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.113072 19641 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.115697 19710 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:52.088913 14227 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:52.118561 19710 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:52.119014 19710 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:52.119479 19729 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:52.119905 19729 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:52.121455 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.122125 19719 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.122797 19719 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.125304 19719 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.126420 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.126915 14375 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:52.094005 19520 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:19:52.128890 19520 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:52.127701 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.129602 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.130342 14372 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:52.131458 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.132272 14375 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:52.131333 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.133822 14373 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:52.129359 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:52.135070 14300 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.134768 19710 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:52.136200 19710 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.140801 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.141959 14302 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:52.121219 19729 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:52.158586 19735 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:19:52.158221 14125 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.159518 14370 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:52.160265 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 300157us
I20260709 13:19:52.161602 14344 leader_election.cc:400] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15.
I20260709 13:19:52.145535 19613 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.116587 19512 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:52.161523 14125 catalog_manager.cc:5697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:52.105688 14378 rpcz_store.cc:269] 0709 13:19:50.186235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.186402 (+   167us) service_pool.cc:224] Handling call
0709 13:19:52.104532 (+1918130us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b540039bcd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:52.104742 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341216640}
W20260709 13:19:52.163903 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 98119.4us
I20260709 13:19:52.165378 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:52.183141 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.185990 19512 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.188849 19512 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.083309 19714 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.190752 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:52.196301 19630 consensus_meta.cc:287] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.013s
I20260709 13:19:52.170457 19561 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:19:52.198203 19661 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.200558 19613 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.178002 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:52.203016 14224 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:19:52.203125 19560 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.203482 14224 pending_rounds.cc:85] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 9
I20260709 13:19:52.203816 14224 pending_rounds.cc:107] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:19:52.204098 14224 raft_consensus.cc:2889] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.204142 19342 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.200578 14125 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 9 to 15, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 15 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.208125 19656 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:52.208963 19656 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.209169 19678 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:52.209271 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:52.209659 19678 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:52.210320 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.210995 19678 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.212211 14375 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:52.212325 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:52.212836 19678 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.213263 14377 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.213999 14371 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:52.214424 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.216785 19539 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.217053 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55698us
I20260709 13:19:52.217509 19539 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.218006 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:52.218045 19630 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:52.220358 19539 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.198457 19542 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:52.220683 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:52.220496 19630 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:52.088620 19632 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:52.222113 19632 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.221232 19542 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.222623 19632 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:52.222733 19542 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:52.226316 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:52.227018 14226 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:52.226688 19507 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:52.203037 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 124498us
I20260709 13:19:52.236495 19630 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:52.236948 19642 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.014s
I20260709 13:19:52.237989 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.241005 14371 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:52.241592 19725 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.241899 19719 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:52.242398 19725 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.242861 19659 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.243594 19659 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.245191 19725 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.201272 19613 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.248294 14300 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:52.129381 19520 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:52.261291 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:52.264626 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.264705 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.266283 19712 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:52.267171 19444 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.596s	user 0.016s	sys 0.006s
I20260709 13:19:52.267719 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:52.267875 19642 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.268502 14299 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.268438 14374 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:19:52.270098 14374 pending_rounds.cc:85] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 6
I20260709 13:19:52.270509 14374 pending_rounds.cc:107] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:19:52.270793 14374 raft_consensus.cc:2889] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.270865 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.272397 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.274325 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.275545 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.276613 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.277223 14303 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:52.278555 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:52.273741 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.281258 14299 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:52.279603 14302 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
W20260709 13:19:52.280198 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49911.2us
I20260709 13:19:52.284651 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:52.286419 14370 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:19:52.289527 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.291491 14371 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:52.291875 14369 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:52.293071 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:52.297297 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.300094 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.301352 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.303423 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.312665 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.313485 14302 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:19:52.306944 14125 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 8 to 11, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 11 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.318146 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:52.209575 19656 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.268554 19642 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.356024 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:52.358629 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:52.359671 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 139117us
W20260709 13:19:52.360702 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.369908 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.379271 14295 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:19:52.379926 19728 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:19:52.332623 19342 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:52.352837 19560 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:52.357007 19613 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:52.404177 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 115688us
I20260709 13:19:52.407975 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.351912 19631 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:19:52.408846 19560 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.409549 19656 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:52.410368 19701 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.731s	user 0.008s	sys 0.014s
I20260709 13:19:52.410915 19718 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:52.411320 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.415551 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.415763 19659 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:52.423823 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.430172 19642 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:52.365720 19710 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:52.477511 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.431936 19713 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.433262 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.434805 14897 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:52.435168 19485 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:52.439217 19660 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.004s
I20260709 13:19:52.367570 19610 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:52.453109 14377 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:52.409173 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:52.454397 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:52.405740 19725 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:52.474246 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.477355 14299 raft_consensus.cc:2410] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:52.467023 19635 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:52.500630 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.477353 14125 catalog_manager.cc:5697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.480435 19710 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.505162 14378 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: [10.11-10.11]
W20260709 13:19:52.505518 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 96428.3us
I20260709 13:19:52.506228 14193 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:52.503285 19444 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.487017 19485 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:52.503649 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:52.504560 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:52.501212 19699 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:19:52.522200 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.527459 14895 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:52.527606 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:52.528260 14893 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.528527 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.528470 19635 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.529861 19656 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.530544 19656 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.532706 19656 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.533049 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:52.534044 19374 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:52.536010 19374 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:52.536989 19612 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.842s	user 0.009s	sys 0.011s
I20260709 13:19:52.537367 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:52.552606 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 154168us
I20260709 13:19:52.537484 19612 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.554057 14125 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.555740 14297 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:52.555924 14125 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 10 to 13, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 13 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:52.557056 19612 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.518036 19444 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:52.558342 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.558918 14123 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37080 (request call id 331) took 41422 ms (client timeout 15000 ms). Trace:
I20260709 13:19:52.538280 19593 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:52.538138 19539 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:52.538679 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 210112us
I20260709 13:19:52.542870 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.544651 19342 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.546528 19542 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:52.485921 19520 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.519647 19485 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.518748 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:52.551834 19560 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:52.510443 19610 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:52.554176 19725 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.554104 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:52.523828 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:52.563030 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:52.508822 19710 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.567032 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.518748 19722 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:52.597059 19722 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.597587 19722 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.521688 19699 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17.
I20260709 13:19:52.510449 19630 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.571623 14901 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:19:52.527390 19720 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:52.602057 19720 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.602473 19720 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.601727 19630 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:52.604875 19630 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:52.522058 19712 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:52.574937 14125 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 7 to 9, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 9 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:52.607137 14125 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.576722 14298 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.576848 19713 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.577351 19444 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:52.577764 14295 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.577948 19342 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.620911 19342 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:52.488696 19660 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.624073 19660 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:52.525362 19729 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.621910 14375 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:19:52.527549 19682 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.626583 19682 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.624516 14893 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:52.608979 14125 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 9 to 12, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 12 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.613631 19720 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.650837 14223 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:52.653229 19720 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.561200 14895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:52.676158 19635 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:52.677877 19612 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:52.678736 19612 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.680913 19542 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:52.682103 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 158147us
I20260709 13:19:52.592272 19714 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:19:52.685089 19661 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:52.685330 19718 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:52.686802 14372 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:52.687381 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 154510us
I20260709 13:19:52.677969 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:52.578909 19653 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:19:52.688256 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 169018us
W20260709 13:19:52.680965 19302 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.656s	user 0.012s	sys 0.000s
I20260709 13:19:52.706871 19659 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:52.707376 19659 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:52.707485 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:52.688807 19718 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:52.708477 19659 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:52.709452 19718 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:52.710423 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:52.711725 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:52.708362 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 188450us
I20260709 13:19:52.712608 19662 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.712849 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.713148 19662 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:52.713944 19342 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:52.714210 19520 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:52.715449 19662 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:52.716842 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 247078us
W20260709 13:19:52.717092 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.706584 19302 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.580348 19561 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:52.713464 14304 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:52.718950 14900 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 12: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:52.702361 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:52.736857 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:52.735327 14295 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:19:52.751910 14298 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:52.762897 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.747329 19682 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.762961 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.766503 14296 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:52.767076 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:52.767995 19342 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:52.769212 19661 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:52.768703 14125 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 9 to 10, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 10 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:52.680979 19612 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.772405 14342 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:52.703068 19641 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.775314 14898 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:52.776357 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.702627 19631 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.777631 14125 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:52.778954 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.781724 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.706115 19660 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.702862 19487 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:52.787351 19713 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:52.787791 19678 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:52.789986 19542 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:52.790653 19532 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:52.826404 19532 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.792234 19635 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.796120 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 242170us
W20260709 13:19:52.778306 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 71930.9us
I20260709 13:19:52.834259 14341 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:52.787714 14125 catalog_manager.cc:5697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 8 to 11, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 11 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.596004 19593 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.746865 19653 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:52.801226 19566 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:52.836453 19444 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.839569 19444 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:52.841679 19532 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:52.821714 19542 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.842510 19542 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:52.843485 19485 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.845973 14299 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:19:52.841679 19444 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:52.846431 19653 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.845712 19485 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.846438 19635 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.851477 19710 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.851799 19635 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:52.853049 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 150812us
I20260709 13:19:52.810153 19713 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:52.859117 19713 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.859450 14125 catalog_manager.cc:5697] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 11, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 11 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.860605 19713 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.802361 14865 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:52.866611 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 64364.6us
I20260709 13:19:52.810509 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:52.774557 19659 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.810343 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:52.825680 19302 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:52.827819 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:52.830497 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.832122 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:52.827560 19641 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.874540 14228 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:52.878221 14223 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
W20260709 13:19:52.559326 14123 rpcz_store.cc:269] 0709 13:19:11.136102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.136875 (+   773us) service_pool.cc:224] Handling call
0709 13:19:52.558606 (+41421731us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:40.689994 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:40.690988 (+   994us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:40.691060 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:19:40.691089 (+    29us) tablet.cc:662] Decoding operations
0709 13:19:40.692653 (+  1564us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:40.692802 (+   149us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:40.692844 (+    42us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:19:40.753747 (+ 60903us) tablet.cc:701] Row locks acquired
0709 13:19:40.790574 (+ 36827us) write_op.cc:260] PREPARE: finished
0709 13:19:40.848156 (+ 57582us) write_op.cc:270] Start()
0709 13:19:40.885983 (+ 37827us) write_op.cc:276] Timestamp: P: 1783603180838099 usec, L: 0
0709 13:19:40.887598 (+  1615us) op_driver.cc:348] REPLICATION: starting
0709 13:19:40.898536 (+ 10938us) log.cc:844] Serialized 4430 byte log entry
0709 13:19:41.344923 (+446387us) op_driver.cc:464] REPLICATION: finished
0709 13:19:41.408806 (+ 63883us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8de9f820ac 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8df0ac2ef0
0709 13:19:41.554188 (+145382us) write_op.cc:301] APPLY: starting
0709 13:19:41.612924 (+ 58736us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:42.071882 (+458958us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:42.087967 (+ 16085us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:42.850304 (+762337us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:42.942508 (+ 92204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:19:42.956404 (+ 13896us) write_op.cc:312] APPLY: finished
0709 13:19:43.080005 (+123601us) log.cc:844] Serialized 105 byte log entry
0709 13:19:43.410616 (+330611us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:43.520516 (+109900us) write_op.cc:454] Released schema lock
0709 13:19:43.546093 (+ 25577us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:43.565838 (+ 19745us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:43.565873 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6092,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":146746,"apply.run_cpu_time_us":64935,"apply.run_wall_time_us":2063774,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":34296,"prepare.run_cpu_time_us":35705,"prepare.run_wall_time_us":309266,"raft.queue_time_us":127757,"raft.run_cpu_time_us":9374,"raft.run_wall_time_us":99517,"replication_time_us":457005,"spinlock_wait_cycles":4142464,"thread_start_us":595368,"threads_started":5,"wal-append.queue_time_us":646474,"wal-append.run_cpu_time_us":10086,"wal-append.run_wall_time_us":2258630}]]}
W20260709 13:19:52.888181 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.897593 14125 catalog_manager.cc:5697] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 10, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 10 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:52.805876 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:52.876333 19632 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.001s
I20260709 13:19:52.876150 19635 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:52.877079 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 93883.9us
I20260709 13:19:52.780252 19560 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:52.882027 14220 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:52.901484 14298 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:52.885980 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:52.912442 14221 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.913502 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:52.917318 14896 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:19:52.917479 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:52.910761 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:52.853677 19710 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:52.921446 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:52.921528 14222 raft_consensus.cc:2368] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15.
I20260709 13:19:52.882184 19532 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:52.962548 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:52.963402 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50024.5us
I20260709 13:19:52.964648 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:52.968240 14375 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:52.966306 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:52.923009 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:52.949059 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.973278 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:52.975919 14377 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:19:52.817337 19561 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.980311 14374 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:52.910125 19712 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.811273 19660 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:52.988498 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.911195 19444 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:52.901612 19566 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:52.988008 14125 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:19:53.000548 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.005143 19539 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:52.997334 14303 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:52.900898 19372 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
W20260709 13:19:53.009752 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 88276.3us
I20260709 13:19:52.978863 19428 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:53.014537 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:53.017076 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:53.019546 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:52.902375 19701 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:19:53.022825 14895 raft_consensus.cc:606] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:53.074486 14895 raft_consensus.cc:614] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:52.917550 19632 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:53.034443 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.805600 19631 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:53.041428 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.025763 19444 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:53.042744 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:52.987632 19487 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.026007 19374 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:53.042255 19566 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.091277 19444 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.030386 19712 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:53.057057 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 316880us
I20260709 13:19:52.901134 19610 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.006323 19699 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:53.026014 19512 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:52.988337 19302 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:19:53.072204 19725 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:53.070039 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:53.070379 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:53.074388 14298 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.983363 19682 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:53.070935 19428 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.086652 14296 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.088436 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:53.055817 14221 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
W20260709 13:19:53.134795 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 64473.1us
I20260709 13:19:53.107486 14892 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:53.107926 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.112246 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.106271 19722 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.508s	user 0.013s	sys 0.000s
I20260709 13:19:53.131038 14369 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:53.080361 19539 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:53.140236 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 159025us
I20260709 13:19:53.068292 14125 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:19:53.144155 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:53.139701 19428 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:53.147781 19539 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:53.083688 19520 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:19:53.113121 19710 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.185007 14220 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
W20260709 13:19:53.186872 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 165519us
W20260709 13:19:53.191135 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.096998 19374 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.206192 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.206552 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:53.145323 19725 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:53.213559 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.196024 14125 catalog_manager.cc:5697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:53.215160 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:53.217056 14220 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:53.199433 14298 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:53.151669 19719 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.223356 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:53.233696 14302 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:19:53.243021 19763 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:19:53.243218 19561 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:53.193806 19532 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:53.193604 19539 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:53.253845 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:53.254877 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:53.141727 19699 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.145274 19722 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:53.259768 14372 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:53.253612 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:53.256623 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:53.194067 19682 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.262488 14298 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:53.217841 19725 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:53.275835 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.272344 14369 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:19:53.250962 19302 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.275467 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:53.254606 19593 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:53.277462 14371 raft_consensus.cc:2376] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17. Re-sending same reply.
I20260709 13:19:53.250658 19642 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:53.280212 14125 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 9 to 13, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 13 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:19:53.260949 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 345286us
I20260709 13:19:53.286065 14221 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:53.287557 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.283159 19507 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:53.301054 19783 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:53.264053 19641 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:53.249974 19710 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.279654 19725 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:53.323868 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 66846.6us
I20260709 13:19:53.328784 14125 catalog_manager.cc:5697] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 12 to 15, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 15 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:53.328043 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 104797us
I20260709 13:19:53.334306 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:53.320488 19507 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.335681 19699 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:53.337428 19764 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:19:53.344882 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 161528us
I20260709 13:19:53.344918 14125 catalog_manager.cc:5697] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:19:53.346573 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 129378us
I20260709 13:19:53.338348 19712 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:53.349135 14270 leader_election.cc:400] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15.
I20260709 13:19:53.350757 14270 leader_election.cc:403] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:19:53.358592 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:53.271493 19719 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.369009 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:53.352640 19728 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:19:53.288188 19539 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:53.289119 19302 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.297808 19766 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:19:53.413390 14377 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:53.387748 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:53.389060 14298 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:53.389279 19653 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:53.390118 19769 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.002s
I20260709 13:19:53.390679 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.391821 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:53.392311 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.426344 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.394024 19756 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:19:53.394418 14223 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:19:53.364593 19783 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:53.398386 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.378794 19612 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.403625 19682 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:53.350281 19660 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:53.435425 19783 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.436170 14302 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:53.437425 19071 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:53.438025 19372 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:53.419305 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:53.441867 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.442646 14227 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:53.381069 19632 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:53.443697 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.419878 19653 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.444588 19539 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:53.446117 19653 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:53.449366 19542 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.002s
W20260709 13:19:53.423334 19772 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:53.423563 14295 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:53.428736 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:53.394423 19762 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:19:53.402091 19487 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:53.424422 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:53.431928 14221 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:53.435590 14301 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:53.442531 14223 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:19:53.422475 19768 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:19:53.456770 14229 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:53.449755 14225 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:53.452809 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:53.454532 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:53.455135 19714 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.419787 19722 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:53.469380 14222 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:53.426093 19631 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:53.456472 19712 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:53.480975 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 108293us
I20260709 13:19:53.451244 19710 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:53.471696 19713 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.003s
I20260709 13:19:53.417018 19532 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:53.491309 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 118757us
I20260709 13:19:53.526587 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:53.527670 19428 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.465709 19542 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:53.494163 19374 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:53.530210 19512 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:53.530652 19512 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:53.495420 19770 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.501662 19610 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:53.502182 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.532173 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:53.534415 14221 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:53.533583 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:53.508154 19712 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:53.508952 19719 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:53.510820 19729 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.886s	user 0.013s	sys 0.000s
I20260709 13:19:53.485558 19777 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:53.548450 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.512336 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1019) took 1150 ms. Trace:
I20260709 13:19:53.548890 19561 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:53.549110 14304 rpcz_store.cc:276] 0709 13:19:52.362198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.867203 (+505005us) service_pool.cc:224] Handling call
0709 13:19:52.867570 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.882782 (+ 15212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.882811 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.883339 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.095581 (+212242us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:53.095620 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.095686 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.512082 (+416396us) raft_consensus.cc:1685] finished
0709 13:19:53.512108 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.512259 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50374,"raft.queue_time_us":15585,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":13971,"thread_start_us":103247,"threads_started":1,"wal-append.queue_time_us":270087}
I20260709 13:19:53.531025 19512 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:53.512851 19653 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:53.551391 19612 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15.
I20260709 13:19:53.552026 14341 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:53.554145 19661 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.554355 19766 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.554778 19661 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.554903 19766 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.513015 19788 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.556185 19642 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.556314 19788 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.556730 19642 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:53.517542 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.557974 19701 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.518777 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1017) took 1157 ms. Trace:
I20260709 13:19:53.474078 19714 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:53.558487 19701 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.533573 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:53.531870 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:53.560580 14371 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.534592 14369 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:19:53.522253 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:53.545305 19632 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:53.545553 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:53.536597 14296 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:53.546514 19610 consensus_queue.cc:1243] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:53.547784 19712 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:53.570151 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:53.570802 14298 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:19:53.571743 19659 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.000s
I20260709 13:19:53.571903 19788 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:53.572082 14341 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:53.572837 19788 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.555202 19771 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.573449 19788 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:53.573976 19710 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:53.542742 19660 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.574383 19788 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:53.530942 19542 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:53.514868 19302 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:19:53.578450 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:53.566720 19632 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.567116 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.566602 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.565296 14370 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:53.573647 19771 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.574637 19660 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.637424 19771 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:53.637598 14895 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:53.576031 14374 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:53.551867 19767 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:53.638679 19767 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:53.639302 19660 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:53.558503 14300 rpcz_store.cc:276] 0709 13:19:52.361576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.826810 (+465234us) service_pool.cc:224] Handling call
0709 13:19:52.827155 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.876812 (+ 49657us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:52.876845 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.910371 (+ 33526us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.189333 (+278962us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:53.189388 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.189489 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.518564 (+329075us) raft_consensus.cc:1685] finished
0709 13:19:53.518591 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.518720 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43884,"raft.queue_time_us":44372,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":27421,"thread_start_us":183717,"threads_started":1,"wal-append.queue_time_us":263862}
W20260709 13:19:53.577030 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 56564.1us
I20260709 13:19:53.560129 19714 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:53.624959 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:53.653827 14298 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:53.626257 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.560191 19507 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:53.476317 19539 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:19:53.550292 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1267) took 1155 ms. Trace:
W20260709 13:19:53.634881 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 56495.5us
I20260709 13:19:53.662397 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:53.663913 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.664948 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:53.641898 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 102190us
I20260709 13:19:53.578649 19788 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:53.631835 19428 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:53.668002 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:53.669448 14298 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:53.670178 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.652583 19656 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:53.670818 14901 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:19:53.672825 14220 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:53.673851 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:53.579908 19785 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:19:53.659320 14371 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:53.660265 14894 rpcz_store.cc:276] 0709 13:19:52.395046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.430257 (+ 35211us) service_pool.cc:224] Handling call
0709 13:19:52.430700 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.493727 (+ 63027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.493761 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.566643 (+ 72882us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.973610 (+406967us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:52.973685 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.549781 (+576096us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b540049fa54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:53.549846 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.549891 (+    45us) raft_consensus.cc:1685] finished
0709 13:19:53.549902 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.550106 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128445184,"thread_start_us":200651,"threads_started":1,"wal-append.queue_time_us":416656}
I20260709 13:19:53.682271 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:53.681133 14342 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:53.625765 19770 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:19:53.677006 19718 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:53.702716 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.703581 14893 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:53.675503 19656 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.701824 14898 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:53.706547 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:53.709087 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.639737 19767 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:53.722095 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.697679 19630 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:53.723105 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.746204 14893 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:53.725209 19713 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:19:53.740541 19759 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.598s	user 0.002s	sys 0.002s
W20260709 13:19:53.740765 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 58562.7us
I20260709 13:19:53.741345 19619 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:53.742842 19793 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:53.702883 19718 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.705856 19539 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:53.710062 19656 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.747895 19630 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.757452 14298 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:53.702409 19610 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:19:53.757426 14267 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:53.771183 19803 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:53.771400 19643 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:53.755125 19766 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:53.748580 19785 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.785281 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.765542 19767 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.783200 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.766100 19718 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:53.791054 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.790264 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83850.5us
I20260709 13:19:53.786022 14901 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
W20260709 13:19:53.792200 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 258686us
I20260709 13:19:53.789624 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.772607 19630 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.800276 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.771596 19713 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:19:53.773175 19619 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:53.773494 19539 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:53.799662 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.800913 14899 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:19:53.809746 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:53.811385 14900 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:53.814421 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:53.813145 14894 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:53.789320 19512 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:53.816819 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1012) took 1483 ms. Trace:
I20260709 13:19:53.816964 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.817883 14893 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:53.818456 19512 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:53.822571 14192 connection.cc:256] RPC call timeout handler was delayed by -1.856944022999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
W20260709 13:19:53.823088 14192 connection.cc:256] RPC call timeout handler was delayed by -1.767178875999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 13:19:53.829039 19790 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:19:53.834923 19765 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:53.835179 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:53.835562 19765 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:53.840375 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.800760 19803 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:53.817226 14297 rpcz_store.cc:276] 0709 13:19:52.333407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.557522 (+224115us) service_pool.cc:224] Handling call
0709 13:19:52.557986 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.558491 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.558526 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.559071 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.665587 (+106516us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:52.665722 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.665985 (+   263us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.739736 (+1073751us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:53.805116 (+ 65380us) raft_consensus.cc:1685] finished
0709 13:19:53.805148 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.816755 (+ 11607us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5603,"raft.queue_time_us":1890,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":10995,"spinlock_wait_cycles":19158400,"thread_start_us":105919,"threads_started":1,"wal-append.queue_time_us":471858}
I20260709 13:19:53.773412 19788 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.842976 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.843230 19785 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.848050 14223 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:53.849725 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:53.854857 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.850955 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.857159 14223 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:53.851656 14899 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:53.851555 19512 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:19:53.857589 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:53.852342 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.852958 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:53.857651 14223 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:53.860123 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.861151 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.862601 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:53.859367 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:53.860309 14864 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:53.863797 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:53.891360 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 82869.5us
I20260709 13:19:53.863999 14229 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:53.848903 19660 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:53.913843 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:53.914908 14899 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
W20260709 13:19:53.908843 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 46292.3us
I20260709 13:19:53.841600 19532 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:19:53.863391 19632 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:53.906364 19610 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.918205 14223 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.907332 14225 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:19:53.921136 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:53.907191 19593 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:53.908310 19660 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.918905 19539 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:53.953086 14223 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.864385 19542 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:19:53.953590 19071 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:53.863946 19803 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:53.920527 19632 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.946149 19610 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:53.966076 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45003.1us
W20260709 13:19:53.967414 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 61672.4us
I20260709 13:19:53.957933 19660 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.965240 19632 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:53.983078 19797 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:19:53.989208 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:53.985180 19701 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:53.986264 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.970192 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 66051.9us
I20260709 13:19:53.957036 19777 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:53.959144 19593 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:53.993620 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:54.005321 14223 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:19:54.005887 14223 pending_rounds.cc:85] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 7
I20260709 13:19:54.006148 14223 pending_rounds.cc:107] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:19:54.006454 14223 raft_consensus.cc:2889] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:53.913209 19771 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:53.996474 19610 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:53.997305 19777 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:53.997819 19071 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:53.989979 19798 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.007s
I20260709 13:19:53.995793 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:54.006387 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:54.014266 19071 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:54.052847 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 59253.5us
W20260709 13:19:54.059897 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50797.4us
I20260709 13:19:54.060087 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:54.060371 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64643.3us
I20260709 13:19:53.959199 19619 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:54.062759 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:54.064023 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57745.9us
I20260709 13:19:54.008265 19771 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.064772 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:53.995183 19512 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:19:54.068264 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:54.069485 14267 leader_election.cc:400] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11.
I20260709 13:19:53.964128 19765 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.062561 19071 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.071556 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:54.065934 19786 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:19:54.071835 19532 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:54.062122 19643 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.070511 19785 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:54.093693 19788 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.097632 19803 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:54.085348 19660 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.113610 19428 raft_consensus.cc:3055] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:54.097713 19725 consensus_meta.cc:287] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.001s
I20260709 13:19:54.118076 19713 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.067304 19771 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:54.119335 14270 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:54.119463 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48032.4us
I20260709 13:19:54.120198 19805 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.120839 19713 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:54.065941 19701 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.077708 19593 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.077775 19765 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.122903 19719 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:54.123323 19719 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:54.086095 19777 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:54.121658 19713 consensus_queue.cc:1243] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:54.127099 19720 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.087563 19630 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:54.063576 19783 raft_consensus.cc:2764] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:54.098181 19786 consensus_queue.cc:1243] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 15.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:54.159117 19786 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.159343 19783 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.160072 14300 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:54.159781 19786 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.099274 19561 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:54.098474 19532 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:54.114173 19428 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:54.102134 19785 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.106554 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:54.087502 19656 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.096745 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1269) took 1218 ms. Trace:
I20260709 13:19:54.120746 19805 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:54.128484 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:54.089157 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:54.128598 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:54.060976 19641 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:54.131202 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:54.131634 14298 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:54.131807 19512 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.132223 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:54.217555 14225 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.186723 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:54.132301 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:54.220043 14221 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:54.220315 14223 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:54.133704 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:54.149902 19789 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:54.150797 19661 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:54.150959 19630 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:54.127709 19720 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.186630 19765 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.230695 19765 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:54.231472 19720 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:54.151808 14894 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:54.117470 19725 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.232714 19765 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:54.232892 19805 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:54.217404 19512 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.233691 19512 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.234858 19725 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:54.153041 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.156433 19632 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.224207 19789 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:54.239080 19632 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:54.239318 19789 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.108505 19718 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.240806 19789 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.159926 19783 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.242563 19786 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:54.217666 19729 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.243168 19786 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.243652 19783 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:54.243430 19729 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:54.243885 19786 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:54.244493 14302 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:54.168053 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:54.245576 19718 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:54.245568 19729 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:19:54.176808 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 108592us
I20260709 13:19:54.114173 19660 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:54.182878 14898 rpcz_store.cc:276] 0709 13:19:52.878290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.879074 (+   784us) service_pool.cc:224] Handling call
0709 13:19:52.910120 (+ 31046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.711060 (+800940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.096476 (+385416us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54007add54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:54.096676 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1819967744}
I20260709 13:19:54.254781 14227 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:54.215948 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:54.200305 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.219345 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:54.255825 14220 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
W20260709 13:19:54.257027 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 89080.1us
I20260709 13:19:54.182937 19785 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:54.207466 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 78939.4us
W20260709 13:19:54.225518 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 136443us
I20260709 13:19:54.227041 19771 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.228219 19661 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:54.259256 14896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:54.259948 14896 raft_consensus.cc:606] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:54.258594 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:54.114848 19722 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:19:54.264258 19714 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:54.264695 19714 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:54.262061 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:54.266611 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:54.267642 14221 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:54.265169 19729 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:54.272689 19714 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:54.274259 19714 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.274540 19428 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.275573 19632 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:19:54.276116 19795 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.606s	user 0.001s	sys 0.005s
I20260709 13:19:54.277820 19428 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.279031 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:54.280198 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:54.280957 19642 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:54.259780 19661 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:54.281688 19661 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.282558 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:54.282687 19656 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:54.283288 14222 raft_consensus.cc:2368] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:19:54.283531 19656 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:54.284911 19566 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:54.285321 19566 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:54.285143 19656 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:54.260281 19687 raft_consensus.cc:2764] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:54.286320 19566 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:54.287213 19771 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:19:54.286250 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:54.281185 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:54.303503 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:54.216156 19641 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:54.296941 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:54.288141 19808 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:54.331965 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:54.252080 19520 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:54.334697 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:54.266230 19766 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:54.345541 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:54.348111 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:54.299103 19722 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:54.301684 19729 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.301944 19718 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.251530 19071 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.363729 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:54.366211 14228 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 12: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:54.330749 19641 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.263417 14867 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:54.380275 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:54.380776 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:54.380393 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:54.380169 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:54.390517 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:54.398856 14894 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:54.397698 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 269287us
I20260709 13:19:54.398876 14899 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.399272 14897 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.341567 19765 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:54.349058 19566 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.399385 14895 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:54.223075 19532 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.362537 19713 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:19:54.402282 14864 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:54.348869 19766 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.362188 19788 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:54.347205 19770 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:54.512593 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:54.417059 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:54.451355 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:54.442663 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:54.526809 14371 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
W20260709 13:19:54.491954 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.404318 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:54.441649 14898 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:54.421465 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:54.495486 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:54.449316 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:54.441160 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:54.457885 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:54.417007 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:54.399962 14900 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:54.495286 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:54.401542 14373 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:54.364662 19805 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:19:54.441895 14370 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:19:54.545215 14378 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.527354 14302 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 9.
W20260709 13:19:54.525691 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 262323us
I20260709 13:19:54.526961 14228 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:54.537195 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:54.547081 14300 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
W20260709 13:19:54.526058 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 123893us
W20260709 13:19:54.552971 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.546351 14374 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:19:54.550632 14867 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:54.555492 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:19:54.361707 19630 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:54.621444 14371 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:54.557363 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:54.630333 14299 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:54.622807 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:54.369230 19561 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:54.636798 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:54.526885 19766 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.544219 19788 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.519354 19765 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:54.647436 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.367547 19619 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:54.634655 14371 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:54.526029 19713 consensus_queue.cc:1243] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:54.466172 19821 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:54.450525 19729 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:54.641280 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 429332us
I20260709 13:19:54.641522 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:54.629817 19660 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:54.545928 19770 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.467027 19520 consensus_queue.cc:1059] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.172s
W20260709 13:19:54.708271 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.708698 19520 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:54.709163 19520 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:54.558482 19771 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.677767 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:54.679280 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:54.710561 14299 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:54.631862 19593 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:54.556602 19818 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:54.630646 19783 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:54.641721 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 535265us
W20260709 13:19:54.693598 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.650890 19765 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.648757 19788 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:54.713436 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:54.693910 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.025s	sys 0.030s
I20260709 13:19:54.718560 14224 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:54.690485 19619 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.763309 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:54.768492 14304 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
W20260709 13:19:54.760960 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 581341us
I20260709 13:19:54.828491 14370 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:54.720446 19593 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.847414 14300 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:19:54.848018 14300 pending_rounds.cc:85] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 11
I20260709 13:19:54.848309 14300 pending_rounds.cc:107] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:19:54.848625 14300 raft_consensus.cc:2889] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:54.720667 19818 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:54.711318 19770 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:54.796241 19619 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.763216 19815 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:54.877063 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:54.806018 19777 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:54.722222 19660 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.719739 19729 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:54.872081 19818 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.890908 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:54.891603 14893 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:19:54.892652 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:54.853507 19822 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:19:54.894402 19786 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:54.797472 19783 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.894982 19786 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.896934 19786 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:54.893728 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:54.899698 19777 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.904330 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:54.905871 19812 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
W20260709 13:19:54.907228 19816 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 13:19:54.909047 19823 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:54.911846 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:54.912567 14373 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:19:54.914080 19815 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:54.914611 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:54.915373 19771 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:54.915890 19771 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.916502 19815 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:54.916405 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:54.918538 19814 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:19:54.919205 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:54.919812 14299 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.887564 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:54.896975 19783 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:54.879506 14370 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:54.913494 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:54.950820 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:54.960706 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.975615 14304 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.758502 19821 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:54.997505 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:54.901616 19661 consensus_meta.cc:287] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.000s
I20260709 13:19:54.844970 19593 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.974714 14373 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:19:54.981935 14270 leader_election.cc:400] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:19:55.008414 14270 leader_election.cc:403] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:55.012383 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:55.016249 14893 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:55.019130 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53202.3us
I20260709 13:19:55.019533 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:55.028614 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:55.029773 14895 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:55.022567 14193 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:55.015901 19661 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.041122 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:54.996562 19071 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:54.972759 19561 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.053508 14299 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:54.883786 19520 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.015734 19630 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:55.045220 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:55.020668 19656 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:19:55.072279 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:55.053179 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.054970 14893 raft_consensus.cc:2410] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:19:55.055788 14897 consensus_meta.cc:287] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.652s	user 0.007s	sys 0.002s
I20260709 13:19:55.056718 14901 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:55.041975 14373 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:55.018935 19805 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:55.077071 14370 raft_consensus.cc:2410] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:55.076993 14897 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:55.082212 19825 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:55.070933 19687 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:19:55.085903 19783 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:55.094038 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:55.094803 14299 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.090801 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:55.101329 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:55.117360 14865 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:55.069628 19610 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:55.123982 14225 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.898s	user 0.008s	sys 0.002s
I20260709 13:19:55.124529 14225 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:55.127147 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:55.128315 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:55.146448 14299 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:55.147938 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:55.148972 14299 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:19:55.150350 14899 consensus_meta.cc:287] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.002s
I20260709 13:19:55.150162 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:55.151961 14370 raft_consensus.cc:2410] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:55.152825 14899 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
W20260709 13:19:55.156457 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.152453 14867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.001s	sys 0.016s
W20260709 13:19:55.157240 14867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.001s	sys 0.017s
W20260709 13:19:55.149953 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 346963us
I20260709 13:19:55.157560 19811 raft_consensus.cc:2764] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:55.158082 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:55.159142 19783 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.159250 19811 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.161111 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:55.161377 14225 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:19:55.161134 19342 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:55.162569 19342 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.156742 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:55.164116 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:55.161242 19817 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:55.164873 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:55.166251 19783 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:55.166481 14299 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:19:55.166810 19783 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.167361 19783 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:55.167487 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:55.164875 19342 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:55.178812 19783 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.180696 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:55.070603 19630 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.121569 19642 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.183318 14341 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:55.184197 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:55.192366 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:55.198927 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:55.199584 14370 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:55.098431 19805 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:55.154999 19661 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:55.120719 19713 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:19:55.210706 14341 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:55.189687 19829 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:55.232160 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:55.190462 19777 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.211874 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:55.244983 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:55.248814 14378 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.000s
I20260709 13:19:55.249372 14378 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:19:55.251158 14373 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:19:55.263381 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:55.272133 14370 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:19:55.215641 19838 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.203845 19642 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:55.281745 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 259277us
I20260709 13:19:55.290693 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:55.293442 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:55.239403 19729 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:55.300311 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:55.301075 14370 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
W20260709 13:19:55.275991 19714 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.001s	user 0.010s	sys 0.005s
I20260709 13:19:55.307265 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:55.338802 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:55.339733 14370 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:55.341671 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:55.345237 14374 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:19:55.345887 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:55.349076 14374 pending_rounds.cc:85] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 6
I20260709 13:19:55.349330 14224 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:55.299105 19713 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:55.349519 14374 pending_rounds.cc:107] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:19:55.300324 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:55.346228 14225 pending_rounds.cc:85] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 6
I20260709 13:19:55.083046 19825 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:55.160030 19811 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.165360 19817 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.362886 14374 raft_consensus.cc:2889] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:55.329686 19610 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:55.363930 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63727.3us
I20260709 13:19:55.324515 19729 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:19:55.351351 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 140755us
W20260709 13:19:55.351457 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 139696us
W20260709 13:19:55.359549 19512 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.125s	user 0.008s	sys 0.006s
I20260709 13:19:55.329701 19656 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:19:55.379987 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:55.359043 14225 pending_rounds.cc:107] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.7
I20260709 13:19:55.303483 19804 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:55.384509 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:55.350906 19842 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:55.376448 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:55.379261 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:55.354880 19838 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:55.396553 19838 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.396984 19838 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.395068 19719 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:55.400481 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:55.369989 19661 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:55.403060 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:55.412612 14892 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:19:55.417763 14894 raft_consensus.cc:606] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:55.407683 14225 raft_consensus.cc:2917] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted by new leader
I20260709 13:19:55.367234 19836 raft_consensus.cc:2764] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:55.353718 19713 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:55.406275 19842 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.448668 19642 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:55.429219 19428 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.151s	user 0.006s	sys 0.007s
I20260709 13:19:55.432691 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:55.428396 14225 raft_consensus.cc:2889] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:55.457968 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 438065us
I20260709 13:19:55.378600 19729 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:55.400163 19610 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:55.453504 19835 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.303s	user 0.001s	sys 0.001s
I20260709 13:19:55.414491 19804 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:55.411173 19847 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:55.384451 19512 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:55.488392 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1314) took 1115 ms. Trace:
I20260709 13:19:55.450760 19713 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:55.466753 19653 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:55.469080 19830 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
W20260709 13:19:55.469391 19820 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.579s	user 0.003s	sys 0.000s
I20260709 13:19:55.441743 19532 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:55.474685 19843 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
W20260709 13:19:55.478127 19832 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
W20260709 13:19:55.478387 19831 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:19:55.479390 19811 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:55.479566 19785 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.173s	user 0.005s	sys 0.006s
I20260709 13:19:55.514597 19785 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:55.479912 19819 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:55.516616 19819 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:55.518433 19844 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:19:55.519340 14375 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:55.519659 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1315) took 1146 ms. Trace:
W20260709 13:19:55.520046 19848 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:55.520056 14372 rpcz_store.cc:276] 0709 13:19:54.373312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.373443 (+   131us) service_pool.cc:224] Handling call
0709 13:19:54.418299 (+ 44856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.458529 (+ 40230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.458574 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.474560 (+ 15986us) log.cc:844] Serialized 26 byte log entry
0709 13:19:55.096820 (+622260us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:55.096864 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.096940 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.519319 (+422379us) raft_consensus.cc:1685] finished
0709 13:19:55.519342 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.519583 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":980,"raft.queue_time_us":431934,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":10846,"thread_start_us":459806,"threads_started":1,"wal-append.queue_time_us":683939}
W20260709 13:19:55.521812 19833 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:19:55.522017 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:55.522648 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:55.523376 19641 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.073s	user 0.011s	sys 0.000s
I20260709 13:19:55.483421 19858 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:55.524076 19858 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:55.484095 19845 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:55.524501 14376 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:55.487763 19771 consensus_meta.cc:287] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.004s
I20260709 13:19:55.526212 19771 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.529181 19771 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:55.414646 19661 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.530066 19661 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.529980 19641 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.531359 14301 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:55.452183 19783 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.533634 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1039) took 1031 ms. Trace:
I20260709 13:19:55.437851 19714 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:19:55.534497 19619 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.647s	user 0.006s	sys 0.006s
I20260709 13:19:55.534617 19714 consensus_queue.cc:1243] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:55.534991 19619 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.524555 19858 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:55.536906 19719 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:55.537143 19619 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:55.537813 19593 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.006s
I20260709 13:19:55.538249 19593 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.539825 14895 raft_consensus.cc:2368] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11.
I20260709 13:19:55.541538 14899 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:19:55.492654 19630 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.482334 14371 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 10. Current term is 11. Ops: [7.7-10.8]
I20260709 13:19:55.456966 19642 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.488899 14377 rpcz_store.cc:276] 0709 13:19:54.372848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.372968 (+   120us) service_pool.cc:224] Handling call
0709 13:19:54.417311 (+ 44343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.648771 (+231460us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:54.648808 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.692488 (+ 43680us) log.cc:844] Serialized 26 byte log entry
0709 13:19:55.075653 (+383165us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:55.075696 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.075771 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.488118 (+412347us) raft_consensus.cc:1685] finished
0709 13:19:55.488138 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.488293 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":440904,"spinlock_wait_cycles":98921728,"thread_start_us":460791,"threads_started":2,"wal-append.queue_time_us":637543}
I20260709 13:19:55.491338 19653 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:55.493652 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:55.496366 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:55.543598 19641 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.482334 19786 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.543430 19653 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:55.501745 19859 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.544602 19653 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.499174 19847 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:19:55.506587 19817 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:55.507200 19804 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:55.567443 19660 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:55.568352 19829 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:55.509442 19818 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.619s	user 0.004s	sys 0.004s
I20260709 13:19:55.509732 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1033) took 1092 ms. Trace:
I20260709 13:19:55.509773 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1032) took 1093 ms. Trace:
I20260709 13:19:55.510746 19825 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:55.511114 19512 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:55.511996 19852 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.512807 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1243) took 1132 ms. Trace:
W20260709 13:19:55.513504 19566 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.970s	user 0.007s	sys 0.004s
I20260709 13:19:55.475759 19839 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:55.523447 14372 raft_consensus.cc:2368] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
W20260709 13:19:55.485982 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.584092 14371 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:55.584504 14371 pending_rounds.cc:85] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 5
I20260709 13:19:55.584718 14371 pending_rounds.cc:107] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:19:55.584995 14371 raft_consensus.cc:2889] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:55.541719 19593 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:55.355895 19821 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.543712 14378 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.497891 14299 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:55.544891 19859 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:55.545234 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:55.574244 19829 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.550122 19819 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.612111 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1239) took 1244 ms. Trace:
I20260709 13:19:55.612583 14901 rpcz_store.cc:276] 0709 13:19:54.367875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.368390 (+   515us) service_pool.cc:224] Handling call
0709 13:19:54.407846 (+ 39456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.078326 (+670480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.611874 (+533548us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400883bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:55.612049 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465878784}
I20260709 13:19:55.614995 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:55.615760 14222 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:19:55.616707 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:55.616902 14867 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:55.618144 19660 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:55.618463 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:55.619943 14378 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:55.499238 19610 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.450701 19842 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.523396 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:55.558885 19642 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:55.532094 19838 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:55.497170 14304 consensus_meta.cc:287] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.004s
I20260709 13:19:55.643508 14304 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:55.644294 19642 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.582291 14896 rpcz_store.cc:276] 0709 13:19:54.380660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.411824 (+ 31164us) service_pool.cc:224] Handling call
0709 13:19:54.412346 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.454127 (+ 41781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.454160 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.481581 (+ 27421us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.977298 (+495717us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:55.238089 (+260791us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.252924 (+ 14835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.253131 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.512536 (+259405us) raft_consensus.cc:1685] finished
0709 13:19:55.512565 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.512731 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14131,"prepare.queue_time_us":382067,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4131,"raft.queue_time_us":14437,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":22272,"thread_start_us":556771,"threads_started":2,"wal-append.queue_time_us":770762}
I20260709 13:19:55.534241 14301 rpcz_store.cc:276] 0709 13:19:54.502588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.524593 (+ 22005us) service_pool.cc:224] Handling call
0709 13:19:54.624573 (+ 99980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.531722 (+907149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.533415 (+  1693us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54001f7f54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:55.533580 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2085010688}
I20260709 13:19:55.563736 19786 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.654166 19838 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.653134 19786 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:55.500635 19788 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.002s
W20260709 13:19:55.569303 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.576598 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53822 (request call id 104) took 17938 ms. Trace:
W20260709 13:19:55.577642 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 144085us
I20260709 13:19:55.575268 14297 rpcz_store.cc:276] 0709 13:19:54.433006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.433201 (+   195us) service_pool.cc:224] Handling call
0709 13:19:54.456794 (+ 23593us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:54.525925 (+ 69131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.525959 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:54.558335 (+ 32376us) log.cc:844] Serialized 52 byte log entry
0709 13:19:54.808241 (+249906us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:54.808289 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.809523 (+  1234us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.509430 (+699907us) raft_consensus.cc:1685] finished
0709 13:19:55.509473 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.509662 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110967,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":41952,"thread_start_us":175381,"threads_started":1,"wal-append.queue_time_us":489034}
I20260709 13:19:55.575445 14303 rpcz_store.cc:276] 0709 13:19:54.416360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.416513 (+   153us) service_pool.cc:224] Handling call
0709 13:19:54.454903 (+ 38390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.455183 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.455221 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.519002 (+ 63781us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.797191 (+278189us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:54.797239 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.797332 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.509554 (+712222us) raft_consensus.cc:1685] finished
0709 13:19:55.509578 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.509716 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":277876,"threads_started":1,"wal-append.queue_time_us":516210}
I20260709 13:19:55.594383 19729 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.594976 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:55.588019 19852 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.668792 19729 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:55.597488 19859 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:55.599716 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:55.671692 19785 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:55.671959 14297 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:55.579397 19818 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.601266 14302 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:55.586784 19839 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.674520 19839 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.676348 19818 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:55.602743 19789 consensus_meta.cc:287] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.361s	user 0.012s	sys 0.004s
I20260709 13:19:55.678254 19852 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.678675 14369 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:55.678632 19661 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.679481 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:55.680312 14223 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:55.681208 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:55.618597 19660 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.605933 14370 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:55.657970 19642 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:55.681874 19660 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.682097 19783 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.682699 19783 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:55.684144 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:55.552294 19766 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.875s	user 0.004s	sys 0.008s
I20260709 13:19:55.686096 19766 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.686975 19713 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.688468 19766 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:55.689092 19713 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.689353 14898 raft_consensus.cc:2368] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15.
I20260709 13:19:55.663054 14225 rpcz_store.cc:276] 0709 13:19:37.621914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.629261 (+  7347us) service_pool.cc:224] Handling call
0709 13:19:37.707610 (+ 78349us) log.cc:844] Serialized 508 byte log entry
0709 13:19:39.534987 (+1827377us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:55.500935 (+15965948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26680,"raft.queue_time_us":116566,"raft.run_cpu_time_us":1163,"raft.run_wall_time_us":1161,"spinlock_wait_cycles":99012864,"thread_start_us":428770,"threads_started":1,"wal-append.queue_time_us":533350,"wal-append.run_cpu_time_us":13774,"wal-append.run_wall_time_us":2237767}
I20260709 13:19:55.667595 14298 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:19:55.643733 19770 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.000s
W20260709 13:19:55.640717 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.698496 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:55.702308 14229 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:55.705654 14342 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:55.707018 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:55.711391 14867 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:55.713593 14896 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:19:55.714147 14896 pending_rounds.cc:85] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 8
I20260709 13:19:55.714411 14896 pending_rounds.cc:107] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:19:55.714756 14896 raft_consensus.cc:2889] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:55.681315 19661 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:55.662480 19786 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.728274 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:55.779311 14229 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.779413 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:55.732851 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58440 (request call id 21) took 1235 ms. Trace:
I20260709 13:19:55.735873 14897 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:19:55.780550 14894 rpcz_store.cc:276] 0709 13:19:54.469726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.519700 (+ 49974us) service_pool.cc:224] Handling call
0709 13:19:55.704449 (+1184749us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54004bfad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded086853 00007f8df205460a 00007f8deb5da7d4 00007f8deb5da762 00007f8deb5da691 00007f8deb5da60c 00007f8deb5d98c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:55.704591 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981366016}
I20260709 13:19:55.736655 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:55.728344 19838 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.744230 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:55.781591 14899 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:19:55.744336 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:55.774150 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:55.782807 14893 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:55.741086 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:55.774259 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:55.748638 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:55.751670 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.713894 19765 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.861s	user 0.005s	sys 0.008s
I20260709 13:19:55.716063 19766 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:55.798785 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:55.800081 14894 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:55.796484 19766 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.804051 19766 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:55.718506 19770 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.807077 14220 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:55.808084 19770 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.808823 19765 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.810286 14222 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:55.811180 19765 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.814304 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:55.816195 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:55.818867 14223 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:19:55.820060 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:55.821017 19766 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:55.821485 19766 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:55.821979 19766 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:55.824898 14375 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:19:55.826418 14229 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:19:55.828025 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:55.829303 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:55.690769 19788 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:55.728641 19642 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:55.713332 19859 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.715528 14224 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:19:55.793874 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49670.3us
I20260709 13:19:55.703742 19829 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.789651 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:55.803125 19838 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.783811 19827 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:55.829567 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:55.748154 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:55.746621 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:55.836226 14229 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:55.843240 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:55.771416 19819 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.847553 14373 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:19:55.848749 14223 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.849086 14900 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
W20260709 13:19:55.845080 14114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 37975f772fc648329a8acae36d33a345 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:19:55.854668 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:55.855319 14900 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.830448 19593 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:55.853689 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:55.856755 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:55.859817 14897 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:55.858428 14377 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:55.838773 19818 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.864692 19818 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.861943 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:55.866511 14373 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:55.866952 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:55.867761 14897 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:55.867800 14373 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:55.868767 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:55.869328 14897 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:55.869928 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.870623 19722 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:55.871737 19818 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:55.878536 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.846124 19713 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:55.848662 19870 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:55.863981 19840 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.731s	user 0.003s	sys 0.000s
I20260709 13:19:55.847918 19610 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.876642 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:55.863960 19838 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.894102 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:55.903993 19653 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:55.904567 19653 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:55.892585 19593 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:55.905149 19653 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.850355 19859 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:55.852691 19642 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:55.869692 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:19:55.860234 19718 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:55.913057 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:55.925519 14223 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:19:55.875818 14900 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
W20260709 13:19:55.988196 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 75225.6us
I20260709 13:19:55.869403 19805 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:56.004220 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:55.990702 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:19:55.970489 14867 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 1.668s (SENT) [suppressed 14 similar messages]
I20260709 13:19:56.011826 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:55.988106 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:55.911352 19722 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.922216 19718 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:56.017129 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:56.014794 19870 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:56.021387 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:56.014653 19858 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.020113 19770 raft_consensus.cc:2764] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:19:56.026579 19870 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:56.027288 19804 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.028105 19858 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.027701 19870 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.032047 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:56.032869 14227 raft_consensus.cc:2368] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15.
I20260709 13:19:56.034852 14344 leader_election.cc:400] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15.
I20260709 13:19:56.035341 14344 leader_election.cc:403] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:19:56.036134 19785 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:56.038729 19788 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:56.040343 19829 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.041589 19766 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.044250 19766 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:56.015426 19765 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:56.045043 19765 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.045410 19765 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.046700 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:56.047637 14227 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:55.853505 19839 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:56.046967 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.018035 19718 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:55.969926 19610 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.050875 19859 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:55.970958 19701 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:56.005401 19852 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.918169 19593 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:56.056854 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.912032 19660 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.078279 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:56.078980 14221 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:56.020961 19805 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:56.008683 19659 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:19:56.092744 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:56.102435 19852 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:56.110239 14901 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:56.097971 19630 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:56.092092 19805 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.089148 14897 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
W20260709 13:19:56.127779 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 348417us
I20260709 13:19:56.129757 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:56.074275 19701 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.107137 19785 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15.
I20260709 13:19:56.137828 14341 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:56.141192 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:56.142043 14900 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:56.148659 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2641) took 1627 ms. Trace:
I20260709 13:19:56.149289 14374 rpcz_store.cc:276] 0709 13:19:54.521326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.628934 (+107608us) service_pool.cc:224] Handling call
0709 13:19:54.629302 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.372331 (+743029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.148356 (+776025us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54000618d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:56.148601 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619325696}
I20260709 13:19:56.123534 19659 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:56.098560 19842 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.151476 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2438) took 1056 ms. Trace:
I20260709 13:19:56.115952 19805 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:56.152024 14377 rpcz_store.cc:276] 0709 13:19:55.095256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.542698 (+447442us) service_pool.cc:224] Handling call
0709 13:19:55.543037 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.860950 (+317913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.145969 (+285019us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400170cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:56.151406 (+  5437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724577536}
W20260709 13:19:56.153649 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.123510 19630 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.168650 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2899) took 1256 ms. Trace:
I20260709 13:19:56.172099 14378 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 13: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:56.169341 14299 rpcz_store.cc:276] 0709 13:19:54.912658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.184733 (+272075us) service_pool.cc:224] Handling call
0709 13:19:55.185028 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.588418 (+403390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.168296 (+579878us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54001a1b54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:56.168563 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719003520}
I20260709 13:19:56.173420 14341 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:56.140640 19877 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:56.151726 19659 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:56.136468 19858 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:19:56.181394 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:56.111711 19642 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.181087 14341 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:56.171558 19785 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:56.194104 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1040) took 1691 ms. Trace:
W20260709 13:19:56.195279 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 992076us
I20260709 13:19:56.196314 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:56.194861 14295 rpcz_store.cc:276] 0709 13:19:54.502854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.511568 (+  8714us) service_pool.cc:224] Handling call
0709 13:19:54.549330 (+ 37762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.549562 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:19:54.645212 (+ 95650us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.156602 (+511390us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.186475 (+ 29873us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.677386 (+490911us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b18003707e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f522 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:19:56.193275 (+515889us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b18003707e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:56.193483 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:56.193548 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:56.193611 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.193721 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.194032 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45763,"prepare.queue_time_us":21859,"prepare.run_cpu_time_us":143,"prepare.run_wall_time_us":151,"raft.queue_time_us":208928,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":19977,"spinlock_wait_cycles":25594624,"thread_start_us":496533,"threads_started":2,"wal-append.queue_time_us":544855}
I20260709 13:19:56.179507 19788 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.206583 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2891) took 1296 ms. Trace:
I20260709 13:19:56.210320 14300 rpcz_store.cc:276] 0709 13:19:54.909905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.962195 (+ 52290us) service_pool.cc:224] Handling call
0709 13:19:54.962624 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.962880 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:55.012972 (+ 50092us) log.cc:844] Serialized 14 byte log entry
0709 13:19:56.206173 (+1193201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:56.206224 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:56.206280 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.206363 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.206510 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":989865,"prepare.queue_time_us":52028,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"thread_start_us":213441,"threads_started":1,"wal-append.queue_time_us":377915}
I20260709 13:19:56.212373 14371 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:56.213809 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:56.214735 14371 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:56.217407 14376 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:19:56.209764 19870 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:56.218242 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1285) took 2089 ms. Trace:
I20260709 13:19:56.218564 19870 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.219074 19870 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.218693 14892 rpcz_store.cc:276] 0709 13:19:54.129277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.132924 (+  3647us) service_pool.cc:224] Handling call
0709 13:19:54.133312 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:55.416500 (+1283188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.217984 (+801484us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54004bfad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:56.218187 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2941192576}
W20260709 13:19:56.218760 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 760017us
I20260709 13:19:56.220240 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:56.220785 14892 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.222407 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1308) took 1960 ms. Trace:
I20260709 13:19:56.222899 14220 rpcz_store.cc:276] 0709 13:19:54.262011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.395387 (+133376us) service_pool.cc:224] Handling call
0709 13:19:56.222154 (+1826767us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400051c54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:56.222313 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2898137472}
I20260709 13:19:56.225957 19612 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:56.226579 19612 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.209923 19777 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:56.228827 19777 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.229410 19612 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.230191 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.217234 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:56.238257 14300 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:19:56.191709 19785 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:56.239393 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 268915us
I20260709 13:19:56.231654 19777 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.232491 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:56.233121 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:56.240162 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:56.233749 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.234011 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:56.233857 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.235168 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:56.241617 14298 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:56.242434 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46213.7us
I20260709 13:19:56.241617 14295 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:19:56.243145 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:56.244333 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:56.245729 14227 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:19:56.246512 14299 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:56.246860 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:56.247773 19821 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:56.248072 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:56.248538 14892 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:56.251266 19870 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.273765 19561 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:56.279175 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.280510 14342 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:56.240978 14301 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:19:56.288518 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.316264 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.304589 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:56.311854 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 68780.6us
I20260709 13:19:56.317451 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:56.317138 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.319089 19687 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.319934 19687 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:56.321884 19641 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:56.322311 19641 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:56.322036 19071 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:56.323653 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:56.342650 14299 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:19:56.323621 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 256513us
I20260709 13:19:56.325521 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:56.327378 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46969.2us
I20260709 13:19:56.314190 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:56.337193 14374 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:56.345661 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:56.346568 14374 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:56.348975 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:56.343918 14297 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 10.
I20260709 13:19:56.350445 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:56.348902 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.216274 19660 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:56.354501 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:56.355811 14374 raft_consensus.cc:2368] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12.
I20260709 13:19:56.311213 19777 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.367522 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:56.312878 19821 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:56.386981 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 113607us
I20260709 13:19:56.281320 19785 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.368527 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:56.369488 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.307304 19867 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.388101 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.389259 14300 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:56.375878 14371 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:19:56.317107 19612 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:56.391409 14371 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:19:56.404737 14371 pending_rounds.cc:85] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 10
I20260709 13:19:56.405022 14371 pending_rounds.cc:107] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:19:56.405256 14371 raft_consensus.cc:2889] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:56.388075 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:56.406344 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:56.395933 14376 raft_consensus.cc:2368] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12.
I20260709 13:19:56.402216 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:56.411140 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:56.395987 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:56.422796 14299 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:56.424252 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:19:56.438002 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 69576.6us
I20260709 13:19:56.437637 14298 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:56.439666 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:56.439889 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:56.440691 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:56.442307 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:56.349225 19825 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.445412 14371 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:56.447124 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:56.451380 14299 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:56.444578 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:56.452342 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.349519 19561 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:56.461071 14299 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:56.455063 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:56.385905 19643 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:56.239267 19659 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.354619 19804 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.122s
I20260709 13:19:56.387480 19619 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 13:19:56.367750 19641 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:56.547739 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 92755.9us
W20260709 13:19:56.644341 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 423406us
W20260709 13:19:56.488062 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 92142.9us
W20260709 13:19:56.652104 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 245829us
I20260709 13:19:56.526181 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:56.403025 19821 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.444482 19660 raft_consensus.cc:2764] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:19:56.436951 19824 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:56.698058 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:56.436753 19849 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:56.702816 19660 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:19:56.697759 14895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1283) took 1711 ms (client timeout 1697 ms). Trace:
W20260709 13:19:56.618183 19765 consensus_meta.cc:287] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.001s
W20260709 13:19:56.714001 14895 rpcz_store.cc:269] 0709 13:19:54.976805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.030719 (+ 53914us) service_pool.cc:224] Handling call
0709 13:19:56.688361 (+1657642us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54006bcbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:56.688524 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095059840}
I20260709 13:19:56.403792 19777 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:56.526413 19687 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:56.475235 19845 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.546412 19858 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:56.477033 19837 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:56.649546 19542 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:56.525612 19825 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:56.717983 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:56.443747 19867 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.650094 19883 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:56.616866 19718 consensus_meta.cc:287] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.563s	user 0.001s	sys 0.010s
I20260709 13:19:56.666461 19701 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:56.687808 19643 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.549924 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.717582 19512 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:56.745965 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:56.694965 19561 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.756459 19825 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:56.714056 19824 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:56.762058 19858 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:56.762212 19777 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:56.723886 19765 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.798202 19610 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.798507 19824 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:56.762895 19687 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.789690 19828 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:56.799880 19872 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.791s	user 0.007s	sys 0.016s
I20260709 13:19:56.787731 19512 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:56.800590 19512 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.742272 19542 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.801990 19542 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.803218 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:56.803829 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:56.804474 14900 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 9.
I20260709 13:19:56.806777 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:56.806638 19858 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.807296 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:56.807370 19839 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:56.718442 19849 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:56.808887 19722 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.000s
I20260709 13:19:56.809289 19722 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.809880 19849 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:56.805490 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:19:56.740265 19878 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.433s	user 0.000s	sys 0.001s
I20260709 13:19:56.810993 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1321) took 1037 ms. Trace:
I20260709 13:19:56.528687 19805 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:56.811398 14378 rpcz_store.cc:276] 0709 13:19:55.773254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.773766 (+   512us) service_pool.cc:224] Handling call
0709 13:19:56.810791 (+1037025us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400349ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:56.810934 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894124288}
I20260709 13:19:56.746380 19884 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:56.812536 19884 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:56.778776 19867 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.813423 19805 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:56.814297 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2818) took 1508 ms. Trace:
I20260709 13:19:56.814677 14225 rpcz_store.cc:276] 0709 13:19:55.306439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.306616 (+   177us) service_pool.cc:224] Handling call
0709 13:19:55.346026 (+ 39410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:55.791271 (+445245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:55.791321 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:55.792092 (+   771us) log.cc:844] Serialized 52 byte log entry
0709 13:19:56.095460 (+303368us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:56.095497 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.095564 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.814092 (+718528us) raft_consensus.cc:1685] finished
0709 13:19:56.814112 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.814241 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":237483,"threads_started":1,"wal-append.queue_time_us":344669}
I20260709 13:19:56.776351 19725 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:56.776080 19718 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.816815 14297 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:19:56.818358 19718 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.776559 19870 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.819139 19630 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.807420 14895 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:56.813447 19884 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.820708 19884 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:56.822209 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:19:56.824864 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.781064 19653 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.875s	user 0.005s	sys 0.005s
I20260709 13:19:56.825373 19722 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:56.825668 19720 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:56.825639 19653 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:56.826448 19720 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.827955 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1319) took 2451 ms. Trace:
I20260709 13:19:56.828142 19653 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:56.791324 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2658) took 1989 ms. Trace:
I20260709 13:19:56.835860 14303 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:56.793267 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:56.836966 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:56.837375 14295 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 11: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:19:56.774432 19770 consensus_queue.cc:1175] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cebb34ac155340899a38c728707ddc0d" responder_term: 17 status { last_received { term: 15 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:56.798270 19765 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.799467 19687 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:56.769593 19883 raft_consensus.cc:697] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:56.740123 19837 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.786494 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:19:56.897496 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 111118us
I20260709 13:19:56.899112 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:56.779486 19643 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.906308 19610 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:56.893639 19653 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:56.908664 19883 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.909271 19653 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:56.911357 19653 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:56.916152 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3017) took 1765 ms. Trace:
I20260709 13:19:56.828562 19720 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:56.828928 19870 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:56.828368 14369 rpcz_store.cc:276] 0709 13:19:54.376119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.376260 (+   141us) service_pool.cc:224] Handling call
0709 13:19:54.376604 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.679089 (+1302485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.827681 (+1148592us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540025a8d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:56.827872 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2993580288}
I20260709 13:19:56.829516 19785 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:56.830384 19825 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:56.831282 19882 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.181s	user 0.002s	sys 0.000s
I20260709 13:19:56.831542 14377 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:56.831812 19895 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.832163 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:56.974157 14374 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:19:56.832267 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:56.975507 14371 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.830490 19722 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:56.833082 19630 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.835873 14370 rpcz_store.cc:276] 0709 13:19:54.802370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.344942 (+542572us) service_pool.cc:224] Handling call
0709 13:19:55.350524 (+  5582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.681958 (+331434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.791033 (+1109075us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54001b9754. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:56.791256 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586217344}
I20260709 13:19:56.835677 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:56.869191 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.983748 14303 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:56.872016 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:56.873025 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:56.984886 14229 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.985749 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:56.774725 19659 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:56.887537 14222 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:56.894209 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:56.987888 14223 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.895071 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:56.901716 19725 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:56.951866 14267 leader_election.cc:400] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:19:56.992290 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:56.916631 14304 rpcz_store.cc:276] 0709 13:19:55.151099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.649341 (+498242us) service_pool.cc:224] Handling call
0709 13:19:55.702714 (+ 53373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:56.234391 (+531677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.234420 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:56.234865 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:19:56.667544 (+432679us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:56.667604 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.667706 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.915902 (+248196us) raft_consensus.cc:1685] finished
0709 13:19:56.915926 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.916080 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":531276,"raft.queue_time_us":531682,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":47,"thread_start_us":432259,"threads_started":1,"wal-append.queue_time_us":679209}
I20260709 13:19:56.970461 19713 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:56.992585 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:56.965412 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:56.899242 19837 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:56.978909 14898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1276) took 2111 ms (client timeout 1968 ms). Trace:
I20260709 13:19:56.873116 19718 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:19:56.966929 19872 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:19:56.991161 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:56.991478 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:19:56.994884 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.012s	sys 0.012s
W20260709 13:19:57.042870 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.012s	sys 0.012s
W20260709 13:19:57.043637 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 693235us
I20260709 13:19:56.967340 19867 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.971083 19765 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.999639 14376 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:57.000326 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:57.052028 14223 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
W20260709 13:19:56.999507 19766 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.011s	sys 0.023s
W20260709 13:19:57.064328 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 64080.9us
W20260709 13:19:57.003949 14898 rpcz_store.cc:269] 0709 13:19:54.859608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.859810 (+   202us) service_pool.cc:224] Handling call
0709 13:19:56.971040 (+2111230us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b54005901d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:56.971192 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803158400}
I20260709 13:19:56.972272 19829 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.982595 19827 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.011438 14893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.003s	sys 0.024s
I20260709 13:19:57.042695 14371 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
W20260709 13:19:57.013391 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 317243us
W20260709 13:19:56.998510 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 162914us
I20260709 13:19:57.059926 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:56.863243 19805 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:57.001423 14377 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 11: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:57.080092 14893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.003s	sys 0.034s
I20260709 13:19:56.998154 19897 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:57.006278 19845 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:57.071337 14229 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:56.991971 19725 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:56.943179 19889 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.142s
I20260709 13:19:57.068140 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.079887 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:57.088367 14267 leader_election.cc:400] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11.
I20260709 13:19:57.088519 14303 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.088838 14267 leader_election.cc:403] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:57.082551 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:57.006407 19838 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:57.081753 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:56.979499 19825 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.086913 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.007519 19777 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:56.983675 19870 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:57.072573 19766 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.013s	sys 0.029s
I20260709 13:19:57.083729 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.125025 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:57.126909 14371 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:56.993194 19630 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.095721 14229 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:57.095098 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.058933 19839 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:56.981688 19895 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.040277 19828 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:19:57.040465 19849 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:19:57.143939 14221 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:57.061968 19765 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:57.087852 19845 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.095006 19725 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.132884 14303 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:57.133399 14370 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:56.998404 19542 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.129472 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:57.095687 19720 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:57.087138 19805 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:57.143023 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 248777us
I20260709 13:19:57.064229 19718 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.189325 14371 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:19:57.189568 14193 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:57.154708 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2449) took 1708 ms. Trace:
I20260709 13:19:57.079545 19829 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.126788 19561 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:19:57.122144 19539 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:57.128449 19642 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:57.107810 19824 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11.
I20260709 13:19:57.160694 14229 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:57.083760 19866 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:57.204385 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.209228 14371 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
W20260709 13:19:57.211381 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.161652 14225 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:57.160274 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:57.212569 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 52378us
I20260709 13:19:57.160851 14369 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:19:57.164835 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:57.213428 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:57.087155 19827 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.170724 19722 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:57.170892 19889 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:57.172428 19870 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:57.175545 19895 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:57.096904 19897 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.177392 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1324) took 1399 ms. Trace:
I20260709 13:19:57.139016 19660 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:19:57.178109 19687 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:57.179065 19785 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:57.180711 19630 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:57.257141 19630 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.257630 19630 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.259703 19630 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:57.267581 19897 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:57.268210 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2883) took 2737 ms. Trace:
I20260709 13:19:57.268630 14296 rpcz_store.cc:276] 0709 13:19:54.531103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.531346 (+   243us) service_pool.cc:224] Handling call
0709 13:19:54.531691 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.041631 (+509940us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:55.200086 (+158455us) log.cc:844] Serialized 14 byte log entry
0709 13:19:56.217897 (+1017811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:56.217970 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:56.218032 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.815337 (+597305us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b4800241ed8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
0709 13:19:57.267960 (+452623us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54000910d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:57.268012 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.268135 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":862049,"prepare.queue_time_us":25078,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":868420,"raft.run_cpu_time_us":2428,"raft.run_wall_time_us":596994,"spinlock_wait_cycles":1191299072,"thread_start_us":288749,"threads_started":2,"wal-append.queue_time_us":236006,"wal-append.run_cpu_time_us":7772,"wal-append.run_wall_time_us":1034048}
I20260709 13:19:57.270777 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.271581 14296 raft_consensus.cc:2410] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:19:57.153764 19619 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:57.272984 19619 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:57.273536 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.273986 19619 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.274716 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.275333 14304 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:19:57.276569 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.158082 19845 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.277252 19818 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:57.277663 19818 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:57.267668 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.185518 19720 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:57.280279 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.183421 19867 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:57.280470 19720 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.281039 19867 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:57.281354 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:57.281926 19867 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.282406 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.283051 14300 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:57.283179 19867 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:57.062534 19653 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:19:57.283921 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:57.284313 19653 raft_consensus.cc:3055] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:57.284430 14300 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:57.284735 19653 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:57.285543 19653 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.086970 19643 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:19:57.286871 19643 consensus_queue.cc:1243] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:57.287701 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.288062 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1298) took 1079 ms. Trace:
I20260709 13:19:57.288169 19643 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:57.288729 19643 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.190882 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.289728 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.290156 14303 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:57.288519 14296 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:19:57.131112 19777 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:57.292500 14295 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:57.292585 14296 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:57.292744 19777 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.294291 19641 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.190377 14372 rpcz_store.cc:276] 0709 13:19:55.446315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.594953 (+148638us) service_pool.cc:224] Handling call
0709 13:19:55.595391 (+   438us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:19:55.595985 (+   594us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:55.596301 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.713975 (+117674us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.714203 (+   228us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:19:55.763215 (+ 49012us) log.cc:844] Serialized 104 byte log entry
0709 13:19:55.763524 (+   309us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:55.766580 (+  3056us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.778083 (+ 11503us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.782841 (+  4758us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.783045 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.783115 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.865360 (+ 82245us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b1800373a80. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:19:56.799279 (+933919us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:57.154458 (+355179us) raft_consensus.cc:1685] finished
0709 13:19:57.154479 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.154641 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125996,"prepare.queue_time_us":9811,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":150,"raft.queue_time_us":89807,"raft.run_cpu_time_us":718,"raft.run_wall_time_us":50331,"spinlock_wait_cycles":140132864,"thread_start_us":95314,"threads_started":1,"wal-append.queue_time_us":255069}
I20260709 13:19:57.213459 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:57.214955 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:57.215993 14227 raft_consensus.cc:2410] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:19:57.207911 19898 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:57.126350 19838 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.308825 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:57.221180 19905 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:57.224979 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:57.226634 19827 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:57.226809 19520 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.231317 19805 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:57.146018 19839 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.312261 19560 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:57.326261 19839 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:57.221731 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:57.210891 19825 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:57.243005 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:57.327158 14225 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:19:57.220517 19866 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:57.328018 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:57.328729 19866 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.329231 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:57.330639 19821 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.000s
I20260709 13:19:57.331116 19821 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.243824 19917 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:57.245568 19718 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:57.222313 19765 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.208441 19642 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:57.306951 19837 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.252074 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.338639 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.255604 19512 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.277608 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.278709 19818 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.184675 19542 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:57.300607 14300 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
W20260709 13:19:57.305506 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.198659 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 312859us
I20260709 13:19:57.306914 14295 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:19:57.307061 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 93665us
I20260709 13:19:57.344801 14864 leader_election.cc:400] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12.
I20260709 13:19:57.345093 14864 leader_election.cc:403] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:57.288507 14893 rpcz_store.cc:276] 0709 13:19:56.208555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.208692 (+   137us) service_pool.cc:224] Handling call
0709 13:19:56.209124 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:56.270147 (+ 61023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.270195 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:56.271001 (+   806us) log.cc:844] Serialized 52 byte log entry
0709 13:19:57.080545 (+809544us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:57.080585 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.080658 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:57.287836 (+207178us) raft_consensus.cc:1685] finished
0709 13:19:57.287857 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.288003 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3657,"raft.queue_time_us":59998,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":769840,"threads_started":1,"wal-append.queue_time_us":1014820}
I20260709 13:19:57.345736 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1052) took 1055 ms. Trace:
W20260709 13:19:57.287070 19875 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.278s	user 0.002s	sys 0.008s
I20260709 13:19:57.311604 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.346175 14297 rpcz_store.cc:276] 0709 13:19:56.290079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.368043 (+ 77964us) service_pool.cc:224] Handling call
0709 13:19:57.345594 (+977551us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54000dcfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:57.345686 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770964352}
I20260709 13:19:57.235987 14373 rpcz_store.cc:276] 0709 13:19:55.778345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.868810 (+ 90465us) service_pool.cc:224] Handling call
0709 13:19:55.869177 (+   367us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:55.869659 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:56.343272 (+473613us) log.cc:844] Serialized 14 byte log entry
0709 13:19:57.017106 (+673834us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:57.082019 (+ 64913us) log.cc:844] Serialized 78 byte log entry
0709 13:19:57.082261 (+   242us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:57.082311 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.082403 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:57.177135 (+ 94732us) raft_consensus.cc:1685] finished
0709 13:19:57.177160 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.177323 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9082,"prepare.queue_time_us":604726,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":44786,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":196,"thread_start_us":958254,"threads_started":3,"wal-append.queue_time_us":357586}
I20260709 13:19:57.315840 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:57.348611 14299 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:19:57.349053 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:57.312189 14193 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:57.328040 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:57.333149 14225 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:19:57.250797 19783 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:57.312590 19905 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.334038 19560 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.227545 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:57.313320 19914 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:57.364102 19718 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:57.354033 14864 leader_election.cc:400] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12.
I20260709 13:19:57.387087 14864 leader_election.cc:403] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:19:57.347390 19765 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.363940 19917 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:57.352469 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:57.368178 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 56089.2us
I20260709 13:19:57.355893 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:57.397147 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:57.357035 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:57.337343 19507 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:19:57.376237 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:57.332201 19887 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:19:57.376910 19837 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:57.309593 19612 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:19:57.383492 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1289) took 1687 ms. Trace:
I20260709 13:19:57.395710 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:57.398111 14226 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:57.397195 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:57.396390 14897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.018s
W20260709 13:19:57.425405 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 69623.9us
I20260709 13:19:57.433853 14901 rpcz_store.cc:276] 0709 13:19:55.695839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.716014 (+ 20175us) service_pool.cc:224] Handling call
0709 13:19:57.383296 (+1667282us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54001045d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:57.383432 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592543616}
W20260709 13:19:57.434449 14897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.007s	sys 0.018s
I20260709 13:19:57.435416 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1245) took 1591 ms. Trace:
I20260709 13:19:57.435968 14865 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:57.379410 19913 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12.
I20260709 13:19:57.382189 19824 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:57.433524 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 98642.3us
I20260709 13:19:57.386742 19914 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.386993 19718 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.435861 14897 rpcz_store.cc:276] 0709 13:19:55.844452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.122708 (+278256us) service_pool.cc:224] Handling call
0709 13:19:56.150997 (+ 28289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:56.159614 (+  8617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.159706 (+    92us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:56.170824 (+ 11118us) log.cc:844] Serialized 52 byte log entry
0709 13:19:56.548261 (+377437us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:56.890480 (+342219us) log.cc:844] Serialized 14 byte log entry
0709 13:19:57.434998 (+544518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.435101 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:57.435163 (+    62us) raft_consensus.cc:1685] finished
0709 13:19:57.435181 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.435348 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32809,"prepare.queue_time_us":193577,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":101132,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":17837,"thread_start_us":1218068,"threads_started":3,"wal-append.queue_time_us":538012}
I20260709 13:19:57.387768 19660 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.383352 19905 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:57.441589 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.428509 19849 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:57.382040 19561 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:19:57.428130 19889 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.383150 19701 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 13:19:57.425697 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 153379us
I20260709 13:19:57.458956 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:57.459710 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:57.429353 19818 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.461647 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:57.429996 19713 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:57.465258 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:57.467772 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:57.468570 14892 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:57.465963 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:57.393699 19560 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.462077 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:57.472924 14892 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:57.445221 19718 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.440481 19824 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.482126 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:57.446458 19919 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:57.485798 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:57.441509 19914 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.461287 19849 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.490599 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:57.490348 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:57.489089 14893 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:57.462838 19913 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:57.428280 19917 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.505610 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:57.517679 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:57.503258 14894 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:19:57.524633 14267 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:57.456514 19770 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:19:57.520707 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:57.528652 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:57.430819 19642 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.477689 19884 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:57.465065 19804 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:19:57.532646 19777 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:57.456308 19660 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.482662 19846 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:57.538097 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:57.542187 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:57.527424 19887 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:57.554171 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:57.506431 19849 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:57.555675 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 119747us
I20260709 13:19:57.501698 19766 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:57.557991 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:57.560775 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:57.488503 19824 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:57.547636 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:57.505025 19828 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.563638 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:57.523365 19687 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:57.549329 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:57.549821 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 154194us
I20260709 13:19:57.543679 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:57.526986 19643 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:57.530604 19838 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:57.503873 19725 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.547684 19913 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:57.583108 14894 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:57.492688 19911 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:19:57.627635 14897 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:57.552439 19846 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:57.552263 19642 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.564081 19777 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:57.577023 19766 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:57.653249 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 115367us
I20260709 13:19:57.564333 19852 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:57.549232 19884 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.574263 19805 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:57.580693 19701 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:57.580180 19821 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:57.580480 19687 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:57.692657 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 131989us
I20260709 13:19:57.637547 19512 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:57.638474 19630 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:57.642231 19887 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:57.705193 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.696899 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:57.701004 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.610394 19866 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:19:57.610841 19561 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:19:57.684253 19913 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:19:57.685570 19921 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:57.696206 19687 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.725752 19507 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:57.732651 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:19:57.745007 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 537736us
I20260709 13:19:57.723400 19842 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:57.721334 19829 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:57.687088 19805 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:57.763973 19805 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.768267 19770 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.768883 19770 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:57.770244 19920 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:19:57.771199 19770 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:57.751792 14894 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:57.578171 19828 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.739403 19852 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:57.740564 19804 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:57.756614 19788 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:19:57.758157 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 455917us
I20260709 13:19:57.758452 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2900) took 1467 ms. Trace:
I20260709 13:19:57.759781 14301 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:57.760942 14370 pending_rounds.cc:85] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 7
I20260709 13:19:57.780743 14370 pending_rounds.cc:107] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:19:57.781104 14370 raft_consensus.cc:2889] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:57.744342 19913 consensus_queue.cc:1243] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:57.780400 14299 rpcz_store.cc:276] 0709 13:19:56.296692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.462735 (+166043us) service_pool.cc:224] Handling call
0709 13:19:56.463001 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.349046 (+886045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.758167 (+409121us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54001f7a54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:57.758386 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036167040}
I20260709 13:19:57.784058 14901 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:19:57.786178 19560 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:57.751979 19507 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:19:57.762260 19925 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:19:57.762903 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:57.763137 19783 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:57.774150 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:57.776415 14228 raft_consensus.cc:2410] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:19:57.810235 14893 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:19:57.750851 14223 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:57.812237 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:57.813568 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:57.815191 14303 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:19:57.815338 14223 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:57.815562 14302 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:57.811470 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:57.818830 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.804904 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 272130us
I20260709 13:19:57.821333 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:57.823518 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60691.6us
I20260709 13:19:57.780369 19852 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.790326 19943 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:57.790014 19821 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.857905 19630 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.880756 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.882562 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:57.862891 19929 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:19:57.893558 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2839) took 1051 ms. Trace:
I20260709 13:19:57.862423 19852 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:57.905151 14227 rpcz_store.cc:276] 0709 13:19:56.841678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.841828 (+   150us) service_pool.cc:224] Handling call
0709 13:19:57.893245 (+1051417us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540033de54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:57.893476 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519424768}
I20260709 13:19:57.805827 19788 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.851596 19713 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.853529 19714 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:57.848449 19858 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:57.853535 19883 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.898242 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.903731 14377 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:57.976708 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.977011 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.977988 14377 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:57.978119 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.978904 14371 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:57.979087 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.853221 19911 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:19:57.949306 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:57.950572 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.956687 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:57.980302 14375 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.811051 19904 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:19:57.979880 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.982478 14371 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
W20260709 13:19:57.904844 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 325967us
I20260709 13:19:57.983480 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:57.980499 14372 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.753916 19777 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:57.801493 19804 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.989634 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:57.900594 19660 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:58.002380 14377 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:19:58.007997 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:58.003141 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:57.952139 19917 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.008818 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:57.992245 19858 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:58.013693 14228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1309) took 3036 ms (client timeout 1668 ms). Trace:
I20260709 13:19:57.893234 19821 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.890048 19630 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.968784 19539 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:58.018077 14228 rpcz_store.cc:269] 0709 13:19:54.977053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.978616 (+  1563us) service_pool.cc:224] Handling call
0709 13:19:58.013354 (+3034738us) spinlock_profiling.cc:243] Waited 2.75 s on lock 0x7b54002760d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:58.013567 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6329759104}
I20260709 13:19:57.987121 19714 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:58.008525 19888 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:58.008677 19725 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:58.021564 19932 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 13:19:58.039546 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3032) took 1172 ms. Trace:
I20260709 13:19:58.046191 14296 rpcz_store.cc:276] 0709 13:19:56.867066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.293405 (+426339us) service_pool.cc:224] Handling call
0709 13:19:57.293696 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.293913 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.293936 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.294369 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.442666 (+148297us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:57.442700 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.442763 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.039309 (+596546us) raft_consensus.cc:1685] finished
0709 13:19:58.039333 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.039479 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":147933,"threads_started":1,"wal-append.queue_time_us":252708}
I20260709 13:19:58.041016 14375 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:58.020129 19560 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:57.916318 19943 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:57.967799 19713 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.000533 19883 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.043802 19701 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:58.047758 19720 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.053297 19952 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.052328 19560 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:58.056777 19947 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:58.105648 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2461) took 1038 ms. Trace:
I20260709 13:19:58.107122 14369 rpcz_store.cc:276] 0709 13:19:57.067584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.067793 (+   209us) service_pool.cc:224] Handling call
0709 13:19:58.105463 (+1037670us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b54003340d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:58.105583 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167252864}
I20260709 13:19:58.077855 19783 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:19:58.098347 19938 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
W20260709 13:19:58.098093 19930 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 13:19:58.120649 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:58.120952 19947 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:58.121744 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:58.122285 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:58.122524 14899 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:19:58.122535 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:58.123960 14899 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:58.126341 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:58.128563 14894 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [11.11-14.13]
W20260709 13:19:58.129007 19905 consensus_meta.cc:287] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.000s
W20260709 13:19:58.106302 19845 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.829s	user 0.011s	sys 0.000s
I20260709 13:19:58.131464 19845 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.105697 19952 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.116580 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:58.121905 19947 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.125254 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:58.108469 19560 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:58.118877 19849 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.000s
I20260709 13:19:58.115204 14369 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:58.098261 19828 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.149183 14341 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:58.160483 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2453) took 1330 ms. Trace:
I20260709 13:19:58.161489 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.164602 14378 rpcz_store.cc:276] 0709 13:19:56.830327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.833247 (+  2920us) service_pool.cc:224] Handling call
0709 13:19:56.833557 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:56.833963 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:56.834293 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 13:19:57.137135 (+302842us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.137499 (+   364us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.137584 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:57.137854 (+   270us) log.cc:844] Serialized 14 byte log entry
0709 13:19:57.735654 (+597800us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b180038d820. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:19:58.151360 (+415706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.151433 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.160237 (+  8804us) raft_consensus.cc:1685] finished
0709 13:19:58.160265 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.160424 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":623544,"prepare.queue_time_us":267,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":1961,"raft.queue_time_us":639967,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":55769,"spinlock_wait_cycles":17307392,"thread_start_us":690003,"threads_started":2,"wal-append.queue_time_us":412254}
I20260709 13:19:58.183259 14369 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:58.054417 19539 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:58.097728 19720 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.129427 19905 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.187301 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.056351 19846 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:58.189710 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:58.190878 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.192117 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.192780 14369 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:58.160000 19919 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:58.114022 19805 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.202474 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.193918 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.106259 19714 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:58.205263 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.202582 19770 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:19:58.214468 19935 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:19:58.202723 19610 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.225850 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.227198 14223 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:58.203414 19701 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.151082 19842 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:19:58.186007 19829 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.218608 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:58.185910 19899 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.219733 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.136519 19783 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.203536 19919 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.166865 19849 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.232043 14226 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:58.232795 19899 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.233264 19960 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.217208 19788 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:58.195740 19895 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:19:58.244184 19720 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.244930 19720 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.247707 19805 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.248291 19905 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:58.250145 19867 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.966s	user 0.009s	sys 0.005s
I20260709 13:19:58.250161 19961 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:58.251230 19956 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:19:58.226512 19846 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.220278 19630 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.226250 19610 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:58.239171 19919 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.252087 19959 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:58.266782 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.267362 19858 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.268568 14372 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:58.269222 14374 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:58.270447 19954 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:19:58.273123 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 468733us
I20260709 13:19:58.242151 19960 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:58.276748 14342 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:58.278147 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:58.287314 14342 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.262044 19610 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.259071 19966 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:58.273240 19766 consensus_meta.cc:287] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.583s	user 0.005s	sys 0.002s
I20260709 13:19:58.296480 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:58.233764 19953 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.135s
I20260709 13:19:58.263046 19952 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.273516 19713 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.307382 14342 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:58.313464 19943 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:58.309777 19948 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:19:58.315476 19765 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.916s	user 0.008s	sys 0.004s
W20260709 13:19:58.316859 19889 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.851s	user 0.010s	sys 0.000s
I20260709 13:19:58.317284 19889 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12.
I20260709 13:19:58.279645 19960 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.318188 14221 raft_consensus.cc:2410] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:19:58.315629 19560 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.293167 19788 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:58.347124 19914 consensus_meta.cc:287] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.827s	user 0.005s	sys 0.007s
I20260709 13:19:58.327456 14892 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:58.362814 19914 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:58.358414 19903 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:58.364322 14220 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:58.366439 19914 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:58.357028 19852 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:58.369153 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 61841.1us
I20260709 13:19:58.309532 19766 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:58.359338 19824 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.779s	user 0.007s	sys 0.003s
I20260709 13:19:58.370421 19824 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:58.371438 19852 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.372579 19824 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:58.290858 19858 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:58.302316 19783 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.297606 19842 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:58.357594 19818 consensus_meta.cc:287] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.886s	user 0.012s	sys 0.000s
W20260709 13:19:58.348246 19718 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.847s	user 0.007s	sys 0.004s
W20260709 13:19:58.356873 19642 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.002s
I20260709 13:19:58.358165 19849 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.379558 19713 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:58.409093 19852 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:58.387646 19842 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:58.407039 19914 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:58.380333 19785 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:19:58.308416 19966 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.475979 19966 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.405000 19858 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:58.478081 19858 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:58.479046 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 679199us
W20260709 13:19:58.481140 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 659894us
I20260709 13:19:58.481642 19612 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:58.481947 19641 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:58.482110 19612 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.482506 19641 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.485142 19641 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.486693 14296 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:58.488324 14304 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:19:58.482506 19612 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.490010 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:58.490686 14302 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:58.490996 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2842) took 1279 ms. Trace:
I20260709 13:19:58.491369 14220 rpcz_store.cc:276] 0709 13:19:57.212083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.212209 (+   126us) service_pool.cc:224] Handling call
0709 13:19:58.490802 (+1278593us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002a1cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:58.490931 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417697536}
I20260709 13:19:58.491681 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:58.492367 14299 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:58.499423 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:58.500204 14296 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:58.500751 19845 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.501004 19485 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:58.501683 19485 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.501082 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:58.453120 14301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 2902) took 2109 ms (client timeout 1772 ms). Trace:
I20260709 13:19:58.471302 19852 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.472467 19842 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.470075 19788 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.505537 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:58.503036 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:58.513173 14299 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:58.503661 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.507892 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:58.513988 14222 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.501713 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:19:58.505568 14301 rpcz_store.cc:269] 0709 13:19:56.341592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.342552 (+   960us) service_pool.cc:224] Handling call
0709 13:19:58.435047 (+2092495us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54000fcdd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:58.451326 (+ 16279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3153385728}
I20260709 13:19:58.492266 19866 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:58.502637 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:58.523140 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:58.524154 14228 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:19:58.524492 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.525027 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.525411 14228 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:58.568266 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:58.568460 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:58.525879 19845 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.526458 14226 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:19:58.529325 19942 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.626s	user 0.000s	sys 0.001s
I20260709 13:19:58.504149 19902 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.530148 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:58.574788 14296 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.530479 19788 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.503417 19887 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:58.531433 19561 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.532016 19866 consensus_queue.cc:1243] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:19:58.532788 19945 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.582417 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.541049 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2480) took 1038 ms. Trace:
I20260709 13:19:58.551852 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:58.412314 19718 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.554911 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:58.565871 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:58.585013 14223 rpcz_store.cc:276] 0709 13:19:57.503069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.816408 (+313339us) service_pool.cc:224] Handling call
0709 13:19:57.816719 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.227748 (+411029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.540753 (+313005us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b540038c554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:58.540972 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":943439232}
I20260709 13:19:58.593391 14304 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:58.596467 14901 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:19:58.566165 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.570250 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:58.434144 19713 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:58.572276 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:58.572453 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:58.600406 14371 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.565552 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:58.566557 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:19:58.573680 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 348355us
W20260709 13:19:58.577804 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 343179us
I20260709 13:19:58.569327 14898 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:19:58.585984 14301 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:58.597775 14223 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:58.597770 14900 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.519747 19914 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:58.605131 14223 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:58.612150 19788 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.615420 14222 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:19:58.615603 19713 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:58.616751 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1304) took 1136 ms. Trace:
I20260709 13:19:58.617856 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.564061 19889 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:19:58.617164 14896 rpcz_store.cc:276] 0709 13:19:57.479954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.480172 (+   218us) service_pool.cc:224] Handling call
0709 13:19:57.480466 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.490882 (+ 10416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.490913 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.491391 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.683639 (+192248us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:57.683701 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.683812 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.528677 (+844865us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:58.616454 (+ 87777us) raft_consensus.cc:1685] finished
0709 13:19:58.616476 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.616688 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10051,"raft.queue_time_us":78538,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":12239,"spinlock_wait_cycles":101781760,"thread_start_us":139329,"threads_started":1,"wal-append.queue_time_us":280051}
I20260709 13:19:58.621295 14296 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:58.582228 19887 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.622603 14222 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:58.622771 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:58.626844 14301 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:58.627806 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:58.630221 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.577173 19948 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:58.633139 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:58.595729 19963 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:58.576745 19661 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:19:58.682875 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:58.682911 14227 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:58.619935 19539 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.690363 14371 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:19:58.679207 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:58.684758 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2844) took 1471 ms. Trace:
I20260709 13:19:58.715544 14224 rpcz_store.cc:276] 0709 13:19:57.213027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.213183 (+   156us) service_pool.cc:224] Handling call
0709 13:19:58.684563 (+1471380us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400051c54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:58.684696 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716629888}
I20260709 13:19:58.716915 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.717103 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:19:58.695354 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 65241.8us
I20260709 13:19:58.717471 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.582908 19902 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.722183 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.708602 14900 raft_consensus.cc:2410] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:19:58.709563 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.713560 19914 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:58.718179 14301 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:58.718187 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:58.620795 19610 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.726028 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:19:58.684533 19947 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:58.745453 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:58.745218 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:58.759109 14227 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.760999 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:58.746619 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.744504 19950 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.709610 19952 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.641279 19911 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
W20260709 13:19:58.756876 19973 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:19:58.775905 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 96514.4us
I20260709 13:19:58.723802 19560 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:58.725414 19783 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.726151 19866 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:58.695044 19520 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:19:58.723227 19966 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.788720 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:58.746676 19943 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:58.739027 19845 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:58.798733 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.805770 14371 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:58.805523 14377 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:58.770493 19829 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:58.777871 19828 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:58.725308 19539 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.820034 19911 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:58.765288 19946 raft_consensus.cc:2764] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:58.757293 19701 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:19:58.795025 19866 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:58.795217 19978 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:58.810781 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:58.776262 19867 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:19:58.805748 19914 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:58.770975 19612 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:58.823648 19849 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:58.836246 14227 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:19:58.801054 19943 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:19:58.850610 19981 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:19:58.851400 19974 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:58.853377 19902 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.855294 19610 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:58.857381 19846 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.000s
I20260709 13:19:58.843837 19866 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.807287 19966 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:58.859017 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:58.884591 19978 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:19:58.860961 19960 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.003s
I20260709 13:19:58.864925 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:58.772904 19947 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.867297 19539 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:58.870522 19687 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.096s	user 0.012s	sys 0.000s
I20260709 13:19:58.835512 19911 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:58.802716 19619 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:19:58.836613 19950 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.899165 14304 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:58.899878 14369 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.846520 19852 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:58.901072 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 178959us
I20260709 13:19:58.885020 19858 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:58.905812 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 95834.7us
I20260709 13:19:58.910123 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.823665 19948 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.915078 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:58.921458 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.923171 19845 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.927919 19653 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.948802 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1306) took 1447 ms. Trace:
I20260709 13:19:58.949390 14892 rpcz_store.cc:276] 0709 13:19:57.501096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.520489 (+ 19393us) service_pool.cc:224] Handling call
0709 13:19:58.948616 (+1428127us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540041d7d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:58.948738 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812251904}
I20260709 13:19:58.950446 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:58.955204 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.956647 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1252) took 1500 ms. Trace:
I20260709 13:19:58.960618 14897 rpcz_store.cc:276] 0709 13:19:57.456725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.457926 (+  1201us) service_pool.cc:224] Handling call
0709 13:19:57.475987 (+ 18061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.643051 (+167064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.956368 (+1313317us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54007e7cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:58.956552 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241853312}
I20260709 13:19:58.913992 19849 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:58.960004 14369 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:19:58.914386 19718 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.901806 19960 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:58.964124 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.906566 19978 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:58.968803 19985 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:19:58.959378 19643 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:19:58.963045 19941 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:19:58.959424 19993 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:58.959584 19852 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.973095 19852 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:58.973464 19852 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.919227 19858 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.975592 19842 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.964893 19722 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:19:58.977126 19887 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:58.913854 19950 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.967134 19783 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.957918 19512 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:58.957553 19619 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.905378 19943 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:58.966360 19919 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.001s
I20260709 13:19:58.979911 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:58.997356 14299 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:59.000933 14296 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:58.988230 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:58.905637 19687 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:58.976583 19858 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.007436 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:58.979616 19979 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:58.980336 19902 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:58.981107 19947 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:59.010320 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:19:59.010856 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.977736 19842 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:58.979048 19945 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:59.015749 14295 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:58.979202 19612 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.008018 19539 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:59.012419 19899 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.048234 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:59.013063 19858 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.010119 19979 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:59.062620 19979 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:59.063699 19979 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.008101 19829 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:19:59.066179 19858 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:59.070252 19960 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:58.980154 19911 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.072163 19911 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:59.075189 19926 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.392s	user 0.000s	sys 0.018s
I20260709 13:19:59.075497 19902 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:59.014143 19943 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.008957 19919 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.058032 19993 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:59.089313 19993 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:59.090155 19936 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.186s	user 0.000s	sys 0.006s
I20260709 13:19:59.090804 19919 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.059082 19950 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.060683 14299 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:59.092067 19870 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:58.994519 19619 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.092454 19870 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:59.094106 14225 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:19:59.039726 19948 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:59.094373 19783 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:59.096738 19947 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:59.097210 19687 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.097726 19947 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:59.098161 19947 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:59.098985 19947 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.099812 19947 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.094152 19619 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.103670 19804 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.090305 19993 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.117050 19966 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.120324 14865 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:59.122002 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:59.123812 14865 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:19:59.129024 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 71248.3us
I20260709 13:19:59.133031 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:59.133728 14225 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:19:59.135241 19889 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:59.136650 19883 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.138338 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:59.139210 14225 raft_consensus.cc:2410] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:19:59.139742 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2664) took 1243 ms. Trace:
I20260709 13:19:59.140132 14376 rpcz_store.cc:276] 0709 13:19:57.895954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.896149 (+   195us) service_pool.cc:224] Handling call
0709 13:19:57.904525 (+  8376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.993399 (+ 88874us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:58.025568 (+ 32169us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.275679 (+250111us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b18004540c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a 00007f8ded096a2a
0709 13:19:58.561717 (+286038us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.584040 (+ 22323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:58.584130 (+    90us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:58.584195 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.139542 (+555347us) spinlock_profiling.cc:243] Waited 88.6 ms on lock 0x7b5400258fd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:59.139587 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.139693 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77168,"prepare.queue_time_us":32092,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":8577,"raft.queue_time_us":36207,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":15485,"spinlock_wait_cycles":215069696,"thread_start_us":267473,"threads_started":1,"wal-append.queue_time_us":624077}
I20260709 13:19:59.093315 19870 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.142372 19566 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:59.142659 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:59.142833 19566 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:59.143514 14225 raft_consensus.cc:2410] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:19:59.143718 19566 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:59.144809 19566 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:59.158419 14898 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:59.129396 19701 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:59.129632 19947 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:59.130035 19921 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:59.156966 19852 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.164101 19701 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.169982 19701 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.174418 19512 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:59.175197 19887 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.175438 19512 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:59.176111 14302 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:59.163846 19902 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:59.173564 19485 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.145254 19866 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:59.176038 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.179701 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1327) took 1909 ms. Trace:
I20260709 13:19:59.186034 14344 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:59.182714 14229 rpcz_store.cc:276] 0709 13:19:57.270460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.754755 (+484295us) service_pool.cc:224] Handling call
0709 13:19:57.802124 (+ 47369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.027809 (+225685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.027871 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:58.027923 (+    52us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:58.027971 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.179458 (+1151487us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54000415d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:59.179516 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.179646 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518491904}
I20260709 13:19:59.180323 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:59.215260 14302 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:19:59.215770 14302 pending_rounds.cc:85] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 9
I20260709 13:19:59.216133 14302 pending_rounds.cc:107] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:19:59.216429 14302 raft_consensus.cc:2889] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:59.165688 19947 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.136710 19889 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:59.223323 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:59.224069 14369 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.226665 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:59.230790 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:59.232024 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.232781 14299 raft_consensus.cc:2393] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 10: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:59.235611 14300 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:59.211882 19933 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.238950 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.239786 14300 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:59.180009 19866 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:19:59.244385 14221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2464) took 2097 ms (client timeout 1702 ms). Trace:
I20260709 13:19:59.243886 19993 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:59.244810 14221 rpcz_store.cc:269] 0709 13:19:57.150680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.150918 (+   238us) service_pool.cc:224] Handling call
0709 13:19:59.244159 (+2093241us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400341554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:59.244309 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538748672}
I20260709 13:19:59.247140 14302 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:59.248266 14302 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:19:59.215409 19642 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.258597 14304 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:59.257386 14369 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:19:59.258316 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:59.258602 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:59.261148 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.212229 19921 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:59.219728 19934 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.234764 19845 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:59.261157 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:59.262384 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:19:59.226385 19947 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.228250 19899 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:59.291462 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.356969 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:59.219324 19765 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.177038 19902 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:59.267303 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:19:59.249902 14302 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.228900 19889 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:59.364082 14302 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.270759 14900 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.268606 19866 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.234467 19643 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:59.215008 19829 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:19:59.356868 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:59.359403 14300 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:59.357136 14221 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:59.368459 14298 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:19:59.360013 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:59.262212 19846 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:59.358286 19788 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.373052 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.379441 19884 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.372387 19866 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.383914 19866 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.384747 19788 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:59.386526 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:59.389581 14221 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:59.390440 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:59.391109 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:59.391984 14221 raft_consensus.cc:2410] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:19:59.394271 19788 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:59.401898 19846 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.404227 19846 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.267313 19642 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.351902 19687 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:19:59.358764 19899 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.260156 19933 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.426492 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:19:59.427547 14225 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:59.428690 14226 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:59.272006 19905 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:19:59.455322 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:59.461118 14900 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:19:59.461776 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:59.470544 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79209.1us
I20260709 13:19:59.432271 19943 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:59.272836 19934 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.471661 14229 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:19:59.472049 14229 pending_rounds.cc:85] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 10
I20260709 13:19:59.472272 14229 pending_rounds.cc:107] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:19:59.472579 14229 raft_consensus.cc:2889] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:59.472525 19788 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:59.473037 19934 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:19:59.460549 19989 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:19:59.367096 19889 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.473937 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:59.474474 19788 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:59.474611 19889 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:59.474929 19788 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:19:59.475515 20003 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:19:59.479391 19701 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.482254 19905 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:59.483633 19766 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:59.484092 19766 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:59.484995 19766 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.481576 19701 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:59.406070 19643 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.487170 19852 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.488778 19902 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:59.490162 20004 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:59.407104 19661 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.511039 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.505234 19889 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.490489 19642 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.422636 19560 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.490478 19947 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.365427 19765 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.461197 19653 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:19:59.492717 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:59.462780 19921 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.493443 19892 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.460234 19687 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:59.494838 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.373633 19858 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:59.538084 19858 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:59.540323 19858 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:59.498716 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:59.502919 14300 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:59.550387 14229 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 8.
W20260709 13:19:59.508558 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.553186 19911 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:59.554033 19852 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:59.554940 19944 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:59.554677 19507 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:59.555346 19944 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:59.555449 19852 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:59.556005 19852 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:59.556237 19944 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:59.556951 19852 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:59.475950 19788 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.561556 19788 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.517630 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.513651 19766 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.519846 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:59.527130 14298 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:19:59.510546 19845 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:19:59.531034 19943 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:59.512960 19661 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.532182 19892 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.534406 14373 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:59.433535 19899 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.511688 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.554224 19911 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:59.598172 19911 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:59.598383 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.598603 19911 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:19:59.599500 19911 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.600672 19911 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.557554 19944 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.513813 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.514628 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:59.565445 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:59.566838 14229 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:59.517644 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:59.606202 14372 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:19:59.567874 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:59.569201 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.515352 19889 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.580022 14224 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:19:59.518599 19701 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.579653 20005 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:59.613123 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47761.4us
I20260709 13:19:59.592998 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:59.614497 14369 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:59.614966 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 391868us
I20260709 13:19:59.617530 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.607582 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.618480 14377 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:19:59.619609 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:59.574093 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:59.523114 19642 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:19:59.517146 19560 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.604915 14374 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:19:59.628619 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.589679 14375 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:19:59.632620 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.633224 14375 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:19:59.634083 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:59.634748 14375 raft_consensus.cc:2376] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13. Re-sending same reply.
I20260709 13:19:59.635720 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:59.626744 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.626336 14298 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:19:59.636813 14298 pending_rounds.cc:85] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 5
I20260709 13:19:59.637073 14298 pending_rounds.cc:107] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:19:59.637301 14298 raft_consensus.cc:2889] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:59.641695 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:59.648407 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.606933 19943 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:59.621009 19852 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:59.662784 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 239750us
I20260709 13:19:59.629488 19783 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:59.684551 14372 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:19:59.688287 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.692001 14375 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
W20260709 13:19:59.700654 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.655081 19943 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:59.630604 19701 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.653084 19934 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:19:59.640473 20005 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.708580 14302 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:19:59.696583 20006 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:59.710287 14372 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:59.712728 14304 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:59.677642 19783 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:59.727041 14375 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:59.734135 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:19:59.739260 14375 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.722823 19933 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.715989 14369 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:19:59.723049 20013 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:59.765690 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2858) took 1069 ms. Trace:
I20260709 13:19:59.773680 14224 rpcz_store.cc:276] 0709 13:19:58.696374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.716623 (+ 20249us) service_pool.cc:224] Handling call
0709 13:19:59.765496 (+1048873us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540026d9d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:19:59.765620 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983163648}
W20260709 13:19:59.776155 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 418405us
I20260709 13:19:59.687498 19845 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.777259 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:19:59.742128 19520 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:19:59.763473 19957 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.549s	user 0.007s	sys 0.001s
W20260709 13:19:59.780292 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 388601us
I20260709 13:19:59.746874 19947 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:59.783162 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.781886 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:59.762312 19889 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.732236 19783 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:59.761451 19687 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.789840 14377 raft_consensus.cc:2410] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:19:59.791563 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2469) took 2031 ms. Trace:
W20260709 13:19:59.831712 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 162665us
I20260709 13:19:59.793968 19661 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:19:59.771061 19933 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:19:59.805648 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:59.807368 19821 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.807691 19512 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.807912 14300 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:59.808238 19485 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.818073 19892 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.810658 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.811355 20001 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:59.812516 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:59.813009 19824 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 13:19:59.845580 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.813304 19846 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:19:59.813913 19520 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.765973 19943 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.858748 19943 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.860307 19520 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.770757 19701 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.861181 19507 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:59.767757 19560 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:19:59.816298 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:59.815196 14298 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:19:59.848368 19485 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:19:59.862530 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46328.1us
I20260709 13:19:59.863024 19641 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:59.863308 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:19:59.864184 19485 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.865099 19867 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:59.757716 20005 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.773617 20013 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:59.866704 20013 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.835639 19947 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:59.868101 20013 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:59.821183 14299 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:59.823238 14370 rpcz_store.cc:276] 0709 13:19:57.760045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.760228 (+   183us) service_pool.cc:224] Handling call
0709 13:19:57.760654 (+   426us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:19:57.787758 (+ 27104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.787793 (+    35us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:19:57.788578 (+   785us) log.cc:844] Serialized 104 byte log entry
0709 13:19:58.009960 (+221382us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:58.044723 (+ 34763us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.481500 (+436777us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b18003b1d60. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:19:58.481710 (+   210us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.482069 (+   359us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.482229 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.482374 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.762825 (+1280451us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:19:59.791317 (+ 28492us) raft_consensus.cc:1685] finished
0709 13:19:59.791338 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.791503 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":417899,"prepare.queue_time_us":527079,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":3643,"raft.queue_time_us":26029,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":24394,"spinlock_wait_cycles":24341760,"thread_start_us":220930,"threads_started":1,"wal-append.queue_time_us":347980}
I20260709 13:19:59.834111 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:59.804626 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:59.825361 19902 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:59.808606 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:19:59.876957 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 68419.6us
I20260709 13:19:59.877730 14193 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:59.830729 19899 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.879140 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:59.873543 19701 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:59.886531 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.840831 14375 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:19:59.818989 19953 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:59.784859 19866 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:19:59.766292 19963 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:19:59.843132 19661 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:19:59.852041 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1337) took 1313 ms. Trace:
I20260709 13:19:59.898242 14371 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:19:59.731668 20006 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.868182 14342 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:19:59.888731 19978 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:59.869334 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:19:59.870590 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.888978 19701 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:19:59.872951 19947 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:19:59.874939 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 70406.3us
I20260709 13:19:59.912734 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:59.793560 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.895493 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.844581 19512 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:19:59.878223 19884 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:59.899340 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.881398 19921 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:59.888595 19653 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:59.822872 19889 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:19:59.918399 19953 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.941926 19889 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.942698 19953 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.898025 14222 rpcz_store.cc:276] 0709 13:19:58.538701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.616373 (+ 77672us) service_pool.cc:224] Handling call
0709 13:19:58.617155 (+   782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.691048 (+ 73893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.851777 (+1160729us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b54002bded4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:19:59.851976 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10867072}
I20260709 13:19:59.874099 19824 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:19:59.875592 19560 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:19:59.913873 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:19:59.871982 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:19:59.895202 19911 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:59.897634 19963 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:59.897294 19520 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:19:59.922844 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.900774 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:19:59.926378 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.978528 14370 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:19:59.909322 20008 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:59.911413 19895 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 13:19:59.935631 19999 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.537s	user 0.002s	sys 0.001s
I20260709 13:19:59.984212 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.949414 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:19:59.985319 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 71541.7us
I20260709 13:19:59.985934 14304 raft_consensus.cc:2410] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 14 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
W20260709 13:19:59.969094 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 97186.7us
I20260709 13:19:59.988992 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:19:59.947804 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:19:59.970136 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.908128 19661 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:19:59.982924 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:19:59.944967 19953 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:19:59.992863 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.994192 14375 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:19:59.944850 19889 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.907958 19933 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
W20260709 13:20:00.000663 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 99980.7us
I20260709 13:20:00.017261 14375 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:00.018483 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:00.019810 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:00.021088 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:00.021153 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:00.021705 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:00.022679 14229 raft_consensus.cc:2410] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:20:00.022595 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:59.920743 20004 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:00.023952 14225 raft_consensus.cc:2410] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:20:00.026072 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:59.922887 19653 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.020474 14224 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:00.031932 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:19:59.945034 19643 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:00.027940 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:19:59.949620 19947 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:19:59.955044 19725 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.017587 19785 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:59.948004 19899 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:00.015105 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:00.036957 14222 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:19:59.984576 19520 consensus_queue.cc:1243] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:00.032641 14370 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:19:59.983760 20018 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260709 13:20:00.111590 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 96632.9us
I20260709 13:20:00.067919 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:00.113278 14300 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:00.113490 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:00.037842 20012 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.036484 19612 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:00.016211 19941 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:59.984681 20008 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.984719 19485 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:59.950441 19948 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:20:00.052997 19934 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:00.025460 19921 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.036336 19653 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:00.043174 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 199602us
I20260709 13:20:00.117198 19852 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:00.125715 14376 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:00.051208 19943 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:00.067727 20015 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:20:00.053457 19785 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.999482 19911 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:00.054589 19725 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:00.150120 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:00.128895 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:00.065549 19933 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:00.066926 20006 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:00.118857 19953 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:00.124534 19866 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:00.138443 19485 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:00.129419 19824 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:00.171084 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:00.128312 20008 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.172596 20024 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:00.181604 20024 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:00.146859 19512 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:00.148633 19661 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:00.160343 19785 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:00.137943 19941 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:00.184782 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:00.150629 19783 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:00.187403 14299 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:00.168169 19933 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:00.185804 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 305256us
I20260709 13:20:00.124221 20012 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:00.207902 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.209216 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:00.163973 19852 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:00.212199 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:00.213163 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.214666 19933 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:00.215904 19933 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.168759 19943 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:00.510999 20024 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:00.571856 20026 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:00.571764 19963 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.556s	user 0.005s	sys 0.005s
W20260709 13:20:00.439204 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.588738 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2867) took 1095 ms. Trace:
I20260709 13:20:00.294893 14296 pending_rounds.cc:85] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 12
I20260709 13:20:00.176033 19953 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:00.302795 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.627195 14228 rpcz_store.cc:276] 0709 13:19:59.492941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.495423 (+  2482us) service_pool.cc:224] Handling call
0709 13:19:59.508636 (+ 13213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.508977 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.509006 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.528643 (+ 19637us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.819749 (+291106us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:59.819799 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.819895 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.238829 (+418934us) raft_consensus.cc:1685] finished
0709 13:20:00.238862 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.588670 (+349808us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":503,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":2818,"thread_start_us":283401,"threads_started":1,"wal-append.queue_time_us":381647}
I20260709 13:20:00.206321 19934 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:00.174605 19921 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:00.288113 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2930) took 1765 ms. Trace:
I20260709 13:20:00.195058 19821 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:00.248011 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.636773 14893 raft_consensus.cc:2410] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:20:00.218129 19883 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:00.631783 20026 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:00.639564 19883 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:00.640204 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:00.641023 14229 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.633529 19963 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:00.248636 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.642236 14897 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:00.643158 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:00.643376 19953 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:00.645010 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:00.236244 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.645833 14220 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:00.646855 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.647431 14892 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:00.648360 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.649361 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.279186 19852 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:00.650046 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:00.221215 19520 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
W20260709 13:20:00.593464 14341 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.006s	sys 0.017s
W20260709 13:20:00.658540 14341 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.006s	sys 0.017s
W20260709 13:20:00.658913 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 689322us
W20260709 13:20:00.596328 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.009s	sys 0.006s
W20260709 13:20:00.660220 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.009s	sys 0.006s
I20260709 13:20:00.294061 19941 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:00.245240 20025 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:20:00.202097 19911 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:00.299578 19783 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:00.220824 19485 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:00.605821 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.641597 19883 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:00.608711 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.609532 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.610417 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:00.595995 19978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.014s	sys 0.000s
I20260709 13:20:00.618482 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:00.602196 19824 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:00.590447 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.687367 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:00.628959 14296 pending_rounds.cc:107] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:20:00.688920 14296 raft_consensus.cc:2889] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:00.634583 14301 rpcz_store.cc:276] 0709 13:19:58.522675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.737833 (+215158us) service_pool.cc:224] Handling call
0709 13:19:58.744859 (+  7026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.746497 (+  1638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.746546 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.747172 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.810312 (+1063140us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b1800013de0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:20:00.037540 (+227228us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:00.037594 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.037670 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.287680 (+250010us) raft_consensus.cc:1685] finished
0709 13:20:00.287714 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.288030 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7032,"raft.queue_time_us":944,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":13948,"spinlock_wait_cycles":18221952,"thread_start_us":227010,"threads_started":1,"wal-append.queue_time_us":1445276}
I20260709 13:20:00.638986 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:00.692591 14893 raft_consensus.cc:2410] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:20:00.645697 19921 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:00.650126 19852 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.219563 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.651139 14223 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:00.612300 19785 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:00.666069 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.671073 14897 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:00.713694 14892 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:00.675571 19520 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:00.595568 14867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.003s	sys 0.007s
W20260709 13:20:00.717479 14867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.003s	sys 0.007s
W20260709 13:20:00.718101 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.719759 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:00.679353 14220 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 9.
I20260709 13:20:00.720341 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:00.722573 19520 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:00.724889 19520 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:00.730677 19653 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.001s
I20260709 13:20:00.731186 19653 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:00.707300 20012 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:00.714293 20008 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
I20260709 13:20:00.734488 20008 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:00.679868 14375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.010s	sys 0.005s
W20260709 13:20:00.737082 14375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.011s	sys 0.005s
I20260709 13:20:00.738727 14378 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:00.738608 20029 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:00.680899 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.739339 20029 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:00.740489 19520 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:00.741052 19520 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:00.743152 19520 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:00.680604 14895 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:00.747159 14898 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:20:00.747562 14898 pending_rounds.cc:85] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 11
I20260709 13:20:00.747781 14898 pending_rounds.cc:107] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:20:00.748034 14898 raft_consensus.cc:2889] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:00.749099 14895 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:20:00.749614 14895 pending_rounds.cc:85] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 10
I20260709 13:20:00.750126 14895 pending_rounds.cc:107] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:20:00.750350 14895 raft_consensus.cc:2889] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:00.709349 19953 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.712342 19783 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.733647 19653 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:00.705811 19824 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:00.714711 19852 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:00.759799 20033 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:20:00.822793 19933 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.007s
I20260709 13:20:00.641045 20026 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:00.709236 14894 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
W20260709 13:20:00.686479 19978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.015s	sys 0.001s
I20260709 13:20:00.679605 20018 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.697571 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:00.760320 19953 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:00.759497 19934 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:20:00.753261 14867 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:00.703307 14229 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:00.801772 19783 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:00.892441 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:00.879545 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:00.895758 14377 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:00.898365 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:00.896310 14894 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:00.905195 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:00.910300 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 157131us
I20260709 13:20:00.898288 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:00.911962 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:00.912281 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:00.888808 14299 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:00.917202 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:00.835628 20037 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:00.879750 19643 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:00.972539 14300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.051s	sys 0.091s
I20260709 13:20:00.928234 19993 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:00.875113 20018 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:00.936565 19783 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:00.938668 19953 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:00.940150 14374 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:00.802259 20029 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:00.903200 19512 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:00.914162 20008 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:00.919754 19933 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:00.942400 20033 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:00.944027 19766 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:00.952316 19948 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.954967 19842 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.955367 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:00.962843 20027 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:00.957050 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:01.053491 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:00.835871 19978 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:00.968991 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:01.058745 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.927137 19824 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:00.974829 14300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.052s	sys 0.091s
I20260709 13:20:00.913707 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:00.876202 19821 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:01.004228 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.017642 19963 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:00.979691 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:00.919968 20026 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:01.013475 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:01.133200 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:01.018712 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.943666 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:01.041524 14370 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:20:01.043459 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 455365us
I20260709 13:20:00.973269 19944 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.047562 14900 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:01.048878 14892 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:00.956176 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:01.142710 14299 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.017632 19783 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.978721 19643 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:00.896310 20006 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.061110 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 147460us
I20260709 13:20:01.162983 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:00.902482 19829 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:01.070256 14377 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:01.015093 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:00.977347 20037 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.168987 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:01.137313 20026 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.139683 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:01.143467 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 199904us
I20260709 13:20:01.145378 14370 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:01.146142 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:01.146699 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.146967 14220 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:01.012356 19993 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.052264 20027 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.151479 14228 raft_consensus.cc:1217] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Deduplicated request from leader. Original: 11.11->[12.12-14.13]   Dedup: 12.12->[14.13-14.13]
I20260709 13:20:01.151893 14225 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 8. Current term is 9. Ops: []
W20260709 13:20:01.154079 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.154125 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:01.046767 19512 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.058701 20042 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:01.167511 19507 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:01.128007 19785 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:01.042276 19766 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:01.129818 19520 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:01.171525 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:01.142361 19852 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.051715 19948 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.158061 14303 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:20:01.303481 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.381641 14225 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:01.305117 14223 raft_consensus.cc:2410] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:20:01.156088 19944 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.313231 14224 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 12: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:01.313865 14302 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:20:01.385129 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:01.385927 14302 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:01.387020 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:01.218084 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.149966 19943 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:01.317608 14341 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 3.051s (SENT) [suppressed 13 similar messages]
W20260709 13:20:01.394304 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 76727.7us
I20260709 13:20:01.156422 19921 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:01.324936 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.357937 19905 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.358203 19642 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.060839 19842 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.129567 19821 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.371064 19520 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.399359 19921 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.437994 19921 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:01.438820 20039 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:20:01.383638 20049 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:01.359170 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:01.497576 14125 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36074 (request call id 216) took 19566 ms (client timeout 15000 ms). Trace:
I20260709 13:20:01.429205 19899 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:01.498207 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.429975 19905 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.498600 19846 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:01.442242 19520 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.360069 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:01.372871 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 201480us
I20260709 13:20:01.501142 14344 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:01.498117 14125 rpcz_store.cc:269] 0709 13:19:41.931345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.931868 (+   523us) service_pool.cc:224] Handling call
0709 13:20:01.497462 (+19565594us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:53.680261 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:53.682587 (+  2326us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:53.682637 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:19:53.682650 (+    13us) tablet.cc:662] Decoding operations
0709 13:19:53.843446 (+160796us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:53.843556 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:53.843590 (+    34us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:19:53.853864 (+ 10274us) tablet.cc:701] Row locks acquired
0709 13:19:53.853915 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:19:53.854124 (+   209us) write_op.cc:270] Start()
0709 13:19:53.854285 (+   161us) write_op.cc:276] Timestamp: P: 1783603193854058 usec, L: 0
0709 13:19:53.854318 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:19:53.953179 (+ 98861us) log.cc:844] Serialized 9092 byte log entry
0709 13:19:55.271043 (+1317864us) op_driver.cc:464] REPLICATION: finished
0709 13:19:55.501741 (+230698us) write_op.cc:301] APPLY: starting
0709 13:19:55.501920 (+   179us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:55.812186 (+310266us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:55.812323 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:56.219383 (+407060us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:56.220064 (+   681us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:19:56.220123 (+    59us) write_op.cc:312] APPLY: finished
0709 13:19:56.220618 (+   495us) log.cc:844] Serialized 204 byte log entry
0709 13:19:56.690986 (+470368us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:56.723249 (+ 32263us) write_op.cc:454] Released schema lock
0709 13:19:56.744476 (+ 21227us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:56.810142 (+ 65666us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:56.810173 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3273977,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":201016,"apply.run_cpu_time_us":78546,"apply.run_wall_time_us":1308383,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100313,"num_ops":23,"prepare.queue_time_us":217515,"prepare.run_cpu_time_us":18791,"prepare.run_wall_time_us":404310,"raft.queue_time_us":685743,"raft.run_cpu_time_us":22110,"raft.run_wall_time_us":290891,"replication_time_us":1374239,"thread_start_us":975163,"threads_started":5,"wal-append.queue_time_us":812481,"wal-append.run_cpu_time_us":22125,"wal-append.run_wall_time_us":2797912}]]}
I20260709 13:20:01.435762 19642 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:01.502282 14378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1359) took 1711 ms (client timeout 2096 ms). Trace:
W20260709 13:20:01.502705 14378 rpcz_store.cc:269] 0709 13:19:59.790542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.869040 (+ 78498us) service_pool.cc:224] Handling call
0709 13:20:01.502094 (+1633054us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b5400060ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:01.502227 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909435648}
I20260709 13:20:01.297957 20026 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.504765 20046 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:01.302242 20044 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.307147 14228 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [12.12-14.13]
I20260709 13:20:01.288476 19953 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:20:01.390194 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:01.393215 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.326278 20027 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:01.398142 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:01.170302 19829 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.549033 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:01.549728 19829 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:01.399869 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.550372 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:01.550921 14302 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.551712 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.552554 14220 raft_consensus.cc:2410] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:20:01.553421 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.564989 14220 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:01.399686 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:01.391203 19852 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.441311 20048 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 13:20:01.451617 20034 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:20:01.452407 20043 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:20:01.401451 20038 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.455649 20032 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.517s	user 0.003s	sys 0.000s
I20260709 13:20:01.455824 19921 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:01.463423 20050 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:20:01.464239 20041 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 13:20:01.465027 20040 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:20:01.467458 19948 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:01.468842 20062 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:01.365149 20042 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.471364 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3079) took 1436 ms. Trace:
I20260709 13:20:01.449200 19766 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.473570 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.478122 19725 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.479946 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:01.481408 14896 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:01.481693 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.482942 14301 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:01.484156 19821 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:01.487524 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.488054 20037 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.489981 19993 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:01.490587 19485 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.606256 20038 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.638288 19485 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.639931 20038 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.640496 19485 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.491621 20018 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.492878 19643 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.640976 19944 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:00.979274 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:01.642155 19520 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.642671 19766 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.496340 19842 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:01.643224 14229 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:01.339097 19978 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.645026 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:01.510972 14299 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:01.402458 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:01.161577 19783 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.647876 19842 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:01.505924 19846 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:01.648846 20027 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.527220 19765 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:01.528455 20036 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.582s	user 0.006s	sys 0.000s
I20260709 13:20:01.535032 19953 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.663542 19953 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.664808 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3077) took 1713 ms. Trace:
I20260709 13:20:01.497547 20049 raft_consensus.cc:697] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:01.498430 19899 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.546039 19905 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.160583 19963 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.555020 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.556424 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.676424 14897 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:01.557262 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.677299 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1318) took 1067 ms. Trace:
I20260709 13:20:01.677762 14225 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:20:01.558774 19642 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.553663 14193 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:01.172214 20006 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.665800 19953 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:01.689946 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:01.691323 20006 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:01.692984 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.693974 19892 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:01.694154 20042 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:01.694489 19892 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:01.695475 19892 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.683167 19963 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.583930 14223 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:20:01.584964 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:01.585511 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.698293 14221 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.698616 14220 raft_consensus.cc:2410] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:20:01.452505 19701 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.594949 14302 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:20:01.595156 19943 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.607472 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 441161us
I20260709 13:20:01.625892 14295 rpcz_store.cc:276] 0709 13:20:00.034897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.035376 (+   479us) service_pool.cc:224] Handling call
0709 13:20:00.035804 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.038304 (+  2500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.038333 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.038896 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.962453 (+923557us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b180047f500. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:20:01.319610 (+357157us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:01.319673 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.320534 (+   861us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.470951 (+150417us) raft_consensus.cc:1685] finished
0709 13:20:01.470985 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.471272 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2038,"raft.queue_time_us":2168,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10853,"spinlock_wait_cycles":8142208,"thread_start_us":356911,"threads_started":1,"wal-append.queue_time_us":1389279}
I20260709 13:20:01.636926 14892 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:01.514283 20044 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.650305 19846 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.650390 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:01.649525 19783 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:01.647917 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 245581us
I20260709 13:20:01.653190 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1085) took 1582 ms. Trace:
W20260709 13:20:01.709082 19884 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.004s	sys 0.024s
I20260709 13:20:01.655997 19520 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.659101 14301 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:01.660041 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1321) took 1054 ms. Trace:
I20260709 13:20:01.661773 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2952) took 1452 ms. Trace:
I20260709 13:20:01.767341 14296 rpcz_store.cc:276] 0709 13:20:00.209399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.294087 (+ 84688us) service_pool.cc:224] Handling call
0709 13:20:00.294621 (+   534us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:00.689905 (+395284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.689952 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:00.690690 (+   738us) log.cc:844] Serialized 52 byte log entry
0709 13:20:00.902488 (+211798us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:00.902528 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.902599 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.661576 (+758977us) raft_consensus.cc:1685] finished
0709 13:20:01.661597 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.661718 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14781,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7469,"thread_start_us":193592,"threads_started":1,"wal-append.queue_time_us":457098}
I20260709 13:20:01.659598 19512 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:01.586642 19852 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.670535 14227 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:01.672111 20049 consensus_queue.cc:237] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:01.673213 20027 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:01.653472 20026 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.665267 14298 rpcz_store.cc:276] 0709 13:19:59.951216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.951374 (+   158us) service_pool.cc:224] Handling call
0709 13:19:59.951802 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.952315 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:00.321262 (+368947us) log.cc:844] Serialized 14 byte log entry
0709 13:20:00.686073 (+364811us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.686591 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.686749 (+   158us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:00.686781 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.686849 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.946248 (+259399us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b180047f560. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:01.505508 (+559260us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:01.664612 (+159104us) raft_consensus.cc:1685] finished
0709 13:20:01.664633 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.664756 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":765162,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":3934,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":20491,"spinlock_wait_cycles":156665600,"thread_start_us":732807,"threads_started":2,"wal-append.queue_time_us":435865}
I20260709 13:20:01.677994 14893 rpcz_store.cc:276] 0709 13:20:00.609676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.693392 (+ 83716us) service_pool.cc:224] Handling call
0709 13:20:00.693860 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.754108 (+ 60248us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:00.754152 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.758287 (+  4135us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.980590 (+222303us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:00.980642 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.980724 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.462806 (+482082us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:01.674179 (+211373us) raft_consensus.cc:1685] finished
0709 13:20:01.674206 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.677211 (+  3005us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59711,"raft.queue_time_us":63193,"spinlock_wait_cycles":99001472,"thread_start_us":221936,"threads_started":1,"wal-append.queue_time_us":414857}
I20260709 13:20:01.683966 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3081) took 1527 ms. Trace:
I20260709 13:20:01.767232 14901 rpcz_store.cc:276] 0709 13:20:00.605583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.605697 (+   114us) service_pool.cc:224] Handling call
0709 13:20:00.606028 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.609345 (+  3317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.609374 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.609828 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.830995 (+221167us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:00.831037 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.831107 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.659821 (+828714us) raft_consensus.cc:1685] finished
0709 13:20:01.659842 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.659979 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3643,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4309,"thread_start_us":207690,"threads_started":1,"wal-append.queue_time_us":421520}
I20260709 13:20:01.789933 14300 rpcz_store.cc:276] 0709 13:20:00.156645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.164923 (+  8278us) service_pool.cc:224] Handling call
0709 13:20:00.165387 (+   464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:00.165871 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.165925 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:00.173714 (+  7789us) log.cc:844] Serialized 52 byte log entry
0709 13:20:01.059679 (+885965us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:01.059726 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.059805 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.683637 (+623832us) raft_consensus.cc:1685] finished
0709 13:20:01.683668 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.683880 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":2749,"thread_start_us":865011,"threads_started":1,"wal-append.queue_time_us":979034}
I20260709 13:20:01.575387 14895 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:01.792320 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:01.792754 20057 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.245s	user 0.002s	sys 0.003s
I20260709 13:20:01.793493 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:01.687438 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.796164 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:01.797395 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.799901 20026 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:01.788784 20046 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:01.800920 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:01.764856 19643 consensus_queue.cc:1175] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cebb34ac155340899a38c728707ddc0d" responder_term: 11 status { last_received { term: 11 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 11 index: 10 } }
I20260709 13:20:01.705524 14270 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:01.706821 14304 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:01.697145 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 143536us
W20260709 13:20:01.803092 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 97641.9us
I20260709 13:20:01.803540 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:01.709918 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1358) took 1919 ms. Trace:
I20260709 13:20:01.718952 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.804845 14892 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:20:01.805657 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.806025 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:01.720299 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.806609 14894 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:20:01.807416 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.712101 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:01.654147 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2685) took 2137 ms. Trace:
W20260709 13:20:01.581029 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.034s	sys 0.026s
I20260709 13:20:01.732342 20061 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:01.808717 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.034s	sys 0.026s
I20260709 13:20:01.718837 19725 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:20:01.738451 19953 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:01.738869 19870 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.739511 20044 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.719504 19943 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.710458 20068 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:01.720156 20063 consensus_queue.cc:1059] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:20:01.741992 19921 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:01.701946 20037 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.744125 19612 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:01.745986 19899 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:01.747633 19963 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:01.749972 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.003s	sys 0.026s
W20260709 13:20:01.858412 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.003s	sys 0.026s
W20260709 13:20:01.858989 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 696048us
I20260709 13:20:01.859768 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:01.861095 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:01.750818 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2871) took 1537 ms. Trace:
I20260709 13:20:01.801743 20046 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.861845 14222 rpcz_store.cc:276] 0709 13:20:00.253045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.253212 (+   167us) service_pool.cc:224] Handling call
0709 13:20:00.253671 (+   459us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:00.268734 (+ 15063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.268781 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:00.594583 (+325802us) log.cc:844] Serialized 52 byte log entry
0709 13:20:00.836559 (+241976us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:01.288577 (+452018us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.750466 (+461889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.750549 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.750595 (+    46us) raft_consensus.cc:1685] finished
0709 13:20:01.750607 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.750752 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":327169,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":12823,"raft.queue_time_us":680952,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":236,"thread_start_us":1055237,"threads_started":3,"wal-append.queue_time_us":526223}
I20260709 13:20:01.864564 14222 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:01.865135 19612 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.751941 19846 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.763767 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1320) took 1161 ms. Trace:
I20260709 13:20:01.811914 19512 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:01.721833 14303 rpcz_store.cc:276] 0709 13:20:00.070447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.070595 (+   148us) service_pool.cc:224] Handling call
0709 13:20:00.071016 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.381176 (+1310160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.652953 (+271777us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000fd7d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:01.653130 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498865408}
I20260709 13:20:01.819116 19884 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:01.766394 14220 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:20:01.769260 14195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.011s	sys 0.002s
I20260709 13:20:01.771523 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:01.825496 19953 consensus_queue.cc:1243] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:01.771804 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:01.774085 14221 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:01.791173 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:01.696441 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.798156 19852 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:01.799325 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:01.852653 20029 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.882972 14221 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:01.880851 14193 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:01.809438 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 819133us
W20260709 13:20:01.808931 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 96925us
I20260709 13:20:01.808634 14371 rpcz_store.cc:276] 0709 13:19:59.517139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.517290 (+   151us) service_pool.cc:224] Handling call
0709 13:20:01.653920 (+2136630us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b540027a6d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:01.654072 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768142976}
I20260709 13:20:01.865916 19701 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.806213 14892 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:01.891212 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.892891 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.804517 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:01.816279 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:01.816721 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:01.820479 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.827538 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:01.827569 14894 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:01.828776 14299 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:01.834679 20062 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:01.840478 14374 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:01.812227 19485 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:01.855970 14227 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:20:01.913028 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 108574us
I20260709 13:20:01.696976 19892 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:01.766104 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.866140 14899 rpcz_store.cc:276] 0709 13:20:00.602650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.602789 (+   139us) service_pool.cc:224] Handling call
0709 13:20:00.614620 (+ 11831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.615083 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.615123 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.615648 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.834956 (+219308us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:00.834999 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.835070 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.759767 (+924697us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b2400330f68. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fddfb0 00007f8decc54488 00007f8decc54be8 00007f8decc2c398 00007f8decc2776a 00007f8decc26bb6
0709 13:20:01.762218 (+  2451us) raft_consensus.cc:1685] finished
0709 13:20:01.762251 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.763674 (+  1423us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6214,"spinlock_wait_cycles":19656448,"thread_start_us":198069,"threads_started":1,"wal-append.queue_time_us":503434}
I20260709 13:20:01.871322 14222 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:01.914567 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 43951.3us
I20260709 13:20:01.873196 14897 raft_consensus.cc:2410] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:01.875300 14369 raft_consensus.cc:2410] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:20:01.851967 20068 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.887781 19946 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.879707 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.919302 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:01.893669 14892 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:01.920303 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.920728 14901 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:01.920768 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:01.921381 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:01.794687 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:01.922385 14895 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.876052 20077 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.923980 14901 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:20:01.866269 19911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.028s	sys 0.067s
I20260709 13:20:01.876508 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:01.950177 14378 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
W20260709 13:20:01.949995 19911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.029s	sys 0.067s
I20260709 13:20:01.802107 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.693039 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1325) took 1070 ms. Trace:
I20260709 13:20:01.951582 14225 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 12: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:01.886021 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:01.952621 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 66732.7us
I20260709 13:20:01.953338 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:01.954095 19485 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:01.954512 19485 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.954873 19485 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.954936 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1346) took 1934 ms. Trace:
I20260709 13:20:01.955122 20078 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:01.955415 14226 rpcz_store.cc:276] 0709 13:20:00.020694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.020830 (+   136us) service_pool.cc:224] Handling call
0709 13:20:01.954757 (+1933927us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b540019afd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:01.954884 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4443288320}
I20260709 13:20:01.868762 19512 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:01.956629 19512 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.873808 19884 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.958436 19884 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:01.954929 14896 rpcz_store.cc:276] 0709 13:20:00.622733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.739936 (+117203us) service_pool.cc:224] Handling call
0709 13:20:01.481099 (+741163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.634992 (+153893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.692827 (+ 57835us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b540041d7d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:01.692973 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1703705984}
I20260709 13:20:01.961616 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.962133 14895 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:20:01.962394 14896 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:01.963040 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.963315 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.963658 14895 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:01.966686 19485 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.906852 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:01.908048 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:01.909467 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:01.971859 14300 raft_consensus.cc:2410] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:01.973609 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.973650 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:01.974546 14225 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:01.975062 14369 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:01.910486 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:01.976086 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65754.6us
W20260709 13:20:01.976917 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57066us
I20260709 13:20:01.978017 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:01.976948 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.979943 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:01.980494 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:01.981343 14378 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:20:01.911682 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:01.915261 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.908625 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:01.879881 14893 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:01.881702 20044 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:01.926259 20062 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.918872 19866 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.930088 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.987669 14270 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:01.930721 19642 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:01.931185 14126 catalog_manager.cc:5697] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:02.022868 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:02.023231 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:02.023494 14267 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:02.023897 14895 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:02.024829 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:01.931876 19507 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:02.028599 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:01.933874 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:02.030015 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 152099us
I20260709 13:20:02.030078 14897 raft_consensus.cc:2376] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14. Re-sending same reply.
I20260709 13:20:01.934394 19943 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:01.891269 19766 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:20:01.938141 19946 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.939024 14373 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:02.040354 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.041065 14221 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
W20260709 13:20:01.939575 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49294us
I20260709 13:20:01.923144 20075 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:20:01.918246 20068 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.942636 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:01.944643 14376 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:01.945043 19783 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:01.945943 14342 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:02.047288 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:02.022342 20070 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.883425 20012 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:20:01.868341 20037 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:01.899627 20027 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:01.804315 14375 rpcz_store.cc:276] 0709 13:19:59.790233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.018208 (+227975us) service_pool.cc:224] Handling call
0709 13:20:00.018525 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.018890 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.018938 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.019419 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.737521 (+718102us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:00.737568 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.737638 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.455000 (+717362us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:01.697356 (+242356us) raft_consensus.cc:1685] finished
0709 13:20:01.697378 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.709825 (+ 12447us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12119,"raft.queue_time_us":1049,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6582,"spinlock_wait_cycles":77714816,"thread_start_us":683025,"threads_started":1,"wal-append.queue_time_us":791897}
I20260709 13:20:01.955639 20078 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:01.983006 14894 raft_consensus.cc:2410] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:20:01.984519 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:01.986665 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:01.989315 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:01.992434 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:02.010028 14892 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:20:02.027169 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:02.030875 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:02.032681 14372 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:02.037089 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.043097 14901 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:01.946255 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:02.031543 20026 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:02.028067 19507 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:02.027549 19824 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:20:02.092953 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.145524 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:02.140359 14378 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:02.151281 14901 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:02.151996 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1266) took 1104 ms. Trace:
I20260709 13:20:02.152135 14895 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:02.152338 14901 rpcz_store.cc:276] 0709 13:20:01.048447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.143517 (+1095070us) service_pool.cc:224] Handling call
0709 13:20:02.151094 (+  7577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.151745 (+   651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.151917 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:02.152778 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1268) took 1093 ms. Trace:
I20260709 13:20:02.153141 14895 rpcz_store.cc:276] 0709 13:20:01.059739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.144005 (+1084266us) service_pool.cc:224] Handling call
0709 13:20:02.151781 (+  7776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.152541 (+   760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.152730 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:02.156944 14299 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:02.073983 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 128131us
I20260709 13:20:02.140894 14300 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:20:02.074941 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:02.141630 14893 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.142194 14374 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
W20260709 13:20:02.142481 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 111687us
I20260709 13:20:02.161706 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:02.142199 14373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2690) took 2547 ms (client timeout 1601 ms). Trace:
I20260709 13:20:02.095753 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:02.163286 14373 rpcz_store.cc:269] 0709 13:19:59.546883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.598129 (+ 51246us) service_pool.cc:224] Handling call
0709 13:20:02.094264 (+2496135us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b5400259ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:02.094408 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5381402496}
I20260709 13:20:02.164201 14304 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:02.143934 14370 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:02.146476 14897 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:02.141505 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:02.156790 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 210598us
I20260709 13:20:02.168193 14894 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:02.168294 14896 raft_consensus.cc:1813] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Handling vote request from an unknown peer 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:02.168531 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:02.037192 19560 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.172693 14896 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:02.172838 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1274) took 1033 ms. Trace:
I20260709 13:20:02.173486 14894 rpcz_store.cc:276] 0709 13:20:01.139119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.165719 (+1026600us) service_pool.cc:224] Handling call
0709 13:20:02.166166 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.172558 (+  6392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.172778 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:02.175336 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 100480us
I20260709 13:20:02.176847 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:02.170358 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:02.051422 19866 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:02.177418 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:02.044142 19846 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:02.042668 19895 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.070923 19725 raft_consensus.cc:3055] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:02.092160 20045 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:02.047703 20047 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.110042 19953 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:02.140157 20026 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.148408 20078 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.035046 19905 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.144s
I20260709 13:20:02.172302 19842 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:02.110282 20070 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:02.161459 19824 consensus_queue.cc:1243] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:20:02.156385 20027 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:02.179571 20049 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.108531 19933 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:20:02.197115 19725 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:02.193974 19846 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:02.213373 19701 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:02.213824 19921 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.215143 19946 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.215963 19560 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:02.351907 19560 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:02.275686 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.233878 19921 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.002871 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.355989 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:01.981554 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.231086 19701 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.016613 14226 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:02.288473 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 264895us
I20260709 13:20:02.289716 14126 catalog_manager.cc:5697] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 9 to 12, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 12 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:20:02.357584 14898 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:02.230815 19905 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:02.202024 14894 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:20:02.378998 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1285) took 1071 ms. Trace:
I20260709 13:20:02.379621 14894 rpcz_store.cc:276] 0709 13:20:01.307636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.200649 (+893013us) service_pool.cc:224] Handling call
0709 13:20:02.201750 (+  1101us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.378133 (+176383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.378769 (+   636us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:02.380414 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1354) took 2663 ms. Trace:
W20260709 13:20:02.201218 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 176485us
W20260709 13:20:02.383394 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.380945 14372 rpcz_store.cc:276] 0709 13:19:59.716363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.726866 (+ 10503us) service_pool.cc:224] Handling call
0709 13:20:01.654389 (+1927523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.140383 (+485994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.167574 (+ 27191us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b540027a6d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:02.379703 (+212129us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b540027a6d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:02.380053 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5275856512}
W20260709 13:20:02.317724 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 155967us
I20260709 13:20:02.333864 14899 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:02.386970 14899 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:20:02.387243 14892 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:20:02.388044 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1265) took 1343 ms. Trace:
I20260709 13:20:02.388101 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:02.342496 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 354792us
I20260709 13:20:02.221449 19507 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:02.344985 19485 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.219180 19612 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.412684 19953 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:02.071651 19783 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:02.414726 19953 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.416674 19783 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:02.204550 19895 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.423669 19895 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.426054 20037 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.427070 19921 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:02.428769 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.431341 14226 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:20:02.431936 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.217548 19911 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.433228 19911 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:02.433873 19612 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.436821 19911 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:02.439075 14222 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:02.231042 19846 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.194610 20012 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.448801 19921 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.208058 20026 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:02.449563 19921 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.348073 20027 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.197743 20046 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:02.454464 20046 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:02.455106 20046 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.208628 20047 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.348695 19725 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:02.228226 20060 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:20:02.463459 14267 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:02.354427 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.359854 20070 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.107s
I20260709 13:20:02.466071 19612 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:02.467609 20070 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:02.468043 20070 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:02.469099 19921 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:02.003911 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 92346.3us
I20260709 13:20:02.357895 14225 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:02.459242 14298 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
W20260709 13:20:02.227142 20079 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:20:02.499289 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:02.500919 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:02.503944 19507 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.504209 20012 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.505133 19642 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.505028 20012 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.505867 19642 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.508272 19642 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:02.214960 14893 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:02.474706 19485 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:20:02.509006 19642 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:02.509918 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.510298 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.499277 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:02.510758 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.512064 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:02.227289 20090 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:02.399391 20018 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:02.550264 20018 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.550885 20018 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:02.401932 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 222466us
I20260709 13:20:02.555645 14342 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:20:02.403614 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 226026us
I20260709 13:20:02.403707 14126 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 8 to 9, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 9 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.558691 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:02.560048 19963 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:02.404983 19785 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:02.560860 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:02.561426 19785 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:02.563055 19785 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.406432 19560 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.389010 14899 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:02.388440 14892 rpcz_store.cc:276] 0709 13:20:01.045096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.141287 (+1096191us) service_pool.cc:224] Handling call
0709 13:20:02.386170 (+244883us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:20:02.386611 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.387738 (+  1127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.387985 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11044224}
I20260709 13:20:02.442430 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.567813 14220 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:02.568356 19870 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:02.568852 19870 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.569240 19870 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:02.569975 14898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1334) took 1566 ms (client timeout 1991 ms). Trace:
W20260709 13:20:02.570479 14898 rpcz_store.cc:269] 0709 13:20:01.003784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.003947 (+   163us) service_pool.cc:224] Handling call
0709 13:20:02.569625 (+1565678us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400268ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:02.569877 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2978275712}
I20260709 13:20:02.458945 19905 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:02.459805 14303 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:02.565312 14126 catalog_manager.cc:5697] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 9 to 10, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 10 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.038244 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.575064 19905 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.576002 14227 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:20:02.460568 20061 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:02.471652 20099 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:02.576843 20061 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:02.577417 20061 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:02.577320 20099 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:02.578394 14896 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:20:02.578661 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54502.1us
I20260709 13:20:02.580237 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1283) took 1410 ms. Trace:
I20260709 13:20:02.473398 19612 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.474764 20092 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:02.580958 20038 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:02.581775 20092 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.582432 20038 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:02.583082 20038 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:02.583393 19783 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:02.495464 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.576990 19905 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.580996 14193 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:02.584714 14301 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:02.508141 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.585393 19963 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:02.358047 19701 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:02.582484 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.586846 19963 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.515247 14228 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:20:02.590058 14228 pending_rounds.cc:85] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 8
W20260709 13:20:02.510293 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 44950us
I20260709 13:20:02.590292 19911 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:02.590920 19911 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.578455 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.591512 19911 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.591784 14302 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:02.593160 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:02.509598 20012 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:02.537968 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.581286 19612 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.538107 20029 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:02.469401 20070 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.596174 14295 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:02.402242 20097 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:02.445241 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 274831us
I20260709 13:20:02.596211 20029 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:02.600481 19560 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.600858 20029 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.597119 20070 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:02.602638 19643 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:02.603267 19643 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.603736 19643 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.604406 19612 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.593545 20092 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.580670 20099 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:02.607800 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:02.599211 14341 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:02.598104 20097 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.609730 20097 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:02.612457 20047 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.580660 14896 rpcz_store.cc:276] 0709 13:20:01.169754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.173999 (+1004245us) service_pool.cc:224] Handling call
0709 13:20:02.577743 (+403744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.578863 (+  1120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.579966 (+  1103us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400268ed0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:02.580156 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859767552}
I20260709 13:20:02.475944 19943 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:02.491178 19821 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:02.567408 20063 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:02.590420 14228 pending_rounds.cc:107] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:20:02.531404 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.574724 14894 pending_rounds.cc:85] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 10
I20260709 13:20:02.616956 14894 pending_rounds.cc:107] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:20:02.583982 19783 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.580397 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.616242 14228 raft_consensus.cc:2889] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:02.621325 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:02.617350 14894 raft_consensus.cc:2889] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:02.630128 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 118302us
I20260709 13:20:02.632489 14223 raft_consensus.cc:2410] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:20:02.624302 19783 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:02.635814 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:02.617733 20038 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.638152 20038 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:02.638391 20076 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:02.638881 20076 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:02.639299 20076 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:02.640998 19766 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:02.641645 19766 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.641990 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:02.615592 19943 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:02.618403 20063 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:02.671289 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48217.2us
I20260709 13:20:02.642086 19766 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:02.673818 14226 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:20:02.685649 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 86598.1us
I20260709 13:20:02.689775 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.622828 19642 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.691403 19842 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:02.701496 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.697713 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.715348 14193 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:02.727175 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 111066us
I20260709 13:20:02.727842 14126 catalog_manager.cc:5697] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 3 to 10, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 10 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:20:02.714922 19612 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:02.737268 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:02.740500 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 61266.3us
I20260709 13:20:02.742389 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.703908 20092 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:02.746369 20092 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:02.750946 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 363121us
I20260709 13:20:02.754127 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.694583 19842 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:02.734668 19821 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:02.758020 14228 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:02.763393 14224 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
W20260709 13:20:02.744156 14296 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.024s	sys 0.011s
I20260709 13:20:02.773880 20062 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.774662 19714 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.775276 19714 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:02.780561 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 55355.1us
I20260709 13:20:02.782230 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:02.784020 19933 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:02.783769 19766 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.786918 19642 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:02.788492 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:02.789181 14295 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:02.789975 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.791589 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.793542 20008 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:02.794364 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.795291 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.795684 20008 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.753695 20037 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:02.797020 20046 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:02.798707 19725 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:02.798877 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:02.827409 20092 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.827874 20061 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.801235 19943 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.838824 20046 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:02.839699 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.847056 20061 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.803507 19766 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:02.806509 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:02.811949 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.850589 14299 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:02.851621 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.852293 14299 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:02.853358 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:02.854166 20078 consensus_meta.cc:287] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.008s
I20260709 13:20:02.854394 14299 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:02.854681 20078 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.855253 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.812071 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:02.855881 14297 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:02.856491 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44511.8us
I20260709 13:20:02.857372 19642 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:02.858256 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.858783 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.814487 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.814370 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:02.859865 14298 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:20:02.816048 19870 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:02.797021 20037 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.862919 19870 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:02.863103 20037 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:02.764884 19821 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.863794 19821 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:02.818440 19842 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:02.865996 14296 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.025s	sys 0.011s
I20260709 13:20:02.867260 20076 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.868432 19842 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:02.869158 19842 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:02.870738 20076 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.853034 19783 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.874473 19943 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.784560 19933 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.880308 19933 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:02.881700 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 137826us
I20260709 13:20:02.885692 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:02.886510 14896 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
W20260709 13:20:02.819247 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73948us
I20260709 13:20:02.800246 19643 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:02.890364 20062 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:02.793431 20068 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.721s	user 0.012s	sys 0.005s
I20260709 13:20:02.834213 20063 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:02.836871 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:02.803032 14295 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:02.741927 19612 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:02.870651 14224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2500) took 1719 ms (client timeout 1973 ms). Trace:
W20260709 13:20:02.914672 14224 rpcz_store.cc:269] 0709 13:20:01.151419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.399438 (+248019us) service_pool.cc:224] Handling call
0709 13:20:02.870368 (+1470930us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b5400082354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:02.870548 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997993856}
I20260709 13:20:02.783834 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:02.920246 14303 raft_consensus.cc:2368] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12.
I20260709 13:20:02.757925 14126 catalog_manager.cc:5697] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 6 to 7, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 7 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:02.922530 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 159491us
I20260709 13:20:02.923297 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:02.938643 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:02.936961 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:02.943663 14226 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:20:02.927634 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:02.920281 19612 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.892422 19643 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:02.948830 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:02.936700 19783 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:02.949568 20029 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:02.789652 20018 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.957598 19485 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:02.994180 14898 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:02.927069 20068 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:02.925809 19846 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:03.013893 19892 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.019s	user 0.010s	sys 0.007s
I20260709 13:20:03.014638 20045 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:03.015412 20068 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.016114 19846 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:03.016795 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.019580 20026 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.000s
I20260709 13:20:03.019682 20018 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:03.020226 20026 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:02.942983 19507 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:20:03.002328 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:02.960304 19714 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:03.027117 14221 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 12: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:03.028339 14892 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:03.003306 19512 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.012s	user 0.007s	sys 0.015s
I20260709 13:20:03.005553 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:03.005949 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:03.034005 14893 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 12: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:03.006415 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:03.006589 20046 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:02.990224 20029 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.007129 20044 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:20:03.011541 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.942250 20092 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:20:03.050203 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:03.065973 20078 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:03.067560 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:03.068395 14226 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.070284 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:03.072860 19884 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.086s	user 0.021s	sys 0.002s
I20260709 13:20:03.073535 19884 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:03.076835 19884 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.079083 20026 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:03.081480 19701 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.043412 20029 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.024607 14298 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:02.997198 19485 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:03.086292 19485 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:03.088937 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 305234us
W20260709 13:20:03.062258 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 225501us
I20260709 13:20:03.062289 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:03.039847 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.035241 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:03.046381 14372 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:03.031976 14895 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
W20260709 13:20:03.099304 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.035324 20046 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.047763 19842 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:03.105516 14898 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:03.105773 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:03.109660 14224 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:03.112253 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 106837us
I20260709 13:20:03.115643 14900 raft_consensus.cc:2410] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:20:03.115396 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:03.104391 19512 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:03.117277 20037 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.119191 14222 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:03.119581 19512 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.121021 20037 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:03.121304 14892 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:03.122603 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:03.126135 20097 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.516s	user 0.015s	sys 0.000s
I20260709 13:20:03.104946 19701 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:20:03.126307 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:03.132383 19821 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:03.136445 19842 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:03.138931 14342 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:03.147539 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:03.148260 19884 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.135870 19485 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:03.112283 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:03.150962 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:03.151602 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:03.152712 14225 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:03.161415 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:03.164186 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:03.103338 20046 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:03.168942 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 78195.6us
I20260709 13:20:03.176087 14226 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:03.172340 14371 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
W20260709 13:20:03.194594 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 55765us
I20260709 13:20:03.195684 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:03.197220 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:03.174499 20012 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.203001 14301 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:03.184928 20070 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:03.236879 19911 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.644s	user 0.015s	sys 0.000s
I20260709 13:20:03.234387 20045 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:03.213167 14303 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:03.187875 19642 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:03.258677 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 61588.4us
I20260709 13:20:03.210711 14228 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:03.229251 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:03.230073 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:03.234750 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 239844us
I20260709 13:20:03.204452 20018 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.201534 20076 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.174825 20097 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.240857 14126 catalog_manager.cc:5697] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 5 to 9, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 9 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:03.266294 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 222399us
I20260709 13:20:03.245404 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:03.182027 19842 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.212028 14867 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:03.244377 19560 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.643s	user 0.012s	sys 0.005s
I20260709 13:20:03.213451 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:03.263337 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 2966) took 1347 ms. Trace:
I20260709 13:20:03.262981 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:03.274813 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62910.3us
I20260709 13:20:03.275611 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:03.268847 14225 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:03.275669 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.270028 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:03.256616 19507 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.286302 14892 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:03.286670 14221 raft_consensus.cc:2368] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17.
I20260709 13:20:03.238646 19884 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:03.257258 20045 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:03.289204 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 93645.6us
I20260709 13:20:03.294122 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:03.294514 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:03.295723 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:03.265420 19701 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:03.297642 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:03.299081 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:03.299804 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:03.273645 19842 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:03.305768 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.252657 19911 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:03.307617 19485 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.298374 20045 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.301167 20076 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:03.309342 20076 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:03.309967 20076 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:03.313881 14370 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:03.314065 19785 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:03.315235 19870 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:03.315698 19870 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:03.315402 14126 catalog_manager.cc:5697] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:03.316646 19870 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.317979 19870 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.318881 14342 leader_election.cc:400] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12.
I20260709 13:20:03.319224 14342 leader_election.cc:403] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:03.320747 20080 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:03.322067 19953 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:03.322994 19783 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:03.323410 19783 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:03.304792 14864 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:03.324430 19783 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.325655 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:03.326066 19783 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.328624 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:03.329521 20070 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:03.330175 20018 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:03.330286 20070 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:03.302631 14303 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.317229 14126 catalog_manager.cc:5697] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 9 to 10, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 10 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:03.338405 19821 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.340338 19884 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.341303 14228 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.342368 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:03.344384 20076 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:03.341295 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:03.346522 14220 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:03.346838 19892 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:03.347771 14901 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.031s	sys 0.044s
W20260709 13:20:03.348205 14901 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.032s	sys 0.044s
I20260709 13:20:03.348423 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:03.349222 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1276) took 2202 ms. Trace:
I20260709 13:20:03.293120 20063 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.349978 19892 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:03.286206 19921 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:03.350916 19921 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:03.352051 19921 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.355119 20097 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:03.356473 14900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1279) took 2197 ms (client timeout 1688 ms). Trace:
W20260709 13:20:03.356868 14900 rpcz_store.cc:269] 0709 13:20:01.159655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.636030 (+476375us) service_pool.cc:224] Handling call
0709 13:20:03.356268 (+1720238us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54005abc54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:03.356410 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2994430720}
I20260709 13:20:03.360008 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1356) took 1388 ms. Trace:
I20260709 13:20:03.360478 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:03.360409 14894 rpcz_store.cc:276] 0709 13:20:01.971199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.381059 (+409860us) service_pool.cc:224] Handling call
0709 13:20:02.381655 (+   596us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:02.632747 (+251092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.632781 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:02.667213 (+ 34432us) log.cc:844] Serialized 52 byte log entry
0709 13:20:03.210095 (+542882us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:03.210144 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.210224 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.359715 (+149491us) raft_consensus.cc:1685] finished
0709 13:20:03.359743 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.359928 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22745,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":13315,"thread_start_us":482065,"threads_started":1,"wal-append.queue_time_us":663357}
I20260709 13:20:03.361941 19701 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:03.362699 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 87162.6us
I20260709 13:20:03.273368 19642 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.363116 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:03.363636 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:03.371234 19824 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:03.353602 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.362712 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.255436 20012 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:03.375135 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.375458 20076 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:03.364054 20114 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:20:03.387532 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:03.365504 19642 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:03.366259 14298 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:03.379094 20068 raft_consensus.cc:3055] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:03.364009 20078 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:03.371826 19821 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:20:03.372053 19643 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:20:03.371519 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:03.380723 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 128887us
I20260709 13:20:03.380777 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:03.401475 14295 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:03.274191 14296 rpcz_store.cc:276] 0709 13:20:01.907981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.910130 (+  2149us) service_pool.cc:224] Handling call
0709 13:20:01.922613 (+ 12483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.922822 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:02.866448 (+943626us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.235830 (+369382us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.238954 (+  3124us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:03.239019 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.248977 (+  9958us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.255015 (+  6038us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":816327,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3447,"raft.queue_time_us":2010,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3775,"thread_start_us":1245555,"threads_started":2}
I20260709 13:20:03.389408 14303 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:03.390450 14228 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:03.376838 20012 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.391964 14225 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:03.363014 19701 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.387001 19560 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.410373 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:03.413470 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:03.414456 14297 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:03.349583 14901 rpcz_store.cc:276] 0709 13:20:01.147292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.167165 (+1019873us) service_pool.cc:224] Handling call
0709 13:20:02.173572 (+  6407us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:20:02.201915 (+ 28343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.201956 (+    41us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:20:02.221632 (+ 19676us) log.cc:844] Serialized 104 byte log entry
0709 13:20:02.574212 (+352580us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:03.348523 (+774311us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.348792 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.348928 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.348962 (+    34us) raft_consensus.cc:1685] finished
0709 13:20:03.348973 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.349134 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68157,"prepare.queue_time_us":233879,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":39172,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":2946,"thread_start_us":857769,"threads_started":2,"wal-append.queue_time_us":293342}
I20260709 13:20:03.398367 20078 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:03.407470 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:03.411149 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:03.418409 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:03.394327 19642 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:03.416779 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:03.420281 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48707.6us
I20260709 13:20:03.394730 20068 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:03.419163 14298 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 9.
I20260709 13:20:03.425478 14900 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:20:03.389770 19714 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:20:03.431106 14898 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:03.427428 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:03.428848 14894 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:03.429294 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:03.433560 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:03.434369 14303 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.431730 14895 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 10.
I20260709 13:20:03.395787 19612 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:03.411553 19911 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.445287 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:03.446213 14296 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.421643 20078 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:03.450045 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:03.454177 14297 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:03.427649 20076 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:03.415104 19783 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:20:03.465770 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:03.468415 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 61078.2us
I20260709 13:20:03.439332 19785 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.474010 14893 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:20:03.479681 14893 pending_rounds.cc:85] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 9
I20260709 13:20:03.479935 14893 pending_rounds.cc:107] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:20:03.480170 14893 raft_consensus.cc:2889] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:03.417080 19560 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.476337 14299 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:03.480607 14298 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:03.483369 14303 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:03.484339 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:03.484544 20121 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:03.485417 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:03.489754 14297 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:03.486442 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:03.500123 14295 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:03.493624 20121 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.503312 20121 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:03.476790 19933 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.596s	user 0.014s	sys 0.000s
I20260709 13:20:03.428282 20029 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:03.466434 20076 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:03.528462 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 237666us
I20260709 13:20:03.455960 19642 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.526873 19946 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:03.500732 19824 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:03.538582 14229 raft_consensus.cc:2368] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16.
I20260709 13:20:03.524379 20076 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.553041 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:03.526482 14192 connection.cc:256] RPC call timeout handler was delayed by -2.6547228150000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 13:20:03.554433 14192 connection.cc:256] RPC call timeout handler was delayed by -2.6511228150000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:20:03.554880 14192 connection.cc:256] RPC call timeout handler was delayed by -2.6097228150001683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:20:03.555308 14192 connection.cc:256] RPC call timeout handler was delayed by -2.5998130989999026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 13:20:03.555661 14192 connection.cc:256] RPC call timeout handler was delayed by -2.5945182069999646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 13:20:03.555972 14192 connection.cc:256] RPC call timeout handler was delayed by -2.5539228150000781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
W20260709 13:20:03.556344 14192 connection.cc:256] RPC call timeout handler was delayed by -2.4532178910001221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 13:20:03.556699 14192 connection.cc:256] RPC call timeout handler was delayed by -2.4252228150000974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 13:20:03.557065 14192 connection.cc:256] RPC call timeout handler was delayed by -2.2767228150000847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:20:03.557400 14192 connection.cc:256] RPC call timeout handler was delayed by -2.1576790840001649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
I20260709 13:20:03.509897 19821 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.525203 20061 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:03.557732 14192 connection.cc:256] RPC call timeout handler was delayed by -2.1054488029999447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:20:03.566061 14192 connection.cc:256] RPC call timeout handler was delayed by -1.789289811000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 13:20:03.567461 14192 connection.cc:256] RPC call timeout handler was delayed by -1.6899228150000454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26730000000000004s for a response
W20260709 13:20:03.568954 14192 connection.cc:256] RPC call timeout handler was delayed by -1.6467298200000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:20:03.570230 14192 connection.cc:256] RPC call timeout handler was delayed by -1.5674368699999377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 13:20:03.571923 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:03.590997 14897 raft_consensus.cc:2410] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:20:03.572321 20125 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:20:03.572503 14225 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:20:03.593091 14192 connection.cc:256] RPC call timeout handler was delayed by -1.1787228150001283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32410000000000005s for a response
I20260709 13:20:03.535722 19785 raft_consensus.cc:2764] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:03.579138 19612 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.579754 20061 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:03.572000 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:03.619855 14304 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:03.585273 20126 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:20:03.585839 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:03.537492 20068 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:03.573256 20127 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:20:03.549252 19943 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.006s
I20260709 13:20:03.521588 19933 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.633359 14375 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:03.663276 19560 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:03.663785 19933 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.665468 14899 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:20:03.617688 20123 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:20:03.671908 14896 raft_consensus.cc:2410] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:20:03.672950 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.674996 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:03.536680 14270 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:03.677270 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 140655us
W20260709 13:20:03.676790 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 107969us
I20260709 13:20:03.686439 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:03.687263 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:03.687623 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:03.689759 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 205549us
I20260709 13:20:03.666714 19921 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.692703 14229 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:03.691361 14193 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:03.698275 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 63070us
I20260709 13:20:03.703058 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:03.705933 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:03.714355 14341 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:03.684361 19946 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:03.721156 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:03.639447 19821 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:03.721951 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 281486us
I20260709 13:20:03.695807 19943 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.732867 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:03.725317 14270 leader_election.cc:400] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17.
I20260709 13:20:03.734292 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:03.736640 14270 leader_election.cc:403] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:20:03.639070 19824 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.705550 19766 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:03.708195 20037 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:03.735069 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:03.744423 14893 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.728745 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:03.720943 19905 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.757525 14304 raft_consensus.cc:2410] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:20:03.705984 19643 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:20:03.765130 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:03.764899 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:03.708343 19485 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:20:03.769467 14898 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:03.771711 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 230906us
I20260709 13:20:03.716954 19921 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.750960 20037 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.751706 19785 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.774847 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:03.805675 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:03.766242 19612 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:03.831357 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.742486 19943 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:03.846205 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.768971 20044 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:03.721424 14897 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:03.853408 14897 raft_consensus.cc:606] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:03.853755 14897 raft_consensus.cc:614] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:03.849645 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 135386us
I20260709 13:20:03.769160 20061 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:03.763469 19905 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.805429 20029 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.810187 20037 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.815810 19953 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.861284 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:03.861984 14369 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:03.845669 19612 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:03.769968 19766 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.849308 19560 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:03.876329 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.853536 19512 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17.
I20260709 13:20:03.854044 19714 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:03.873698 20046 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.004s
W20260709 13:20:03.879177 19842 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.009s
W20260709 13:20:03.877620 20045 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.011s
I20260709 13:20:03.895992 19824 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:03.896593 20129 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 13:20:03.879851 19643 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:20:03.884835 19507 consensus_meta.cc:287] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.004s
I20260709 13:20:03.872359 19783 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:03.878069 19612 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:03.924675 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.862445 20044 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:03.936882 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 120382us
W20260709 13:20:03.947008 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 69555.1us
I20260709 13:20:03.953423 14898 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:03.861428 20136 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 13:20:03.921610 19943 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:03.894783 19714 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:03.962432 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 155674us
I20260709 13:20:03.966543 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:03.933494 19643 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:03.885667 19560 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:03.951076 19507 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.900565 20046 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:03.971074 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 257212us
I20260709 13:20:03.954569 19642 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:03.934787 20045 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:03.970755 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 163995us
I20260709 13:20:03.970746 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:03.973142 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:03.986327 14295 raft_consensus.cc:2410] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:20:03.978391 14898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:03.934518 19842 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:03.972244 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 266375us
W20260709 13:20:03.984782 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 281836us
I20260709 13:20:03.985247 14300 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:20:03.988896 14898 raft_consensus.cc:606] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:03.993219 14898 raft_consensus.cc:614] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:03.993513 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:03.994452 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.989594 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:03.999804 19884 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:04.000768 19884 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:04.001116 19884 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:04.001993 20137 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:04.001929 19884 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.002628 20137 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:04.003345 19884 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:04.003541 20137 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:03.955644 19783 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:04.006534 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.977672 19821 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:04.007205 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:04.011749 14377 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:04.014892 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:04.015630 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:04.019656 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:04.020529 14226 raft_consensus.cc:2368] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16.
I20260709 13:20:04.016038 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:04.027853 14229 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:04.029336 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 56282.9us
W20260709 13:20:04.033710 14373 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.535s	user 0.014s	sys 0.005s
I20260709 13:20:04.034302 14373 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
W20260709 13:20:04.012631 20121 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.509s	user 0.013s	sys 0.006s
I20260709 13:20:04.003355 19560 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:04.039557 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 59757.7us
I20260709 13:20:04.006480 20029 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:04.054257 14296 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.008s
I20260709 13:20:04.054751 14296 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:04.015286 19485 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:04.066959 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:04.072261 14225 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:04.062644 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:04.073760 14229 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:04.065586 20078 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.603s	user 0.014s	sys 0.002s
I20260709 13:20:04.094695 14893 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
W20260709 13:20:04.097029 20122 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.587s	user 0.001s	sys 0.003s
I20260709 13:20:04.099843 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:04.100600 14296 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:04.101830 14303 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:04.102970 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:04.103585 14301 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.111706 20061 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:20:04.121526 20132 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.250s	user 0.000s	sys 0.003s
I20260709 13:20:04.146384 14301 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
W20260709 13:20:04.150902 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 143799us
I20260709 13:20:04.075412 20142 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:04.071921 19921 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:04.160465 20045 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:04.161530 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:04.048908 20147 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:20:04.031492 20044 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.174077 20143 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:04.077540 19714 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.175117 20142 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:04.170684 19783 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:04.170354 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 108379us
I20260709 13:20:04.052409 20121 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.198892 19905 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:04.202255 20143 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.212239 20143 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:04.196452 20153 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:04.217465 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.225344 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.242259 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.197649 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:04.197822 14193 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:04.244431 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46721.4us
I20260709 13:20:04.245759 19911 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:04.246330 19911 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:04.245635 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:04.194963 14270 leader_election.cc:400] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16.
I20260709 13:20:04.232115 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1288) took 1342 ms. Trace:
I20260709 13:20:04.232509 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:04.233297 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:04.233731 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:04.247530 14896 rpcz_store.cc:276] 0709 13:20:02.889603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.916385 (+ 26782us) service_pool.cc:224] Handling call
0709 13:20:04.231888 (+1315503us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54006bcbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:04.232050 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679529216}
I20260709 13:20:04.247407 14270 leader_election.cc:403] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:20:04.234771 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:04.147713 20078 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.246160 20029 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:04.234153 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:04.248612 14228 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:04.238857 20068 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.230376 19842 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:04.248740 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 199495us
I20260709 13:20:04.252903 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:04.194569 19766 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:04.262784 14224 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:04.246879 20046 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:04.265931 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:04.276168 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:04.250102 14227 raft_consensus.cc:2368] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17.
I20260709 13:20:04.267218 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:04.281127 14297 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:04.282087 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:04.285111 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:04.292774 14867 leader_election.cc:400] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17.
I20260709 13:20:04.296737 14867 leader_election.cc:403] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:04.297925 14228 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:04.267889 20153 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:04.291404 14301 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:04.286937 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 211777us
I20260709 13:20:04.301545 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:04.282327 20076 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.004s
W20260709 13:20:04.305212 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 118560us
W20260709 13:20:04.307788 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.278756 19921 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:04.311231 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:04.312850 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:04.315979 14299 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:04.286561 19892 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:04.292184 19766 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:04.335753 19766 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.336311 19766 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:04.337467 20063 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.987s	user 0.000s	sys 0.015s
W20260709 13:20:04.322602 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.327139 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 74340.2us
I20260709 13:20:04.330432 19643 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.278637 20144 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16.
I20260709 13:20:04.334373 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:04.292019 19943 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:04.337992 20142 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.301093 19905 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.247258 19911 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:04.317674 20080 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.996s	user 0.014s	sys 0.004s
I20260709 13:20:04.343310 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:04.347501 14300 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:04.311570 19921 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.350075 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:04.352955 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:04.355729 14894 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:04.351686 19921 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.358461 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:04.344609 19943 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.360394 20157 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:04.377332 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:04.382413 14899 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
W20260709 13:20:04.393743 14369 consensus_meta.cc:287] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.000s
I20260709 13:20:04.397497 14369 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:04.354270 19560 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.354017 20080 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12.
W20260709 13:20:04.410290 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 164718us
I20260709 13:20:04.308665 20076 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.379033 19943 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.430788 19612 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.434342 20153 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.435642 14220 raft_consensus.cc:2410] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:20:04.438093 14299 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:04.414299 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:04.415053 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:04.417354 20162 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:04.418102 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:04.441251 14297 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:04.420571 14301 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:04.421968 20121 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:04.429009 19884 raft_consensus.cc:2764] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:20:04.416152 20037 consensus_meta.cc:287] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 13:20:04.446595 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:04.412002 19643 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.403115 20157 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:04.433676 19612 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:04.399931 20152 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:04.505034 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:04.520458 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:04.521183 14897 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.460968 20163 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:04.528266 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 219774us
I20260709 13:20:04.529680 14898 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:04.529480 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:04.532070 14270 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:04.533064 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:04.537266 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:04.416326 19560 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.540378 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:04.541242 14894 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:20:04.500633 20157 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:04.467069 20162 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:04.559139 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:04.560020 14221 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:04.443183 19701 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:20:04.526382 19946 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:04.572839 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:04.531349 19512 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:04.565464 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:04.579299 14228 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:04.538887 20068 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:04.505033 20037 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.521991 20173 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:04.584491 14223 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:04.541003 19892 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.588850 14344 leader_election.cc:400] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16.
I20260709 13:20:04.599587 14344 leader_election.cc:403] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:04.606920 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 74938.9us
W20260709 13:20:04.608379 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.687143 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 328790us
I20260709 13:20:04.577265 20163 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:04.685575 14225 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:04.532964 20029 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:20:04.566802 19870 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:04.572445 19953 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:04.572535 20142 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:04.690790 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.702222 14894 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:20:04.706672 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.704176 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 110091us
I20260709 13:20:04.707561 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:04.594213 19612 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.594532 20121 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:04.703401 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 114755us
I20260709 13:20:04.716712 14369 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:20:04.717219 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:04.686259 19884 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.698009 20149 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:04.725339 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 278869us
I20260709 13:20:04.587218 19642 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 13:20:04.736639 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:04.742266 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:04.725083 20138 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:04.752166 14900 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:04.751163 14894 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:20:04.754156 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:04.705405 19512 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:04.757961 14223 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.697949 19783 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:20:04.736925 19785 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.741250 19911 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:04.758561 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:04.736128 20147 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:04.736515 19892 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:04.771292 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48665.7us
I20260709 13:20:04.779357 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:04.783948 14901 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:04.750943 19714 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.785275 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:04.786293 14369 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:04.724228 19612 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.726402 20142 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.699007 20157 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.718797 19953 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.740870 20121 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.782680 19911 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:04.804497 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116050us
W20260709 13:20:04.805007 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 43908.7us
I20260709 13:20:04.811127 20145 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:04.811770 20145 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.813868 20141 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:04.814030 20164 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:04.814414 20141 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.814852 20141 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:04.818444 20171 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:20:04.820282 20176 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:04.821381 19560 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:04.799924 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.827049 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:04.748020 20149 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.751487 19884 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:04.814260 20168 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
I20260709 13:20:04.824234 19766 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.792025 20076 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:04.881564 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.827925 14901 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:04.821084 19943 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.830824 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:04.762352 19512 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.739615 19870 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.886248 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:04.830170 19933 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:04.913926 14378 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.759992 20162 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.927094 14898 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:04.914927 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:04.927783 14369 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:04.918015 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:04.920928 14893 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:04.795060 19892 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:04.954216 14895 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:04.953415 14223 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:04.926589 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:04.956454 14376 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:04.937935 20179 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 13:20:04.807452 20163 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:04.947103 19766 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:04.947417 19953 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:04.948642 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:04.948768 20142 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:04.933856 14897 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
W20260709 13:20:04.958892 14372 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.002s
I20260709 13:20:04.979703 14372 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:04.977641 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:04.928958 20145 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:04.979274 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:04.985564 14297 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:20:04.998231 14304 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:04.999416 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:04.997848 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:04.987114 19921 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.628s	user 0.004s	sys 0.006s
I20260709 13:20:04.981290 20037 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:05.006460 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.025571 14376 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:05.009436 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:05.026499 20185 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.027129 19921 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.029399 19921 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:05.029636 20143 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:05.030041 14896 raft_consensus.cc:2368] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:20:04.983800 19612 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:04.949990 19933 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.010603 20187 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:05.011034 20180 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.083s	user 0.004s	sys 0.002s
I20260709 13:20:05.005591 19824 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:05.012691 20181 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:05.017526 20149 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:05.019482 19643 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.003s
I20260709 13:20:05.031602 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:04.995990 19905 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.647s	user 0.005s	sys 0.005s
W20260709 13:20:05.033236 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 115286us
I20260709 13:20:05.033571 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:05.059424 14223 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.033617 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:05.041086 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 208081us
W20260709 13:20:05.013610 20170 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:05.011262 19870 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:05.047540 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.012696 19892 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:05.030074 20143 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:05.065200 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 108597us
I20260709 13:20:04.966372 19911 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.072197 14378 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:05.077729 14223 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:05.068526 19824 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:05.061913 19905 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17.
I20260709 13:20:05.060124 19842 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:05.086930 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:05.088303 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:05.089340 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.093998 19933 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:05.100281 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:05.056855 20173 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:20:05.108366 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.114019 19785 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16.
I20260709 13:20:05.110641 19933 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:05.116711 20173 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:05.117192 20173 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:05.118054 19884 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:05.118227 20173 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.105986 19842 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:05.121308 19842 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.119998 20173 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:05.129415 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 123678us
I20260709 13:20:05.144207 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:05.144714 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:05.138772 19946 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.008s
W20260709 13:20:05.147666 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81111us
I20260709 13:20:05.152761 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:05.155807 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:05.160503 20177 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:05.161989 20187 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:05.162271 19905 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.162868 19905 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.165288 19905 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:05.165954 19560 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:05.169000 20185 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:05.169840 20184 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:20:05.130400 19933 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:05.171725 19933 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.174557 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:05.174998 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:05.175395 14895 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
W20260709 13:20:05.176155 20193 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:20:05.177290 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:05.177603 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.179330 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.138388 20121 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:05.180990 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.180987 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:05.182665 14896 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.183636 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:05.184789 14220 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:05.185616 14895 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:20:05.186563 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:05.187148 14894 raft_consensus.cc:606] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:05.187731 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:05.188298 14295 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.188565 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:05.189872 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.185595 19824 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.195633 14267 leader_election.cc:400] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:20:05.196023 14267 leader_election.cc:403] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:05.199085 14295 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:05.199668 14892 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:05.201503 14896 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:05.204504 14228 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:05.203790 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:05.177337 19642 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:05.207840 14220 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 14. (term mismatch)
I20260709 13:20:05.213392 14220 pending_rounds.cc:85] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 13
I20260709 13:20:05.213737 14220 pending_rounds.cc:107] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 13.14
I20260709 13:20:05.214095 14220 raft_consensus.cc:2889] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:05.208061 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.157506 19946 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:05.217942 19512 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
W20260709 13:20:05.254740 14372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2518) took 1800 ms (client timeout 2181 ms). Trace:
I20260709 13:20:05.255028 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:05.255208 14372 rpcz_store.cc:269] 0709 13:20:03.453954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.462489 (+  8535us) service_pool.cc:224] Handling call
0709 13:20:05.254546 (+1792057us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b540028bc54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:05.254656 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2179312384}
I20260709 13:20:05.256500 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.256541 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.257287 14378 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 13: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:05.257370 14372 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 13: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:05.218669 20198 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:05.258253 20198 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:05.260638 20198 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:05.225101 20157 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.212597 19642 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.262403 19642 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.193717 20174 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:05.266189 20174 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:05.267122 20174 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.268769 20078 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:05.271795 14298 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:20:05.234696 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:05.274013 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.273758 20037 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:05.226675 19884 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.274751 19884 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:05.235024 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.275187 19884 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:05.276574 20190 log.cc:927] Time spent T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:20:05.236085 14370 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 16. Ops: []
I20260709 13:20:05.236680 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.236745 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.278789 14373 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:05.237397 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:05.238090 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.281172 14375 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:05.236451 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.216198 14222 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
W20260709 13:20:05.239701 20178 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.545s	user 0.003s	sys 0.000s
W20260709 13:20:05.246239 20183 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.332s	user 0.002s	sys 0.000s
I20260709 13:20:05.246939 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:05.247768 20029 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:05.292919 20029 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:05.293359 20186 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 13:20:05.293895 20029 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.253341 20152 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:05.295534 20185 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:05.296253 20185 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.290514 14894 raft_consensus.cc:606] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:05.297087 14894 raft_consensus.cc:614] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:05.291071 20195 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:05.299624 20195 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.299993 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:05.302047 20185 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:05.292420 19911 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.295445 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.271592 20061 consensus_queue.cc:1059] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:05.302294 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.244386 19943 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:05.310412 14899 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:05.313694 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:05.316022 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ede0d59e482a4cff952455ca90001863"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:05.318670 14378 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.330601 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:05.335305 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.295585 20029 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.344406 14895 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:20:05.344856 14895 pending_rounds.cc:85] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 11
I20260709 13:20:05.345089 14895 pending_rounds.cc:107] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:20:05.345333 14895 raft_consensus.cc:2889] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:05.346530 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:05.307149 20044 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.350143 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:05.307780 20152 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:05.353776 14221 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:05.359872 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:05.363338 14900 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:05.357597 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.364691 14374 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 13: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:05.373432 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:05.374356 14897 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:05.332964 20195 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:05.378331 20045 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.378907 20045 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:05.379877 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.385074 19642 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.388649 14378 raft_consensus.cc:2410] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:20:05.334872 19785 raft_consensus.cc:3055] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:05.406394 19785 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:05.418337 14901 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:05.419106 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:05.417380 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 199203us
I20260709 13:20:05.421696 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:05.428258 14374 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:05.372289 20152 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.431244 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:05.421525 20141 consensus_meta.cc:287] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.606s	user 0.012s	sys 0.000s
I20260709 13:20:05.437683 20204 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:05.438313 20204 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:05.440384 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 338021us
I20260709 13:20:05.441980 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.442358 14372 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:05.371099 20044 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.449095 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:05.433974 19485 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:05.447456 14864 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.668s (SENT)
I20260709 13:20:05.456735 14864 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:05.476222 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:05.484642 20191 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:05.485242 20191 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:05.479491 14224 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:05.480119 20209 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:05.454807 19485 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:05.486755 19485 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:05.491406 19642 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:05.492419 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:05.443194 19884 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.443658 20141 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.436093 20158 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:20:05.523803 14894 raft_consensus.cc:606] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:05.505894 19642 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:05.540897 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.541739 14376 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:05.541867 20152 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:05.547885 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:05.548787 14377 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:05.555305 19884 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:05.557133 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:05.557505 20141 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:05.557940 14298 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:20:05.558992 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:05.486313 20191 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:05.439322 20204 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.527320 20044 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:05.529497 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 373739us
I20260709 13:20:05.460741 19785 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:05.564895 19785 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:05.568621 19953 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:05.571918 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.571949 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:05.572816 14192 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:05.572958 20145 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.573598 20145 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.574250 20143 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:05.575624 20143 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:05.572634 14369 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:05.580245 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:05.581125 14301 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:05.593945 14295 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:05.594219 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:05.590127 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:05.603220 14295 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:05.603735 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.573625 19884 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:05.604614 14223 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:05.617434 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:05.618496 14899 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.576066 20145 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:05.572311 20164 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.623394 14270 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:05.587688 19643 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.623689 14299 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:05.621142 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:05.626169 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:05.628041 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:05.630556 20199 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:05.631279 20199 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:05.632407 20199 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.634572 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:05.635305 14297 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.621767 19884 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.651087 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:05.652076 14893 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:05.620988 20173 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:05.595629 19485 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:05.661520 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 216869us
I20260709 13:20:05.639915 19953 raft_consensus.cc:2764] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:05.665729 14270 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:05.670434 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 97721us
I20260709 13:20:05.649287 19824 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.674044 14298 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:05.655488 19884 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.688817 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:05.693043 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:05.693876 14370 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:05.699923 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.701218 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:05.681166 19485 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:05.681705 14300 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:05.650627 20142 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:20:05.660368 20209 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.640162 19643 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:05.685603 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.676275 19824 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.634016 20164 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.642387 20149 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:20:05.649627 20163 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:20:05.716475 14221 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.705873 20196 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.740850 14297 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:05.741318 14341 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:05.741807 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1364) took 1216 ms. Trace:
I20260709 13:20:05.745450 14892 rpcz_store.cc:276] 0709 13:20:04.525396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.525641 (+   245us) service_pool.cc:224] Handling call
0709 13:20:05.741525 (+1215884us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54001045d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:05.741707 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315545472}
I20260709 13:20:05.705750 20174 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:05.744284 14898 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:05.738101 14864 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:05.756407 19643 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:05.764103 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 122675us
I20260709 13:20:05.716603 19943 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.776645 19943 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.778266 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.778959 14373 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:20:05.738823 20185 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:20:05.779729 20164 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:05.765836 20152 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:20:05.773588 20045 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:05.782665 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.783542 14224 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:05.744769 20196 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.784780 20196 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.786414 20044 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:05.751291 20174 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:05.788388 20174 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:05.791765 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 73182.8us
I20260709 13:20:05.721030 20209 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:05.794783 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:05.795187 20170 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:05.795361 20209 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:05.796729 20229 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.075s	user 0.003s	sys 0.000s
I20260709 13:20:05.735455 20173 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:20:05.800654 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:05.719280 19785 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:05.779791 19943 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:05.734220 19824 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.813344 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:05.779695 19714 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:05.825465 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.816980 14899 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:05.829100 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.831220 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:05.816835 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.835000 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.836867 14369 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:05.844017 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.848011 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.848951 14224 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:05.813663 19785 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.816107 20185 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.810719 19783 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:20:05.858423 19785 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.866827 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:05.819587 20149 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:20:05.862627 20185 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:05.867560 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 208709us
I20260709 13:20:05.867570 14370 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:05.897133 14226 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:05.897251 20185 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:05.902354 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 155944us
I20260709 13:20:05.905184 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.905624 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:05.905452 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:05.928177 20230 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:05.928716 20230 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:05.929097 20230 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.935949 19766 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:05.919775 20061 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:20:05.936580 19766 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:05.936774 20061 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:05.937177 20061 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:05.937992 20061 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.939416 20061 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.941876 20204 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:05.942446 20204 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:05.943310 20237 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.943775 20237 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.944103 20237 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.920469 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:05.950899 14373 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:05.943341 20204 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.955581 20141 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.956239 20141 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:05.958019 20152 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:05.896888 20209 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.962102 20209 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.962495 20209 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.966717 20141 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:05.967767 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:05.968417 14376 raft_consensus.cc:2376] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12. Re-sending same reply.
I20260709 13:20:05.969710 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.970146 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:05.970345 14377 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:05.971345 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.972898 14378 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:05.973822 20144 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:05.974400 20144 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.975457 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:05.976369 19507 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:05.976410 20144 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:05.977172 14221 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:05.976706 14267 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:05.978945 20142 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:05.978658 20144 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:05.979772 20196 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:05.949925 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:05.985736 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:05.986924 14224 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.996176 14341 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:06.006747 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:05.998075 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:06.007555 14378 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:05.968724 20230 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.010921 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.001572 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:05.995405 20149 raft_consensus.cc:2764] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:20:05.937510 19766 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.006959 20163 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:06.038681 14224 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:06.038962 14341 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:06.032182 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.040756 14270 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:06.046979 14375 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:06.047259 19507 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:06.042315 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:06.047962 19507 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:06.048491 14900 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:20:06.038996 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 238452us
I20260709 13:20:06.034449 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:06.016960 20141 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:06.045284 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:06.025457 20196 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:05.995419 20209 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:06.032639 20152 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:06.054042 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 333682us
I20260709 13:20:06.067557 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:06.039726 20145 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:20:06.049157 19507 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.038044 19714 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:20:06.046386 20163 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:06.058817 20141 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:06.046407 19884 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.074146 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:06.080081 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:06.091300 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:06.100237 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 279857us
I20260709 13:20:06.102353 14223 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:06.080060 20195 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:06.108408 14378 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:06.096022 19870 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:06.117137 19714 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:06.076946 20196 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:20:06.093595 20141 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:06.120626 14900 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:20:06.115851 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 307050us
I20260709 13:20:06.124099 14224 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:06.104501 20204 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:06.147130 20204 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.147634 20204 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:06.148505 20145 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:06.149827 20145 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:06.150321 20145 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:06.151029 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:06.151548 20145 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:06.128299 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.153499 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:06.154387 14295 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:06.154561 20029 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.139328 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:06.155278 20029 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:06.155869 14225 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:06.156840 20204 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:06.156576 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:06.140879 14229 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:06.158185 14900 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.129534 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:06.142931 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:06.158718 20029 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:06.160926 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.161571 14378 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:20:06.161665 14192 connection.cc:256] RPC call timeout handler was delayed by -1.5076167709999027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260709 13:20:06.162557 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:20:06.164688 14192 connection.cc:256] RPC call timeout handler was delayed by -1.5058167709998997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 13:20:06.165448 14192 connection.cc:256] RPC call timeout handler was delayed by -1.4734167709998474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 13:20:06.166106 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3789167709999219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 13:20:06.166412 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:06.166893 14192 connection.cc:256] RPC call timeout handler was delayed by -1.2808167709999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:20:06.167707 14192 connection.cc:256] RPC call timeout handler was delayed by -1.1737167709998175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 13:20:06.168872 19643 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:06.168598 14192 connection.cc:256] RPC call timeout handler was delayed by -1.1638167709998015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260709 13:20:06.170513 14192 connection.cc:256] RPC call timeout handler was delayed by -1.1287167709999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 13:20:06.171257 14192 connection.cc:256] RPC call timeout handler was delayed by -1.1161167709999518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 13:20:06.159333 14898 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:20:06.159538 14222 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
W20260709 13:20:06.173219 14192 connection.cc:256] RPC call timeout handler was delayed by -1.0468167709998397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
I20260709 13:20:06.175215 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:06.176110 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:06.178346 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:06.191479 14900 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:06.159250 20204 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:06.197034 20029 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:06.113488 20144 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.204553 14222 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:20:06.125448 19870 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.208433 20230 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:06.195832 20044 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:06.210472 14222 pending_rounds.cc:85] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 7
I20260709 13:20:06.126046 19714 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:06.125047 20195 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.201363 20245 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.237036 14222 pending_rounds.cc:107] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:20:06.244555 14378 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
W20260709 13:20:06.238111 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 170585us
I20260709 13:20:06.128036 20174 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.125720 20238 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 13:20:06.195755 19933 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:06.263866 14222 raft_consensus.cc:2889] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:06.266376 20174 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:06.267006 14227 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:06.362085 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 149418us
I20260709 13:20:06.264436 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:06.215435 19870 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.205261 20029 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:06.392159 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:06.209532 20144 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:06.262004 20239 raft_consensus.cc:993] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: : Instructing follower bee4f7fc1b4740dc875537c79309664f to start an election
W20260709 13:20:06.406605 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 261599us
I20260709 13:20:06.506361 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.507298 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:06.508365 14376 raft_consensus.cc:2410] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:06.510260 14375 raft_consensus.cc:2368] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18.
I20260709 13:20:06.222816 20163 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.421859 20209 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:06.535307 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.536005 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.538432 14376 raft_consensus.cc:2376] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14. Re-sending same reply.
I20260709 13:20:06.537029 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.368506 20245 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.539518 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:06.499908 20239 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:06.489595 20174 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:06.515799 20215 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:20:06.510768 20233 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.433s	user 0.001s	sys 0.000s
I20260709 13:20:06.545837 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:06.559540 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 295190us
I20260709 13:20:06.544533 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.545070 14369 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:06.546744 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.560416 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:06.561362 14377 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 13: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:06.516884 20212 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:20:06.541806 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:06.565708 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:06.543964 14371 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:06.567032 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1374) took 1242 ms. Trace:
W20260709 13:20:06.541013 20143 consensus_meta.cc:287] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.965s	user 0.011s	sys 0.002s
I20260709 13:20:06.560364 14375 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.567514 14896 rpcz_store.cc:276] 0709 13:20:05.324638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.324766 (+   128us) service_pool.cc:224] Handling call
0709 13:20:05.325030 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.325217 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:05.347619 (+ 22402us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.798291 (+450672us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b18003daf80. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a 00007f8ded096a2a
0709 13:20:06.232326 (+434035us) log.cc:844] Serialized 14 byte log entry
0709 13:20:06.566665 (+334339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:06.566733 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:06.566788 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.566857 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.566977 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131840,"prepare.queue_time_us":22375,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":2849,"raft.queue_time_us":372279,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":12933,"spinlock_wait_cycles":3198208,"thread_start_us":630596,"threads_started":3}
W20260709 13:20:06.547731 20236 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
W20260709 13:20:06.548933 19824 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.001s
W20260709 13:20:06.584203 20269 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:20:06.584473 19824 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:06.585166 20251 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.454s	user 0.001s	sys 0.000s
I20260709 13:20:06.553839 19884 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:06.586896 19824 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:06.587565 19824 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:06.587724 20185 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.000s
I20260709 13:20:06.588160 19824 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.588259 20185 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.589515 14894 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:06.580731 14228 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
W20260709 13:20:06.584508 20255 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:20:06.591143 14898 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:06.593888 20245 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:06.593901 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:06.575254 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:06.608825 19953 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.445035 19714 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:06.580214 20237 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.636s	user 0.013s	sys 0.000s
W20260709 13:20:06.605542 20061 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.001s
I20260709 13:20:06.410885 20141 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:06.673017 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 112668us
I20260709 13:20:06.676136 14892 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:06.611451 19785 consensus_meta.cc:287] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.000s
I20260709 13:20:06.718962 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:06.767889 14374 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:06.788383 14898 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:06.799916 14376 raft_consensus.cc:2410] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:20:06.794350 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:06.802752 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:06.803668 14896 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:06.761000 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:06.798358 20220 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:20:06.817556 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.832567 14374 raft_consensus.cc:2410] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:06.845471 20144 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:06.850064 20254 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:06.829886 19714 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:06.697587 20245 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:06.814451 20153 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:20:06.852605 20245 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.850112 20263 raft_consensus.cc:1081] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Signalling peer bee4f7fc1b4740dc875537c79309664f to start an election
I20260709 13:20:06.855603 14898 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:06.858372 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.859025 14374 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.735803 19953 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:06.829926 19785 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.863896 19953 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:06.864758 20276 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:06.865391 20276 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.867689 20195 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:06.867769 20276 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:06.868316 19824 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:06.869431 20029 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:06.866925 19870 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:06.870352 14378 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:20:06.788784 20262 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.162s
I20260709 13:20:06.875353 19870 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:06.876081 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:06.876469 20185 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:06.876772 20257 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.454s	user 0.001s	sys 0.000s
W20260709 13:20:06.877349 20242 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.658s	user 0.001s	sys 0.000s
I20260709 13:20:06.815158 20282 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:20:06.878630 14372 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:06.882614 14370 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:06.842017 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 123181us
I20260709 13:20:06.888176 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:06.873198 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:06.896494 14375 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:06.890027 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:06.910346 14374 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:06.929454 14901 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:06.930102 14372 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:06.930258 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:06.932081 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.024s	sys 0.016s
I20260709 13:20:06.855805 20263 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:06.933291 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.024s	sys 0.017s
I20260709 13:20:06.863925 19785 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:06.958966 14342 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:06.962096 14370 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:06.898211 20061 raft_consensus.cc:2764] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:06.950768 20263 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.952767 19507 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:06.898495 20282 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:20:06.907239 20209 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
W20260709 13:20:06.977413 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 183162us
W20260709 13:20:06.977712 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 585602us
I20260709 13:20:06.968799 19953 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:06.968318 20230 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:20:06.760128 20237 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:07.049933 14866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.010s	sys 0.003s
I20260709 13:20:06.984827 20250 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:07.051796 14892 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
W20260709 13:20:07.102815 14866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.010s	sys 0.003s
I20260709 13:20:07.053730 14864 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:07.103259 14899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.006s	sys 0.055s
I20260709 13:20:07.104699 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:07.104593 14899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.006s	sys 0.055s
I20260709 13:20:06.980690 20263 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.099521 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:07.103946 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50331.3us
W20260709 13:20:07.107259 20243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.010s	sys 0.021s
I20260709 13:20:07.118009 14864 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:07.118708 14900 raft_consensus.cc:2368] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:20:06.980912 19507 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.127364 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:07.130034 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:07.109658 19485 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:07.120313 20243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.010s	sys 0.022s
I20260709 13:20:07.109552 20286 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:07.121268 19953 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:07.119618 20282 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:07.133560 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:07.116245 20281 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:07.123517 19507 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:07.133486 14892 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:07.139489 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:07.131232 20250 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.133134 20239 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:07.136917 19953 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:07.162719 19953 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.164224 19953 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:07.166759 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:07.140898 20282 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.169821 20252 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:07.170370 20268 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:20:07.170652 20252 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:07.136519 19485 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:07.171895 20252 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.173278 19485 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:07.175173 19842 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:07.175704 19842 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:07.176522 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1303) took 1075 ms. Trace:
I20260709 13:20:07.141923 20281 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:07.155171 20280 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:07.158681 20260 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:07.160658 20277 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.179131 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:07.185806 14376 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:20:07.186690 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:07.187291 14376 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:07.181565 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:07.177234 14893 rpcz_store.cc:276] 0709 13:20:06.101234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.109282 (+  8048us) service_pool.cc:224] Handling call
0709 13:20:06.131537 (+ 22255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:06.542678 (+411141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:06.542719 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:06.564327 (+ 21608us) log.cc:844] Serialized 26 byte log entry
0709 13:20:07.035031 (+470704us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:07.035090 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.035190 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.176234 (+141044us) raft_consensus.cc:1685] finished
0709 13:20:07.176262 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.176446 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83659,"raft.queue_time_us":365433,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12461,"spinlock_wait_cycles":475520,"thread_start_us":631414,"threads_started":2,"wal-append.queue_time_us":538966}
I20260709 13:20:07.188367 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:07.188350 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:07.189754 14375 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:07.195048 20282 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.176618 19842 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.197921 19842 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:07.198046 20281 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:07.198688 20278 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:07.200032 20237 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:07.204525 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:07.212231 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1300) took 1152 ms. Trace:
I20260709 13:20:07.212713 14894 rpcz_store.cc:276] 0709 13:20:06.061191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.072624 (+ 11433us) service_pool.cc:224] Handling call
0709 13:20:06.073066 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:06.674146 (+601080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.211950 (+537804us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b540079a254. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:07.212158 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187270400}
I20260709 13:20:07.214483 14894 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:20:07.219055 20293 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:07.220495 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:07.220448 20263 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.193657 20280 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.193514 20260 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:07.227324 20260 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.230170 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:07.230844 14375 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.234959 20263 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:07.193671 20277 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:07.244391 14228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2567) took 1419 ms (client timeout 1617 ms). Trace:
I20260709 13:20:07.244867 14896 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:07.237527 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1299) took 1191 ms. Trace:
I20260709 13:20:07.246490 14229 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:07.246014 14901 rpcz_store.cc:276] 0709 13:20:06.046213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.058474 (+ 12261us) service_pool.cc:224] Handling call
0709 13:20:06.058857 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:06.932815 (+873958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.237226 (+304411us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54006bcbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:07.237459 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1966917504}
W20260709 13:20:07.244975 14228 rpcz_store.cc:269] 0709 13:20:05.824828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.825132 (+   304us) service_pool.cc:224] Handling call
0709 13:20:07.244144 (+1419012us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b540026cfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:07.244302 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734467456}
I20260709 13:20:07.253933 14372 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:07.269184 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:07.270310 14295 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:07.261634 19714 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.276363 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:07.264735 19766 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:07.280370 14375 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
W20260709 13:20:07.322974 14864 leader_election.cc:336] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.652s (SENT)
I20260709 13:20:07.271600 20078 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:07.272318 20280 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:07.271878 20199 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:07.343137 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:07.342272 19943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.445s	user 0.013s	sys 0.018s
I20260709 13:20:07.308107 19714 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.342131 20271 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.349292 20078 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:07.358613 19943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.467s	user 0.013s	sys 0.018s
W20260709 13:20:07.367266 20291 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:20:07.370997 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2564) took 1547 ms. Trace:
I20260709 13:20:07.371533 14223 rpcz_store.cc:276] 0709 13:20:05.823734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.823874 (+   140us) service_pool.cc:224] Handling call
0709 13:20:07.370768 (+1546894us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540014a5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:07.370922 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591599488}
I20260709 13:20:07.373231 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:07.374116 14298 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:07.376284 19507 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.357693 14297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:45306
I20260709 13:20:07.380170 14297 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:07.380595 14297 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.340204 19766 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.366048 20271 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:07.388983 20078 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.391264 20280 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.391549 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:07.391868 20280 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.352218 20199 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.394218 20280 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:07.389516 20271 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:07.394554 20199 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.399348 20277 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:07.400590 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:07.401273 14370 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:07.401561 14377 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:07.404330 19714 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.414580 14297 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.418377 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:07.419220 14892 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:20:07.423689 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:07.425865 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:07.428102 14297 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:07.430763 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.430809 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1382) took 1259 ms. Trace:
I20260709 13:20:07.394580 19507 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.434381 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:07.435523 14892 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:07.432228 19953 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:07.476248 14894 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:07.463261 20078 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.479694 20078 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.466126 19507 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:07.483153 19507 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.486243 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:07.486749 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:07.486912 14376 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:07.489873 14894 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:07.485519 19507 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.499224 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:07.499895 14301 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:07.500247 14892 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:07.501428 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:07.502874 14298 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:07.489336 19953 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:07.504199 20078 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.502168 14895 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:07.504819 19485 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:07.507539 19485 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:07.508971 20294 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.309s	user 0.001s	sys 0.001s
I20260709 13:20:07.515080 19953 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:07.498950 19824 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.516865 19824 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.524690 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:07.522243 14895 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:07.529244 14226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2548) took 2372 ms (client timeout 1826 ms). Trace:
I20260709 13:20:07.501731 19507 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:07.529748 14226 rpcz_store.cc:269] 0709 13:20:05.152174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.152448 (+   274us) service_pool.cc:224] Handling call
0709 13:20:07.524358 (+2371910us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b540026ded4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:07.524494 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1520140544}
I20260709 13:20:07.538378 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2553) took 1020 ms. Trace:
I20260709 13:20:07.539469 14378 rpcz_store.cc:276] 0709 13:20:06.517641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.892306 (+374665us) service_pool.cc:224] Handling call
0709 13:20:06.892743 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:06.913674 (+ 20931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:06.913706 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:06.938515 (+ 24809us) log.cc:844] Serialized 26 byte log entry
0709 13:20:07.138996 (+200481us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:07.139049 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.139115 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.508383 (+369268us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:07.538112 (+ 29729us) raft_consensus.cc:1685] finished
0709 13:20:07.538132 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.538316 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20434,"raft.queue_time_us":59007,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":16338,"spinlock_wait_cycles":8180992,"thread_start_us":170026,"threads_started":1,"wal-append.queue_time_us":240594}
I20260709 13:20:07.542410 14892 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:07.545491 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:07.546419 14377 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:07.538532 14895 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.548265 14895 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.544430 19485 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:07.544443 19507 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:07.560932 19824 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.567603 19507 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:07.585649 14895 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
W20260709 13:20:07.594596 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.596518 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:07.597765 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:07.598749 14301 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 13: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:07.599858 14299 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:07.599232 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1398) took 1386 ms. Trace:
I20260709 13:20:07.602214 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:07.603399 14298 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:07.605329 20029 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:07.611681 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.611954 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:07.613114 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:07.618912 20283 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:07.619553 20283 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.622224 20283 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.618685 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:07.633368 14267 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:07.617009 19485 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:07.634490 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:07.618388 20196 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:07.606642 20029 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:07.640201 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 589518us
I20260709 13:20:07.639467 19507 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:07.641098 20145 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.641531 20029 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:07.636438 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:07.431995 14899 rpcz_store.cc:276] 0709 13:20:06.171597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.171755 (+   158us) service_pool.cc:224] Handling call
0709 13:20:06.172186 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:07.107669 (+935483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:07.107715 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:07.116367 (+  8652us) log.cc:844] Serialized 26 byte log entry
0709 13:20:07.262098 (+145731us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:07.429974 (+167876us) log.cc:844] Serialized 14 byte log entry
0709 13:20:07.430377 (+   403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.430482 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.430539 (+    57us) raft_consensus.cc:1685] finished
0709 13:20:07.430558 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.430729 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141183,"raft.queue_time_us":392814,"raft.run_cpu_time_us":505,"raft.run_wall_time_us":116778,"thread_start_us":1157252,"threads_started":3,"wal-append.queue_time_us":237727}
I20260709 13:20:07.646265 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:07.646875 20173 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:07.648202 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:07.627071 20204 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:20:07.650871 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.631626 19911 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:07.652802 14225 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:07.653257 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.655306 20230 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:07.653862 20283 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:07.656824 19507 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:07.676532 20240 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.463s	user 0.003s	sys 0.002s
I20260709 13:20:07.672292 19485 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:07.677560 19485 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:07.677677 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2569) took 1721 ms. Trace:
I20260709 13:20:07.650065 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:07.678642 14224 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.674994 20164 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:20:07.675325 20196 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:07.680438 20196 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:07.681190 20196 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:07.634393 20142 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:07.682035 20142 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:07.667670 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:07.670073 14228 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:07.649022 19643 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:07.672883 14220 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:07.677043 19507 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:07.665021 14226 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.674446 19911 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:07.675310 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.699572 14223 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:07.665988 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:07.678160 14227 rpcz_store.cc:276] 0709 13:20:05.956468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.956628 (+   160us) service_pool.cc:224] Handling call
0709 13:20:05.956947 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:06.376200 (+419253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.677444 (+1301244us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540026cad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:07.677617 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712450432}
I20260709 13:20:07.674317 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:07.695554 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.701727 14228 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:07.710184 14226 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:07.734154 14224 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
W20260709 13:20:07.751910 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 77654.2us
I20260709 13:20:07.753041 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:07.757907 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:07.678052 19485 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.771898 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:07.815220 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 46786.9us
I20260709 13:20:07.685276 20143 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:07.751860 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.819988 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.818333 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:07.772980 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 105360us
I20260709 13:20:07.688870 20313 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:07.751817 19911 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:07.694310 20230 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.751055 19643 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:07.802398 20164 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:07.601235 14222 rpcz_store.cc:276] 0709 13:20:06.207895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.397928 (+190033us) service_pool.cc:224] Handling call
0709 13:20:06.398307 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:06.398540 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:06.646199 (+247659us) log.cc:844] Serialized 14 byte log entry
0709 13:20:06.680452 (+ 34253us) log.cc:844] Serialized 14 byte log entry
0709 13:20:07.234847 (+554395us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b18003cefe0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f6d2a6 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1
0709 13:20:07.236385 (+  1538us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18003cefe0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:07.593941 (+357556us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b18003cefe0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:20:07.594115 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:07.594170 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:07.594219 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.594289 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.594417 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":821107,"prepare.queue_time_us":188398,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":953400,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":65973,"spinlock_wait_cycles":170886144,"thread_start_us":173495,"threads_started":1}
I20260709 13:20:07.811044 20185 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:07.832957 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:07.834059 14895 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:07.812754 14899 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:07.816042 14864 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:07.817625 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:07.836321 14226 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:07.685504 19824 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:20:07.682933 20142 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:07.676532 20283 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.821880 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:07.823180 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:07.873131 14228 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.796973 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.761973 20144 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:07.672631 20173 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.875213 14220 raft_consensus.cc:2393] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:07.830195 14270 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 1.599s (SENT) [suppressed 10 similar messages]
I20260709 13:20:07.877872 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.842793 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:07.880651 14899 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:07.860178 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.882020 14226 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:07.861557 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:07.862406 20143 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:07.906121 14303 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:20:07.906536 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 84762us
I20260709 13:20:07.907395 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:07.933652 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 72198.1us
I20260709 13:20:07.934271 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:07.934494 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:07.839054 20259 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:07.938314 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:07.839594 20164 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:07.939386 14224 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:20:07.838682 19933 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:07.959462 20230 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:07.961885 20240 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:20:07.962913 19943 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.964314 19766 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:07.829555 20313 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.965049 14227 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:20:07.966323 14222 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:07.966686 14222 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:07.966773 20313 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.967502 20164 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.967417 14222 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.968587 14222 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:07.969462 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.970216 14223 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:07.938999 20185 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:07.950213 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:07.952399 20283 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.955188 20173 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:07.885293 20144 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:07.933058 20143 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.980875 20143 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.940707 14302 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
W20260709 13:20:07.984520 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 318769us
I20260709 13:20:07.985632 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:07.985994 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:07.986609 14227 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.969537 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.970275 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1356) took 2398 ms. Trace:
I20260709 13:20:07.971153 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:07.942154 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:07.947844 14228 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:07.980378 20144 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:07.989763 14225 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:07.987707 14220 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
W20260709 13:20:07.992408 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50286.6us
I20260709 13:20:07.994344 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:07.991999 14228 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:07.996645 14228 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:07.998799 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.967410 20313 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:08.001129 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:07.988162 14897 rpcz_store.cc:276] 0709 13:20:05.571787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.698521 (+126734us) service_pool.cc:224] Handling call
0709 13:20:05.698964 (+   443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:05.699464 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:05.699751 (+   287us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.791157 (+ 91406us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b180038a160. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:06.029637 (+238480us) log.cc:844] Serialized 14 byte log entry
0709 13:20:06.046969 (+ 17332us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:06.047609 (+   640us) log.cc:844] Serialized 52 byte log entry
0709 13:20:06.047806 (+   197us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:06.051155 (+  3349us) log.cc:844] Serialized 14 byte log entry
0709 13:20:06.173087 (+121932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.176212 (+  3125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.239946 (+1063734us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b180038a160. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:07.616764 (+376818us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:07.970025 (+353261us) raft_consensus.cc:1685] finished
0709 13:20:07.970049 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.970195 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3004,"prepare.queue_time_us":10523,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":1674,"raft.queue_time_us":691246,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":44018,"spinlock_wait_cycles":96096384,"thread_start_us":411270,"threads_started":2,"wal-append.queue_time_us":373003}
I20260709 13:20:08.006199 14220 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:08.002163 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:07.970925 19643 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:07.998797 14228 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:07.989724 20173 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:08.043213 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:08.021332 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 267238us
I20260709 13:20:08.036176 14228 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.060559 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:07.998003 20248 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:08.027439 20185 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:07.990844 20157 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 13:20:08.070127 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 84563.2us
I20260709 13:20:08.082620 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.083853 14223 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:20:08.026152 19766 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:08.028496 20152 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:08.089738 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:08.096590 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:08.097411 14373 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:08.071326 20185 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.084524 20238 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:08.103719 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:08.101933 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 271740us
I20260709 13:20:08.088394 19766 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:08.107743 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:08.144431 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.145426 14223 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:08.145902 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.144682 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:08.147826 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2946) took 2010 ms. Trace:
I20260709 13:20:08.143895 14228 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:20:08.105635 20185 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:08.150305 14228 pending_rounds.cc:85] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 9
I20260709 13:20:08.105963 20238 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.162338 20238 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:08.148285 14229 rpcz_store.cc:276] 0709 13:20:06.137107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.158468 (+ 21361us) service_pool.cc:224] Handling call
0709 13:20:07.245954 (+1087486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:07.246998 (+  1044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:08.145546 (+898548us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540026cfd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:08.147772 (+  2226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500249984}
I20260709 13:20:08.171742 14228 pending_rounds.cc:107] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:20:08.172324 14228 raft_consensus.cc:2889] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:08.176241 20238 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.173638 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.185298 14228 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
W20260709 13:20:08.153178 20314 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:08.108142 19766 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:08.095301 20152 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.171128 20143 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:08.206548 20259 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:08.207096 20259 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:08.207454 20259 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:08.209199 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.121613 20196 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:08.227892 20144 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.230818 19485 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:08.239600 19911 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:08.241396 14226 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:08.255692 20143 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:08.259320 14224 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:20:08.259857 14224 pending_rounds.cc:85] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 11
I20260709 13:20:08.260141 14224 pending_rounds.cc:107] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:20:08.260411 14224 raft_consensus.cc:2889] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:08.261157 20145 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.002s
I20260709 13:20:08.262421 14228 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:08.263806 14304 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:08.227916 19943 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:08.209725 20164 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:08.289222 14227 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:08.274837 20297 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:08.276567 20199 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.300981 20297 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:08.299454 14222 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:20:08.302974 14222 pending_rounds.cc:85] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 10
I20260709 13:20:08.303305 14222 pending_rounds.cc:107] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:20:08.303602 14222 raft_consensus.cc:2889] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:08.304795 20245 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:08.303133 20199 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.321108 19911 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:08.325949 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 298951us
I20260709 13:20:08.328157 14867 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:08.331563 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:08.333734 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:08.334578 14378 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:08.333370 19943 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:08.335002 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:08.326773 20281 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.337810 14373 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:08.361636 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 454268us
I20260709 13:20:08.362854 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:08.364698 14270 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:08.331406 19485 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:08.367025 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:08.368960 14897 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:08.330895 20238 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:08.333772 20245 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:08.389158 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:08.390198 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:08.378299 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:08.368017 19911 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:08.394644 14373 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:08.391149 14376 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:08.334990 20244 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:20:08.417469 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.419970 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:08.390522 20320 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:20:08.421341 14895 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:08.419922 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:08.423120 20256 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.262s	user 0.005s	sys 0.023s
W20260709 13:20:08.423255 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45850.8us
I20260709 13:20:08.397588 19643 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:20:08.434701 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:08.424324 20272 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.444s	user 0.002s	sys 0.007s
I20260709 13:20:08.435577 20143 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:08.436983 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3154) took 2258 ms. Trace:
I20260709 13:20:08.424886 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:08.438205 14374 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:08.368201 19507 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:20:08.426070 20317 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:08.427663 20325 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:20:08.370642 20324 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:08.388604 20248 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:08.437371 14300 rpcz_store.cc:276] 0709 13:20:06.178484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.178643 (+   159us) service_pool.cc:224] Handling call
0709 13:20:06.179053 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:06.184191 (+  5138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:06.184233 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:06.184883 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 13:20:06.366900 (+182017us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:06.366977 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.367152 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:08.370687 (+2003535us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:08.436662 (+ 65975us) raft_consensus.cc:1685] finished
0709 13:20:08.436688 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:08.436898 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4576,"raft.queue_time_us":6407,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":3558144,"thread_start_us":181422,"threads_started":1,"wal-append.queue_time_us":784834}
I20260709 13:20:08.444669 20248 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.422001 19911 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.448980 19911 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:08.395948 20283 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:20:08.390815 20329 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:08.366088 20281 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.447607 14371 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:08.452911 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:08.455693 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:08.479830 14373 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:08.480180 19870 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:08.428951 20259 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.462762 14220 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:08.465233 14374 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:08.391731 20245 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.480957 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:08.470450 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81372.3us
I20260709 13:20:08.471165 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:08.479290 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1140) took 1201 ms. Trace:
I20260709 13:20:08.523500 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:08.471231 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 447933us
I20260709 13:20:08.501199 14295 rpcz_store.cc:276] 0709 13:20:07.278267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.279153 (+   886us) service_pool.cc:224] Handling call
0709 13:20:07.279517 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:07.395332 (+115815us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:07.469822 (+ 74490us) log.cc:844] Serialized 14 byte log entry
0709 13:20:07.550941 (+ 81119us) log.cc:844] Serialized 14 byte log entry
0709 13:20:07.551180 (+   239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:07.551232 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:07.551279 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.805405 (+254126us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b18003d49e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f6d2a6 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1
0709 13:20:08.236123 (+430718us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b18003d49e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:08.479066 (+242943us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000dcfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:08.479118 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:08.479236 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74763,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":95,"raft.queue_time_us":1681,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":2296,"spinlock_wait_cycles":273437056,"thread_start_us":151225,"threads_started":2,"wal-append.queue_time_us":95569}
W20260709 13:20:08.537981 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.483836 20142 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:08.543983 14270 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:08.500628 20245 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:08.483769 19507 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.472954 20329 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:08.541579 20283 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:08.538285 19870 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:08.563556 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 93975.8us
W20260709 13:20:08.588945 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45066.6us
I20260709 13:20:08.592597 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:08.600098 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 137457us
W20260709 13:20:08.610805 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 116270us
I20260709 13:20:08.611595 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:08.601265 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:08.610903 14867 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:08.563668 20238 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:08.565598 20142 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.545092 20332 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.061s
W20260709 13:20:08.625768 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.595425 19870 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.595989 20283 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:08.553933 20157 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:20:08.599048 19507 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.620119 19766 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.635756 20331 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:08.636747 19911 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:08.596280 20329 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.650718 20318 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:08.651149 20318 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.636921 20283 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.637897 19643 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:20:08.654850 20259 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:08.635802 19870 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:08.651551 20318 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:08.634420 14192 leader_election.cc:400] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18.
I20260709 13:20:08.665891 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:08.646189 20264 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:08.672196 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:08.644376 20345 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:08.669085 20344 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:08.629998 20142 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:08.670080 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:08.672700 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:08.676494 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:08.686311 14295 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 13: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:08.686368 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:08.646855 20334 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:20:08.635591 20149 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:08.698784 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 107495us
I20260709 13:20:08.702309 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:08.642508 19507 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:08.703305 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:08.638670 20281 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:08.698768 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:08.708539 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116055us
I20260709 13:20:08.649215 19766 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:08.712152 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:08.707067 14303 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:08.712944 14227 raft_consensus.cc:2393] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 10: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:08.713653 19783 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:08.714359 19783 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.716749 19783 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:08.719039 20333 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:08.685751 20331 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:20:08.721426 20328 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:08.739471 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:08.701602 20143 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:08.729027 14301 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:08.719028 20259 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:20:08.670642 20248 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:08.729765 19766 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:08.674772 20317 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:08.730391 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.732599 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:08.740242 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.741806 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:08.742067 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:08.743611 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:08.640291 20185 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.700080 20345 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:08.746596 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:08.750582 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.770077 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.754097 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:08.752964 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:08.701709 19943 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:08.771116 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 150790us
I20260709 13:20:08.771441 14224 raft_consensus.cc:2376] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14. Re-sending same reply.
I20260709 13:20:08.772737 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.745740 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:08.765239 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:08.768194 14373 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:08.768735 14226 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:08.730223 20331 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:08.731104 20141 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:08.784591 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:08.778518 14342 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:08.785282 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.785930 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.785975 14227 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:08.805341 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:08.683876 20264 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:08.808833 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:08.811956 14378 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:08.814956 14303 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:08.700400 20344 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:08.814114 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 126970us
I20260709 13:20:08.776075 19943 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:08.818487 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 185079us
I20260709 13:20:08.812674 14267 leader_election.cc:400] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:20:08.836519 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:08.835116 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:08.842478 14303 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:08.847045 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:08.814049 20157 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:08.767994 19766 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:08.852895 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 166606us
I20260709 13:20:08.849913 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:08.779805 19911 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:20:08.782877 20332 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:20:08.855686 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:08.856678 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:08.834394 20141 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:08.861959 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:08.862988 20245 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:08.864154 20335 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.254s	user 0.000s	sys 0.002s
I20260709 13:20:08.865705 20345 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.866848 20185 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:08.844507 19943 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:08.868887 20283 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:08.768417 20317 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:08.870888 19766 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:08.791064 20331 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:08.857522 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 119313us
I20260709 13:20:08.871958 20145 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:08.871788 19870 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:08.872448 20349 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:20:08.894802 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.901268 14225 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:08.778368 20248 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:08.877130 14303 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:08.886737 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 47214.7us
I20260709 13:20:08.888527 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:08.872001 20157 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:08.890792 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 300579us
I20260709 13:20:08.901932 14227 raft_consensus.cc:2393] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 11: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:08.878255 19911 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.916329 14303 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:08.916424 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:08.916661 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:08.917402 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:08.918879 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:08.919495 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:08.881695 19783 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.920527 14896 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:08.879405 20141 raft_consensus.cc:697] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:08.921075 14894 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 13: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:08.921137 14898 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:08.931020 14378 raft_consensus.cc:2368] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16.
I20260709 13:20:08.931136 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:08.931178 14895 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:20:08.890561 20145 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:08.934924 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:08.935218 14370 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:09.076835 14900 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.935977 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:08.896000 19766 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:08.939734 14303 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:08.943049 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.064874 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 159605us
I20260709 13:20:09.067528 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.068586 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.070623 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:09.091811 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.092640 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1394) took 1207 ms. Trace:
I20260709 13:20:09.092954 14225 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:09.093065 14899 rpcz_store.cc:276] 0709 13:20:07.885330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.902065 (+ 16735us) service_pool.cc:224] Handling call
0709 13:20:07.902669 (+   604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:07.935223 (+ 32554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:07.935253 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:07.935700 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:20:08.373570 (+437870us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:08.552029 (+178459us) log.cc:844] Serialized 14 byte log entry
0709 13:20:08.552260 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:08.552337 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:08.782310 (+229973us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:09.076414 (+294104us) raft_consensus.cc:1685] finished
0709 13:20:09.092414 (+ 16000us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.092575 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32035,"prepare.queue_time_us":308576,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":34521,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":41490,"spinlock_wait_cycles":6193536,"thread_start_us":497130,"threads_started":2,"wal-append.queue_time_us":567823}
I20260709 13:20:09.103524 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:09.107527 14374 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:08.890116 20143 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:20:08.927697 20149 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:09.105198 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:09.113082 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:09.117673 14370 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:09.121315 20196 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.125995 20149 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:09.127238 20331 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:09.127190 20149 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.133225 14893 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:08.923121 20157 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.187s
I20260709 13:20:08.894752 20357 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.215s
W20260709 13:20:09.147425 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.920173 20185 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.183s
I20260709 13:20:09.131029 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:09.162320 14227 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:08.935480 19911 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.193s
I20260709 13:20:09.163262 20145 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.164410 20370 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:09.167178 20329 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.002s
I20260709 13:20:09.167676 20329 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.168895 14297 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:09.170838 19870 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:09.171584 19870 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:09.172125 19870 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.180379 14297 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:09.183267 20321 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:08.930357 19783 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.164749 20145 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.188975 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:09.195677 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 293465us
I20260709 13:20:09.075867 20355 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.226s
W20260709 13:20:09.198683 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 276316us
I20260709 13:20:09.204030 14370 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:09.212057 14900 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
W20260709 13:20:09.216317 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 313799us
I20260709 13:20:09.217528 20329 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:09.218331 20329 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:09.218763 20329 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:09.219679 20329 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.220150 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:09.220919 20329 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:09.222893 14900 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:20:09.224362 14270 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:09.227417 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:09.230841 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:09.216563 20335 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:20:09.236572 14192 connection.cc:256] RPC call timeout handler was delayed by -1.5380281840000407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:20:09.238399 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3463281840001855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260709 13:20:09.239064 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3310281840001608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 13:20:09.239578 14192 connection.cc:256] RPC call timeout handler was delayed by -1.1438281840000855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260709 13:20:09.240036 14192 connection.cc:256] RPC call timeout handler was delayed by -1.1276281840000593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 13:20:09.240680 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:09.241533 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:09.228859 20264 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:09.222118 20331 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.274720 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:09.279157 14192 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:09.282357 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:09.241385 20143 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:09.252048 20355 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.246856 20365 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:09.252972 20356 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:09.253232 20372 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:09.237639 19507 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:20:09.279330 20344 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.279309 20362 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:09.278333 20331 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.286993 20375 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:09.335700 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.293889 20245 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:09.297040 19870 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:09.295192 20283 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.302507 20372 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:09.340011 20368 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:09.294166 20374 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.315315 20344 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:09.313166 20365 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:09.296800 20143 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.310609 20362 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:09.273890 20141 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.339272 20373 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:09.299429 20355 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.343286 20317 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.359887 20283 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:09.305963 20356 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:09.377202 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 93295.6us
I20260709 13:20:09.385823 14370 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:09.341980 20378 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:09.347707 20245 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:09.361490 20367 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:20:09.448998 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 66420.6us
I20260709 13:20:09.451313 20392 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:09.451815 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:09.452541 20383 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:20:09.474093 20377 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:09.474690 20355 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.341163 20375 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.477334 20375 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:09.479460 20356 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:09.364190 20368 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:09.481398 20372 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.394029 20378 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.482847 20378 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:09.483124 20372 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:09.455506 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2949) took 1467 ms. Trace:
I20260709 13:20:09.490510 14228 rpcz_store.cc:276] 0709 13:20:07.986096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.200545 (+214449us) service_pool.cc:224] Handling call
0709 13:20:08.200826 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:08.262998 (+ 62172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.453550 (+1190552us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b540011fdd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:09.453750 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141055872}
I20260709 13:20:09.364202 20362 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:09.498886 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:09.499912 14228 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:09.392416 20371 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:09.507876 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.360657 20363 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
W20260709 13:20:09.471632 20379 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:20:09.391779 20373 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.524811 20373 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.496006 20392 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:09.495709 20353 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.526190 20353 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.528995 20353 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.530865 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:09.452978 19943 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:20:09.449756 20185 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.558112 14226 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:20:09.559293 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:09.521432 20364 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 13:20:09.532900 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 81188.9us
I20260709 13:20:09.499308 20356 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:09.542435 20328 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:09.546087 20152 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:09.487051 20317 consensus_queue.cc:1175] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cebb34ac155340899a38c728707ddc0d" responder_term: 14 status { last_received { term: 14 index: 12 } last_committed_idx: 11 last_received_current_leader { term: 14 index: 12 } }
I20260709 13:20:09.516311 20371 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.514909 20375 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:20:09.567044 20387 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:09.581470 20387 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.577579 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:09.584460 20387 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.565639 20383 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:09.566058 20143 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.569381 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:09.605823 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:09.606328 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:09.570770 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.606834 14224 raft_consensus.cc:2393] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:09.607425 14370 raft_consensus.cc:2410] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:20:09.574906 20392 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.566747 19943 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.513193 20248 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.455317 20245 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.573570 14374 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:09.573505 20328 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:09.590350 20331 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:20:09.579744 20371 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.577888 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:09.624063 14375 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: [13.14-13.14]
I20260709 13:20:09.580857 20375 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:20:09.592427 20142 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.886s	user 0.008s	sys 0.013s
I20260709 13:20:09.642346 20142 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.644665 20142 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:09.621510 20344 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:09.646332 20344 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.572057 20185 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.648689 20344 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:09.649333 20185 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.650112 14300 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:09.650828 20375 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:09.650940 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:09.651799 20375 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.652992 20375 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:09.655087 19943 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:09.655344 14901 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 13:20:09.658696 14376 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 10.
I20260709 13:20:09.611706 20145 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:09.659996 19911 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:09.659926 20145 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.603128 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:09.660898 14371 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
W20260709 13:20:09.607729 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.532958 19783 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:09.661829 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:09.662474 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.610304 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.663141 14371 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:09.663311 14370 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:09.553905 20357 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:09.617141 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.665035 20357 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:09.613209 19766 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:09.618264 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.665000 14371 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:09.618105 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:09.667179 14374 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:09.614775 20374 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:09.601130 20356 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.641659 20164 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.667979 20329 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:09.668668 20329 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:09.670079 20356 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.670671 20356 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:09.667920 20374 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.671665 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.672868 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:09.667567 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49579.7us
I20260709 13:20:09.673981 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:09.674582 20318 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.990s	user 0.009s	sys 0.005s
I20260709 13:20:09.674651 14896 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:20:09.675132 20318 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.676118 20356 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.569336 14228 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:09.660998 14377 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:09.604152 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:09.678020 20373 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.609479 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:09.679086 14221 raft_consensus.cc:2368] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:20:09.678730 20373 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.679917 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:09.680704 20373 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:09.680982 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:09.681728 20328 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.682247 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:09.682832 20328 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:09.666040 20357 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.666460 19766 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.685551 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:09.686089 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.686704 14375 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:09.687180 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:09.686851 20384 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:09.688627 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:09.689330 14899 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:20:09.678087 14225 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
W20260709 13:20:09.685685 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.692523 14898 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:09.660436 19911 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:09.662619 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2577) took 1276 ms. Trace:
I20260709 13:20:09.691953 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:09.699506 14372 rpcz_store.cc:276] 0709 13:20:08.386569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.386734 (+   165us) service_pool.cc:224] Handling call
0709 13:20:09.661697 (+1274963us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67eee 0000000000375939 00007f8df1fdb1e0 00007f8df20a40c4 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:20:09.662564 (+   867us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4680320}
I20260709 13:20:09.700176 14303 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:09.681568 14221 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:20:09.701231 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:09.673995 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.618927 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:09.694924 14270 leader_election.cc:400] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:20:09.702483 14270 leader_election.cc:403] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:09.696589 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:09.696630 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:09.698592 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:09.704187 14372 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: [15.7-17.8]
I20260709 13:20:09.705044 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:09.705490 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.706048 14228 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:09.702615 14224 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:20:09.708454 14377 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:09.709358 14376 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:09.713761 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:09.737569 14228 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:09.738327 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:09.740561 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 44943us
W20260709 13:20:09.746970 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52240.5us
I20260709 13:20:09.747349 14267 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:09.721963 14370 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:20:09.747012 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:09.746024 14901 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:09.717746 14899 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:20:09.759781 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 63257.3us
I20260709 13:20:09.763023 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:09.766570 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 52907.4us
I20260709 13:20:09.768033 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.765193 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:09.769340 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:09.770478 14222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.004s	sys 0.023s
W20260709 13:20:09.772205 14222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.005s	sys 0.023s
I20260709 13:20:09.769865 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:09.774452 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:09.718072 20143 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:09.776590 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2598) took 1065 ms. Trace:
I20260709 13:20:09.776367 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:09.775038 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:09.788820 14192 leader_election.cc:400] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16.
I20260709 13:20:09.789327 14192 leader_election.cc:403] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:09.746989 20377 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:09.786767 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:09.754084 20164 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14.
I20260709 13:20:09.718678 20317 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:09.766940 20356 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.773869 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.781015 20391 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:09.781664 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:09.796911 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:09.777968 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:09.816630 14901 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:09.668685 20297 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.663367 20245 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:09.767187 19824 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:20:09.777693 19870 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:09.792200 20390 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:20:09.788597 20157 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:09.792466 20142 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:09.899124 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.795445 20381 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:09.793111 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:09.796406 20152 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:09.707752 20383 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:20:09.771148 20283 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.792135 14222 rpcz_store.cc:276] 0709 13:20:08.710957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.711407 (+   450us) service_pool.cc:224] Handling call
0709 13:20:08.711739 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:08.711990 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:08.726058 (+ 14068us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.776245 (+1050187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:09.776309 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:09.776359 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.776421 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.776537 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14346,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":275079,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":1049744,"threads_started":2,"wal-append.queue_time_us":652398}
W20260709 13:20:09.914213 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.013s	sys 0.025s
I20260709 13:20:09.815850 14896 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:20:09.785032 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:09.914669 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.013s	sys 0.025s
I20260709 13:20:09.737152 20185 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:20:09.689021 20384 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.669587 20329 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.779582 20259 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:09.837448 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:09.851254 20355 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:09.851743 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 54926.8us
I20260709 13:20:09.855059 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:09.799472 20196 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:09.806344 20317 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:09.866147 20394 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16.
I20260709 13:20:09.795301 20143 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:09.778038 20372 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:20:09.800252 20248 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:09.805434 20362 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:09.736488 20373 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:09.932353 20355 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:09.906855 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 371532us
I20260709 13:20:09.909499 14901 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:09.867832 19870 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.932603 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:09.822168 20045 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:20:09.898828 20142 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:09.995267 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 62749.4us
I20260709 13:20:09.943159 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:09.933166 14899 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:09.913913 20152 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.015925 20142 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.016336 20152 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.944698 20259 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:09.949265 14229 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:09.904541 20157 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:10.022998 20259 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.023667 20157 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.951427 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.027192 20362 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:09.916360 20381 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:10.028636 20144 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.028355 20381 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:09.866223 20380 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:20:10.033454 20281 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:10.033993 20281 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.034297 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:09.957726 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.035907 14295 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 10.
I20260709 13:20:10.036348 14893 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:09.959771 14304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1142) took 2644 ms (client timeout 1899 ms). Trace:
I20260709 13:20:10.022951 14229 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:09.906067 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 113034us
I20260709 13:20:09.981698 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:09.982487 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2574) took 1574 ms. Trace:
I20260709 13:20:09.945591 20317 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:09.822235 19911 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:09.993484 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.998859 20388 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.000140 14299 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:20:10.044397 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:10.003779 20358 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:10.008942 20361 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:10.010917 20149 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:10.013387 20163 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:09.946933 20196 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:09.987699 20372 consensus_queue.cc:1243] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:09.950289 20248 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:10.037228 14304 rpcz_store.cc:269] 0709 13:20:07.304530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.304700 (+   170us) service_pool.cc:224] Handling call
0709 13:20:09.947846 (+2643146us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54000db6d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:09.947999 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114603904}
I20260709 13:20:10.038807 14369 rpcz_store.cc:276] 0709 13:20:08.383888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.384072 (+   184us) service_pool.cc:224] Handling call
0709 13:20:09.957619 (+1573547us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b5800044d98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:20:09.957839 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.958033 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.958057 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:09.958098 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:09.958134 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.958185 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.958337 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5296384}
I20260709 13:20:10.003090 20384 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:10.060546 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:10.043538 20377 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:09.985571 20373 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:10.050465 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:09.994709 19870 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.052937 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:10.054517 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:09.943697 20378 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.057928 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:10.105762 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 47954.9us
I20260709 13:20:10.107041 20378 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.107712 20378 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:10.105780 14298 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:20:10.108147 20378 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.059725 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:10.108726 20378 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:09.989007 20355 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.041057 19953 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.110085 19953 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.110869 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.111567 14223 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:10.048498 20328 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:10.112478 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.112640 20328 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:10.073747 14295 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:10.078126 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.078604 20281 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:10.079185 20397 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.079332 20152 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.071175 19824 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:20:10.080796 20143 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.064853 20377 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:10.062143 20248 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:10.061684 20361 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:10.046380 20394 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:20:10.053499 20388 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.052333 20385 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.055380 20358 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.070161 20363 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:10.058085 20163 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.137588 20377 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.113639 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.121078 14302 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:20:10.122264 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:10.187568 14303 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:10.125133 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.129341 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.195024 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.134975 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.073431 20373 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:10.142092 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 228454us
I20260709 13:20:10.203795 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.157891 19953 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.127313 20349 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:20:10.114167 20196 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.208801 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.175166 20163 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.173655 20355 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.113654 20328 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.182647 20388 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:10.221745 14303 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
W20260709 13:20:10.130198 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 364475us
I20260709 13:20:10.185452 20358 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.115548 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:10.220510 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:10.247833 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.248246 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:10.250450 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:10.252061 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:10.206813 20363 raft_consensus.cc:697] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:10.208905 20380 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.165484 20142 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.257336 14222 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 13:20:10.261312 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 145841us
I20260709 13:20:10.165755 20385 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.269289 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:10.261744 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.265261 20045 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:10.288053 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 362763us
I20260709 13:20:10.290478 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.297876 14193 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:10.302000 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.178205 20361 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.306880 14299 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:10.278035 19824 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:10.308562 14223 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:10.320185 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.322060 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.323724 14223 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:10.314360 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:10.288851 20141 raft_consensus.cc:2764] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:10.327193 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:10.341732 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:10.343564 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.343978 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:10.347529 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:10.296478 20045 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:10.353071 14303 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:10.277199 20380 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.302278 20412 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:10.377818 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.350646 20204 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:10.389758 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.317071 20344 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:20:10.353253 20164 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.363813 20045 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.309145 19485 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:20:10.302613 20317 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:10.400209 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 152060us
I20260709 13:20:10.377018 20381 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:10.414217 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.418601 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.406908 14225 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:10.377561 20397 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:10.351795 20349 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:20:10.404273 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:10.394230 20358 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:10.430692 14221 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:10.435420 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:10.438304 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:10.439296 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:10.423283 20392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.003s	sys 0.007s
I20260709 13:20:10.448840 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:10.457228 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 53055.2us
W20260709 13:20:10.458871 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 161088us
I20260709 13:20:10.462951 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:10.419410 20152 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:10.561411 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 123174us
I20260709 13:20:10.565516 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:10.565909 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 130603us
I20260709 13:20:10.571048 20433 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:10.572899 20433 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:10.575065 20442 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:10.573506 20433 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:10.457399 20392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.004s	sys 0.007s
I20260709 13:20:10.451562 20419 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.580155 20164 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:10.362159 20363 consensus_queue.cc:237] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.576946 20442 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:10.606446 20416 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:20:10.601066 20199 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.610610 20380 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.591727 20438 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.424865 20381 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.618669 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.622907 20435 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.623282 20434 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:10.624284 20369 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.154s	user 0.000s	sys 0.005s
I20260709 13:20:10.673317 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2968) took 1180 ms. Trace:
W20260709 13:20:10.625258 20407 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:20:10.587656 20349 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:10.554016 20358 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.674532 20349 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:10.675244 20349 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.673990 14224 rpcz_store.cc:276] 0709 13:20:09.493083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.706852 (+213769us) service_pool.cc:224] Handling call
0709 13:20:09.707206 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:09.758373 (+ 51167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.758419 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:09.770944 (+ 12525us) log.cc:844] Serialized 52 byte log entry
0709 13:20:10.275846 (+504902us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:10.275887 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.275952 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.672974 (+397022us) raft_consensus.cc:1685] finished
0709 13:20:10.673008 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.673225 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18503,"raft.queue_time_us":39537,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":25499,"thread_start_us":425363,"threads_started":1,"wal-append.queue_time_us":589267}
I20260709 13:20:10.676054 20358 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.601292 20143 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:10.657693 20422 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:20:10.658174 20418 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:20:10.676791 20143 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:10.677276 20143 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:10.647718 19870 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.000s
I20260709 13:20:10.678061 19870 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:10.679751 20403 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.584s	user 0.000s	sys 0.002s
I20260709 13:20:10.680229 19953 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.680765 19953 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.681157 19870 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:10.639549 20433 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:10.666263 20440 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:10.666718 20438 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.669028 20442 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:10.598969 20164 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:10.671471 20435 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.672940 20355 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:10.679832 20423 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:10.451913 20397 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.626530 20392 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:10.684661 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 222006us
W20260709 13:20:10.721752 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 372010us
I20260709 13:20:10.685060 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.724691 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:10.725286 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:10.660156 20318 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:10.689383 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.639400 20142 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:10.710196 14223 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:10.728281 14227 raft_consensus.cc:2410] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:10.673401 20434 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:10.682569 20440 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.737840 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:10.742277 14224 raft_consensus.cc:2410] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:20:10.719837 20317 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:10.741245 20377 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.002s
I20260709 13:20:10.752728 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:10.601680 20419 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.740319 20434 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:10.743742 20345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.263s	user 0.007s	sys 0.027s
I20260709 13:20:10.753623 14227 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.757007 14295 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:10.740715 20355 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:10.760860 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1400) took 1052 ms. Trace:
I20260709 13:20:10.763299 14898 rpcz_store.cc:276] 0709 13:20:09.708162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.714849 (+  6687us) service_pool.cc:224] Handling call
0709 13:20:09.715257 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.715713 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.715752 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.716333 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:20:10.164253 (+447920us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:10.164294 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.164365 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.760594 (+596229us) raft_consensus.cc:1685] finished
0709 13:20:10.760619 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.760775 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":304,"raft.queue_time_us":123,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":28673,"thread_start_us":375420,"threads_started":1,"wal-append.queue_time_us":592868}
I20260709 13:20:10.765416 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:10.766731 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.767369 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.767823 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:10.768455 14302 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:10.766105 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:10.772405 14302 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:20:10.772969 14193 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:10.773401 14299 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:10.774900 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:10.755905 20415 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:10.752993 20392 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:10.776906 14299 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:10.780496 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:10.760085 20345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.279s	user 0.007s	sys 0.027s
W20260709 13:20:10.759536 20259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.008s	sys 0.009s
I20260709 13:20:10.781255 14304 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:10.777936 20370 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:10.779458 20317 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:10.796355 14227 raft_consensus.cc:2410] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:20:10.759003 20377 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.778293 20415 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:10.861869 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2965) took 1655 ms. Trace:
I20260709 13:20:10.862536 14226 rpcz_store.cc:276] 0709 13:20:09.206233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.207291 (+  1058us) service_pool.cc:224] Handling call
0709 13:20:09.557851 (+350560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.558616 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.855649 (+1297033us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540026cfd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:10.861758 (+  6109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753616640}
I20260709 13:20:10.833395 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1393) took 1743 ms. Trace:
I20260709 13:20:10.866214 14893 rpcz_store.cc:276] 0709 13:20:09.090166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.134233 (+ 44067us) service_pool.cc:224] Handling call
0709 13:20:09.586182 (+451949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.041075 (+454893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.832387 (+791312us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b540078f5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:10.833114 (+   727us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b540078f5d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:10.833312 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009130112}
I20260709 13:20:10.868573 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:10.797150 20428 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:10.788916 20259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.008s	sys 0.009s
I20260709 13:20:10.816745 19953 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.751832 20164 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:10.788344 20355 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:20:10.817466 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:11.008773 14227 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.818018 20438 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.826457 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1397) took 1262 ms. Trace:
I20260709 13:20:10.830348 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1150) took 2158 ms. Trace:
I20260709 13:20:11.010623 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:10.834797 20397 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:10.810129 20443 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.836670 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1395) took 1286 ms. Trace:
I20260709 13:20:10.836855 20381 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.837903 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:11.021962 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:11.022296 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 184501us
I20260709 13:20:11.022725 14895 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
W20260709 13:20:11.023135 20398 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.929s	user 0.003s	sys 0.000s
I20260709 13:20:11.023506 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:10.839100 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2975) took 1238 ms. Trace:
I20260709 13:20:11.026192 20396 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.027058 20396 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.840390 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2969) took 1347 ms. Trace:
I20260709 13:20:11.028542 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.029311 14371 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:10.840596 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:10.842819 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.782723 20442 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:20:10.843740 20357 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:10.849737 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2612) took 1605 ms. Trace:
I20260709 13:20:10.851428 14898 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:20:10.853292 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:10.855067 14897 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:10.855723 20433 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.855919 20392 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.858590 20377 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:10.843758 20245 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
W20260709 13:20:10.859694 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 93669us
I20260709 13:20:10.798764 20370 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:10.881640 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:10.880860 20444 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:10.902753 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:10.813827 20045 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.044893 20245 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:11.045714 20245 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:11.046710 20245 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.048118 20245 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:11.048888 20444 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.049376 20444 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:10.807077 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:20:10.918221 20354 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:20:10.943572 20376 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:10.879438 14896 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:10.945005 20349 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:10.945681 20455 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:10.946403 20373 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.727s	user 0.010s	sys 0.004s
I20260709 13:20:10.947990 20143 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:10.948642 20408 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.865s	user 0.003s	sys 0.000s
I20260709 13:20:11.063812 20143 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:10.952756 20358 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:10.952320 14229 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.035275 20259 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:10.958678 14377 raft_consensus.cc:1217] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Deduplicated request from leader. Original: 14.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:20:10.958768 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.069816 14377 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:20:11.010182 14892 rpcz_store.cc:276] 0709 13:20:09.564145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.577265 (+ 13120us) service_pool.cc:224] Handling call
0709 13:20:10.826180 (+1248915us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400602054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:10.826368 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937999616}
W20260709 13:20:11.013198 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.018546 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.070856 14375 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:11.010730 14297 rpcz_store.cc:276] 0709 13:20:08.671825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.671943 (+   118us) service_pool.cc:224] Handling call
0709 13:20:10.830104 (+2158161us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54001f8454. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:10.830264 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140649728}
I20260709 13:20:11.010453 20457 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:11.072552 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1410) took 2395 ms. Trace:
I20260709 13:20:11.072681 20457 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.073866 20374 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.073011 14220 rpcz_store.cc:276] 0709 13:20:08.669085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.669455 (+   370us) service_pool.cc:224] Handling call
0709 13:20:08.669853 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:08.670335 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:08.670367 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:08.683018 (+ 12651us) log.cc:844] Serialized 52 byte log entry
0709 13:20:08.881609 (+198591us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:08.900368 (+ 18759us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.276647 (+376279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.276726 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.613683 (+1336957us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b1800405fa0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:11.064483 (+450800us) raft_consensus.cc:1685] finished
0709 13:20:11.064599 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.064759 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23600,"prepare.queue_time_us":14406,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":266317,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":9031,"spinlock_wait_cycles":55341440,"thread_start_us":550448,"threads_started":2,"wal-append.queue_time_us":395176}
I20260709 13:20:11.074949 20457 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.075325 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:11.021309 20435 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.077661 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.078444 20440 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.079041 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:11.021137 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:11.079317 20358 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.050218 20415 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.080753 20415 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.053653 20376 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.031293 20443 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.075927 14220 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.092160 14227 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:20:11.027143 20434 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.104353 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.028108 14228 rpcz_store.cc:276] 0709 13:20:09.493447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.750486 (+257039us) service_pool.cc:224] Handling call
0709 13:20:09.750838 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.870926 (+120088us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:10.134763 (+263837us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.380588 (+245825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:10.380665 (+    77us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:10.380724 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.840179 (+459455us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540026d4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:10.840223 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.840336 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":439729,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":192090,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":275583744,"thread_start_us":486973,"threads_started":2,"wal-append.queue_time_us":532617}
I20260709 13:20:11.106469 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.107612 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.108383 14377 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:11.032298 20431 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.953544 20394 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.025270 14221 rpcz_store.cc:276] 0709 13:20:09.600798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.778252 (+177454us) service_pool.cc:224] Handling call
0709 13:20:09.778549 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.452567 (+674018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.838867 (+386300us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54002779d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:10.839039 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494512896}
W20260709 13:20:11.009356 20248 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.847s	user 0.015s	sys 0.000s
W20260709 13:20:11.033699 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 193169us
I20260709 13:20:11.019428 14900 rpcz_store.cc:276] 0709 13:20:09.549942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.550123 (+   181us) service_pool.cc:224] Handling call
0709 13:20:09.550445 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.550661 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:09.707938 (+157277us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.961466 (+253528us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.836080 (+874614us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b18004a9200. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:20:10.836295 (+   215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:10.836350 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:10.836405 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.836471 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.836611 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18106,"prepare.queue_time_us":130596,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":908330,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":7119,"spinlock_wait_cycles":77283968,"thread_start_us":394670,"threads_started":2,"wal-append.queue_time_us":399255}
I20260709 13:20:11.037066 14901 raft_consensus.cc:2410] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:11.035874 14225 rpcz_store.cc:276] 0709 13:20:09.244278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.690391 (+446113us) service_pool.cc:224] Handling call
0709 13:20:09.738749 (+ 48358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.427103 (+688354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.849475 (+422372us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b540026cad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:10.849670 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536171264}
I20260709 13:20:11.041354 14226 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.024824 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:11.044236 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:11.044893 20370 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.051000 14371 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:20:11.054244 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 247290us
I20260709 13:20:11.054908 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:11.060411 20373 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.061285 20455 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.034462 20428 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.062479 20349 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:11.065223 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2588) took 1317 ms. Trace:
I20260709 13:20:10.954808 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:11.065516 14229 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:11.089502 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 68489.6us
I20260709 13:20:11.094956 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.090101 20145 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.088164 20443 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:11.051605 20433 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.058728 20377 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:11.097211 20297 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:11.102064 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1165) took 1029 ms. Trace:
I20260709 13:20:11.093138 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:11.231256 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:11.211412 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2581) took 1551 ms. Trace:
I20260709 13:20:11.251490 14220 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:11.214042 14898 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:11.213205 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3183) took 1037 ms. Trace:
I20260709 13:20:11.170118 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:11.310961 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 286184us
I20260709 13:20:11.157171 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:11.184157 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2617) took 1570 ms. Trace:
I20260709 13:20:11.196647 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:11.216853 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:11.239674 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.243273 14223 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:11.141824 14375 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:11.313978 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:11.315608 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:11.316164 14867 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:11.316967 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:11.069545 20390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.010s	sys 0.004s
W20260709 13:20:11.087903 20436 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:20:11.102334 20419 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:11.395829 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.321092 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:11.336567 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:11.318087 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 161011us
I20260709 13:20:11.334203 14867 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:11.379575 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.317890 14896 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:11.319041 14221 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:11.317183 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:11.392767 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:11.085748 20376 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.393452 14301 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:11.144742 20451 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:20:11.312067 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.403295 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:11.423911 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:11.234862 20401 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.138s	user 0.003s	sys 0.000s
I20260709 13:20:11.312026 14376 rpcz_store.cc:276] 0709 13:20:09.659806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.689478 (+ 29672us) service_pool.cc:224] Handling call
0709 13:20:09.709143 (+ 19665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.709883 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.211206 (+1501323us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b54000b9850. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:11.211351 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44480896}
W20260709 13:20:11.170802 20378 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.061s	user 0.015s	sys 0.001s
I20260709 13:20:11.318516 14894 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
W20260709 13:20:11.436434 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 119316us
I20260709 13:20:11.321894 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:11.314184 14303 rpcz_store.cc:276] 0709 13:20:10.175509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.249094 (+ 73585us) service_pool.cc:224] Handling call
0709 13:20:10.265734 (+ 16640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.354834 (+ 89100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.212998 (+858164us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b5400154ad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:11.213152 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200200576}
I20260709 13:20:11.320389 14298 rpcz_store.cc:276] 0709 13:20:10.073551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.075944 (+  2393us) service_pool.cc:224] Handling call
0709 13:20:10.076340 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:10.108619 (+ 32279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.101724 (+993105us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b54001a09d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:11.102000 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67065216}
I20260709 13:20:11.329614 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2619) took 1715 ms. Trace:
I20260709 13:20:11.102938 20375 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.105862 20440 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.428289 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2620) took 1737 ms. Trace:
I20260709 13:20:11.451793 14221 rpcz_store.cc:276] 0709 13:20:09.691316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.318563 (+1627247us) service_pool.cc:224] Handling call
0709 13:20:11.318866 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.427980 (+109114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.428227 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.385767 20245 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:11.321105 20397 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.389058 20443 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:11.432065 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:11.323024 20348 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.257541 19783 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:11.317595 14224 rpcz_store.cc:276] 0709 13:20:09.613652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.746338 (+1132686us) service_pool.cc:224] Handling call
0709 13:20:10.746835 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.754096 (+  7261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.754130 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:10.754638 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:20:10.786370 (+ 31732us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:10.801391 (+ 15021us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.801595 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.801685 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.183801 (+382116us) raft_consensus.cc:1685] finished
0709 13:20:11.183835 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.184069 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8978,"prepare.queue_time_us":12371,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3962,"raft.queue_time_us":18755,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":70734,"thread_start_us":31425,"threads_started":1,"wal-append.queue_time_us":288813}
I20260709 13:20:11.312515 14374 rpcz_store.cc:276] 0709 13:20:09.747785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.747900 (+   115us) service_pool.cc:224] Handling call
0709 13:20:09.748256 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:09.748726 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.748766 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:09.749480 (+   714us) log.cc:844] Serialized 52 byte log entry
0709 13:20:09.943984 (+194504us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:10.288176 (+344192us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.651391 (+363215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.651497 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.852294 (+200797us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b4800130158. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
0709 13:20:10.947941 (+ 95647us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:11.065008 (+117067us) raft_consensus.cc:1685] finished
0709 13:20:11.065029 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.065165 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108116,"prepare.queue_time_us":507674,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":66600,"raft.run_cpu_time_us":3311,"raft.run_wall_time_us":517948,"spinlock_wait_cycles":65716352,"thread_start_us":844323,"threads_started":3,"wal-append.queue_time_us":305835}
I20260709 13:20:11.437266 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:11.165447 20374 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.166285 19643 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.228554 20435 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:11.438666 14223 rpcz_store.cc:276] 0709 13:20:09.614276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.228000 (+1613724us) service_pool.cc:224] Handling call
0709 13:20:11.241693 (+ 13693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.329240 (+ 87547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.329526 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.251346 19870 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:11.322757 20143 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.309831 20377 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:11.191838 20415 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:11.441921 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 107809us
I20260709 13:20:11.510290 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:11.379029 20248 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.256870 20457 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:11.321359 20259 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:11.441802 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:11.424775 14900 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:11.453293 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:11.531426 14221 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:11.424291 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:11.532930 14295 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:20:11.140453 20358 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.432425 14377 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:20:11.402964 20438 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:11.426102 20390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.324s	user 0.011s	sys 0.005s
I20260709 13:20:11.331864 20297 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:11.468482 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.496104 14226 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:11.541512 14228 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:20:11.499969 14225 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:11.511883 14867 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:11.543620 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:11.543895 14893 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:11.329181 20434 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.376557 20394 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.516171 20415 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.547696 14373 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.548692 20394 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.548949 20415 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:11.549237 19911 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.192642 20444 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.451718 19943 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:11.457746 20245 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:11.509884 20451 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:11.566957 20245 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.568509 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1431) took 1348 ms. Trace:
I20260709 13:20:11.568928 14369 rpcz_store.cc:276] 0709 13:20:10.220124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.220281 (+   157us) service_pool.cc:224] Handling call
0709 13:20:10.256663 (+ 36382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.394620 (+137957us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:10.558638 (+164018us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.755438 (+196800us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.857173 (+101735us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b180008dca0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:20:10.857356 (+   183us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:10.857892 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:20:10.858073 (+   181us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:10.858108 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.858183 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.952022 (+ 93839us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b180008dca0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:11.568289 (+616267us) raft_consensus.cc:1685] finished
0709 13:20:11.568313 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.568452 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13145,"prepare.queue_time_us":198206,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":171245,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":9484,"spinlock_wait_cycles":11685504,"thread_start_us":349792,"threads_started":3,"wal-append.queue_time_us":278285}
I20260709 13:20:11.571633 14369 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:11.509400 20377 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:11.572382 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 173215us
I20260709 13:20:11.537875 20259 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:11.507872 20443 raft_consensus.cc:697] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:11.577513 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:11.580029 20259 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:11.580633 20348 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:11.581125 20348 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.581478 20348 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.588826 20370 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.516166 20396 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:11.526610 20383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.549s	user 0.032s	sys 0.018s
I20260709 13:20:11.533152 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:11.596632 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63566.1us
I20260709 13:20:11.555032 20373 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:11.526252 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2623) took 1834 ms. Trace:
I20260709 13:20:11.450362 20378 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.546552 20438 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.432174 20419 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:11.540035 20391 raft_consensus.cc:2764] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:11.500995 19783 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.475565 20397 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.507361 20435 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.557094 14377 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:11.614166 20435 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.616899 20438 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:11.607017 20419 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.547716 20297 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.451200 20185 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.560550 14373 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:11.514715 20143 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.562063 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2977) took 1863 ms. Trace:
I20260709 13:20:11.660594 14226 rpcz_store.cc:276] 0709 13:20:09.699094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.544086 (+1844992us) service_pool.cc:224] Handling call
0709 13:20:11.561567 (+ 17481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.561729 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.561753 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.561821 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:11.561859 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.561911 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.562009 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.563679 14295 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:11.661971 14295 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:11.507618 19643 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.565717 20428 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.561399 20142 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:11.566246 19943 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:11.511240 19870 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.379822 20431 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.457605 20392 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:11.508759 20374 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.576406 20394 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.534638 20457 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.591884 14374 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:20:11.455654 20376 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:20:11.597952 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:11.455201 20375 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.598439 14370 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:11.600400 14223 rpcz_store.cc:276] 0709 13:20:09.692073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.506846 (+1814773us) service_pool.cc:224] Handling call
0709 13:20:11.525239 (+ 18393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.525736 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.525776 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.525872 (+    96us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:11.525918 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.526009 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.526177 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5358}
I20260709 13:20:11.601825 14369 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:20:11.589398 20348 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:11.596238 20383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.640s	user 0.033s	sys 0.018s
I20260709 13:20:11.609861 20370 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:11.611451 20378 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.621518 20297 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.604614 20415 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:11.726471 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:08.302588 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:11.735040 14229 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:11.622306 20396 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.621641 20419 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.702018 14295 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.772661 14297 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:11.773027 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:11.781106 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 183231us
I20260709 13:20:11.799803 14225 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:11.782207 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2978) took 2017 ms. Trace:
I20260709 13:20:11.785655 20383 consensus_queue.cc:1243] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:20:11.783798 20357 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.004s
I20260709 13:20:11.608724 20443 consensus_queue.cc:237] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.791301 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2626) took 1888 ms. Trace:
I20260709 13:20:11.768528 20392 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.786815 20434 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:11.803637 14295 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.768050 20142 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.802518 14226 rpcz_store.cc:276] 0709 13:20:09.764604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.771961 (+2007357us) service_pool.cc:224] Handling call
0709 13:20:11.781681 (+  9720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.781881 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.781907 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.781947 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:11.781980 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.782040 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.782152 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.783181 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:11.810377 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 368645us
I20260709 13:20:11.813436 14303 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.804613 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:11.799702 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2962) took 3342 ms. Trace:
I20260709 13:20:11.814560 14229 rpcz_store.cc:276] 0709 13:20:08.457619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.458818 (+  1199us) service_pool.cc:224] Handling call
0709 13:20:08.459083 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.949168 (+1490085us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b54001d59a0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded003dc0 00007f8ded08e1c0 00007f8ded08f231 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c
0709 13:20:10.950767 (+1001599us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b54001d59a0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded00a06f 00007f8ded082f60 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62
0709 13:20:11.799363 (+848596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.799635 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99950208}
I20260709 13:20:11.799700 14298 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
W20260709 13:20:11.807500 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.808637 14223 rpcz_store.cc:276] 0709 13:20:09.902850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.780832 (+1877982us) service_pool.cc:224] Handling call
0709 13:20:11.790746 (+  9914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.790944 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.790968 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.791023 (+    55us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:11.791056 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.791114 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.791241 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.815750 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:11.818038 14298 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:11.787138 20415 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.854995 20415 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:11.778046 20394 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.860039 20385 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:11.811277 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 267770us
I20260709 13:20:11.820791 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:11.824904 14304 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:11.825438 20469 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:11.867941 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:11.830804 20142 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.831436 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:11.878623 14223 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:11.870481 19943 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.883174 19943 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.886140 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2616) took 2272 ms. Trace:
I20260709 13:20:11.886515 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.886603 14222 rpcz_store.cc:276] 0709 13:20:09.613294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.921882 (+308588us) service_pool.cc:224] Handling call
0709 13:20:09.922250 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.278440 (+356190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.885871 (+1607431us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54002a1cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:11.886081 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770057472}
I20260709 13:20:11.886189 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.832928 20248 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:20:11.833408 20434 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:11.830832 20348 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.834276 19870 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:11.834554 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2621) took 2143 ms. Trace:
I20260709 13:20:11.906775 14224 rpcz_store.cc:276] 0709 13:20:09.691576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.504891 (+1813315us) service_pool.cc:224] Handling call
0709 13:20:11.550560 (+ 45669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.550739 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.550767 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.550809 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:11.550837 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.550889 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.834370 (+283481us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b5400149bd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:11.834482 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104219008}
I20260709 13:20:11.907485 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:11.835597 20431 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:11.837517 14295 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:11.837983 20375 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:11.838683 20441 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:11.842092 14227 raft_consensus.cc:2410] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 15 because replica has last-logged OpId of term: 13 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:20:11.885558 19943 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:11.819756 20145 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:11.843094 19643 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:11.843508 20370 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:11.938776 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:11.844990 19783 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:11.848654 20152 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:11.820506 20378 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:20:11.808981 20324 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:20:11.943972 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.852649 20374 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:11.805610 20368 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:20:11.853986 20444 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:11.862576 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:11.958846 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 96314.6us
I20260709 13:20:11.959983 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:11.864408 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:11.865015 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.830299 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:11.870491 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:11.962183 14304 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:20:11.961500 14374 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:11.870823 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:11.963218 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:11.872524 20426 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.175s	user 0.000s	sys 0.007s
I20260709 13:20:11.910861 20355 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.875447 20143 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:11.870555 20396 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:11.810582 20381 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:11.832430 20400 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.751s	user 0.004s	sys 0.002s
W20260709 13:20:11.889355 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.891140 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:11.897181 14223 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:11.986101 14297 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:11.950126 20390 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:11.899479 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:11.899356 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:11.901011 20317 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:11.891738 20297 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:11.904848 20245 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:11.861080 20466 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:11.851372 20457 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:11.971654 14865 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:11.910866 20441 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:11.987006 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2630) took 1926 ms. Trace:
I20260709 13:20:12.017367 14223 rpcz_store.cc:276] 0709 13:20:10.060391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.986172 (+1925781us) service_pool.cc:224] Handling call
0709 13:20:11.986510 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.986685 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.986706 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.986745 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:11.986771 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.986826 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.986954 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:12.023476 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.024453 14299 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
W20260709 13:20:12.026197 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 55787us
I20260709 13:20:11.987602 14225 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:11.897181 14303 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:11.989463 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.027863 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.028448 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:11.942687 20152 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:11.967128 20460 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:20:11.994306 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:11.994995 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:11.996122 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:11.984437 20469 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:11.998255 20396 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:11.976699 20248 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:12.005239 14372 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:12.005813 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:12.008780 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.983965 20355 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:12.012109 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.946460 20370 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:11.987078 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:11.956825 20378 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.030385 14298 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:11.991703 20390 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:12.031879 14297 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:12.006633 20317 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:12.038542 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:12.074597 14374 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:12.010234 20374 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:12.028566 19943 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.041285 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:11.906739 20428 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:20:12.045861 14372 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:12.084375 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.046763 20391 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:12.037374 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:12.054447 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.087572 14302 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:12.055442 14901 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:12.028455 20438 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:12.036268 20152 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.962255 20145 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.044304 20377 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:12.076390 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.030931 20433 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.038292 20185 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.014073 20297 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.084821 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2625) took 2389 ms. Trace:
I20260709 13:20:11.993237 20381 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.083498 14297 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:12.015533 20434 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.090286 20390 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.022090 20466 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.079280 20317 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.071476 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.091073 20245 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:12.102196 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.119326 14901 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:12.105279 14221 rpcz_store.cc:276] 0709 13:20:09.695711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.540917 (+1845206us) service_pool.cc:224] Handling call
0709 13:20:11.556124 (+ 15207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.556324 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:11.890926 (+334602us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.084466 (+193540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:12.084523 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:12.084571 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.084644 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.084763 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":477422,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3774,"raft.queue_time_us":2103,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":3657,"thread_start_us":507139,"threads_started":2}
I20260709 13:20:12.057204 20348 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:20:12.121392 20372 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.122058 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:12.124684 20329 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:12.125763 20385 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:12.127414 19643 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:12.127876 20385 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:12.091811 20391 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.128535 20385 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:12.129616 20145 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.130246 20391 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:12.059136 20259 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.092262 20438 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:12.128067 20297 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:12.134141 14224 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:20:12.134732 14224 pending_rounds.cc:85] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 7
I20260709 13:20:12.134968 14224 pending_rounds.cc:107] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:20:12.135221 14224 raft_consensus.cc:2889] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:12.136270 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.137439 14896 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:12.107841 14897 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:20:12.075814 20441 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.109838 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:12.085918 20374 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:12.133047 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 187320us
I20260709 13:20:12.121474 20348 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:12.130316 20145 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:12.142709 14341 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:12.118659 20433 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.152199 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:12.132632 20390 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.150767 20441 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.111209 20185 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.154227 20433 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.141772 14297 raft_consensus.cc:2368] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14.
I20260709 13:20:12.149370 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:12.146546 14899 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:12.153041 14896 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.170439 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:12.173588 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:12.174324 14372 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:12.174238 14374 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:20:12.175508 14374 pending_rounds.cc:85] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 8
I20260709 13:20:12.122124 20372 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.156126 20430 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:12.177023 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.175815 14374 pending_rounds.cc:107] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:20:12.184371 14897 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:20:12.184897 14374 raft_consensus.cc:2889] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:12.145772 20348 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:12.152153 20145 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:12.191828 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:12.193485 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:12.194442 14900 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:12.190968 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:12.198336 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:12.161168 20455 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.154932 20443 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:20:12.181118 20428 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:12.138216 20396 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.206291 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.183758 20430 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.190313 20045 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.200304 20245 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.205428 20383 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:20:12.209587 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.210228 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1421) took 2223 ms. Trace:
I20260709 13:20:12.210331 20259 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:12.211254 20377 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:12.213013 20378 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.203258 20415 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.208321 20348 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.217640 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.218359 20430 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.196792 20457 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:12.219687 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:12.215498 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:12.249284 20457 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.249716 20457 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.250351 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:12.251418 20466 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.251535 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:12.218617 20473 log.cc:927] Time spent T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:12.191092 20329 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:12.252918 20329 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.260046 20164 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.266697 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:12.268347 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:12.269649 14303 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:12.265664 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2744) took 2667 ms. Trace:
I20260709 13:20:12.221962 20428 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.269668 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:12.206439 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81452.4us
I20260709 13:20:12.224254 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:12.227563 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50664.4us
I20260709 13:20:12.228011 14896 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:12.225631 14222 rpcz_store.cc:276] 0709 13:20:09.986543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.887856 (+1901313us) service_pool.cc:224] Handling call
0709 13:20:11.890806 (+  2950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.891170 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:12.059825 (+168655us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.199382 (+139557us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.200006 (+   624us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.203888 (+  3882us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.204482 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.204652 (+   170us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:12.204700 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.204791 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:12.210032 (+  5241us) raft_consensus.cc:1685] finished
0709 13:20:12.210051 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.210176 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8264,"prepare.queue_time_us":164590,"prepare.run_cpu_time_us":151,"prepare.run_wall_time_us":2743,"raft.queue_time_us":4713,"raft.run_cpu_time_us":468,"raft.run_wall_time_us":9826,"thread_start_us":245882,"threads_started":2,"wal-append.queue_time_us":95626}
I20260709 13:20:12.205260 20357 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:12.225520 20370 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:12.200711 20143 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:20:12.238571 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:12.244346 20472 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:20:12.167182 20385 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.245253 20415 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:12.245970 14369 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:12.272951 14378 rpcz_store.cc:276] 0709 13:20:09.598134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.598611 (+   477us) service_pool.cc:224] Handling call
0709 13:20:09.599046 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.601400 (+  2354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.601447 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.608611 (+  7164us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.934385 (+325774us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:10.267164 (+332779us) log.cc:844] Serialized 14 byte log entry
0709 13:20:11.220311 (+953147us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:11.257168 (+ 36857us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b18003e1220. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287
0709 13:20:11.257361 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.257501 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:12.263506 (+1006005us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b240037bab8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fddfb0 00007f8decc54488 00007f8decc54be8 00007f8decc2c398 00007f8decc2776a 00007f8decc26bb6
0709 13:20:12.265373 (+  1867us) raft_consensus.cc:1685] finished
0709 13:20:12.265399 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.265586 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31315,"prepare.queue_time_us":474786,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":17824,"raft.queue_time_us":85191,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":9689,"spinlock_wait_cycles":76749824,"thread_start_us":718704,"threads_started":3,"wal-append.queue_time_us":474397}
I20260709 13:20:12.271291 20317 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.298554 20317 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:12.301256 20185 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:12.283993 20357 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.302170 20357 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.303485 20145 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.304606 20145 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.306552 20370 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:12.316020 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.283888 20428 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.322537 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:12.323928 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:12.324803 20397 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:12.325045 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:12.287784 20378 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.294900 20383 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:12.319345 20143 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.330767 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.331055 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53139.9us
W20260709 13:20:12.330935 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47136.7us
I20260709 13:20:12.353597 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.346576 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.329805 20433 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.358213 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:12.355331 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.362591 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.363286 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:12.364675 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:12.365274 14372 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.367460 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:12.368862 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:12.369675 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.370546 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:12.372186 14378 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:12.372270 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 563131us
W20260709 13:20:12.372886 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.330168 20385 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.373549 14342 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.334223 20374 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.316112 20370 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:12.409924 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46715.9us
I20260709 13:20:12.410804 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.411830 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1319) took 1101 ms. Trace:
I20260709 13:20:12.412240 14893 rpcz_store.cc:276] 0709 13:20:11.310856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.311064 (+   208us) service_pool.cc:224] Handling call
0709 13:20:12.411617 (+1100553us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54005f64d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:12.411764 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276221824}
I20260709 13:20:12.371543 20443 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.383137 14372 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:12.334923 20430 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.360829 19953 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:12.415205 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:12.361670 19870 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.340598 20479 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:20:12.375285 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.429006 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:12.374749 20317 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:12.450127 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:12.404786 20377 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:12.371884 20045 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:12.419859 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.519493 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.342363 20383 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.420970 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:12.450625 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.360164 20143 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.402134 20329 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:12.373298 20433 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:12.461449 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3028) took 1145 ms. Trace:
I20260709 13:20:12.535962 14296 rpcz_store.cc:276] 0709 13:20:11.315555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.315672 (+   117us) service_pool.cc:224] Handling call
0709 13:20:11.322302 (+  6630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.387870 (+ 65568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.387909 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.388434 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.221442 (+833008us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b18004c8e20. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:20:12.274081 (+ 52639us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:12.274125 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.274198 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:12.461163 (+186965us) raft_consensus.cc:1685] finished
0709 13:20:12.461186 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.461386 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65085,"raft.queue_time_us":65222,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":33856,"spinlock_wait_cycles":12036352,"thread_start_us":52432,"threads_started":1,"wal-append.queue_time_us":1015801}
W20260709 13:20:12.516976 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 141751us
I20260709 13:20:12.514770 20317 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:12.538089 20317 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.464396 20394 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.539520 20355 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.542086 20397 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:12.544682 20397 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:12.420288 20345 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.545943 20351 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:12.382880 20357 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.546337 20351 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:12.546900 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2600) took 1467 ms. Trace:
I20260709 13:20:12.548316 20357 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:12.547327 14376 rpcz_store.cc:276] 0709 13:20:11.079290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.431654 (+352364us) service_pool.cc:224] Handling call
0709 13:20:11.432816 (+  1162us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:11.784251 (+351435us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:11.791399 (+  7148us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.052892 (+261493us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:12.069661 (+ 16769us) log.cc:844] Serialized 52 byte log entry
0709 13:20:12.069904 (+   243us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:12.070169 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.070436 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.345508 (+275072us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b18000dd020. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:12.457695 (+112187us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b18000dd020. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f6d2a6 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419
0709 13:20:12.458172 (+   477us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54000618d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:12.458218 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:12.546670 (+ 88452us) raft_consensus.cc:1685] finished
0709 13:20:12.546691 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.546840 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":282837,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":2128,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":25985,"spinlock_wait_cycles":839408384,"thread_start_us":233642,"threads_started":1,"wal-append.queue_time_us":304727}
W20260709 13:20:12.553411 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.438182 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:12.554905 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 116830us
I20260709 13:20:12.374857 20464 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:12.375736 20466 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:12.440439 20483 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:20:12.452859 20370 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.528543 20377 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:12.513839 20374 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:20:12.513175 20378 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:20:12.417987 20443 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.531338 20283 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:12.416074 20476 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.418212 20482 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:12.441636 20430 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.455856 20152 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.590006 20482 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:12.590456 20482 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.591737 20152 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:12.527041 20157 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.594107 20348 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.595258 20443 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:12.596714 20457 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.560736 20345 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:12.598264 20345 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:12.598918 20457 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.599474 20345 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.600059 20428 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.600764 20351 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.586079 20283 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:12.602368 20372 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:12.587162 20383 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.569432 20390 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.602901 20283 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.603788 20390 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.604861 20283 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.579756 20377 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.606248 20390 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.603724 20392 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.598270 20438 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.653687 14221 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:12.654925 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2628) took 2607 ms. Trace:
I20260709 13:20:12.655129 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1427) took 2592 ms. Trace:
I20260709 13:20:12.655606 14224 rpcz_store.cc:276] 0709 13:20:10.047129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.908042 (+1860913us) service_pool.cc:224] Handling call
0709 13:20:11.908316 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.135680 (+227364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.654099 (+518419us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540014a0d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:12.654630 (+   531us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518543104}
I20260709 13:20:12.532142 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2618) took 2918 ms. Trace:
I20260709 13:20:12.655764 14223 rpcz_store.cc:276] 0709 13:20:10.063063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.018699 (+1955636us) service_pool.cc:224] Handling call
0709 13:20:12.036911 (+ 18212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.139409 (+102498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.139440 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:12.139493 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:12.139526 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.654549 (+515023us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400135bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:12.654631 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.654949 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235199232}
W20260709 13:20:12.520694 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.671799 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.564577 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.691952 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.681641 14220 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:12.695609 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2985) took 1927 ms. Trace:
I20260709 13:20:12.696769 14220 rpcz_store.cc:276] 0709 13:20:10.768130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.675595 (+1907465us) service_pool.cc:224] Handling call
0709 13:20:12.679356 (+  3761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.695150 (+ 15794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.695520 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:12.699137 14220 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:12.660732 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2629) took 2605 ms. Trace:
I20260709 13:20:12.658890 14222 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 19: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:12.680815 14226 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:12.699227 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.559689 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:12.703462 14371 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:20:12.661124 14228 rpcz_store.cc:276] 0709 13:20:09.613982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.131223 (+1517241us) service_pool.cc:224] Handling call
0709 13:20:11.541274 (+410051us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.542032 (+   758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.531910 (+989878us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b540026bbd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:12.532077 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941978880}
I20260709 13:20:12.706732 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:12.707875 14228 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:12.708467 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:12.708649 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2990) took 1318 ms. Trace:
I20260709 13:20:12.710388 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:12.710620 14228 rpcz_store.cc:276] 0709 13:20:11.390237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.706985 (+1316748us) service_pool.cc:224] Handling call
0709 13:20:12.707525 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.708386 (+   861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.708595 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:12.700084 14225 rpcz_store.cc:276] 0709 13:20:10.055650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.908402 (+1852752us) service_pool.cc:224] Handling call
0709 13:20:11.987445 (+ 79043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.026951 (+ 39506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.660271 (+633320us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b5400341550. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:12.660543 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181134080}
I20260709 13:20:12.712905 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:12.709962 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.515551 14370 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:12.715301 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:12.716605 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 177078us
I20260709 13:20:12.718786 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.715425 14896 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:12.699241 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 2984) took 1931 ms. Trace:
I20260709 13:20:12.721251 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.721494 14227 rpcz_store.cc:276] 0709 13:20:10.767858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.092888 (+325030us) service_pool.cc:224] Handling call
0709 13:20:12.698762 (+1605874us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54002bd9d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:12.699047 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217773440}
I20260709 13:20:12.722162 14304 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:12.723248 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.723891 14227 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:12.719743 14300 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:12.718303 14296 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:12.682657 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2983) took 1915 ms. Trace:
I20260709 13:20:12.716107 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.728864 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:12.729460 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.730260 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2988) took 1310 ms. Trace:
I20260709 13:20:12.700718 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2986) took 1929 ms. Trace:
I20260709 13:20:12.731624 14220 rpcz_store.cc:276] 0709 13:20:11.389719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.698032 (+1308313us) service_pool.cc:224] Handling call
0709 13:20:12.698562 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.699682 (+  1120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.699888 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:12.728246 14221 rpcz_store.cc:276] 0709 13:20:10.767622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.657623 (+1890001us) service_pool.cc:224] Handling call
0709 13:20:12.666421 (+  8798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.682081 (+ 15660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.682128 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:12.682221 (+    93us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:12.682314 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.682390 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.682549 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:12.730226 14372 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:12.523262 20045 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.770421 20045 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:12.772357 14377 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:12.772666 20199 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:20:12.774140 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.777981 20392 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:12.779036 20392 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:12.780435 20490 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.164s	user 0.002s	sys 0.000s
I20260709 13:20:12.749291 20391 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:12.782676 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.731885 14226 rpcz_store.cc:276] 0709 13:20:10.771788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.677616 (+1905828us) service_pool.cc:224] Handling call
0709 13:20:12.680180 (+  2564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.700477 (+ 20297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.700670 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:12.731010 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:12.784796 14227 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:12.659328 14224 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:12.746546 20185 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:12.748147 20259 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.790091 20152 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:12.751050 14220 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:20:12.754951 14373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2757) took 1795 ms (client timeout 2195 ms). Trace:
I20260709 13:20:12.515385 19870 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.759596 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:12.759781 20438 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.760814 20143 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:12.788760 20317 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.790263 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.790861 20428 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.750348 20396 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:12.810068 19943 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:12.811213 19943 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.814268 20349 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:12.814998 20349 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:12.815128 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 114907us
I20260709 13:20:12.817034 20349 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.791968 20381 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:12.794570 14373 rpcz_store.cc:269] 0709 13:20:10.958962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.033956 (+ 74994us) service_pool.cc:224] Handling call
0709 13:20:12.754368 (+1720412us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54003340d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:12.754678 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544106368}
I20260709 13:20:12.818295 20390 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:12.795522 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2636) took 2173 ms. Trace:
I20260709 13:20:12.822340 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.823164 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:12.823501 20185 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:12.824126 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64957.4us
I20260709 13:20:12.824983 20443 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:12.825026 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.783417 20391 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.837287 14224 rpcz_store.cc:276] 0709 13:20:10.613698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.657602 (+2043904us) service_pool.cc:224] Handling call
0709 13:20:12.658561 (+   959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.785845 (+127284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.786898 (+  1053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:12.826409 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.825453 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:12.794901 20152 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:12.804340 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2993) took 1368 ms. Trace:
W20260709 13:20:12.844635 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.847498 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.849072 20434 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:12.850023 20259 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.852299 20185 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:12.853035 20259 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:12.783777 20388 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:20:12.854733 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:12.856448 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.857143 14267 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:12.857621 19943 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:12.857029 20374 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:12.858636 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:12.858984 20374 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:12.859478 20374 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:12.860199 20317 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.863018 20434 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:12.866331 20392 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.844278 20152 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.875303 20434 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:12.876152 20434 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:12.879454 20489 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.264s	user 0.000s	sys 0.002s
I20260709 13:20:12.880930 14300 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:12.882141 20443 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:12.849378 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50853.6us
W20260709 13:20:12.893935 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.853576 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:12.901502 14228 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:12.906245 19643 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:12.906554 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49626.4us
I20260709 13:20:12.907446 14899 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.908396 14303 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:12.912123 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:12.918215 20432 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:12.918757 20432 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:12.919203 20432 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.923005 14342 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:12.925556 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 116679us
I20260709 13:20:12.927215 20317 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:12.928635 20317 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:12.929082 20317 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:12.930469 20317 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.931999 20391 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:12.932602 20317 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.883477 20443 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.934589 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.935297 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:12.936733 20492 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:20:12.935298 14892 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:12.955189 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.967504 20199 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.972590 20199 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.841838 14225 rpcz_store.cc:276] 0709 13:20:11.436221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.713083 (+1276862us) service_pool.cc:224] Handling call
0709 13:20:12.713631 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.723346 (+  9715us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:12.723841 (+   495us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.798649 (+ 74808us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.804017 (+  5368us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:12.804098 (+    81us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:12.804141 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.804201 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.804291 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5163,"prepare.queue_time_us":20238,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":101,"raft.queue_time_us":11824,"raft.run_cpu_time_us":497,"raft.run_wall_time_us":500,"thread_start_us":73589,"threads_started":1,"wal-append.queue_time_us":102216}
I20260709 13:20:12.974879 20349 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.975214 20199 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:12.967581 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:12.976258 14897 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:12.979079 14193 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:12.982224 20480 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.982434 14270 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:12.983227 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2611) took 1826 ms. Trace:
I20260709 13:20:12.983067 20480 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:12.983690 14377 rpcz_store.cc:276] 0709 13:20:11.156353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.686639 (+530286us) service_pool.cc:224] Handling call
0709 13:20:12.755655 (+1069016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.773105 (+ 17450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.983011 (+209906us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003340d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:12.983151 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457447680}
I20260709 13:20:12.965924 20390 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:20:12.992702 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2631) took 2921 ms. Trace:
I20260709 13:20:12.992488 20482 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:12.982288 20378 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:20:12.998314 20494 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:12.999292 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:13.001601 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 78795.1us
I20260709 13:20:13.002775 20500 raft_consensus.cc:2764] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:20:13.003528 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:12.900063 20259 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:20:13.004480 14374 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:12.985908 20245 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:13.006459 20385 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.591s	user 0.014s	sys 0.000s
I20260709 13:20:13.007135 20453 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:13.007444 20464 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:13.008047 20464 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.008442 20464 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.009385 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2762) took 1134 ms. Trace:
I20260709 13:20:13.009852 14369 rpcz_store.cc:276] 0709 13:20:11.866028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.868589 (+  2561us) service_pool.cc:224] Handling call
0709 13:20:12.999450 (+1130861us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b540004c4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:12.999686 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822819200}
I20260709 13:20:13.010277 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.005537 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:13.010624 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.011317 14892 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:13.006510 20245 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.011554 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:13.012146 14894 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:13.012224 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:13.012627 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.013120 14892 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:13.010283 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.014192 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.014896 14900 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:13.015297 14897 raft_consensus.cc:1217] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Deduplicated request from leader. Original: 11.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:20:13.015853 14897 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:20:13.017273 14114 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 37975f772fc648329a8acae36d33a345 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9b2cf49ceed478480fb0f27ccf55d81 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:13.019322 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:13.007162 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49057.3us
I20260709 13:20:13.022526 14899 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
W20260709 13:20:13.030701 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48562.4us
I20260709 13:20:13.028030 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:12.995127 20480 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:13.032931 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.036793 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:13.037289 20152 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.038017 20428 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:13.039740 20428 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:13.040447 20428 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:13.042130 20381 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:13.042867 20381 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.045380 20381 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.046051 20392 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:13.050037 14893 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:20:13.035269 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:13.054596 14897 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:13.054890 20351 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:13.055434 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 51210.5us
I20260709 13:20:13.058328 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:13.058422 20329 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:13.059664 20385 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:13.060283 20329 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:13.060972 20385 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:13.061262 20329 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:13.036809 20493 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.420s	user 0.002s	sys 0.000s
I20260709 13:20:13.062278 14377 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:13.063226 20142 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:13.064812 20297 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:13.031292 20045 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.061419 20385 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:13.057646 14222 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:20:13.065620 14894 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:13.032534 20390 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.993108 14229 rpcz_store.cc:276] 0709 13:20:10.071192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.464937 (+2393745us) service_pool.cc:224] Handling call
0709 13:20:12.465352 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.465821 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.465865 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.513107 (+ 47242us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.668470 (+155363us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:12.668596 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.668740 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:12.935848 (+267108us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:12.992178 (+ 56330us) raft_consensus.cc:1685] finished
0709 13:20:12.992202 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.992499 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41855,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"spinlock_wait_cycles":389367680,"thread_start_us":131354,"threads_started":1,"wal-append.queue_time_us":88223}
I20260709 13:20:13.072669 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:13.063311 20157 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.074167 20482 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.075155 20045 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.067371 20329 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:13.075750 20142 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.069125 14222 pending_rounds.cc:85] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 9
I20260709 13:20:13.074793 20152 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.078580 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:13.069451 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.087850 14377 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:13.086465 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:13.091382 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.092289 14372 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:20:13.092533 14374 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
W20260709 13:20:13.095765 20348 consensus_meta.cc:287] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.501s	user 0.014s	sys 0.006s
W20260709 13:20:13.097509 14126 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37072 (request call id 324) took 58198 ms (client timeout 15000 ms). Trace:
W20260709 13:20:13.098062 20505 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
I20260709 13:20:13.099382 20494 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:13.101042 20494 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:13.102352 20377 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:13.103411 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.085582 14222 pending_rounds.cc:107] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 13.10
W20260709 13:20:13.118266 14192 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.546s (SENT) [suppressed 11 similar messages]
I20260709 13:20:13.101529 20494 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:13.085260 20297 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:20:13.114082 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:13.041719 20428 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:13.140170 14892 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:13.139171 14222 raft_consensus.cc:2889] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:13.137902 14299 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
W20260709 13:20:13.148810 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 175045us
I20260709 13:20:13.155593 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.157524 20390 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:20:13.162580 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 2992) took 1753 ms. Trace:
I20260709 13:20:13.163060 14228 rpcz_store.cc:276] 0709 13:20:11.409028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.711636 (+1302608us) service_pool.cc:224] Handling call
0709 13:20:12.712163 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.903201 (+191038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.162268 (+259067us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540026c5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:13.162490 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395244800}
I20260709 13:20:13.164222 20385 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.165751 19943 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:13.165877 20385 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.166313 19943 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:13.167337 19943 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.168828 19943 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.171686 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:13.186347 14301 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:13.192445 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:13.196434 20480 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:13.198743 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.199070 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.199631 14228 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:13.200474 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.200217 20464 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.202193 14226 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:13.202369 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.203373 14224 raft_consensus.cc:2410] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:20:13.203434 20464 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.203949 14229 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:13.204181 20142 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.205309 14220 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:13.209833 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 143601us
I20260709 13:20:13.210719 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:13.211334 14221 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:13.211660 14193 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:13.212589 14224 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:13.212829 20392 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.146986 20482 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:20:13.213492 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:13.219206 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.213480 20392 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:13.219506 14895 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:13.192224 20297 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:13.236255 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.234774 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.213675 20143 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:13.186625 20378 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:20:13.191632 20390 consensus_queue.cc:1243] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:20:13.098024 14126 rpcz_store.cc:269] 0709 13:19:14.898737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.899500 (+   763us) service_pool.cc:224] Handling call
0709 13:20:13.097199 (+58197699us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:03.878996 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:03.895928 (+ 16932us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:03.895988 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:20:03.896027 (+    39us) tablet.cc:662] Decoding operations
0709 13:20:03.897249 (+  1222us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:03.897405 (+   156us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:03.897441 (+    36us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:20:04.002088 (+104647us) tablet.cc:701] Row locks acquired
0709 13:20:04.002147 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:20:04.002333 (+   186us) write_op.cc:270] Start()
0709 13:20:04.002514 (+   181us) write_op.cc:276] Timestamp: P: 1783603204002257 usec, L: 0
0709 13:20:04.002552 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:20:04.003344 (+   792us) log.cc:844] Serialized 3663 byte log entry
0709 13:20:04.326158 (+322814us) op_driver.cc:464] REPLICATION: finished
0709 13:20:04.584324 (+258166us) write_op.cc:301] APPLY: starting
0709 13:20:04.596811 (+ 12487us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:05.162860 (+566049us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:05.163044 (+   184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:05.698492 (+535448us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:05.698899 (+   407us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:20:05.698969 (+    70us) write_op.cc:312] APPLY: finished
0709 13:20:05.699368 (+   399us) log.cc:844] Serialized 89 byte log entry
0709 13:20:06.040993 (+341625us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:06.041179 (+   186us) write_op.cc:454] Released schema lock
0709 13:20:06.041272 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:06.044171 (+  2899us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:06.044218 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":169948,"reported_tablets":46,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":204680,"apply.run_cpu_time_us":57516,"apply.run_wall_time_us":1483434,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41765,"num_ops":9,"prepare.queue_time_us":236434,"prepare.run_cpu_time_us":23497,"prepare.run_wall_time_us":194558,"raft.queue_time_us":111272,"raft.run_cpu_time_us":14899,"raft.run_wall_time_us":53912,"replication_time_us":323412,"thread_start_us":636163,"threads_started":5,"wal-append.queue_time_us":587976,"wal-append.run_cpu_time_us":12517,"wal-append.run_wall_time_us":2160741}]]}
I20260709 13:20:13.258555 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.236918 20392 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.268659 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:13.261451 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:13.253382 20143 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.273435 14865 leader_election.cc:400] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14.
W20260709 13:20:13.274154 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 188706us
W20260709 13:20:13.275628 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 62229.6us
I20260709 13:20:13.278735 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:13.279923 20383 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:13.280417 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:13.280967 14373 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:13.272109 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:13.289657 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.264813 20381 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:13.295432 20504 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.282589 20143 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.286851 20383 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.304850 14221 raft_consensus.cc:2410] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:20:13.299091 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:13.306636 20502 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.307379 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:13.303692 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.303151 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:13.309974 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:13.310678 14864 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:13.233690 20494 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:13.316936 14229 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:13.320855 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:13.321712 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:13.315062 14220 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:20:13.325363 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.295962 20504 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:13.268095 20464 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:20:13.314536 20383 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.338446 14892 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:13.339555 14304 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:13.305150 20245 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:13.336844 14226 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:13.332242 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:13.345414 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 253621us
I20260709 13:20:13.347325 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.334151 20504 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.339093 20185 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:13.340976 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:13.356796 20499 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:20:13.342132 20381 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:13.323314 20432 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:13.340606 20383 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.358399 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:13.347884 20377 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.350364 19953 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:13.365586 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:13.365726 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:13.366439 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46832.5us
I20260709 13:20:13.365767 20374 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:13.376068 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:13.378060 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 96206.1us
W20260709 13:20:13.411898 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 113833us
I20260709 13:20:13.378913 20494 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:13.384889 20497 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.357s	user 0.002s	sys 0.000s
I20260709 13:20:13.385473 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:13.390792 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.393841 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1432) took 1259 ms. Trace:
I20260709 13:20:13.355794 20245 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:13.394835 20199 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:13.414862 14220 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:13.362347 20434 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.330777 20502 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.426314 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:13.414531 14222 rpcz_store.cc:276] 0709 13:20:12.134334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.790678 (+656344us) service_pool.cc:224] Handling call
0709 13:20:12.791192 (+   514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:13.163679 (+372487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.393557 (+229878us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400277ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:13.393762 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601448704}
I20260709 13:20:13.358914 20185 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:13.432190 19953 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.433246 20381 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:13.432693 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 56765.4us
I20260709 13:20:13.434476 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:13.434727 19953 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.436007 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:13.436532 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.436721 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.437469 14225 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:13.437760 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.438253 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:13.438463 14228 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
W20260709 13:20:13.439044 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 103796us
W20260709 13:20:13.439749 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50069.3us
I20260709 13:20:13.440621 14225 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:13.441054 20501 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:13.442171 20455 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:13.426942 20199 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:13.445254 14192 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:13.446246 20455 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:13.446672 20455 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:13.447057 20455 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.438104 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.453013 14226 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:13.454466 14303 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:13.430593 20185 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.460404 14892 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
W20260709 13:20:13.464280 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 78994.9us
I20260709 13:20:13.438503 20377 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.479605 14220 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:13.470016 19870 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:13.471415 20377 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:13.490742 20509 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:20:13.490999 20388 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:13.429944 20143 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.491704 20388 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:13.492141 20388 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:13.493438 20143 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.476466 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:13.488991 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 43825.9us
I20260709 13:20:13.491065 20377 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.454684 20500 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:20:13.498365 20500 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:13.501343 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:13.502502 20464 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.503089 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:13.503024 20464 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:13.504000 20508 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.189s	user 0.001s	sys 0.001s
I20260709 13:20:13.505167 20480 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:13.508541 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.508852 20396 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:20:13.509078 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.509310 20396 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:13.510881 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:13.511274 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:13.511675 14375 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:13.511801 14373 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:13.512180 20391 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:13.512661 20391 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.513031 20391 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:13.513221 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57612.3us
I20260709 13:20:13.445246 20199 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.515194 20199 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.514214 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:13.488372 20511 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:20:13.525369 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52048.9us
I20260709 13:20:13.526840 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:13.529186 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.532832 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.534873 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:13.535553 14226 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.535804 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:13.536449 14369 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.542196 20396 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.493253 20329 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:13.550325 14372 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:20:13.550263 20329 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.529983 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:13.555505 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 58958.2us
I20260709 13:20:13.563215 14222 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:20:13.566591 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.566682 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:13.567440 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.571956 14377 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.581864 19643 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.582661 19643 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.582964 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:13.583381 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:13.585299 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:13.586895 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.588076 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.584837 19643 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.590651 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.594559 14227 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:13.591115 20358 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:13.594954 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:13.595598 20358 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:13.595974 20358 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:13.596168 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:13.596779 14299 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.596972 20358 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:13.598057 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:13.598847 14220 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:13.602216 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:13.603226 20358 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.603506 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:13.604813 14375 raft_consensus.cc:2410] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 19 because replica has last-logged OpId of term: 18 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:20:13.606014 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:13.607831 19870 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:13.610929 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:13.611902 19643 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:13.612489 19643 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:13.612697 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:13.613052 19643 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:13.613586 20351 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:13.614045 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:13.614904 20351 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:13.615217 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:13.616043 14298 raft_consensus.cc:2410] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 16 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
W20260709 13:20:13.619400 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46851.2us
I20260709 13:20:13.612901 14375 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:13.621899 14369 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
W20260709 13:20:13.623754 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.560459 20374 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.633116 14377 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:13.553285 20504 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.625483 14373 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:13.629328 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:13.631023 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 69126.7us
I20260709 13:20:13.631125 14193 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:13.631829 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.634497 14299 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
W20260709 13:20:13.646656 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 132742us
I20260709 13:20:13.647048 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:13.647511 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:13.676024 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:13.676712 14304 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:13.677315 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 63365.1us
I20260709 13:20:13.649654 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:13.678519 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:13.682668 14229 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:13.632720 20499 raft_consensus.cc:2764] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:20:13.688145 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 52694.7us
I20260709 13:20:13.693538 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:13.692194 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 204173us
W20260709 13:20:13.695677 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 48263us
W20260709 13:20:13.696146 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 65109us
I20260709 13:20:13.714946 14193 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:13.677217 20143 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:13.723415 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:13.693122 20351 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:13.688815 20501 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:13.730566 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:13.742192 14297 raft_consensus.cc:3055] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:13.743955 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:13.744650 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 169348us
I20260709 13:20:13.747949 19943 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:13.717924 20143 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:13.742743 14297 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:13.754143 14298 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.720679 20464 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:13.698872 20428 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:13.749912 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:13.733290 20351 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:13.730525 20432 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:13.781587 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.762990 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:13.777658 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:13.780159 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:13.762570 20143 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.792870 14220 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:20:13.793018 20396 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:13.793289 14220 pending_rounds.cc:85] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 10
I20260709 13:20:13.793640 14220 pending_rounds.cc:107] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:20:13.793910 14220 raft_consensus.cc:2889] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:13.791610 20259 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:13.792044 20245 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.794919 20245 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:13.798466 20245 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.799861 14123 catalog_manager.cc:5697] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 13 to 17, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 17 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.801904 20397 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:20:13.802127 14123 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 9 to 12, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 12 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:13.804064 14123 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 9 to 17, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 17 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.810235 20517 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:13.810678 20283 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.810979 20517 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:13.811301 20283 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.811967 20502 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:13.811942 20517 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:13.810206 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 84509.3us
W20260709 13:20:13.795841 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 76860.8us
I20260709 13:20:13.816684 14865 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:13.818490 20501 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.819456 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:13.759552 19870 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:13.823993 20500 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.813634 20283 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:13.771747 20428 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.827865 20428 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.783221 20351 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:13.830183 20496 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.873s	user 0.002s	sys 0.002s
W20260709 13:20:13.840421 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 81521.5us
I20260709 13:20:13.853655 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:13.872278 14226 raft_consensus.cc:2410] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 15 because replica has last-logged OpId of term: 13 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:20:13.856966 14123 catalog_manager.cc:5697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 8 to 10, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 10 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:20:13.883104 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 133300us
I20260709 13:20:13.878237 20431 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:13.901186 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:13.896488 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 113788us
W20260709 13:20:13.904181 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 131960us
I20260709 13:20:13.887766 20142 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:13.907073 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 53518us
I20260709 13:20:13.899828 14297 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:13.910015 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 90663.3us
I20260709 13:20:13.790620 20455 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.878530 20499 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:20:13.870395 19643 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:13.911010 20504 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:13.928514 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:13.933032 14297 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.920497 14123 catalog_manager.cc:5697] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 7 to 11, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 11 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:13.903888 20045 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:13.888772 20185 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.910130 20142 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:13.907608 20317 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:13.943610 14123 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 11 to 16, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 16 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:13.949407 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:13.960978 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64213.6us
I20260709 13:20:13.909624 20199 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:20:13.928961 20391 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.975301 20519 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.975648 14123 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:13.968672 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:13.976616 20529 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:20:13.969543 20524 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:13.977205 14226 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 13: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:13.977296 20391 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:13.989367 14297 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:20:13.990039 14297 pending_rounds.cc:85] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 6
I20260709 13:20:13.990450 14297 pending_rounds.cc:107] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:20:13.990823 14297 raft_consensus.cc:2889] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:13.992413 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:14.002113 14301 raft_consensus.cc:2410] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:20:14.002192 14297 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
W20260709 13:20:14.002974 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.004040 20432 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:14.004451 20432 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:14.004992 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:14.006897 20245 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.007983 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:14.010030 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:13.928754 20283 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:20:14.011600 20143 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:14.016649 20494 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
W20260709 13:20:14.020762 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 91010.4us
W20260709 13:20:14.022725 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 102155us
W20260709 13:20:14.025081 20523 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:20:14.026028 20534 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:14.026423 20527 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:20:14.026595 20534 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:14.027088 20534 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.009500 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:13.969978 20504 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.974776 20381 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:13.975914 20519 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:13.978003 20259 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:14.036939 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:14.036863 20259 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.038208 14377 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:14.039013 20351 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:14.039705 14893 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
I20260709 13:20:14.040686 20519 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:14.040786 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:14.041313 20504 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.042492 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:14.043161 14894 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:14.044291 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:14.045174 14220 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:14.046161 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:13.978721 19643 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:14.061286 14297 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:13.967669 20185 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:13.979970 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:13.970546 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:13.982520 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:14.065989 14221 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:20:14.065021 14304 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:14.066412 14226 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:13.946476 20431 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:14.029434 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:14.030005 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:14.073916 14897 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:13.977370 14123 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.956346 20142 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.004778 20455 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:14.084295 14296 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 11.
I20260709 13:20:14.086339 14296 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:14.062343 20392 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.772s	user 0.008s	sys 0.004s
I20260709 13:20:14.088745 20392 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.091336 20392 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:14.092168 14223 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:14.092422 14300 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:20:14.037384 14375 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:14.048590 14896 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: [18.15-19.16]
I20260709 13:20:14.062889 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:14.099812 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65730.4us
I20260709 13:20:14.100629 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:14.102424 20385 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:14.102869 20385 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:14.104059 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2638) took 2998 ms. Trace:
I20260709 13:20:14.103847 20385 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:14.105306 20385 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.106154 20434 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:14.107052 20434 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:14.107403 20434 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:14.039726 20259 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:14.107705 20536 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:14.108218 20259 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:14.108912 20259 consensus_queue.cc:1243] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:14.109364 20518 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:14.109696 20388 consensus_meta.cc:287] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.002s
I20260709 13:20:14.110075 20518 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:14.082633 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:14.065335 20377 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.005s
I20260709 13:20:14.112337 20377 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.114389 20351 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:14.084283 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 113817us
I20260709 13:20:14.083756 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:14.115401 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:14.033530 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:14.084329 20504 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:14.104611 14223 rpcz_store.cc:276] 0709 13:20:11.106028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.115102 (+2009074us) service_pool.cc:224] Handling call
0709 13:20:13.229634 (+114532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.092643 (+863009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.103799 (+ 11156us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540026ded4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:14.103991 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983098240}
I20260709 13:20:14.081866 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:14.116689 14302 raft_consensus.cc:2410] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:14.111137 14369 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:20:14.082284 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:14.029868 20378 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:14.034942 20143 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:14.085116 20455 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:14.110173 20388 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:14.117439 14295 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:14.114491 20377 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:14.121701 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:14.122125 14300 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:20:14.106125 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 57408us
I20260709 13:20:14.048169 20381 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:14.140583 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:14.141285 14302 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:14.069316 14298 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
W20260709 13:20:14.127708 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77107.8us
I20260709 13:20:14.138674 14123 catalog_manager.cc:5697] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 3 to 8, term changed from 10 to 13, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130), VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 13 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:14.141891 14226 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
W20260709 13:20:14.142266 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.142336 14296 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:14.128130 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 82138.6us
I20260709 13:20:14.124550 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:14.005463 20432 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.107779 20434 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.148069 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:14.124402 20464 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:14.149892 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:14.152961 14304 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:20:14.153548 14304 pending_rounds.cc:85] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 6
I20260709 13:20:14.153853 14304 pending_rounds.cc:107] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:20:14.154151 14304 raft_consensus.cc:2889] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:14.158286 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:14.158493 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:14.159580 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:14.159741 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:14.160255 14295 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
W20260709 13:20:14.161294 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.161218 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:14.162261 20283 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:14.163424 20245 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:14.163857 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:14.164011 20431 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:20:14.165056 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:14.165418 20431 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:14.166127 20499 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:14.166728 20499 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:14.167295 20351 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:14.166973 20381 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.167698 20499 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.169489 20534 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:14.169765 20455 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:14.169222 14123 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 9 to 14, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 14 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:14.176446 14193 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:14.177629 14193 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:14.170413 14369 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:20:14.170871 20383 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.000s
I20260709 13:20:14.180739 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:14.186873 14300 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:20:14.187356 14300 pending_rounds.cc:85] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 6
I20260709 13:20:14.179760 14865 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:14.161523 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:14.173141 14295 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:14.187585 14300 pending_rounds.cc:107] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:20:14.175716 14123 catalog_manager.cc:5697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 7 to 11, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 11 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:14.190382 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:14.148159 20143 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:14.191231 14300 raft_consensus.cc:2889] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:14.193177 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:14.180164 20377 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.208297 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:14.202188 14341 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:14.201071 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:14.221961 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:14.188202 20392 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:14.297079 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:14.166142 20397 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:20:14.311091 14375 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [13.8-14.9]
I20260709 13:20:14.187999 20329 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:20:14.198179 20385 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
W20260709 13:20:14.300642 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 78779.3us
I20260709 13:20:14.301344 20502 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:14.194947 20534 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:14.201190 20533 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:20:14.217209 20432 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:14.331095 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 169644us
I20260709 13:20:14.307091 14302 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:14.258101 14123 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 9 to 12, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 12 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:14.307837 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 89645.9us
I20260709 13:20:14.332178 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:14.195345 19643 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:14.226094 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 83369.6us
I20260709 13:20:14.315845 14295 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:14.199904 20500 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:14.216574 20259 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.270310 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:14.318970 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:14.192514 20383 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:14.328506 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:14.195114 20431 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 13:20:14.192348 20045 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:14.198771 20185 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 13:20:14.339576 14123 catalog_manager.cc:5697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:14.219708 20520 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:14.258296 20396 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.219889 20199 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.118s
W20260709 13:20:14.383276 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 51151us
I20260709 13:20:14.345319 20500 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:14.322309 20502 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.359304 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:14.306936 20377 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:14.367070 14123 catalog_manager.cc:5697] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 11, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 11 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:14.343340 20358 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:14.319829 20351 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:14.345587 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 138482us
I20260709 13:20:14.356355 14375 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:14.216799 20518 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:14.392863 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 214418us
I20260709 13:20:14.362941 20045 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:14.381754 19943 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:14.367880 20517 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.381306 20317 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:14.381608 20519 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:14.381426 20391 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:14.402180 14123 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 13 to 15, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 15 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:14.412480 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:14.392318 20500 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.410166 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:14.392555 20502 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.416563 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:14.357189 20259 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.399709 20045 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.412021 20358 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:14.449719 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:14.412473 20504 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 13:20:14.455156 19870 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.001s
I20260709 13:20:14.460470 20533 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:14.502193 20533 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:14.502650 20533 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:14.503073 20533 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.503125 20259 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:14.438051 20388 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:14.466208 20431 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:14.505353 20431 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:14.506318 20431 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:14.507426 20431 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:14.466773 20557 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:14.508773 20557 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:14.509737 20557 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:14.510711 20377 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:14.511297 20557 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:14.467677 20538 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:20:14.454316 20428 consensus_meta.cc:287] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.003s
W20260709 13:20:14.468911 20540 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:20:14.525779 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.470300 20539 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:20:14.528440 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:14.529244 14896 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.530274 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:14.471621 20383 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:14.433352 20553 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:14.416848 20517 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.416213 20519 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.479940 20142 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.455837 20385 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:14.482224 20543 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:20:14.567113 20544 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:20:14.525889 20351 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:14.490303 20500 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.491308 20358 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.493659 20045 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.498785 20374 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:14.435474 20501 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:14.412946 20391 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.467834 20551 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.451995 20317 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.533610 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:14.535295 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:14.539846 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:14.540385 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:14.536547 20428 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.551738 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:14.520995 19870 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:14.540431 20388 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.535691 20185 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:14.536235 19943 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:14.535919 20245 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:14.581591 14297 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:14.568147 20385 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:14.581905 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 147139us
I20260709 13:20:14.605710 14894 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:14.609877 14898 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:20:14.443408 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 246807us
I20260709 13:20:14.576503 20351 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:14.637856 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.582262 20374 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:14.639007 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:14.594357 20283 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:14.644618 14229 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:20:14.641948 14369 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:14.648058 14341 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:14.650507 20519 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:14.651218 20545 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:20:14.640383 20551 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.627305 20385 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.634502 20388 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:14.659205 20142 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:14.664389 20518 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.669283 20391 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:14.632002 20185 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.603475 20501 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.612305 19943 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.639303 20317 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:14.634063 20245 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.692389 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:14.583540 20329 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:20:14.670517 20520 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:20:14.675247 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.693452 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 45482.6us
I20260709 13:20:14.816049 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:14.840396 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:14.846674 14222 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:20:14.717145 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:14.853308 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.006s	sys 0.007s
W20260709 13:20:14.694180 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46812.4us
W20260709 13:20:14.863647 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.007s	sys 0.008s
I20260709 13:20:14.712618 14226 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:20:14.855039 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:14.864176 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 599989us
W20260709 13:20:14.853613 20392 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.001s	sys 0.013s
W20260709 13:20:14.867993 20392 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.001s	sys 0.013s
I20260709 13:20:14.868336 20392 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:14.869488 20546 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.399s	user 0.004s	sys 0.000s
I20260709 13:20:14.869395 20392 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:14.786293 20434 consensus_meta.cc:287] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.004s
I20260709 13:20:14.872958 20434 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:14.875377 20434 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:14.877040 20329 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:14.877544 20329 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:14.878033 20541 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.423s	user 0.003s	sys 0.000s
I20260709 13:20:14.878520 20329 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.879947 20329 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:14.865967 20520 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:14.886027 14225 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:20:14.887686 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.859624 14896 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:14.715662 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:14.694796 20558 log.cc:927] Time spent T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:20:14.867177 14226 pending_rounds.cc:85] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 12
I20260709 13:20:14.890856 14226 pending_rounds.cc:107] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:20:14.891201 14226 raft_consensus.cc:2889] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:14.682206 19870 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:14.897315 14301 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.001s
I20260709 13:20:14.898850 14301 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:14.889106 14223 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:14.900846 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:20:14.902872 20396 consensus_meta.cc:287] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:20:14.903535 14193 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:14.890586 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:14.714005 20374 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.781265 20431 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:14.910005 20383 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:14.901638 20245 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:14.914714 20045 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:14.916368 20533 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.916643 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:14.917112 14299 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:14.917572 20547 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.918164 20494 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.922654 20464 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:14.813165 20283 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.710613 20199 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:14.919330 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:14.713605 20551 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:14.940210 20143 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:14.698170 19643 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:14.922062 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 81774.2us
W20260709 13:20:14.919322 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55249.5us
W20260709 13:20:14.923089 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 254049us
I20260709 13:20:14.706543 20517 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:15.005594 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50429.7us
I20260709 13:20:15.006176 20499 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:15.007567 20499 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:15.008013 20499 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:14.913543 20432 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.000s
I20260709 13:20:14.715759 20519 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:14.925892 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47003.6us
I20260709 13:20:15.013744 14300 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:14.927073 14224 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:14.926523 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 234226us
I20260709 13:20:14.932221 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:14.932575 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:14.934563 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:15.015161 14301 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:15.015337 14267 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:14.937855 14302 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:20:14.949259 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 48524.3us
I20260709 13:20:14.950129 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:14.715509 20561 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.208s
I20260709 13:20:14.918731 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:14.847061 20560 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:20:14.925359 20536 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:14.802796 20562 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.945762 20396 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:14.940075 20378 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.012403 14295 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:14.913713 20502 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:15.019285 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 86859.4us
I20260709 13:20:14.978399 20434 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:14.954208 19870 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:15.027529 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:15.028879 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:15.038484 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:15.041234 20551 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:15.042631 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:15.009477 20554 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.066610 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:14.995428 20199 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:15.044721 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:15.069088 14225 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:14.997949 20431 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:15.012873 19643 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:15.052546 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:15.062274 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45737.7us
I20260709 13:20:14.949036 20383 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.031248 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:15.065959 14299 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:14.978790 20358 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:20:15.070055 14222 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:15.094354 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:15.093768 14897 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:15.017987 20143 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:14.980101 20494 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:15.022370 20517 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:15.044248 20428 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:15.099166 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 56669us
I20260709 13:20:14.999965 20283 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:14.980469 20547 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:15.102845 20568 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:15.103932 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 65524.9us
I20260709 13:20:15.104619 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:15.013582 20519 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.122682 14373 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:15.109370 14894 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
W20260709 13:20:15.109615 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 80893.8us
I20260709 13:20:15.045415 20534 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:20:15.126160 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:15.126693 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:15.129922 14302 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:20:15.131695 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:15.136940 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:15.138031 14303 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:15.076146 20434 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:15.073556 20555 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.197376 14375 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:15.106148 20560 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:15.212991 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 85996.9us
I20260709 13:20:15.120548 20517 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:15.261873 20501 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.262699 20517 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.263986 20569 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:15.264452 20569 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:15.266286 20391 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:15.266772 20391 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:15.267242 20582 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.267762 20582 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.128664 20396 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:15.119082 20561 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:15.054080 20378 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:15.220551 19943 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.221205 20432 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:15.053841 20562 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:15.283115 20562 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.283973 14229 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:20:15.221884 20383 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:15.217314 20555 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:15.287046 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:15.288098 14296 raft_consensus.cc:2410] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 16 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:20:15.288462 20143 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.289105 20555 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.222322 20142 raft_consensus.cc:3055] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:15.223073 20580 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.290225 20142 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:15.291150 20142 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.292557 20142 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.292752 20582 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:15.293447 20317 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.295315 20494 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:15.297380 20378 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.135327 20568 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:15.303898 14892 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:15.106115 20431 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:15.221246 20570 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:20:15.228575 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:15.230245 20519 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.232297 20547 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.078861 20559 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.153s
I20260709 13:20:15.105640 20392 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 13:20:15.352188 20317 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:15.352672 20317 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:15.353541 20317 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:15.233836 20550 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
I20260709 13:20:15.354874 20317 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:15.235319 20575 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:20:15.239750 20520 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.090865 20554 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.358284 14297 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:15.072932 20499 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.359345 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:15.359959 20499 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:15.243259 20533 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:15.244889 20502 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:15.251556 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 142936us
I20260709 13:20:15.365000 14192 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:15.287075 20388 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:15.259651 20434 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.261125 20504 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:15.265530 20586 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.265377 20569 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:15.240882 19870 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.223501 20556 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
W20260709 13:20:15.224463 20525 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:20:15.344521 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 223804us
I20260709 13:20:15.287035 14227 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:15.348055 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:15.349977 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:15.274912 20396 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.278918 20185 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.303921 20568 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.255475 20553 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:15.135442 20500 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.385749 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:15.385767 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:15.362397 14223 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:15.388607 14369 raft_consensus.cc:2376] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17. Re-sending same reply.
I20260709 13:20:15.218569 20045 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.131s
I20260709 13:20:15.370206 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:15.262744 20501 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.099s
W20260709 13:20:15.377862 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 256751us
I20260709 13:20:15.359380 20554 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:15.390285 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:15.371430 20550 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:15.395601 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:15.385664 20351 consensus_meta.cc:287] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.000s
I20260709 13:20:15.453769 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:15.345969 20580 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:15.455703 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 409604us
I20260709 13:20:15.394402 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:15.452176 14376 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:15.452518 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:15.453204 20552 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:15.450898 20568 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.454185 20351 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:15.468022 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 342940us
I20260709 13:20:15.378502 20283 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:15.456683 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62363.6us
I20260709 13:20:15.451071 14373 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:15.458928 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61210.4us
I20260709 13:20:15.394483 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:15.474432 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 459145us
I20260709 13:20:15.474525 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:15.477712 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.455127 20385 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.000s
I20260709 13:20:15.482833 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:15.493429 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:15.488803 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:15.386109 20396 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:15.458235 20577 log.cc:927] Time spent T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:15.490443 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:15.455147 20559 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:15.449218 20185 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:15.481964 20552 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:15.507225 14220 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:15.510453 14374 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:15.457049 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:15.490744 20569 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.474826 20568 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:15.519104 20431 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:15.519160 20591 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:20:15.519891 20597 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.520434 20597 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:15.522617 20597 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:15.518953 20600 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:15.522960 20351 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:15.524075 20185 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.530156 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:15.531275 14227 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:15.394832 20553 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.502041 20385 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.383195 20586 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:15.541275 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 84326.3us
I20260709 13:20:15.502597 20559 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.511407 20519 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:15.620709 14374 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:15.536906 20185 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:15.676523 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 195546us
I20260709 13:20:15.586436 20600 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:15.591463 20559 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.696245 14373 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:15.682950 20383 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.514456 20283 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:15.797293 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:15.797358 14371 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:15.797742 14223 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:15.816407 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:15.845479 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:15.777748 20392 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.822831 14376 raft_consensus.cc:2376] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14. Re-sending same reply.
I20260709 13:20:15.860500 14227 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:15.858734 14225 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:15.863660 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:15.889361 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 206988us
W20260709 13:20:15.887252 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.844861 20600 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:15.865437 20594 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:15.893319 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:15.864589 20351 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.865985 20185 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.827911 20383 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.888372 20283 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.915846 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:15.902374 20518 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.042s	user 0.012s	sys 0.000s
I20260709 13:20:15.863999 20593 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:15.903244 14372 raft_consensus.cc:2376] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15. Re-sending same reply.
I20260709 13:20:15.696076 20519 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.916684 14374 raft_consensus.cc:2376] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16. Re-sending same reply.
I20260709 13:20:15.892823 20587 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:15.943892 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:15.948405 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 153860us
I20260709 13:20:15.884675 20392 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:15.950918 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:15.971772 14227 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:15.974213 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3070) took 1050 ms. Trace:
I20260709 13:20:15.932597 20593 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.976070 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:15.973197 20504 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.912580 20351 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.942765 20597 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.980845 14374 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:15.974728 14295 rpcz_store.cc:276] 0709 13:20:14.918586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.918700 (+   114us) service_pool.cc:224] Handling call
0709 13:20:14.918970 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.033514 (+114544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.969205 (+935691us) spinlock_profiling.cc:243] Waited 93.1 ms on lock 0x7b54000910d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:15.969424 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214237952}
I20260709 13:20:15.949328 20587 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:15.983707 20561 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.986809 20571 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:15.915820 20185 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.994405 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:15.934250 20283 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.982893 20593 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:15.988586 20589 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.989666 20385 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.009903 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.010409 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.011109 14374 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:15.994199 20580 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:16.014681 20601 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:20:16.015041 20615 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:15.992601 20597 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.016108 20283 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:16.016450 20499 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.004s
I20260709 13:20:15.985498 20504 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:15.987547 20561 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.026477 20615 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.039743 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.041911 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.043653 14374 raft_consensus.cc:2410] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 19 because replica has last-logged OpId of term: 18 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:20:16.044006 14373 raft_consensus.cc:2410] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:15.987664 20571 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.027249 20586 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:15.905532 20600 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.037470 20392 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:15.822695 20552 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.068168 20561 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:16.008236 20589 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:16.068411 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.070070 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.070936 20589 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.071599 20378 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.071847 20555 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:16.072211 20597 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.072145 20378 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.072510 20555 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.035420 20587 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.075470 20592 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:16.075560 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 592743us
I20260709 13:20:16.076113 20571 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:16.076411 20547 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:16.077322 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.039772 20518 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:16.078095 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:16.060874 20317 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.705s	user 0.008s	sys 0.004s
I20260709 13:20:16.074052 20329 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:16.103036 20329 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.104192 20378 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.076061 20533 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.068795 20185 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:16.077976 20554 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:16.089116 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:16.087174 20592 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.106734 14373 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.108443 20592 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.092382 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:16.110008 20518 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.111642 20587 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.092269 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.113850 20615 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.114144 14223 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
W20260709 13:20:16.115576 20610 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.128s	user 0.003s	sys 0.000s
I20260709 13:20:16.116158 14369 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:16.116204 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:16.116529 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.095749 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:16.117522 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.117687 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.118158 14299 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:16.118331 14301 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:16.118702 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:16.118981 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.119333 14369 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.119791 14299 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:16.120100 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.120736 14298 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:16.105116 20533 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.076154 20534 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.121771 20534 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.098215 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.117534 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.123274 14303 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:16.123914 20329 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.124281 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.124513 20329 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:16.124728 20600 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:16.124909 14225 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:16.085117 20536 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.125612 20536 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.126042 20533 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.123939 20534 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.127462 14369 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:16.127712 20536 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.077381 20504 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.128595 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:16.130033 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.131350 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.132663 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.089960 20383 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:16.134564 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49797.4us
I20260709 13:20:16.125116 20329 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.137729 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.138142 20554 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:16.138598 14378 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:16.139869 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.140744 20329 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.143405 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.146363 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3018) took 1332 ms. Trace:
I20260709 13:20:16.146970 14229 rpcz_store.cc:276] 0709 13:20:14.814147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.815353 (+  1206us) service_pool.cc:224] Handling call
0709 13:20:14.843134 (+ 27781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.284383 (+441249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.146000 (+861617us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b5400341554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:16.146261 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012954880}
I20260709 13:20:16.148628 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.148953 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:16.149572 14893 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.149878 20555 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.150674 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:16.151278 14894 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.152463 19643 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.149732 14898 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:16.148372 14223 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:16.146781 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.112186 20518 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:16.150213 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:16.153744 19643 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.165225 14295 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:16.167377 14373 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:16.154132 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.170595 14897 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:16.154704 14895 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:16.172787 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.174286 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.175393 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:16.175730 14229 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:16.176002 14378 raft_consensus.cc:2376] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17. Re-sending same reply.
I20260709 13:20:16.176448 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:16.177105 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.178763 14229 raft_consensus.cc:2410] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 16 because replica has last-logged OpId of term: 13 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:20:16.178208 20199 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.180590 14373 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 12: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:16.177052 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.194959 14892 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:16.157086 14372 raft_consensus.cc:2376] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15. Re-sending same reply.
I20260709 13:20:16.157401 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.159830 14893 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:16.197428 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:16.159413 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.202616 14225 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:16.156436 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:16.204074 20317 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:16.204743 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.204674 20317 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.205601 14223 raft_consensus.cc:2410] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 13:20:16.206720 14894 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
W20260709 13:20:16.157483 20142 consensus_meta.cc:287] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.864s	user 0.013s	sys 0.000s
I20260709 13:20:16.242175 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:16.243453 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:16.245945 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 56088.8us
I20260709 13:20:16.248531 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:16.251427 14342 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.050518 20553 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.196497 20383 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.262632 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.255347 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:16.240582 20569 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
I20260709 13:20:16.284672 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.286052 20317 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:16.288035 20396 consensus_meta.cc:287] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.000s
I20260709 13:20:16.289229 20600 raft_consensus.cc:2764] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:20:16.290400 14894 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:16.291141 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.311112 14892 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:16.292055 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.322763 14893 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 12: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:16.322940 20563 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:16.231801 20392 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:16.323586 20563 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:16.323935 20392 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.294273 20142 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.326913 20142 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.327956 14228 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:16.329276 20142 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.294450 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.329993 14376 raft_consensus.cc:2376] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15. Re-sending same reply.
I20260709 13:20:16.330405 14895 raft_consensus.cc:2410] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:20:16.295481 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.312335 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.332350 14377 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:16.274019 20551 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:16.296706 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:16.296197 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.269516 20045 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:16.300902 20557 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.275004 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:16.270066 20519 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.302881 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:16.348069 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45334.3us
I20260709 13:20:16.313373 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.314350 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.350178 14371 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:16.314762 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.315690 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.309346 20464 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:16.316341 20391 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.309566 19643 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.320080 20589 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:16.320915 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3030) took 1092 ms. Trace:
I20260709 13:20:16.346170 14224 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:20:16.344372 14898 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 11.
W20260709 13:20:16.352418 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 49420.8us
W20260709 13:20:16.354904 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 80000.6us
I20260709 13:20:16.364283 14222 rpcz_store.cc:276] 0709 13:20:15.228500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.256110 (+ 27610us) service_pool.cc:224] Handling call
0709 13:20:15.256553 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.585582 (+329029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.585615 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:15.585660 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:15.585693 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.320602 (+734909us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54003e0654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:16.320670 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.320841 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756080384}
W20260709 13:20:16.362555 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 291227us
I20260709 13:20:16.310694 20533 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:16.366401 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:16.330658 20396 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:16.367893 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.368798 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:16.370390 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:16.371479 14864 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:16.373733 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 111225us
I20260709 13:20:16.325008 20563 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.374884 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.303958 20383 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.376151 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.338151 20317 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.331746 20378 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:20:16.386914 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:16.360416 20598 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:16.361819 20142 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:16.386627 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:16.394968 14372 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:16.395196 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:16.346625 20045 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.156312 20593 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.375991 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:16.366796 20434 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:16.390618 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.390897 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:16.397707 14302 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.377286 20500 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:16.376976 20569 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:16.372877 20501 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:16.377554 20518 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:16.426244 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:16.389127 20329 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.396127 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:16.397105 20045 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.358963 20557 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.403698 20383 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.385531 20589 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.383096 20464 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:16.454102 20625 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.454818 20464 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.454929 20625 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.432524 20554 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:16.458158 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.459118 14228 raft_consensus.cc:2410] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 17 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:20:16.458567 20554 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.346859 20559 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.392144 20536 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:20:16.394008 20563 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.389254 20502 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:16.408048 20392 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.382869 20553 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:16.413676 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.481266 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.416141 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.482440 14372 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:16.417718 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.391543 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.377133 20519 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:20:16.378331 19643 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.394531 20142 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.410584 20534 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:16.397936 20504 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:16.410610 20391 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.444573 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.381458 20533 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.410315 20560 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:16.411310 20283 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:16.518141 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 122100us
I20260709 13:20:16.446409 14302 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:16.447911 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.519774 14295 raft_consensus.cc:2410] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 18 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 13:20:16.450333 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.451064 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.451524 20557 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.451833 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.453645 20589 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:16.463047 14226 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:16.463939 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.464900 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.427590 20555 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:16.518121 20598 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.528016 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:16.527946 20598 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.529219 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.529847 14228 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:16.530654 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.531363 14228 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:16.429316 20500 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:16.484130 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 92674.4us
I20260709 13:20:16.532258 20351 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.532625 14864 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:16.485534 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 110940us
I20260709 13:20:16.534243 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.534467 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.536741 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:16.492172 14221 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:16.440101 20434 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:16.494447 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.538292 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.497758 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.538942 14377 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:16.514171 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.539690 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.539845 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.540488 14377 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:16.540623 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.540921 20548 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:16.541301 14373 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:16.541689 14222 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 15: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:16.542183 20548 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:16.542363 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.506026 20501 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:16.478044 20592 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:16.520654 14227 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:16.443357 20329 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.522969 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.525983 20502 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.527225 20580 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.532524 20500 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.534891 14897 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:16.538481 20434 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.541095 14341 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:16.444638 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:16.565655 14370 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.540549 20392 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:16.499759 14303 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:16.533633 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.391384 20317 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.543016 14373 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:16.576097 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.574023 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.544378 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.544713 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.504766 14374 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:16.493754 20559 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.541353 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.550375 14864 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:16.507086 20142 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.581207 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.581619 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.581938 14899 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:16.582347 14897 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:16.583699 20633 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.586517 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.587293 20317 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.587723 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.588160 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:16.588907 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.589751 14373 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:16.566426 20502 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.590776 14225 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:16.590494 20142 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:16.591738 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 47102.3us
I20260709 13:20:16.592221 20502 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.592581 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.594256 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.595094 14900 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:16.596279 20623 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:20:16.559299 20622 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:16.597839 20142 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.600069 20593 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:16.543104 20589 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:20:16.601954 20556 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:16.602335 20556 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:16.602401 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.603293 14301 raft_consensus.cc:2410] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 13:20:16.603325 20556 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.604856 20556 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.606324 20392 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:16.606907 14297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1204) took 1690 ms (client timeout 2158 ms). Trace:
I20260709 13:20:16.607368 14892 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:16.589521 14295 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
W20260709 13:20:16.607532 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.609058 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 58795.3us
I20260709 13:20:16.555013 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.610371 14302 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:16.582373 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.611212 14894 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 11.
I20260709 13:20:16.508033 20553 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.492281 14371 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:16.565393 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.519901 20624 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:16.541706 20582 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:16.527273 20533 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.552201 20504 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.580595 20501 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:16.573980 20351 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:16.542995 20548 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:16.549273 20554 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.616571 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.517524 20625 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.633047 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.613752 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.609902 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:16.636181 14303 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
W20260709 13:20:16.607311 14297 rpcz_store.cc:269] 0709 13:20:14.916165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.916286 (+   121us) service_pool.cc:224] Handling call
0709 13:20:16.606725 (+1690439us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540022c9d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:16.606825 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940916480}
I20260709 13:20:16.620939 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.628396 14296 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:16.650868 14302 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:16.575322 20499 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:16.598035 20329 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.655395 14222 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 13:20:16.668674 14222 pending_rounds.cc:85] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 13
I20260709 13:20:16.668992 14222 pending_rounds.cc:107] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 13.14
I20260709 13:20:16.669283 14222 raft_consensus.cc:2889] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:16.651904 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.670084 14373 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
W20260709 13:20:16.626360 20587 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.001s
I20260709 13:20:16.675923 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:16.628165 20582 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.682318 20582 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.674278 20499 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.566329 20580 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.686295 20383 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:16.686792 20383 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.687026 20499 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.687213 20580 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.688805 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:16.689528 14900 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:16.690183 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.691118 14895 raft_consensus.cc:2410] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:20:16.692137 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.692883 14895 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 12: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:16.674595 20559 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:16.693670 20559 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:16.633126 20624 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.656454 20518 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:16.632897 20548 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:16.622028 20519 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:16.677604 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:16.699195 14900 raft_consensus.cc:2410] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:20:16.700559 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.751703 14899 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:16.751909 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:16.700860 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.705242 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:16.705726 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2635) took 1601 ms. Trace:
I20260709 13:20:16.729560 14867 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:16.622258 20392 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:20:16.721634 14193 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.756585 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.756237 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:16.736318 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.772202 14373 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:16.772465 14299 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:16.757215 14227 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:16.737569 20553 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.736544 20378 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:16.775247 20378 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:16.731889 20518 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:16.776322 20378 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.732988 20568 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.624853 20317 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.118s
I20260709 13:20:16.731189 20624 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.708063 20374 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.773352 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:16.777190 20518 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:16.744064 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 219857us
I20260709 13:20:16.786615 14372 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:16.789172 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:16.744506 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:16.730988 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1444) took 1674 ms. Trace:
I20260709 13:20:16.746161 14369 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:16.720248 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:16.792284 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 70712.6us
I20260709 13:20:16.745522 20283 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:16.754278 14375 rpcz_store.cc:276] 0709 13:20:15.103882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.104050 (+   168us) service_pool.cc:224] Handling call
0709 13:20:15.104396 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.209028 (+104632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.705495 (+1496467us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b54001c9dd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:16.705671 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81764736}
I20260709 13:20:16.700202 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:16.794750 14303 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:16.693758 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:16.743485 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 65994.1us
I20260709 13:20:16.790666 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:16.632525 20504 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.836400 14899 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:16.833721 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:16.838693 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.839955 14895 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:16.840273 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:16.829766 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:16.834542 14377 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:16.794126 14896 rpcz_store.cc:276] 0709 13:20:15.056761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.057917 (+  1156us) service_pool.cc:224] Handling call
0709 13:20:16.730278 (+1672361us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:20:16.730480 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.730649 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.730672 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:16.730713 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:16.730743 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.730795 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.730895 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4740992}
W20260709 13:20:16.854804 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.687222 20383 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:16.833977 20571 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:20:16.862103 20563 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.831882 20283 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.736951 20199 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:16.866248 20283 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.866730 20317 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:16.867794 20317 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:16.858338 20378 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.870448 20607 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:16.870903 20607 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.871263 20607 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.801024 20519 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:16.874271 20519 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.874648 20519 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:16.875661 20518 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.733687 20501 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.881315 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:16.733062 20548 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.882223 20494 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:16.882870 20494 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.883013 20548 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:16.883363 20494 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.729722 20580 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.156s
I20260709 13:20:16.897153 20563 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:16.903955 20494 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.911484 14897 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:16.697130 19643 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:16.928193 14370 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:16.796319 20568 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:16.746589 20560 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:16.716867 20598 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:16.797564 20391 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.931901 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:16.937599 14899 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.833648 20185 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:16.829867 20592 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:16.935487 14893 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:16.901238 20607 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.855486 20431 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:16.953608 20592 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:16.966907 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 177813us
W20260709 13:20:16.969076 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.959717 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.959815 14900 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:20:16.960091 20560 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:16.925769 20494 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:16.963209 20351 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.837580 20045 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.974756 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:16.943818 20633 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:16.707085 20559 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:16.931808 20142 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:20:16.998121 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.962682 20593 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:16.964653 20431 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.999270 14899 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
W20260709 13:20:17.011292 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 312990us
W20260709 13:20:17.012926 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.014272 14378 raft_consensus.cc:2368] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16.
I20260709 13:20:16.985664 20555 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.016767 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:16.989984 20557 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.021407 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:16.986110 20351 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:17.011241 20431 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.017544 14865 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:17.041386 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:17.028950 20329 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:17.010696 20593 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:17.060062 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:17.063838 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:17.064272 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:17.084393 14371 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:17.030344 20378 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:17.035236 20533 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:17.085175 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:17.093482 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:17.095222 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:17.097019 20624 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:17.040307 20557 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.086244 20378 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.098222 20378 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.099550 14304 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:17.100090 20557 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:17.056598 20385 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:17.101008 20385 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:17.101500 20385 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.104317 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:17.102494 20569 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.106823 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:17.108223 14865 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:17.107842 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:17.022331 20383 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.112486 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:17.113853 14375 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:17.080505 20329 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.059356 20500 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.121430 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:17.030329 20555 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.127298 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1463) took 1009 ms. Trace:
I20260709 13:20:17.137674 14369 rpcz_store.cc:276] 0709 13:20:16.117737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.132385 (+ 14648us) service_pool.cc:224] Handling call
0709 13:20:17.127140 (+994755us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400060ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:17.127238 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409230592}
I20260709 13:20:17.081861 20518 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:17.086647 20580 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:17.135262 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 296650us
I20260709 13:20:17.088896 20533 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.046474 20637 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:20:17.088596 20625 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:17.146768 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 317127us
I20260709 13:20:17.088532 20534 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:17.181389 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:17.142257 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:17.120410 20502 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:17.085803 20536 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:20:17.128832 20142 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.210361 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:17.210734 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:17.211176 14227 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:17.134789 20329 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.217307 14378 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:17.106860 20622 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:17.194298 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:17.195894 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:17.200644 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:17.202277 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.212510 14299 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:17.219941 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3248) took 1118 ms. Trace:
I20260709 13:20:17.139456 20620 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:17.193053 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50914.3us
I20260709 13:20:17.216189 20317 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:17.123648 20520 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:17.221720 14303 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:17.221930 14298 rpcz_store.cc:276] 0709 13:20:16.101436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.121360 (+ 19924us) service_pool.cc:224] Handling call
0709 13:20:16.121691 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.121936 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:16.390470 (+268534us) log.cc:844] Serialized 14 byte log entry
0709 13:20:16.586565 (+196095us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18002c0aa0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a
0709 13:20:17.219564 (+632999us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:17.219618 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:17.219663 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.219726 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.219838 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269956,"prepare.queue_time_us":360237,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":4426,"raft.queue_time_us":368159,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":96,"spinlock_wait_cycles":27072384,"thread_start_us":722501,"threads_started":3,"wal-append.queue_time_us":237309}
I20260709 13:20:17.232331 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.233515 14303 raft_consensus.cc:2393] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:17.222245 14295 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.193730 20504 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:17.182021 20374 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:17.223551 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.217203 20143 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.225445 14377 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:17.182438 20533 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:17.221210 14372 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:17.187534 20598 raft_consensus.cc:2764] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:17.192255 20392 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:20:17.276701 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.128854 20569 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.279825 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:17.281381 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:17.242846 20374 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:17.235723 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.210124 20568 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.237242 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:17.215767 14370 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
W20260709 13:20:17.224654 20582 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.001s
I20260709 13:20:17.235729 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:17.307900 20374 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.248011 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:17.249106 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:17.249997 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:17.243803 14299 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:17.374302 14223 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:17.375195 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.219798 20637 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:17.186414 20595 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 13:20:17.382400 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 182564us
I20260709 13:20:17.216392 20613 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:20:17.211364 20625 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.240622 20633 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:20:17.403663 20142 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.405821 20652 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.406633 20652 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.412132 20625 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:17.235445 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 403671us
I20260709 13:20:17.321987 14894 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:20:17.310966 14295 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:17.415151 14299 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:17.344741 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.415232 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:17.416538 14303 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:17.336874 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:17.238384 20317 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.286366 20045 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:17.322554 14900 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:17.273464 19643 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.356050 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:17.458976 14899 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.356981 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:17.354948 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:17.243796 14270 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:17.461233 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:17.462155 14894 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:20:17.379766 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 144145us
W20260709 13:20:17.380319 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 143189us
I20260709 13:20:17.380908 14896 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:20:17.463838 14896 pending_rounds.cc:85] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 12
W20260709 13:20:17.463589 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 219848us
I20260709 13:20:17.464210 14896 pending_rounds.cc:107] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:20:17.464540 14896 raft_consensus.cc:2889] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:17.308320 20607 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:17.266546 20143 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:17.370082 20534 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.409548 20652 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:17.379376 20637 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.394232 20593 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:17.394551 20555 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:17.395409 20642 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:17.398880 20650 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:17.385345 20383 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:17.489181 20625 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:17.418180 14895 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:17.420499 14295 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:17.415426 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:17.379679 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:17.460762 14901 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:17.465595 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:20:17.549192 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83717.9us
I20260709 13:20:17.550350 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:17.465188 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:17.553704 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 88568.6us
I20260709 13:20:17.554783 14193 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:17.467118 14900 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
W20260709 13:20:17.467916 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.467916 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.386740 20553 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:17.388150 20643 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:20:17.501639 14220 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:17.371889 20568 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:17.508787 14899 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:17.470330 20633 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:17.566784 20633 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.567679 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1447) took 1038 ms. Trace:
I20260709 13:20:17.379009 20582 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.568145 14898 rpcz_store.cc:276] 0709 13:20:16.529542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.553064 (+ 23522us) service_pool.cc:224] Handling call
0709 13:20:16.570583 (+ 17519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.608990 (+ 38407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.609026 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:16.609529 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:20:16.989635 (+380106us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:16.989692 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.989802 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.567412 (+577610us) raft_consensus.cc:1685] finished
0709 13:20:17.567434 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.567565 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1184,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":38713,"thread_start_us":322627,"threads_started":1,"wal-append.queue_time_us":613042}
I20260709 13:20:17.569352 20633 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:17.458541 20647 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:17.570520 20647 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.571092 20633 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:17.571702 20633 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.572196 20633 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.573109 20647 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:17.496547 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 388371us
I20260709 13:20:17.529259 14894 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:17.497655 20637 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.581699 14267 leader_election.cc:400] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16.
I20260709 13:20:17.607916 14267 leader_election.cc:403] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:17.583963 20520 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:17.611867 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:17.586278 20142 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:17.587005 20639 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.551s	user 0.000s	sys 0.003s
I20260709 13:20:17.587180 20555 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:17.587394 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 56461.4us
I20260709 13:20:17.588044 20499 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:17.589058 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 173705us
W20260709 13:20:17.628417 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 244997us
W20260709 13:20:17.629410 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 165885us
I20260709 13:20:17.589847 20598 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.630659 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:17.593230 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:17.644847 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.595286 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:17.693967 14901 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:17.596838 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:17.695537 14900 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:17.598016 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:17.598904 14268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.026s	sys 0.053s
W20260709 13:20:17.599026 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47014.6us
I20260709 13:20:17.599936 20045 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:17.600358 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:17.604640 20396 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:17.717921 14895 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:20:17.606051 14304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3076) took 2337 ms (client timeout 2013 ms). Trace:
I20260709 13:20:17.609186 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.612716 14892 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:17.614230 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:17.719947 14377 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:17.614547 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:17.720971 14299 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:17.615753 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.502938 20593 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.620563 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:17.470829 19643 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.623699 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.534358 20650 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.622944 14864 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:17.593989 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:17.731842 14894 raft_consensus.cc:606] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:17.732389 14894 raft_consensus.cc:614] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:17.577332 20351 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:17.696653 14268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.026s	sys 0.053s
I20260709 13:20:17.733575 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.623463 20555 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.734246 14295 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:20:17.734344 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:17.725922 14303 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:17.697970 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:17.576928 20553 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.607179 20259 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:17.724542 14222 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:17.620872 20142 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:17.744096 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:17.756399 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 133557us
I20260709 13:20:17.612464 20520 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:17.719105 14304 rpcz_store.cc:269] 0709 13:20:15.268452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.269819 (+  1367us) service_pool.cc:224] Handling call
0709 13:20:17.605693 (+2335874us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54000fcdd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:17.605885 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3944610176}
I20260709 13:20:17.573760 20647 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:17.732805 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 102249us
W20260709 13:20:17.795049 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 97193.6us
I20260709 13:20:17.795848 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:17.796924 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:17.690948 20592 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.698693 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:17.798216 14270 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:17.636463 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:17.637688 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:17.802986 14227 raft_consensus.cc:2368] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 18. Current term is 19.
W20260709 13:20:17.740180 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 185510us
I20260709 13:20:17.747010 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.804941 14295 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
W20260709 13:20:17.722904 20431 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.002s
I20260709 13:20:17.750231 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.717960 14375 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:20:17.761721 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1473) took 1110 ms. Trace:
I20260709 13:20:17.699945 20045 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:17.757535 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:17.792721 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.579543 20199 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:17.748958 20378 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.004s
I20260709 13:20:17.851152 14303 raft_consensus.cc:2368] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16.
I20260709 13:20:17.804044 14193 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:17.730670 20185 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.844812 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:17.740319 20555 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.736981 20650 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.889627 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:17.567737 20568 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:17.746590 20651 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.755234 20383 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:17.876325 14299 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:17.913904 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:17.915261 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:17.810503 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58151us
W20260709 13:20:17.879262 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 140958us
I20260709 13:20:17.755053 20658 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.787606 20536 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.766175 20142 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:17.809187 20620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.034s	sys 0.056s
I20260709 13:20:17.755620 20259 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:17.747229 20582 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:17.897913 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:17.878464 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 249311us
W20260709 13:20:17.860885 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 103419us
I20260709 13:20:17.737001 20682 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:17.850493 20378 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:17.764999 20560 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:17.917351 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:20:17.920509 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 359257us
W20260709 13:20:17.921420 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 117494us
W20260709 13:20:17.921548 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 124693us
W20260709 13:20:17.865809 20638 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:20:17.812268 14376 rpcz_store.cc:276] 0709 13:20:16.651116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.651247 (+   131us) service_pool.cc:224] Handling call
0709 13:20:16.682243 (+ 30996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.682695 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.682727 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:16.683318 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.085941 (+402623us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:17.085984 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.086057 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.761394 (+675337us) raft_consensus.cc:1685] finished
0709 13:20:17.761428 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.761635 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3366,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":376046,"threads_started":1,"wal-append.queue_time_us":581851}
I20260709 13:20:17.841246 20245 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:17.858647 20480 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:17.928735 20283 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.062s	user 0.009s	sys 0.004s
I20260709 13:20:17.747007 20595 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.148s
I20260709 13:20:17.736495 20593 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:17.946101 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 202068us
I20260709 13:20:17.841262 20613 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:20:18.026325 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:17.929028 20569 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:17.620638 20648 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.288s
I20260709 13:20:17.890714 14303 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:17.914091 20396 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:17.950230 20620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.041s	sys 0.056s
I20260709 13:20:18.003708 20317 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:17.972537 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:17.973985 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3049) took 1344 ms. Trace:
I20260709 13:20:17.977028 20582 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:17.947759 20658 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:17.972653 20688 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:17.982592 20661 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:20:17.973539 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 56280.7us
I20260709 13:20:18.070035 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:17.913290 20647 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:17.925457 20665 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:20:17.972757 20560 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:17.992038 20657 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
W20260709 13:20:17.957772 20391 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.012s	user 0.008s	sys 0.003s
W20260709 13:20:17.996260 20374 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.000s
I20260709 13:20:17.969983 20502 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:17.968165 20659 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 13:20:17.998190 19643 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:17.853842 20431 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.022190 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:18.063145 20582 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.907507 20559 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:20:17.941484 20568 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:17.929462 20383 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:17.904150 20185 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.027663 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:17.948338 20536 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.050563 20434 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:20:17.965703 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 67967.8us
I20260709 13:20:18.107352 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:20:18.046006 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80607.3us
I20260709 13:20:18.053828 14229 rpcz_store.cc:276] 0709 13:20:16.629335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.629521 (+   186us) service_pool.cc:224] Handling call
0709 13:20:16.678522 (+ 49001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.209560 (+531038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.209605 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.228040 (+ 18435us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.532612 (+304572us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:17.532675 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.532832 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.973754 (+440922us) raft_consensus.cc:1685] finished
0709 13:20:17.973773 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.973926 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29954,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":675564,"threads_started":2,"wal-append.queue_time_us":537541}
I20260709 13:20:17.930011 20651 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.026994 20654 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:18.037247 20143 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.025892 20694 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:18.048398 20620 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:18.024153 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:18.062438 20351 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.026681 20283 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.065626 20569 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.143990 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:18.094717 20582 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:18.095408 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 73350.9us
I20260709 13:20:18.145629 14865 leader_election.cc:400] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16.
I20260709 13:20:18.146135 14865 leader_election.cc:403] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:18.066187 20396 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:18.069361 20648 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.077591 20647 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.983469 20245 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:18.103814 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 76246.7us
I20260709 13:20:18.169018 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:18.170518 14372 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:18.104236 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 67432.3us
I20260709 13:20:18.104413 14304 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:18.102468 20691 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
W20260709 13:20:18.110594 20660 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.459s	user 0.001s	sys 0.000s
I20260709 13:20:18.178085 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1220) took 1459 ms. Trace:
I20260709 13:20:18.178692 14302 rpcz_store.cc:276] 0709 13:20:16.719106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.719248 (+   142us) service_pool.cc:224] Handling call
0709 13:20:16.719628 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:16.963413 (+243785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.963462 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:16.973421 (+  9959us) log.cc:844] Serialized 52 byte log entry
0709 13:20:17.271622 (+298201us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:17.271669 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.271743 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.177663 (+905920us) raft_consensus.cc:1685] finished
0709 13:20:18.177708 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.177997 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":271343,"raft.queue_time_us":246731,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4228,"thread_start_us":256537,"threads_started":1,"wal-append.queue_time_us":389786}
W20260709 13:20:18.114676 20685 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:20:18.121156 20185 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.068853 20317 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:20:18.091825 20374 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.190200 20374 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:18.122882 20519 consensus_meta.cc:287] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.248s	user 0.007s	sys 0.005s
I20260709 13:20:18.191274 20519 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.123855 20383 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.020617 20045 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.127104 20593 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:18.127749 20536 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.128526 19643 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:18.195910 19643 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:18.196542 19643 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.128836 20378 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.200476 20185 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:18.201299 20185 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.199146 20519 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.181478 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:18.210144 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:18.211282 14302 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:18.212679 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:18.226434 14302 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
W20260709 13:20:18.136842 20533 consensus_meta.cc:287] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.851s	user 0.007s	sys 0.002s
I20260709 13:20:18.038942 20682 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:20:18.085352 20391 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:18.139521 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3255) took 1592 ms. Trace:
I20260709 13:20:18.140221 14369 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:18.145996 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 121958us
I20260709 13:20:18.065218 20480 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.152449 20664 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.162904 20647 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:18.152971 20499 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:18.153527 20504 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.152904 20620 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.154230 20663 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:18.154443 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:18.154773 20652 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.277468 14893 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:18.137872 20559 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:18.155404 20662 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16.
I20260709 13:20:18.155719 20502 raft_consensus.cc:2764] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:18.302019 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3080) took 1581 ms. Trace:
I20260709 13:20:18.155427 20658 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:18.157501 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48853.8us
I20260709 13:20:18.138087 20434 consensus_queue.cc:1243] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:20:18.131090 20684 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:18.221479 20185 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:18.319916 20548 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.436s	user 0.006s	sys 0.009s
I20260709 13:20:18.330937 20431 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.281086 20374 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:20:18.278277 20664 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.334163 20684 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:18.334542 20283 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.334966 20684 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.281325 20504 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.336980 20504 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.338212 20560 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.222565 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:18.342135 14226 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:18.167514 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.140887 20654 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.241166 19643 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:18.249707 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 170592us
I20260709 13:20:18.304867 20663 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.159147 20568 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:18.253680 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:18.254751 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.355760 20607 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:18.356261 20607 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:18.159987 20694 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:18.357810 20694 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.358225 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.247009 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.320595 20391 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:18.226481 20245 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.359786 20391 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:18.360080 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1466) took 1044 ms. Trace:
I20260709 13:20:18.263334 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:18.242746 20533 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.076354 20259 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.240573 20534 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.113667 20650 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.249569 14301 rpcz_store.cc:276] 0709 13:20:16.546846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.603944 (+ 57098us) service_pool.cc:224] Handling call
0709 13:20:16.604248 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.931771 (+327523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.931803 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:16.932302 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.244086 (+311784us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:17.244125 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.244192 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.139220 (+895028us) raft_consensus.cc:1685] finished
0709 13:20:18.139252 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.139436 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":320114,"raft.queue_time_us":350617,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":54,"thread_start_us":307090,"threads_started":1,"wal-append.queue_time_us":562496}
W20260709 13:20:18.289366 20556 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.684s	user 0.016s	sys 0.000s
W20260709 13:20:18.291055 20329 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.062s	user 0.010s	sys 0.001s
I20260709 13:20:18.299618 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:18.372268 14304 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:18.299964 20598 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.000s
I20260709 13:20:18.375093 20650 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.160518 20351 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.376935 20533 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.310940 14300 rpcz_store.cc:276] 0709 13:20:16.720389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.738190 (+ 17801us) service_pool.cc:224] Handling call
0709 13:20:16.738481 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.191019 (+452538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.191052 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.215274 (+ 24222us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.513752 (+298478us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:17.513842 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.513927 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.301755 (+787828us) raft_consensus.cc:1685] finished
0709 13:20:18.301778 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.301956 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142980,"raft.queue_time_us":30891,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":5926,"thread_start_us":750002,"threads_started":2,"wal-append.queue_time_us":1078404}
I20260709 13:20:18.378211 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:18.378973 14300 raft_consensus.cc:2410] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:20:18.379920 14300 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:18.289366 20633 consensus_meta.cc:287] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.717s	user 0.009s	sys 0.002s
W20260709 13:20:18.304615 20385 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.203s	user 0.010s	sys 0.002s
I20260709 13:20:18.382164 20385 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.384191 20385 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.385203 20283 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:18.385712 20283 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.386126 20283 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.386929 20199 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:18.387415 20199 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.388051 20555 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:18.391446 14296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1218) took 1742 ms (client timeout 1909 ms). Trace:
W20260709 13:20:18.391844 14296 rpcz_store.cc:269] 0709 13:20:16.648703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.652402 (+  3699us) service_pool.cc:224] Handling call
0709 13:20:18.391252 (+1738850us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54000910d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:18.391385 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2168947072}
I20260709 13:20:18.393258 14296 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:18.315915 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:18.268728 20651 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.155548 20592 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16.
I20260709 13:20:18.265898 20480 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:18.351153 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 552967us
I20260709 13:20:18.303535 20559 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:18.406013 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:18.407776 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:18.353271 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 130836us
I20260709 13:20:18.354236 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:18.354331 20693 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:18.347815 20396 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.358896 14370 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:18.360582 14893 rpcz_store.cc:276] 0709 13:20:17.315512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.315637 (+   125us) service_pool.cc:224] Handling call
0709 13:20:17.368915 (+ 53278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.277990 (+909075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.359813 (+ 81823us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54007d0354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:18.360011 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088924544}
I20260709 13:20:18.301347 20383 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:20:18.334235 20664 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.311461 20691 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.393988 20329 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.415166 20691 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.365326 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:18.367254 19643 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.369922 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:18.414052 14267 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:18.360812 20391 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.374043 20678 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:18.374550 20679 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.408124 20559 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:18.312711 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 158357us
I20260709 13:20:18.377059 20351 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:18.372781 20534 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.462790 20534 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.394769 14299 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:18.447463 20383 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:18.281483 20499 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.463749 20383 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.464236 20534 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:18.465260 20499 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.466534 20534 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.397511 14300 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:18.396327 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:18.478214 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 81951.6us
I20260709 13:20:18.327893 20142 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.400449 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:18.352061 20654 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.364216 20663 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:18.403262 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 87495.1us
I20260709 13:20:18.487246 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:18.314533 20652 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.381479 20633 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.410043 14270 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:18.410986 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:18.357244 20607 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.401268 20259 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:18.412230 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 58064.9us
I20260709 13:20:18.500943 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:18.399986 20317 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:18.471889 20383 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.510025 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.510732 14378 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:18.511386 20534 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.502099 20317 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.513578 20501 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:18.514086 20501 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:18.515038 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:18.516266 20142 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.516398 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.477047 20533 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.518458 20533 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.519227 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:18.534138 14224 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:18.535555 20385 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:18.536054 20385 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.536441 20385 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:18.539624 20675 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:18.540126 20675 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:18.540558 20675 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:18.425200 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:18.445097 20556 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:18.546203 14370 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:18.485814 20568 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:18.415190 20637 consensus_meta.cc:287] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.793s	user 0.007s	sys 0.004s
I20260709 13:20:18.430119 20480 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.418787 14301 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.561697 20637 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.564221 20637 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.565862 14298 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:18.427170 20647 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.438831 20283 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.431818 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.452508 20678 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:18.417193 20555 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.408267 20431 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:18.433478 20199 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:18.385116 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 121847us
I20260709 13:20:18.452546 20679 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.460131 20582 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:18.467471 20674 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.513s	user 0.004s	sys 0.000s
I20260709 13:20:18.416715 20329 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.469120 20664 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:18.469010 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.583949 14893 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:18.585044 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:18.469682 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.470171 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2812) took 1289 ms. Trace:
I20260709 13:20:18.470252 14899 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:20:18.586243 14894 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:18.586160 14369 rpcz_store.cc:276] 0709 13:20:17.180847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.181078 (+   231us) service_pool.cc:224] Handling call
0709 13:20:18.469988 (+1288910us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b540004ced4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:18.470115 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183848192}
I20260709 13:20:18.397262 14372 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:18.412215 20378 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:18.447047 20693 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.480918 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:18.483755 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.589779 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:18.589970 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:18.490106 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:18.590859 14300 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:18.590485 14899 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.591683 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:18.592142 14300 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:18.592952 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:18.593878 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 113051us
W20260709 13:20:18.491250 20655 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.007s	sys 0.011s
W20260709 13:20:18.496928 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86961.5us
I20260709 13:20:18.498929 20607 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:18.502713 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 91807.8us
I20260709 13:20:18.634639 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:18.505373 14377 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:18.424124 19643 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:18.513715 20317 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.520550 20533 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.495249 20351 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:18.521242 20593 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:18.375149 20598 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:18.523617 20696 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:18.497524 20587 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:20:18.527334 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.648257 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:18.651225 14374 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:18.533460 20633 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.425557 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:18.653215 14223 pending_rounds.cc:85] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 5
I20260709 13:20:18.653357 14371 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.653558 14223 pending_rounds.cc:107] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:20:18.417454 20691 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.548101 14378 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:18.663803 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.647799 20696 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:18.664453 14378 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:20:18.665409 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.551232 20684 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.666827 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.667573 14378 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:20:18.667755 20684 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:18.553651 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:18.668481 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.668807 14864 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:18.669183 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:18.670651 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:18.671494 14296 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:18.555081 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.556813 20704 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:18.556948 20434 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:18.672402 14898 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:18.547009 20391 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.672487 20704 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.673378 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:18.558355 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.674002 14898 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.561134 20652 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:18.569154 20677 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.466s	user 0.002s	sys 0.000s
I20260709 13:20:18.570309 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:18.676231 14303 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 19: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:18.676762 20704 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.677115 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:18.678367 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:18.679136 14303 raft_consensus.cc:2410] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:18.546815 20142 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:18.679772 20045 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.422676 20245 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.682096 20245 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.558463 20568 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.682868 20568 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:18.572499 14301 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:18.573383 14373 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:18.687076 14299 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:20:18.687450 14373 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:18.688499 14299 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:18.688802 14373 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:18.673467 20391 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.576655 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:18.691006 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 114433us
I20260709 13:20:18.692247 20391 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.680117 20142 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.694214 20142 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:18.696234 20548 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:18.579738 20694 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:18.580811 20283 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.697007 20548 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:18.697461 20283 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:18.698376 20283 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.699048 20143 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:18.581313 20199 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:18.581900 20431 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:18.700420 20385 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.700927 20431 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.703145 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2686) took 1455 ms. Trace:
I20260709 13:20:18.703512 14226 rpcz_store.cc:276] 0709 13:20:17.247241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.248774 (+  1533us) service_pool.cc:224] Handling call
0709 13:20:18.702980 (+1454206us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b540033e354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:18.703087 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227791616}
I20260709 13:20:18.582309 20654 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.585843 14893 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:18.587873 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:18.730146 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72978.7us
I20260709 13:20:18.730762 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.731897 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:18.729772 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 81606.2us
I20260709 13:20:18.589421 14376 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:18.595330 20582 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.595196 20678 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.602432 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.742575 14900 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:18.602717 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:18.603268 20383 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:18.604094 20673 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.529s	user 0.001s	sys 0.001s
I20260709 13:20:18.604693 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.750286 14895 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:18.750765 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.607378 20693 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.608044 20664 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.515038 20501 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.612274 14894 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:18.618834 14300 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:18.753731 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.754489 14894 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:18.754848 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:18.755997 14300 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:18.757483 14300 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:20:18.621620 14295 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:18.625315 20671 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:18.629575 14227 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:18.631071 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.632450 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:18.637542 19643 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:18.638677 14899 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:18.638962 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:18.644050 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.644599 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:18.644122 14377 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:18.698925 20548 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.645020 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:18.632148 20655 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.007s	sys 0.014s
I20260709 13:20:18.649296 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:18.649706 14222 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:18.651913 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:18.653894 14223 raft_consensus.cc:2889] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:18.785476 14224 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:18.655180 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.662056 14897 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:18.664991 20696 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.549625 20556 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.556784 20675 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.707631 14867 leader_election.cc:400] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 18. Current term is 19.
W20260709 13:20:18.804633 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 97189.5us
I20260709 13:20:18.749620 20383 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.733611 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:18.811797 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 78254us
I20260709 13:20:18.813313 14865 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:18.737639 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:18.814589 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 77036.4us
I20260709 13:20:18.816495 14342 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:18.818288 20690 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:18.818876 20690 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.819322 20690 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.822172 20620 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:18.770349 20681 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.785372 20694 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.747682 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:18.748013 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.748893 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:18.748991 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 80212.1us
I20260709 13:20:18.621447 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3091) took 1412 ms. Trace:
I20260709 13:20:18.835693 14298 rpcz_store.cc:276] 0709 13:20:17.209125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.313956 (+104831us) service_pool.cc:224] Handling call
0709 13:20:17.609014 (+295058us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:20:18.621207 (+1012193us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540022ddd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:18.621376 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982431360}
I20260709 13:20:18.772763 14302 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:18.764029 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:18.770885 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 64463.7us
I20260709 13:20:18.787149 20671 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:18.782387 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.772629 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:18.798540 20647 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.699791 20143 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.730190 20651 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.734870 20396 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:18.788440 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 156099us
I20260709 13:20:18.788571 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.878172 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.789690 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:18.879470 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:18.879892 20718 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:20:18.880429 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:18.771548 20385 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.882992 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1481) took 1248 ms. Trace:
I20260709 13:20:18.883749 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:18.879472 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:18.884644 14899 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:18.885326 14304 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:20:18.797421 20693 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:18.885445 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:18.886040 20693 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.886376 14899 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:18.886579 20693 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:18.886945 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:18.887320 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:18.881596 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:18.798151 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.791472 20692 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.890121 14374 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:18.890198 20692 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.891405 14304 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:18.742086 20663 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.798774 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:18.892575 14224 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:20:18.893174 20045 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:18.893585 20663 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:18.893591 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:18.782387 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:18.895104 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:18.895853 14300 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:18.896442 20553 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:18.896876 20555 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:18.897308 14300 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:20:18.800100 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.897975 20392 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:18.898415 20392 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:18.786211 20652 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:18.833369 20533 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.835206 14375 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.771312 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:18.842985 14901 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:18.823477 20571 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:18.845140 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:18.845830 14373 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:18.804131 20556 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.847859 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:18.935847 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:18.784123 19643 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:18.846967 14892 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:18.771056 20633 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:20:18.844753 20502 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:20:18.834406 20620 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.848150 20694 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.869894 20593 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:18.848011 20681 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.824467 20383 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.838716 20259 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:20:18.877213 20651 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.897028 20283 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:18.897604 20555 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:18.758355 20691 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.588148 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:18.899832 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46079.8us
I20260709 13:20:18.899941 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:18.897780 14300 pending_rounds.cc:85] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 15
I20260709 13:20:18.896458 14867 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:18.899827 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:18.899777 14378 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:18.904183 14371 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:18.856151 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:18.891366 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:19.004745 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 104904us
W20260709 13:20:19.005865 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 109509us
I20260709 13:20:18.744961 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:18.915239 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.883388 14220 rpcz_store.cc:276] 0709 13:20:17.634748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.634940 (+   192us) service_pool.cc:224] Handling call
0709 13:20:18.606260 (+971320us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67eee 0000000000375939 00007f8df1fdb1e0 00007f8df20a40c4 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:20:18.606440 (+   180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.606832 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:18.606862 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.607308 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.648891 (+ 41583us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:18.648940 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.649007 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.882681 (+233674us) raft_consensus.cc:1685] finished
0709 13:20:18.882702 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.882924 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3187,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":6522240,"thread_start_us":41181,"threads_started":1,"wal-append.queue_time_us":164160}
I20260709 13:20:18.929083 14296 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:18.846976 20391 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:18.929744 14893 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.931345 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3081) took 2190 ms. Trace:
W20260709 13:20:18.933372 14342 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.130:44127 timed out after 1.743s (SENT) [suppressed 12 similar messages]
I20260709 13:20:18.938320 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.958909 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1231) took 1304 ms. Trace:
I20260709 13:20:19.015345 14302 rpcz_store.cc:276] 0709 13:20:17.654235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.253409 (+599174us) service_pool.cc:224] Handling call
0709 13:20:18.958622 (+705213us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54000901d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:18.958827 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958291712}
I20260709 13:20:18.909861 20652 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.966749 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:19.025324 14369 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:19.025221 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:18.943040 20666 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:20:19.044838 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:18.939815 20663 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.994547 14224 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:18.995527 14894 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:20:18.999835 20716 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:20:19.001058 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 412962us
I20260709 13:20:19.001588 14300 pending_rounds.cc:107] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:20:19.014394 14297 rpcz_store.cc:276] 0709 13:20:16.720757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.740723 (+ 19966us) service_pool.cc:224] Handling call
0709 13:20:16.741087 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.964180 (+223093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.964212 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.128107 (+163895us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b2c00000e98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb985a11 00007f8deb995372 00007f8ded0c7a01 00007f8ded08c43a 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2
0709 13:20:17.136773 (+  8666us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.531734 (+394961us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:17.531776 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.531844 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.603404 (+1071560us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:18.911096 (+307692us) raft_consensus.cc:1685] finished
0709 13:20:18.911127 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.911341 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":242751,"raft.queue_time_us":230562,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12034,"spinlock_wait_cycles":27481216,"thread_start_us":288551,"threads_started":1,"wal-append.queue_time_us":815436}
I20260709 13:20:19.068614 14300 raft_consensus.cc:2889] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:19.017732 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:19.019079 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 274233us
I20260709 13:20:19.070533 14192 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:19.073128 20283 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:19.073817 20283 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:19.045310 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.978597 14892 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:19.025238 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:19.026571 19643 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:19.026233 14371 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:19.057637 14229 raft_consensus.cc:2410] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:19.059458 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:18.856732 20520 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.935408 20533 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:18.977421 14377 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:18.899391 20392 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:19.014001 20391 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.981972 20499 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:20:19.075841 20143 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:19.065111 14228 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:19.168009 14298 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:19.097280 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:19.079042 14892 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
W20260709 13:20:19.170162 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 97029.9us
I20260709 13:20:19.080716 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:19.046234 20464 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:19.089749 14893 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:19.016697 20557 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:19.091331 14302 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:19.172104 14370 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:19.256604 14371 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:18.985256 20620 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.014730 20691 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:19.069593 20719 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.230s	user 0.000s	sys 0.003s
I20260709 13:20:19.266930 19643 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:19.290817 14896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.015s	sys 0.051s
I20260709 13:20:19.024557 20199 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:19.304494 14296 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:18.982583 20671 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.306162 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:19.274734 20378 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.264114 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:19.517942 14896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.015s	sys 0.051s
W20260709 13:20:19.482548 14897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1452) took 1886 ms (client timeout 1799 ms). Trace:
W20260709 13:20:19.526599 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 262591us
I20260709 13:20:19.526846 14228 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:19.165426 20283 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:19.489754 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:19.491802 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.484774 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:19.483193 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2666) took 1084 ms. Trace:
I20260709 13:20:19.319046 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:19.044711 20652 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:19.309541 20520 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:19.516827 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 583431us
I20260709 13:20:19.527973 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:19.532915 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:19.433180 14898 consensus_meta.cc:287] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.002s
W20260709 13:20:19.490610 20720 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:20:19.508967 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 444117us
I20260709 13:20:19.167770 20650 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:19.526724 14897 rpcz_store.cc:269] 0709 13:20:17.596336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.597588 (+  1252us) service_pool.cc:224] Handling call
0709 13:20:19.482252 (+1884664us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b540041d7d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:19.482418 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220056320}
I20260709 13:20:19.302692 20675 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:19.077178 20555 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:19.294324 20392 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:19.473663 20559 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.015s	user 0.007s	sys 0.003s
I20260709 13:20:19.172964 14369 raft_consensus.cc:2410] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:20:19.512116 20548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.002s	sys 0.014s
W20260709 13:20:19.483572 20693 consensus_meta.cc:287] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.000s
I20260709 13:20:19.539114 14898 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
W20260709 13:20:19.521914 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 441252us
I20260709 13:20:19.307590 20391 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:19.422083 20678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.019s	sys 0.057s
I20260709 13:20:19.344465 20654 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:19.487289 20664 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:19.466293 20045 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.602715 20678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.025s	sys 0.057s
I20260709 13:20:19.542006 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1458) took 1071 ms. Trace:
I20260709 13:20:19.532656 14376 rpcz_store.cc:276] 0709 13:20:18.398888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.399051 (+   163us) service_pool.cc:224] Handling call
0709 13:20:19.482966 (+1083915us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540025a8d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:19.483129 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406400384}
I20260709 13:20:19.583957 20682 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:19.433384 20598 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:19.445438 20692 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:19.471706 20681 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:19.449666 20655 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:19.546564 14229 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:19.544070 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:19.547802 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:19.560283 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:19.639183 14894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.013s	sys 0.005s
W20260709 13:20:19.583838 14295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3265) took 1826 ms (client timeout 1743 ms). Trace:
W20260709 13:20:19.639683 14295 rpcz_store.cc:269] 0709 13:20:17.757185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.844452 (+ 87267us) service_pool.cc:224] Handling call
0709 13:20:19.583577 (+1739125us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400333954. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:19.583742 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723577216}
I20260709 13:20:19.534204 20143 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:19.531589 20385 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:19.600150 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3101) took 1117 ms. Trace:
W20260709 13:20:19.644534 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 96850.8us
I20260709 13:20:19.531251 20725 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:20:19.533181 20557 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:19.669770 20557 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:19.683961 20587 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:19.685022 20431 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:19.686250 20587 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:19.686650 20587 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:19.687454 20587 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:19.690003 20385 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:19.691066 20385 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:19.693778 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3060) took 1052 ms. Trace:
I20260709 13:20:19.694248 14223 rpcz_store.cc:276] 0709 13:20:18.641149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.650795 (+  9646us) service_pool.cc:224] Handling call
0709 13:20:18.653017 (+  2222us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:18.807994 (+154977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.808030 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:18.808700 (+   670us) log.cc:844] Serialized 52 byte log entry
0709 13:20:19.302242 (+493542us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:19.444145 (+141903us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.511526 (+ 67381us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.511857 (+   331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.511961 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.693517 (+181556us) raft_consensus.cc:1685] finished
0709 13:20:19.693542 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.693713 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87902,"prepare.queue_time_us":103703,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":81901,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":18790,"spinlock_wait_cycles":36473856,"thread_start_us":493018,"threads_started":1,"wal-append.queue_time_us":735667}
I20260709 13:20:19.696650 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:19.643704 20143 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.698580 20143 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:19.706058 20679 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:19.604045 14375 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.004s
I20260709 13:20:19.706825 14375 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
W20260709 13:20:19.604316 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.016s	sys 0.062s
I20260709 13:20:19.543282 20728 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:19.707669 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.016s	sys 0.063s
I20260709 13:20:19.608413 14896 rpcz_store.cc:276] 0709 13:20:18.470359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.470469 (+   110us) service_pool.cc:224] Handling call
0709 13:20:18.470745 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.471034 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:18.729423 (+258389us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.541573 (+812150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.541644 (+    71us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:19.541704 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.541801 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.541938 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11865,"prepare.queue_time_us":299972,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":62257,"thread_start_us":1054876,"threads_started":2,"wal-append.queue_time_us":805873}
W20260709 13:20:19.708015 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 806510us
I20260709 13:20:19.491429 20696 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:19.710577 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:19.711831 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:19.523170 20199 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:19.641124 14894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.014s	sys 0.006s
W20260709 13:20:19.608645 20719 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:19.544718 20650 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:19.537263 20378 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.642442 14228 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 15: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:19.613951 20142 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.919s	user 0.012s	sys 0.000s
I20260709 13:20:19.644160 14298 rpcz_store.cc:276] 0709 13:20:18.482438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.914435 (+431997us) service_pool.cc:224] Handling call
0709 13:20:18.947103 (+ 32668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.259832 (+312729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.599770 (+339938us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54002c01d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:19.600056 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507528576}
I20260709 13:20:19.601447 20693 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:19.646670 20655 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.647331 20692 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:19.616412 20598 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.651760 14301 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:19.741247 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3095) took 1592 ms. Trace:
I20260709 13:20:19.741596 14301 rpcz_store.cc:276] 0709 13:20:18.149284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.686361 (+537077us) service_pool.cc:224] Handling call
0709 13:20:19.651387 (+965026us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67eee 0000000000375939 00007f8df1fdb1e0 00007f8df20a40c4 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:20:19.651563 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.741000 (+ 89437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.741189 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63391104}
I20260709 13:20:19.658424 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:19.659664 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1472) took 1020 ms. Trace:
I20260709 13:20:19.608106 20045 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.614624 20533 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:19.661847 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:19.750559 14226 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:19.662348 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:19.663173 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:19.664172 20727 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:20:19.714880 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:19.715730 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:19.717962 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.753759 14299 raft_consensus.cc:2393] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:19.754496 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:19.756161 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:19.722167 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:19.712771 20199 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:19.731878 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.589695 20559 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.540535 20651 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:19.660472 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1483) took 1014 ms. Trace:
I20260709 13:20:19.743836 14899 rpcz_store.cc:276] 0709 13:20:18.638806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.888417 (+249611us) service_pool.cc:224] Handling call
0709 13:20:18.937613 (+ 49196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.937844 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.937879 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:18.937939 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:18.937977 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.938054 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.659475 (+721421us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b5400883bd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:19.659603 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112315648}
I20260709 13:20:19.749035 14302 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:20:19.728371 20664 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:19.718530 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:19.756273 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:19.757196 14896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:19.738950 20652 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.758360 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:19.759428 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:19.760973 20655 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:19.743295 20598 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:19.776969 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:19.794471 14300 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:19.850464 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.855074 14893 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:19.853942 14378 rpcz_store.cc:276] 0709 13:20:18.646448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.668247 (+ 21799us) service_pool.cc:224] Handling call
0709 13:20:19.660305 (+992058us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b540027a6d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:19.660414 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529637120}
I20260709 13:20:19.766227 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:19.835983 14867 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:19.803828 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:19.853504 14897 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:19.876317 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72639.6us
I20260709 13:20:19.856127 14896 raft_consensus.cc:606] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
W20260709 13:20:19.876555 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 120499us
I20260709 13:20:19.825414 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:19.769538 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:19.877908 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:19.862089 14223 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:19.778944 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:19.785506 20383 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.001s
I20260709 13:20:19.881381 20663 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:19.891157 14895 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.006s	sys 0.018s
W20260709 13:20:19.891633 14895 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.006s	sys 0.018s
I20260709 13:20:19.826231 20571 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.787664 20045 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:19.789247 20693 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:19.782588 20691 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:19.795414 20593 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:20:19.872632 20690 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.053s	user 0.012s	sys 0.001s
I20260709 13:20:19.938328 20690 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:19.940616 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:19.941206 20690 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:19.892764 14227 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:19.823974 20650 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:19.831645 20552 raft_consensus.cc:3055] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:19.871670 20664 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.941586 14301 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:19.942405 14372 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:19.950408 14193 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:19.950735 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:19.769052 20464 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:19.893342 14866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.019s	sys 0.105s
W20260709 13:20:19.955353 14866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.019s	sys 0.105s
I20260709 13:20:19.883299 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3063) took 1230 ms. Trace:
I20260709 13:20:19.956269 14224 rpcz_store.cc:276] 0709 13:20:18.654529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.882264 (+1227735us) service_pool.cc:224] Handling call
0709 13:20:19.882642 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.882864 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.882905 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.882978 (+    73us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:19.883028 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.883102 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.883231 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.910938 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:19.764483 20378 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:19.822654 20553 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.916335 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2698) took 1030 ms. Trace:
I20260709 13:20:19.963431 14229 rpcz_store.cc:276] 0709 13:20:18.885542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.484394 (+598852us) service_pool.cc:224] Handling call
0709 13:20:19.916121 (+431727us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b540026e3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:19.916268 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18807552}
I20260709 13:20:19.776259 20694 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:19.917706 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1473) took 1278 ms. Trace:
I20260709 13:20:19.881484 20728 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:19.887240 20651 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:20:19.918994 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:19.920425 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3064) took 1264 ms. Trace:
I20260709 13:20:19.856786 20633 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:19.926455 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:19.928391 20620 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:19.929757 20707 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:19.931860 20568 consensus_meta.cc:287] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.248s	user 0.012s	sys 0.000s
I20260709 13:20:19.740612 20142 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.975878 20553 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.002209 20728 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:20.010197 20142 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:19.932364 20692 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:20.010385 20728 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.934391 20045 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:19.910356 20548 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
W20260709 13:20:19.953963 14297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.033s	sys 0.021s
I20260709 13:20:19.957669 14226 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
W20260709 13:20:20.012118 14297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.034s	sys 0.021s
I20260709 13:20:20.012331 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1491) took 1306 ms. Trace:
I20260709 13:20:19.946201 20571 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.964630 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:20.015528 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:20.015899 14220 raft_consensus.cc:2410] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:20:20.016144 14222 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:19.965567 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:20.016942 14301 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:19.761648 20283 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:19.965375 14900 rpcz_store.cc:276] 0709 13:20:18.639142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.898463 (+259321us) service_pool.cc:224] Handling call
0709 13:20:18.898846 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.998632 (+ 99786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.998676 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.000406 (+  1730us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.534772 (+534366us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:19.534825 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.534911 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.917470 (+382559us) raft_consensus.cc:1685] finished
0709 13:20:19.917492 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.917643 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14385,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":10351,"thread_start_us":457238,"threads_started":2,"wal-append.queue_time_us":865067}
I20260709 13:20:19.971648 14228 rpcz_store.cc:276] 0709 13:20:18.655910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.887863 (+1231953us) service_pool.cc:224] Handling call
0709 13:20:19.919882 (+ 32019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.920085 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.920115 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.920162 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:19.920199 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.920257 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.920368 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.976336 20651 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:20.019091 14897 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:19.976123 20633 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.947669 20391 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.031247 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:19.977813 20501 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:19.979538 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2691) took 1096 ms. Trace:
I20260709 13:20:19.982156 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
W20260709 13:20:19.982372 20724 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.390s	user 0.005s	sys 0.000s
I20260709 13:20:19.983269 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:20.047924 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:20.049208 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:19.954245 20552 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:20.050457 20552 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.051832 20552 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.055706 20283 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.057025 20571 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:20.058826 20664 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.059139 20633 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.059958 20553 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.062043 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:20.062912 14295 raft_consensus.cc:2393] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:20.063863 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:20.064687 14295 raft_consensus.cc:2410] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:20:19.992856 20598 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.012910 20568 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:19.987151 20652 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:19.990403 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 2819) took 1281 ms. Trace:
I20260709 13:20:20.019014 20651 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:19.991389 20556 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.027s	user 0.012s	sys 0.000s
I20260709 13:20:19.992599 20559 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:19.997301 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:20.085062 14229 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:19.894588 20679 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:20:20.086153 20679 consensus_queue.cc:1243] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:20.086692 20553 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:20.086918 14901 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:20:20.087073 20553 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:20.005419 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:19.963136 20650 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:20.007566 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:20.012738 14226 rpcz_store.cc:276] 0709 13:20:18.705442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.881808 (+1176366us) service_pool.cc:224] Handling call
0709 13:20:20.012265 (+130457us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:20.013447 14304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.018s	sys 0.059s
W20260709 13:20:20.095230 14304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.018s	sys 0.059s
I20260709 13:20:19.965211 20663 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:20.016291 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1488) took 1319 ms. Trace:
I20260709 13:20:19.890964 20383 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:20.110523 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:19.976001 20143 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:19.954557 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:20.006321 20317 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.046106 14893 raft_consensus.cc:606] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:20.113726 14893 raft_consensus.cc:614] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:20.111083 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1492) took 1405 ms. Trace:
I20260709 13:20:20.045902 14227 rpcz_store.cc:276] 0709 13:20:18.883496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.658150 (+774654us) service_pool.cc:224] Handling call
0709 13:20:19.979326 (+321176us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540019afd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:19.979472 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342918016}
I20260709 13:20:20.114264 14229 rpcz_store.cc:276] 0709 13:20:18.705674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.110222 (+1404548us) service_pool.cc:224] Handling call
0709 13:20:20.110591 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.110773 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.110796 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.110835 (+    39us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:20.110868 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.110919 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.111030 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62080}
I20260709 13:20:20.067638 14295 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:20.110272 20571 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:19.986124 20199 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:20.068181 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3276) took 1318 ms. Trace:
I20260709 13:20:20.120514 14300 rpcz_store.cc:276] 0709 13:20:18.749843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.269441 (+519598us) service_pool.cc:224] Handling call
0709 13:20:19.297339 (+ 27898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.877272 (+579933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.067960 (+190688us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54001a1154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:20.068122 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142634240}
I20260709 13:20:20.020375 20392 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:20.075062 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1490) took 1369 ms. Trace:
I20260709 13:20:20.125555 14222 rpcz_store.cc:276] 0709 13:20:18.705186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.019991 (+1314805us) service_pool.cc:224] Handling call
0709 13:20:20.067226 (+ 47235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.074545 (+  7319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.074595 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.074659 (+    64us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:20.074709 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.074794 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.074983 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:20.125581 14864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.033s	user 0.001s	sys 0.026s
W20260709 13:20:20.127152 14864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.002s	sys 0.027s
W20260709 13:20:20.135022 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 1.11729e+06us
I20260709 13:20:20.079735 14372 rpcz_store.cc:276] 0709 13:20:18.709186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.879190 (+170004us) service_pool.cc:224] Handling call
0709 13:20:19.990197 (+1111007us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003c3cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:19.990334 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2442263936}
I20260709 13:20:20.022321 20728 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.088811 20553 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:20.146234 20143 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.066310 20707 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:20.090314 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1380) took 1330 ms. Trace:
I20260709 13:20:20.178460 14894 rpcz_store.cc:276] 0709 13:20:18.759956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.063444 (+303488us) service_pool.cc:224] Handling call
0709 13:20:19.076146 (+ 12702us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.076407 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:19.076435 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.076990 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.713564 (+636574us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:19.713621 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.713713 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.090048 (+376335us) raft_consensus.cc:1685] finished
0709 13:20:20.090077 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.090247 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":636127,"threads_started":1,"wal-append.queue_time_us":943077}
I20260709 13:20:20.013736 14299 raft_consensus.cc:2368] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
W20260709 13:20:20.182739 14374 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.014s	sys 0.008s
W20260709 13:20:20.183238 14374 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.014s	sys 0.008s
I20260709 13:20:20.100440 14224 rpcz_store.cc:276] 0709 13:20:18.696700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.015520 (+1318820us) service_pool.cc:224] Handling call
0709 13:20:20.015806 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.015988 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.016012 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.016052 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:20.016080 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.016138 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.016240 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:20.101897 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 94458.3us
I20260709 13:20:20.185712 20520 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:20.186223 20520 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:20.187148 20520 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:20.188370 20520 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:20.102581 14221 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:20.104688 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1474) took 1465 ms. Trace:
I20260709 13:20:20.190193 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:20.111994 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2700) took 1219 ms. Trace:
I20260709 13:20:20.120561 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:20.127699 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2707) took 1232 ms. Trace:
I20260709 13:20:20.191407 14220 rpcz_store.cc:276] 0709 13:20:18.892719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.645984 (+753265us) service_pool.cc:224] Handling call
0709 13:20:20.105576 (+459592us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b540033d454. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:20.111918 (+  6342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697057024}
I20260709 13:20:20.191884 14222 rpcz_store.cc:276] 0709 13:20:18.895720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.126627 (+1230907us) service_pool.cc:224] Handling call
0709 13:20:20.127001 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.127241 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.127277 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.127332 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:20.127388 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.127475 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.127624 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:20.192883 14865 leader_election.cc:400] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:20.193198 14865 leader_election.cc:403] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:20:20.081246 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:20.094319 20650 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.190481 14901 rpcz_store.cc:276] 0709 13:20:18.639464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.949738 (+310274us) service_pool.cc:224] Handling call
0709 13:20:18.950690 (+   952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.087395 (+1136705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.104276 (+ 16881us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540066dad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:20.104600 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2613516416}
I20260709 13:20:20.125391 20392 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:20.135633 14225 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:20.142223 14298 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
W20260709 13:20:20.082243 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.015s	sys 0.008s
I20260709 13:20:20.125078 20317 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.134790 20651 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.084376 20556 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:20.146848 20553 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:20.111562 20663 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.215937 20598 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.197153 20650 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:20.216620 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3273) took 1480 ms. Trace:
W20260709 13:20:20.199627 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.016s	sys 0.009s
I20260709 13:20:20.143759 14303 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:20.201723 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:20.206281 14220 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:20.221765 14223 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:20:20.208679 14901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:20.222694 14901 raft_consensus.cc:606] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:20.177610 20707 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.211848 14228 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:20.208264 20571 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:20.218227 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.004s	sys 0.032s
I20260709 13:20:20.219574 14297 rpcz_store.cc:276] 0709 13:20:18.736181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.068855 (+332674us) service_pool.cc:224] Handling call
0709 13:20:19.069238 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.069487 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.069516 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.276171 (+206655us) log.cc:844] Serialized 26 byte log entry
0709 13:20:20.012700 (+736529us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:20.012771 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.012848 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.216381 (+203533us) raft_consensus.cc:1685] finished
0709 13:20:20.216407 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.216547 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":590247,"threads_started":1,"wal-append.queue_time_us":847351}
W20260709 13:20:20.229116 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.004s	sys 0.032s
I20260709 13:20:20.229861 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:20.230335 14341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.006s	sys 0.012s
W20260709 13:20:20.230772 14341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.006s	sys 0.012s
I20260709 13:20:20.231369 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:20.231895 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 703952us
W20260709 13:20:20.201087 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.223058 14901 raft_consensus.cc:614] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:20.228009 14270 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:20.232021 14297 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.223047 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:20.227782 20738 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.234208 20738 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.224014 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:20.225286 14343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.021s	sys 0.027s
W20260709 13:20:20.242586 14343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.021s	sys 0.027s
I20260709 13:20:20.233220 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:20.254770 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.254638 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:20.258258 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:20.270124 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:20.273365 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3057) took 1643 ms. Trace:
I20260709 13:20:20.274008 14221 rpcz_store.cc:276] 0709 13:20:18.630140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.630264 (+   124us) service_pool.cc:224] Handling call
0709 13:20:18.630565 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.189706 (+1559141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.273006 (+ 83300us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400082354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:20.273278 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3384803200}
W20260709 13:20:20.287526 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.288218 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.262166 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:20.239509 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:20.225006 20245 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:20.310504 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.298645 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 3061) took 1657 ms. Trace:
I20260709 13:20:20.311811 14225 rpcz_store.cc:276] 0709 13:20:18.641586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.642777 (+  1191us) service_pool.cc:224] Handling call
0709 13:20:20.298418 (+1655641us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540011fdd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:20.298580 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3095931648}
I20260709 13:20:20.299953 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:20.313402 14298 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:20.313449 14378 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:20.227684 20559 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.086s
W20260709 13:20:20.320380 14267 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.015s	sys 0.026s
I20260709 13:20:20.225311 20142 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.228384 20651 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:20.228152 20707 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:20.314524 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2699) took 1422 ms. Trace:
I20260709 13:20:20.326831 20671 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:20.341976 14223 rpcz_store.cc:276] 0709 13:20:18.892411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.119694 (+1227283us) service_pool.cc:224] Handling call
0709 13:20:20.136581 (+ 16887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.222334 (+ 85753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.306464 (+ 84130us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b540026cad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:20.314464 (+  8000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185821440}
I20260709 13:20:20.316262 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:20.343353 14375 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.345484 20693 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.317209 14894 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:20.302851 14303 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:20.305050 20283 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:20.322752 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 60833.9us
I20260709 13:20:20.239684 20738 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.237937 20392 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:20.348959 20392 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:20.349185 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:20.350759 20730 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:20.352754 20199 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.267273 20679 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:20.353911 20679 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:20.356492 20679 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.358071 20378 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:20.358538 20378 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:20.358932 20378 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:20.360596 14375 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:20.361994 20730 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.362658 20730 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.331552 20502 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:20.367285 20391 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.333477 20620 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:20.311302 20633 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:20.368471 20620 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.309715 20245 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.370085 20245 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:20.370797 20620 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.314580 20694 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:20.377175 14370 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:20.377430 20694 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:20.378358 20556 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:20.378681 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:20.379698 20694 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.371706 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:20.371837 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:20.381970 14371 raft_consensus.cc:2393] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:20.382118 20045 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:20.314818 20690 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.382825 20663 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:20.323647 14267 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.015s	sys 0.026s
I20260709 13:20:20.241025 20143 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:20.327359 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 87929.4us
I20260709 13:20:20.315382 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:20.297148 20692 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.267181 20728 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.299134 20598 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.336319 20142 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.336830 14297 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:20.316860 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:20.346297 20693 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.326799 20675 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.327647 20593 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.382648 20045 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:20.371387 14377 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:20.383522 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 781244us
I20260709 13:20:20.334332 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:20.441636 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:20.417304 20557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.013s
W20260709 13:20:20.323365 14296 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.003s	sys 0.017s
W20260709 13:20:20.450343 14296 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.004s	sys 0.017s
I20260709 13:20:20.387518 14270 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:20.452001 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64559.1us
I20260709 13:20:20.453058 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:20.390256 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 74956.5us
I20260709 13:20:20.391094 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:20.396412 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.029s	sys 0.026s
W20260709 13:20:20.454172 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.029s	sys 0.026s
W20260709 13:20:20.454535 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 787642us
W20260709 13:20:20.408638 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 91841.9us
W20260709 13:20:20.422883 14344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.010s	sys 0.047s
W20260709 13:20:20.455513 14344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.010s	sys 0.047s
I20260709 13:20:20.422814 14223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e531770baa044bc49820df7e47c608eb"
dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:56160
I20260709 13:20:20.442693 14369 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:20.458191 14223 raft_consensus.cc:606] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:20.443593 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:20.385136 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1475) took 1745 ms. Trace:
I20260709 13:20:20.444691 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:20.445650 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:20.328292 20742 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:20.458576 14223 raft_consensus.cc:614] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:20.426389 20647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.006s	sys 0.015s
W20260709 13:20:20.463174 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.466022 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:20.468425 14896 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:20.470383 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:20.479749 14192 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:20.462776 14901 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:20.473114 14270 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:20.416986 20559 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:20.482266 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:20.480268 14373 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:20.459478 14895 rpcz_store.cc:276] 0709 13:20:18.639771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.949806 (+310035us) service_pool.cc:224] Handling call
0709 13:20:18.950225 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:18.951608 (+  1383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.951658 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:18.954953 (+  3295us) log.cc:844] Serialized 52 byte log entry
0709 13:20:19.892040 (+937087us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:20.268073 (+376033us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.268391 (+   318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.268494 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.384847 (+116353us) raft_consensus.cc:1685] finished
0709 13:20:20.384865 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.385057 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":947,"raft.queue_time_us":456738,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":30277,"thread_start_us":1154472,"threads_started":2,"wal-append.queue_time_us":1220935}
I20260709 13:20:20.475598 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:20.476689 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.418213 20663 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.479861 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:20.481230 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:20.488289 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.481135 14893 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:20.497344 14899 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:20.497502 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:20.493109 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:20.474824 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:20.499421 14371 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:20.481743 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:20.484030 14301 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:20.479911 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:20.422322 20143 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:20.500613 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:20.501111 14896 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:20.478614 20647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.006s	sys 0.016s
I20260709 13:20:20.447456 20696 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:20.434576 20568 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.502477 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:20.522648 14898 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:20.382902 20690 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.474327 20199 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:20.466356 20557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.008s	sys 0.013s
W20260709 13:20:20.506039 20681 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.008s	sys 0.023s
I20260709 13:20:20.506160 20559 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:20.474172 20738 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:20.513147 14899 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:20.509188 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:20.633872 14896 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:20.431125 20598 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.424464 20728 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.424556 20692 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.483744 20741 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:20.497897 20499 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.447057 20675 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.538205 14224 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:20:20.652647 14224 pending_rounds.cc:85] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 11
I20260709 13:20:20.652946 14224 pending_rounds.cc:107] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:20:20.653306 14224 raft_consensus.cc:2889] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:20.525274 20696 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:20.526412 20620 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:20:20.539139 20199 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:20.539892 20143 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.559630 20142 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.561499 20045 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:20.575305 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.578909 20693 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.579799 20396 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:20.679390 14895 raft_consensus.cc:2410] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:20:20.582792 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:20.641709 20557 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:20:20.590075 20568 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.482045 20742 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.586056 20664 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:20.602908 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:20.606591 20652 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:20.607285 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:20.607900 20431 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:20.610637 14375 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:20.703893 14223 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:20.577129 20245 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.533144 14373 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:20.622241 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:20.484159 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:20.716732 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 232635us
I20260709 13:20:20.718478 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:20.474421 20593 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.569216 20650 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:20.614368 20500 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.505018 20663 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.463642 20707 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:20.624472 20681 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.008s	sys 0.024s
W20260709 13:20:20.655428 14302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.006s	sys 0.034s
W20260709 13:20:20.620764 20691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.011s	sys 0.020s
I20260709 13:20:20.678260 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:20.580351 20678 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:20.588177 20690 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.694231 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:20.765491 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 71397us
I20260709 13:20:20.766166 14375 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:20.697863 14376 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:20.699390 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.699920 14304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.011s	sys 0.006s
W20260709 13:20:20.702349 14227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.026s	sys 0.027s
W20260709 13:20:20.767575 14304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.011s	sys 0.006s
I20260709 13:20:20.705756 14221 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:20.699764 20385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.007s	sys 0.011s
W20260709 13:20:20.745908 14300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.014s	sys 0.018s
I20260709 13:20:20.707603 20431 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:20.773221 14300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.015s	sys 0.019s
I20260709 13:20:20.748095 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:20.649904 20378 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.690033 20199 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.681696 20571 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:20.652104 20499 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:20.760066 14302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.006s	sys 0.034s
I20260709 13:20:20.760490 14228 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:20.783812 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:20.784533 14228 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.652822 20741 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.789430 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1243) took 1073 ms. Trace:
I20260709 13:20:20.762104 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:20.696578 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:20.767656 14227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.026s	sys 0.028s
I20260709 13:20:20.790730 14297 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:20.791146 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2689) took 1908 ms. Trace:
W20260709 13:20:20.705003 14374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.023s	sys 0.034s
W20260709 13:20:20.764685 20691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.012s	sys 0.021s
I20260709 13:20:20.794842 14229 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 21. Ops: []
I20260709 13:20:20.776154 14301 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:20.747364 20520 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:20.772262 20385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.007s	sys 0.011s
I20260709 13:20:20.779114 20199 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:20.792199 14374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.023s	sys 0.034s
I20260709 13:20:20.804246 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1492) took 1963 ms. Trace:
I20260709 13:20:20.772565 20592 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:20.791549 14227 rpcz_store.cc:276] 0709 13:20:18.882929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.114619 (+1231690us) service_pool.cc:224] Handling call
0709 13:20:20.114948 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.115161 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:20.135145 (+ 19984us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.790818 (+655673us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.790869 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:20.790921 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.790984 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.791095 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27943,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"thread_start_us":655340,"threads_started":1}
I20260709 13:20:20.766754 20501 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:20.796712 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:20.777905 20431 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:20.789990 14295 rpcz_store.cc:276] 0709 13:20:19.715925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.129443 (+413518us) service_pool.cc:224] Handling call
0709 13:20:20.129852 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.131217 (+  1365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.131260 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.137944 (+  6684us) log.cc:844] Serialized 26 byte log entry
0709 13:20:20.623085 (+485141us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:20.623129 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.623202 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.789149 (+165947us) raft_consensus.cc:1685] finished
0709 13:20:20.789176 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.789360 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":676,"raft.queue_time_us":849,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":10992,"thread_start_us":406417,"threads_started":1,"wal-append.queue_time_us":589761}
I20260709 13:20:20.799393 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:20.812501 14225 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:20.813373 14221 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:20.812366 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50354.4us
I20260709 13:20:20.792016 20678 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.703574 20568 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:20.802809 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 305782us
I20260709 13:20:20.770614 14299 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:20.772336 20259 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:20.768230 20553 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:20.804689 14374 rpcz_store.cc:276] 0709 13:20:18.840587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.267724 (+427137us) service_pool.cc:224] Handling call
0709 13:20:19.268050 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.268305 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:20.183682 (+915377us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.803781 (+620099us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.803853 (+    72us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:20.803925 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.804017 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.804176 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1260735,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"thread_start_us":1429117,"threads_started":2}
I20260709 13:20:20.707942 20664 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.760726 20500 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.839600 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:20.840550 14301 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
W20260709 13:20:20.846246 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 387204us
I20260709 13:20:20.814248 20651 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:20.854946 20730 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.857174 20592 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:20.859692 20317 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.860110 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3278) took 2097 ms. Trace:
I20260709 13:20:20.860548 14304 rpcz_store.cc:276] 0709 13:20:18.763165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.327593 (+564428us) service_pool.cc:224] Handling call
0709 13:20:19.328062 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.095646 (+767584us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:20.095674 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.096207 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:20:20.768247 (+672040us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:20.768302 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.768397 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.859885 (+ 91488us) raft_consensus.cc:1685] finished
0709 13:20:20.859907 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.860042 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15986,"raft.queue_time_us":57174,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":14654,"thread_start_us":1328599,"threads_started":2,"wal-append.queue_time_us":709817}
I20260709 13:20:20.862490 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:20.863225 14304 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:20.863628 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3067) took 2011 ms. Trace:
I20260709 13:20:20.864003 14226 rpcz_store.cc:276] 0709 13:20:18.852513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.111633 (+1259120us) service_pool.cc:224] Handling call
0709 13:20:20.125680 (+ 14047us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.126111 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.126145 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.130476 (+  4331us) log.cc:844] Serialized 26 byte log entry
0709 13:20:20.684909 (+554433us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:20.684950 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.685028 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.863409 (+178381us) raft_consensus.cc:1685] finished
0709 13:20:20.863428 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.863550 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2250,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4557,"thread_start_us":494422,"threads_started":1,"wal-append.queue_time_us":714718}
I20260709 13:20:20.857712 20592 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:20.868294 20749 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:20:20.869517 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:20.827095 20142 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.827533 14900 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
W20260709 13:20:20.758431 14222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.012s	sys 0.011s
W20260709 13:20:20.871731 14222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.013s	sys 0.011s
I20260709 13:20:20.811900 20501 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:20.829682 14297 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:20.815740 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:20.703557 20559 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.805372 20589 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:20.830071 20259 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.873062 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1499) took 1016 ms. Trace:
I20260709 13:20:20.874130 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3112) took 1163 ms. Trace:
W20260709 13:20:20.872202 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 379159us
I20260709 13:20:20.875150 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:20.879590 20696 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.879379 20501 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:20.880677 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 65041.6us
I20260709 13:20:20.890082 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:20.894335 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:20.894685 14227 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:20.827580 20678 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.900178 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:20.876520 20283 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:20.898181 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:20.886062 20259 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:20.888226 20589 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.894287 20743 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:20.916066 20743 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:20.916491 20743 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:20.919211 20678 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.902559 20620 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:20:20.902838 20681 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:20.894768 20750 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:20:20.924405 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1245) took 1001 ms. Trace:
I20260709 13:20:20.927627 14300 rpcz_store.cc:276] 0709 13:20:19.922566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.178150 (+255584us) service_pool.cc:224] Handling call
0709 13:20:20.191818 (+ 13668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.197329 (+  5511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.197363 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.197965 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:20:20.773724 (+575759us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:20.773800 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.773893 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.924187 (+150294us) raft_consensus.cc:1685] finished
0709 13:20:20.924208 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.924345 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5107,"raft.queue_time_us":5222,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5048,"thread_start_us":552143,"threads_started":1,"wal-append.queue_time_us":660293}
I20260709 13:20:20.888068 14296 rpcz_store.cc:276] 0709 13:20:19.710464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.716407 (+  5943us) service_pool.cc:224] Handling call
0709 13:20:19.716675 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.716871 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:20.450849 (+733978us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.848118 (+397269us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.850724 (+  2606us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.851958 (+  1234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.852011 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:20.852059 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.852128 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.874073 (+ 21945us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":201571,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":117,"raft.queue_time_us":2728,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":19794,"spinlock_wait_cycles":54789504,"thread_start_us":1108084,"threads_started":2}
I20260709 13:20:20.929884 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:20.930557 14296 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
W20260709 13:20:20.931600 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.929476 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:20.904963 20663 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.886528 20598 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:20.894515 20692 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.906263 20568 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.907130 20728 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:20.908365 20751 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:20:20.909153 20753 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:20:20.910136 20501 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:20.910820 20742 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.911273 20383 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.911556 20707 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.913002 20245 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.888295 20651 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:20.913444 20675 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:20.877902 20142 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:20.905617 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3115) took 1194 ms. Trace:
I20260709 13:20:21.061856 14302 rpcz_store.cc:276] 0709 13:20:19.711262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.088518 (+377256us) service_pool.cc:224] Handling call
0709 13:20:20.089069 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.095632 (+  6563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.095674 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.102093 (+  6419us) log.cc:844] Serialized 26 byte log entry
0709 13:20:20.782343 (+680250us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:20.782397 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.782489 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.905391 (+122902us) raft_consensus.cc:1685] finished
0709 13:20:20.905416 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.905556 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6092,"raft.queue_time_us":11512,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":9874,"thread_start_us":651959,"threads_started":1,"wal-append.queue_time_us":717248}
W20260709 13:20:20.924635 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.931486 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:20.932646 14192 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:20.926970 14341 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:20.932158 14300 raft_consensus.cc:2376] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16. Re-sending same reply.
W20260709 13:20:20.944648 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 471586us
I20260709 13:20:20.823490 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:20.931466 20520 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:21.031221 14220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.021s
I20260709 13:20:20.929390 20752 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:20:21.071111 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:21.071651 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:20.940569 20691 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 13:20:21.034951 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2695) took 2150 ms. Trace:
I20260709 13:20:21.073838 14229 rpcz_store.cc:276] 0709 13:20:18.884676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.115292 (+1230616us) service_pool.cc:224] Handling call
0709 13:20:20.134387 (+ 19095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.801461 (+667074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.034568 (+233107us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b540026cfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:21.034859 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517729664}
I20260709 13:20:21.037014 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:21.075516 14299 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:21.044363 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:21.024494 20587 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.055748 14228 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:21.046412 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:21.057495 14223 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:21.022248 20650 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:21.034732 14344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.038s	sys 0.036s
W20260709 13:20:21.084064 14344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.038s	sys 0.036s
W20260709 13:20:21.084781 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 587319us
W20260709 13:20:21.066679 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 134150us
I20260709 13:20:21.068648 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:21.069063 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 245692us
W20260709 13:20:21.069713 14220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.008s	sys 0.021s
I20260709 13:20:21.070116 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:21.078514 20691 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:21.083717 14300 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:21.058768 20620 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:21.083159 14865 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:21.099118 14296 raft_consensus.cc:2410] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:20:21.114640 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 187752us
W20260709 13:20:21.120745 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52180.9us
I20260709 13:20:21.122102 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:21.127103 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:21.127516 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:21.128257 14895 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:21.129215 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:21.130044 14893 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:21.131682 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:21.132313 14897 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:21.134944 14864 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:21.136070 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 66052.9us
W20260709 13:20:21.137293 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51184.6us
I20260709 13:20:21.115869 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:21.073138 20707 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:21.069572 20520 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:21.073318 20378 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:21.081981 20742 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:21.082753 20568 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:21.150454 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:21.155956 20663 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:21.176406 20742 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:21.177181 20764 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:21.059823 20743 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:21.235203 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.091564 20691 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:21.176045 20769 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:21.211318 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:21.115653 20598 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.116430 20647 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:21.212100 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.154635 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:21.115991 20620 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:21.150429 20692 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:20:21.124679 20746 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:21.265120 20746 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.265586 20746 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.267570 20620 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.269095 20620 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.225461 20663 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.270967 20663 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:21.272212 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:21.274298 20691 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.275520 20738 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:21.275792 20691 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.276155 20738 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:21.276728 20738 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:21.278702 20771 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:21.279068 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:21.279706 14375 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:21.280618 20770 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:21.280833 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.282032 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.282094 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:21.283213 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.283798 14378 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:21.284605 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:21.286007 20500 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:21.230014 20607 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.290226 20607 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.290666 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:21.291872 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:21.292917 20607 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:21.229871 20742 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:21.293370 14300 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:21.297540 20499 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:21.298532 20593 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:21.299914 20743 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:20.881702 14222 rpcz_store.cc:276] 0709 13:20:19.856290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.193873 (+337583us) service_pool.cc:224] Handling call
0709 13:20:20.194199 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.194429 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:20.204878 (+ 10449us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.872425 (+667547us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.872605 (+   180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.872774 (+   169us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:20.872818 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.872881 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.872991 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11279,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":4933,"spinlock_wait_cycles":8503168,"thread_start_us":666935,"threads_started":1}
I20260709 13:20:21.303318 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3070) took 1400 ms. Trace:
I20260709 13:20:21.304008 14220 rpcz_store.cc:276] 0709 13:20:19.902941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.238411 (+335470us) service_pool.cc:224] Handling call
0709 13:20:20.308358 (+ 69947us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:20.331844 (+ 23486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.331890 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:20.425122 (+ 93232us) log.cc:844] Serialized 52 byte log entry
0709 13:20:21.092080 (+666958us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:21.092138 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.092226 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.302992 (+210766us) raft_consensus.cc:1685] finished
0709 13:20:21.303023 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.303233 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":349,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":8849,"thread_start_us":585524,"threads_started":1,"wal-append.queue_time_us":756186}
I20260709 13:20:21.240890 20730 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:21.215583 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.309348 14377 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:21.150887 20675 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:21.217772 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.155675 20768 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.158910 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:21.221850 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.223933 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:21.139981 20765 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:21.160473 20520 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.226670 14227 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:21.323527 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:21.324283 14377 raft_consensus.cc:2368] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19.
I20260709 13:20:21.325052 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:21.326084 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 102242us
W20260709 13:20:21.228729 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 93863.5us
I20260709 13:20:21.230145 14228 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:21.329286 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:21.224155 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:21.330240 14376 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:21.235977 14221 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:21.239460 14299 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:21.332404 14270 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:21.241349 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:21.242027 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.334232 14229 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:21.242611 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:21.334546 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.335347 14302 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:21.224964 20761 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:20:21.342280 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.158090 20696 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:20:21.213495 14373 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:21.257748 20647 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:21.349592 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.243209 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:21.260660 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 106075us
I20260709 13:20:21.352573 14221 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:21.353227 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:21.220881 20752 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:21.240890 20431 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:21.307528 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.092115 20245 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:21.214515 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.310410 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:21.318163 14375 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:21.366703 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:21.367132 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.367575 14375 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.320706 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:21.368505 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:21.369501 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48889.9us
I20260709 13:20:21.370553 14341 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:21.370591 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:21.335764 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.340528 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.374198 14374 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:20:21.374601 20750 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:21.375032 20750 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.375375 20750 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.375599 14374 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:21.341421 14300 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:21.334694 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:21.377408 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:21.380029 20692 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:21.330585 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.336714 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:21.344305 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.382766 14377 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:21.359234 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.347458 20743 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:21.341872 20769 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:21.364447 14222 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:21.385281 14192 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:21.387821 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:21.336488 20730 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:21.389973 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:21.403793 14371 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.261307 20598 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.349097 20675 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:21.401568 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 64964us
I20260709 13:20:21.355587 20396 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:21.407004 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:21.422967 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.423954 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:21.414261 14375 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:21.418749 14370 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:21.364933 20245 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:21.393361 20752 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:21.393597 20143 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:21.393288 20769 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.348767 20681 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:20:21.430733 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:21.431154 14192 leader_election.cc:400] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19.
I20260709 13:20:21.451665 14192 leader_election.cc:403] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:20:21.388445 20378 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:21.416007 20732 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:21.439772 14302 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:21.361661 20765 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 13:20:21.422605 20761 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:21.342839 20768 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:21.350834 20385 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:20:21.441905 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:21.442399 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.393702 20707 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:21.420969 20692 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:21.447775 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:21.415418 20650 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:21.425515 20737 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:21.386551 20693 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:20:21.435773 20568 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:21.478694 14373 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:21.506749 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:21.440392 20245 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:21.448874 20666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.007s	sys 0.049s
I20260709 13:20:21.486136 14371 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:21.449976 20769 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:21.509467 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:21.470139 20767 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:21.481446 20696 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:21.475431 20378 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:21.516004 14371 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.512080 14376 raft_consensus.cc:2410] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:20:21.479022 20782 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:21.482861 20143 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:21.514613 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:21.514490 20259 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.005s
W20260709 13:20:21.550778 20775 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:20:21.552945 20778 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:20:21.546622 20707 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.553149 14225 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
W20260709 13:20:21.554443 20777 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:20:21.562505 20779 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:20:21.563555 20776 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:20:21.572650 20746 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.517280 20675 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:21.572467 14371 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:21.429013 20647 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.576085 14372 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:21.577069 20378 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.578238 14222 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:20:21.581768 20598 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:21.583253 20283 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19.
W20260709 13:20:21.587425 20199 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.774s	user 0.007s	sys 0.002s
I20260709 13:20:21.590106 20785 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.513897 20666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.008s	sys 0.050s
I20260709 13:20:21.592202 20768 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:21.591797 20742 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.595023 20741 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:21.508504 20730 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:21.517946 20592 consensus_meta.cc:287] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.004s
I20260709 13:20:21.574229 20693 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.548354 20568 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:21.573055 20501 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.002s
W20260709 13:20:21.634740 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 264249us
I20260709 13:20:21.636991 14375 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:21.580356 20663 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.601008 20142 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:21.670861 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:21.673532 14297 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:20:21.644166 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 218628us
I20260709 13:20:21.675473 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:21.633961 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:21.645323 14303 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:21.676913 20663 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:21.598850 20782 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:21.597817 20431 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:21.678464 20782 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:21.684103 20589 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:21.673910 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:21.689949 20681 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.695811 20664 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:21.696179 20800 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:21.660513 20647 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.697815 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:21.706432 20552 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:21.707000 20552 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:21.652300 14377 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:21.709043 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1506) took 1097 ms. Trace:
I20260709 13:20:21.640905 20752 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:21.648801 20696 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:21.714381 20792 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.715078 20794 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:21.701889 20681 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.667589 14304 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:20:21.628389 20259 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.714952 20792 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:21.717563 20746 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:21.717916 20259 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:21.718603 14897 raft_consensus.cc:1813] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Handling vote request from an unknown peer 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:21.709602 14226 rpcz_store.cc:276] 0709 13:20:20.611754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.865355 (+253601us) service_pool.cc:224] Handling call
0709 13:20:20.865661 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.871818 (+  6157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.871850 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.871904 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:20.871942 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.708787 (+836845us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b5400094f54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:21.708838 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.708965 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13724032}
I20260709 13:20:21.719178 14897 raft_consensus.cc:2368] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 17.
W20260709 13:20:21.713016 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79160.6us
I20260709 13:20:21.713352 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:21.714932 20696 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.666925 20742 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:21.725518 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1496) took 1870 ms. Trace:
I20260709 13:20:21.725957 14224 rpcz_store.cc:276] 0709 13:20:19.855443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.185718 (+330275us) service_pool.cc:224] Handling call
0709 13:20:20.186092 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.653884 (+467792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.725268 (+1071384us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b540038c554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:21.725449 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808564992}
I20260709 13:20:21.651787 20199 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.664712 20592 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:21.704595 20743 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:21.697392 20790 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:21.698589 20738 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.734809 20794 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:21.735975 20794 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:21.738507 14302 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:21.738112 20552 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:21.735602 20738 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:21.739313 20552 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.741029 14267 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:21.669097 20693 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:21.742201 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:21.743288 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:21.743687 20693 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:21.744110 20142 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:21.744556 20142 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:21.744372 20693 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:21.744967 20142 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.660176 20785 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:21.747408 20788 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.165s	user 0.003s	sys 0.001s
I20260709 13:20:21.747833 20785 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:21.716065 20681 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.749068 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:21.750299 20681 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:21.750360 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.745673 14303 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:21.751157 14226 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:21.727358 20671 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:21.752166 20671 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:21.751992 20520 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.753170 20671 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.755391 20199 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:21.755589 14227 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:21.756084 20199 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:21.756495 20199 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.756878 20199 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:21.732084 20651 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.661s	user 0.006s	sys 0.005s
I20260709 13:20:21.757676 20651 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:21.759137 14229 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:21.759577 20798 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:21.760309 20798 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:21.760974 20798 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:21.760236 20245 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.762142 14899 raft_consensus.cc:2410] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:20:21.763047 20787 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260709 13:20:21.763218 20245 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:21.743723 20592 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:21.767059 20789 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:20:21.718591 20792 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:21.771550 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.772183 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:21.773483 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:21.774720 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.780505 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.782496 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:21.783046 14223 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:21.785331 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:21.787674 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:21.788306 14220 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
W20260709 13:20:21.789122 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45912.9us
I20260709 13:20:21.790433 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:21.793567 20663 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.777491 14867 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:21.791532 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:21.802798 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:21.806849 14229 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.808037 14867 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:21.805076 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:21.805270 20245 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.695891 20782 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.711747 20750 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.825778 14223 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:21.801857 20790 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:21.814872 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:21.813967 20693 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:21.856702 20752 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.816300 14864 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:21.793864 20664 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:21.778092 20798 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:21.912065 14222 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:21.813832 20501 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:21.854100 20499 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:21.869436 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 54639.7us
I20260709 13:20:21.957216 14267 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:21.815829 20801 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:20:21.815912 20598 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:20:21.802086 20557 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:21.810889 20663 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:21.854741 20790 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:22.063100 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79850.2us
I20260709 13:20:21.812855 20245 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.118598 20245 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:21.795118 20769 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.119239 14897 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:20:22.120671 20769 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:22.122538 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:22.123446 14225 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:22.126127 20142 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.042709 14893 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:20:22.127331 14893 pending_rounds.cc:85] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 12
I20260709 13:20:22.127637 14893 pending_rounds.cc:107] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:20:22.127952 14893 raft_consensus.cc:2889] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:22.053977 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:22.008030 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3297) took 1094 ms. Trace:
I20260709 13:20:22.129184 14296 rpcz_store.cc:276] 0709 13:20:20.913410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.931224 (+ 17814us) service_pool.cc:224] Handling call
0709 13:20:22.007804 (+1076580us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b54000dc0d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:22.007950 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76135168}
I20260709 13:20:22.134218 20792 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:22.113767 20803 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.301s	user 0.004s	sys 0.000s
I20260709 13:20:22.135106 20792 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.137404 20792 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:22.033965 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3295) took 1121 ms. Trace:
I20260709 13:20:22.183547 14302 rpcz_store.cc:276] 0709 13:20:20.912966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.467211 (+554245us) service_pool.cc:224] Handling call
0709 13:20:21.467517 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.738932 (+271415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.033695 (+294763us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54000fd7d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:22.033898 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622790016}
W20260709 13:20:22.016297 20781 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
I20260709 13:20:22.025274 20553 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.964287 20378 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.853817 20396 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:22.068686 20767 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.994143 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:22.114840 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 75995.7us
W20260709 13:20:22.116150 20780 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.541s	user 0.002s	sys 0.000s
I20260709 13:20:22.125774 14125 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 9 to 15, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 15 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.139715 20728 raft_consensus.cc:993] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: : Instructing follower 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:20:22.142915 20142 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:22.023341 20750 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:22.145856 20199 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:22.147330 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:22.156013 20790 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:22.148530 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:22.220460 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:22.221223 14893 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:22.148855 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:21.959360 20500 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:22.203051 20553 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:22.223376 20500 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:22.223974 20500 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:22.224925 20199 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:22.225226 20553 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:22.151427 14895 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:20:22.151763 20801 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:22.226817 20801 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.229064 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:22.153328 20663 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:21.840186 20520 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:21.905277 20693 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:22.014917 20791 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.433s	user 0.002s	sys 0.000s
W20260709 13:20:21.965603 20620 consensus_meta.cc:287] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.004s
I20260709 13:20:22.035320 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:22.034243 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 569507us
I20260709 13:20:22.041157 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:22.248651 14899 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:20:22.016937 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1251) took 1828 ms. Trace:
I20260709 13:20:22.249964 14298 rpcz_store.cc:276] 0709 13:20:20.188083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.386395 (+198312us) service_pool.cc:224] Handling call
0709 13:20:20.436198 (+ 49803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.759178 (+322980us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:20.774405 (+ 15227us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.415741 (+641336us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.606847 (+191106us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.606899 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:21.606945 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.016683 (+409738us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54000fd2d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:22.016737 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.016878 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3402,"prepare.queue_time_us":264299,"prepare.run_cpu_time_us":3083,"prepare.run_wall_time_us":29073,"raft.queue_time_us":159568,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":11310,"spinlock_wait_cycles":742029056,"thread_start_us":822152,"threads_started":3,"wal-append.queue_time_us":574094}
W20260709 13:20:21.921121 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 104901us
I20260709 13:20:21.972568 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3284) took 1082 ms. Trace:
I20260709 13:20:22.252607 14304 rpcz_store.cc:276] 0709 13:20:20.889893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.303638 (+413745us) service_pool.cc:224] Handling call
0709 13:20:21.304075 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.716307 (+412232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.972240 (+255933us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540022d8d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:21.972495 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835320192}
I20260709 13:20:22.253189 14864 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:22.068953 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:22.004207 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:20:22.182313 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72586.6us
I20260709 13:20:22.256376 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:22.191817 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:22.193643 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:22.258304 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:22.259202 14378 raft_consensus.cc:2410] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:20:22.259130 14302 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:22.260309 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:22.194450 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:22.261518 14296 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:22.194751 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:22.262251 14303 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:22.263340 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:22.195199 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:22.195955 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:21.956432 20499 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:22.048394 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:22.091945 20431 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.977982 20501 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:21.952397 20664 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.208170 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:22.209292 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:22.211266 14341 leader_election.cc:400] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 17.
I20260709 13:20:22.007834 20782 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:22.213479 14892 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:22.147866 20738 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:22.046416 20607 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.179s
I20260709 13:20:22.200796 20385 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.200796 20396 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.274236 20785 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:22.232285 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:22.266369 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 231148us
I20260709 13:20:22.330611 14225 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:22.331564 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:22.333011 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:22.267104 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 262984us
I20260709 13:20:22.267808 20801 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:22.221930 20728 raft_consensus.cc:1081] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Signalling peer 181bbac22422408c87cd13b7fe3008f9 to start an election
I20260709 13:20:22.247905 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:22.207978 20767 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:22.342957 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 95153.1us
I20260709 13:20:22.269665 14303 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 21: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:22.309715 20553 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:22.310277 20738 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:22.273110 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:22.373214 14223 raft_consensus.cc:2410] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:20:22.269325 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:22.278285 14341 leader_election.cc:403] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:22.278424 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:22.374444 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:22.374402 14304 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:22.281137 20741 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:22.283435 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:22.376859 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 165703us
I20260709 13:20:22.284250 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:22.377749 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:22.378520 14224 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:22.301003 14893 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:22.269025 20378 raft_consensus.cc:2764] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:22.231910 14222 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:22.275424 20499 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:22.327651 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2837) took 1111 ms. Trace:
W20260709 13:20:22.311167 20671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.010s	sys 0.053s
I20260709 13:20:22.334673 14267 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:22.285844 20730 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:22.337915 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:22.342085 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3291) took 1439 ms. Trace:
W20260709 13:20:22.272363 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 80690us
I20260709 13:20:22.264750 14300 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:22.322525 20663 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:22.328517 20396 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:22.355690 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:22.407330 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:22.334218 20678 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:22.330116 20785 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.367033 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:22.352802 20750 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:22.345811 20245 consensus_queue.cc:1059] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:20:22.366218 20744 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:20:22.358197 20552 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:20:22.349033 20782 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:22.456612 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 89635.7us
I20260709 13:20:22.392185 20768 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.401732 20647 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:22.382405 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:22.463901 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:22.464897 14372 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:22.462579 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:22.383198 14229 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
I20260709 13:20:22.383630 14296 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:22.385073 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:22.473878 14220 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:22.386883 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:22.328150 20385 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:22.387789 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:22.475775 14370 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:22.477160 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:22.400167 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 65620us
I20260709 13:20:22.478518 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:22.391798 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:22.390425 14369 rpcz_store.cc:276] 0709 13:20:21.216254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.216389 (+   135us) service_pool.cc:224] Handling call
0709 13:20:21.216659 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.216885 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:21.394212 (+177327us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.325132 (+930920us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.327276 (+  2144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.327333 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:22.327387 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.327466 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.327591 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":423403,"prepare.queue_time_us":42886,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":475653,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":9809,"thread_start_us":666467,"threads_started":3,"wal-append.queue_time_us":276249}
I20260709 13:20:22.480679 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:22.405964 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:22.406113 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:22.407418 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:22.482177 14300 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:22.408185 14304 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:22.483029 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:22.403968 14299 rpcz_store.cc:276] 0709 13:20:20.902431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.331643 (+429212us) service_pool.cc:224] Handling call
0709 13:20:21.332098 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.332406 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.332449 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.343411 (+ 10962us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.479375 (+135964us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:21.479414 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.479488 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.014236 (+534748us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:22.335928 (+321692us) raft_consensus.cc:1685] finished
0709 13:20:22.335952 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.342004 (+  6052us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105203072,"thread_start_us":63607,"threads_started":1,"wal-append.queue_time_us":200083}
I20260709 13:20:22.329092 20557 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:22.408911 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 71158us
I20260709 13:20:22.485389 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:22.486008 14229 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:22.408403 20675 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.298938 20431 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:22.492769 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 86736.6us
W20260709 13:20:22.390704 20752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.006s	sys 0.007s
W20260709 13:20:22.399487 20671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.011s	sys 0.054s
I20260709 13:20:22.359253 20553 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:22.280789 14302 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:22.408273 20794 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:22.410243 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.489423 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:22.403438 20692 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:22.425683 20568 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:22.414099 14371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:37700
I20260709 13:20:22.516383 14371 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.516921 14371 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:22.430310 20785 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.426061 20741 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.388793 20593 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 17
I20260709 13:20:22.497184 20647 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:22.520475 14297 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:22.522652 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:22.462901 20746 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:22.524379 20801 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:22.492538 20383 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:22.503328 20752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.006s	sys 0.007s
I20260709 13:20:22.619158 20647 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:22.562450 20741 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.551183 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:22.496766 20199 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:22.556463 14374 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:22.503671 20750 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:22.559175 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1385) took 2094 ms. Trace:
I20260709 13:20:22.635561 14894 rpcz_store.cc:276] 0709 13:20:20.464728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.472327 (+  7599us) service_pool.cc:224] Handling call
0709 13:20:20.472796 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:20.653674 (+180878us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:20.950367 (+296693us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.430179 (+479812us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.604267 (+174088us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.604463 (+   196us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:21.605047 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 13:20:21.605176 (+   129us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:21.605208 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.749578 (+144370us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54007468d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:21.749715 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.115230 (+365515us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:22.558873 (+443643us) raft_consensus.cc:1685] finished
0709 13:20:22.558914 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.559101 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22468,"prepare.queue_time_us":67490,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":148,"raft.queue_time_us":11509,"raft.run_cpu_time_us":635,"raft.run_wall_time_us":49499,"spinlock_wait_cycles":486931072,"thread_start_us":790560,"threads_started":4,"wal-append.queue_time_us":417944}
I20260709 13:20:22.564713 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:22.638129 14372 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
W20260709 13:20:22.541044 14343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.035s	sys 0.081s
W20260709 13:20:22.639119 14343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.036s	sys 0.081s
I20260709 13:20:22.494154 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:22.565927 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:22.490451 20690 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 13:20:22.525480 20568 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:22.641582 20568 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.515106 20587 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:22.497802 20598 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:20:22.567047 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:22.489089 20768 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:22.550390 20802 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 13:20:22.493780 20738 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.505447 20675 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:22.729565 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:22.730103 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 179028us
I20260709 13:20:22.492748 20557 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:22.651576 20793 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.466341 20501 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.727752 20744 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.746949 14369 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:22.732210 20801 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:22.646070 20587 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:22.728842 20671 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:22.762406 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:22.754843 20142 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:22.743841 20738 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.797549 14297 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:22.732759 20750 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:22.796370 14371 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.827716 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:22.771493 20766 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:22.852078 14371 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:22.857993 14894 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:20:22.860970 14901 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:22.799466 20767 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:22.811141 20598 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:22.745083 20692 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:22.751825 14301 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:22.813529 20142 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:22.759985 20793 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:22.876652 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 427951us
I20260709 13:20:22.877239 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:22.874192 14125 catalog_manager.cc:5697] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:20:22.863963 20383 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.767871 20744 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:22.890518 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 322844us
I20260709 13:20:22.896500 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:22.897341 14901 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:22.877895 20730 raft_consensus.cc:697] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:22.906816 20730 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:22.879637 20790 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.002s
W20260709 13:20:22.910995 14378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1501) took 1651 ms (client timeout 1882 ms). Trace:
W20260709 13:20:22.939261 14378 rpcz_store.cc:269] 0709 13:20:21.259526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.284372 (+ 24846us) service_pool.cc:224] Handling call
0709 13:20:22.910701 (+1626329us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b540025a3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:22.910911 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239550720}
I20260709 13:20:22.939313 20790 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:22.897714 14901 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:22.864588 20663 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:22.942605 20790 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:22.942572 20663 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.917428 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:22.840924 20671 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.946367 20768 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:22.948137 20671 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:22.871476 20664 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:22.871833 20598 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:22.950476 20598 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:22.922611 20385 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:22.853394 20752 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:20:22.926292 20744 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:22.927033 20814 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:22.909430 20383 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:22.961498 20811 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.398s	user 0.000s	sys 0.001s
I20260709 13:20:22.965543 20383 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.931525 20520 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:22.931958 20812 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.427s	user 0.000s	sys 0.001s
I20260709 13:20:22.931859 14220 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:22.936484 20782 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:22.938150 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:22.972438 14894 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:22.882156 20142 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:22.879494 20767 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:20:22.883136 20766 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:22.922823 20816 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:20:22.863164 20651 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:20:22.960654 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:22.951715 20598 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:22.941149 14901 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:22.976725 20808 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.435s	user 0.000s	sys 0.001s
I20260709 13:20:22.955302 20664 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.964334 20553 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:22.997402 14901 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:22.998097 14893 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:22.963903 20431 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:22.975454 20520 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:22.959023 20750 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.037118 20431 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:22.955559 20801 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.030944 20814 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:20:23.038324 20675 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:23.047430 20557 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:23.060750 20571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.006s
I20260709 13:20:23.059541 20431 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:23.032465 20664 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.065256 20833 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:23.072283 20652 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:23.077654 20587 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:23.083659 20571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.009s	sys 0.006s
W20260709 13:20:23.091190 20806 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.044s	user 0.003s	sys 0.000s
W20260709 13:20:23.093583 20824 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:20:23.095741 20652 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:23.120200 20752 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:23.120682 20752 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:23.121415 20752 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.122413 20752 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:23.122865 20785 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.000s
I20260709 13:20:23.123313 20785 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.111658 20837 raft_consensus.cc:3055] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:23.124806 20837 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:23.125643 20837 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.111863 20793 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:23.103338 20833 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.134375 20817 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:23.134649 20833 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.134841 20817 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:23.135684 20817 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.136986 20817 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:23.141868 20785 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:22.923458 14125 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:22.930714 14123 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36074 (request call id 217) took 17540 ms (client timeout 15000 ms). Trace:
I20260709 13:20:23.194454 14125 catalog_manager.cc:5697] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 9 to 17. New cstate: current_term: 17 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:20:23.204979 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:23.191743 14123 rpcz_store.cc:269] 0709 13:20:05.390421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.391350 (+   929us) service_pool.cc:224] Handling call
0709 13:20:22.930571 (+17539221us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:14.768603 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:14.769614 (+  1011us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:14.769678 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:20:14.769702 (+    24us) tablet.cc:662] Decoding operations
0709 13:20:14.771557 (+  1855us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:14.771703 (+   146us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:14.771736 (+    33us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:20:14.773407 (+  1671us) tablet.cc:701] Row locks acquired
0709 13:20:14.773477 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:20:14.773689 (+   212us) write_op.cc:270] Start()
0709 13:20:14.838203 (+ 64514us) write_op.cc:276] Timestamp: P: 1783603214773607 usec, L: 0
0709 13:20:14.846185 (+  7982us) op_driver.cc:348] REPLICATION: starting
0709 13:20:14.847344 (+  1159us) log.cc:844] Serialized 6008 byte log entry
0709 13:20:15.896295 (+1048951us) op_driver.cc:464] REPLICATION: finished
0709 13:20:16.953329 (+1057034us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b1800083f20. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:16.953585 (+   256us) write_op.cc:301] APPLY: starting
0709 13:20:16.953730 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:17.978912 (+1025182us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:17.978969 (+    57us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:18.117519 (+138550us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:18.118042 (+   523us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:20:18.118119 (+    77us) write_op.cc:312] APPLY: finished
0709 13:20:18.118670 (+   551us) log.cc:844] Serialized 139 byte log entry
0709 13:20:18.301138 (+182468us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8de9f820ac 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b
0709 13:20:18.408956 (+107818us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:18.425644 (+ 16688us) write_op.cc:454] Released schema lock
0709 13:20:18.425738 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:18.430037 (+  4299us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:18.430075 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42076,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":607845,"apply.run_cpu_time_us":42789,"apply.run_wall_time_us":1476382,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66857,"num_ops":15,"prepare.queue_time_us":97832,"prepare.run_cpu_time_us":31855,"prepare.run_wall_time_us":229976,"raft.queue_time_us":471502,"raft.run_cpu_time_us":21417,"raft.run_wall_time_us":192644,"replication_time_us":1041775,"spinlock_wait_cycles":53130368,"thread_start_us":661571,"threads_started":5,"wal-append.queue_time_us":499815,"wal-append.run_cpu_time_us":13519,"wal-append.run_wall_time_us":2475829}]]}
I20260709 13:20:23.204897 14125 catalog_manager.cc:5697] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 10 to 14, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 14 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.216563 14125 catalog_manager.cc:5697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:20:22.979592 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:23.224143 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:23.224368 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 244721us
I20260709 13:20:23.228267 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:23.235236 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:23.237248 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 395854us
I20260709 13:20:23.238863 14344 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:20:23.243837 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 366535us
I20260709 13:20:23.245662 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:23.245905 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:23.245249 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:23.250630 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.251487 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.220338 14125 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 13 to 16, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 16 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:23.063473 20245 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.007s	sys 0.007s
W20260709 13:20:23.262557 20245 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.007s	sys 0.008s
I20260709 13:20:23.263330 14125 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:23.264061 20259 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:23.266216 20431 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.268388 20589 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:23.271442 20501 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:23.272535 20520 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.275389 20767 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:23.278082 20652 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.249498 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:23.249571 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:23.285555 20501 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.327208 20501 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.330021 20838 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.331043 20838 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.332427 20845 raft_consensus.cc:2764] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:23.333348 20845 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:23.334066 20845 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.337116 20845 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.338975 20431 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:23.284006 20589 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.133661 20678 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:23.307724 20681 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:23.307962 20500 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.083s	user 0.013s	sys 0.003s
I20260709 13:20:23.318224 20847 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:23.322039 20785 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:23.322576 20690 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.322661 20664 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.326321 20792 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:23.291581 14864 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:23.286033 20767 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:23.345760 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 96428.9us
I20260709 13:20:23.343740 14125 catalog_manager.cc:5697] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
W20260709 13:20:23.343519 20593 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.771s	user 0.009s	sys 0.008s
I20260709 13:20:23.349895 20767 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.353243 20259 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.353842 20520 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:23.354013 20860 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.354395 20520 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.354916 20520 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:23.354806 20860 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.357254 20860 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.343940 20589 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:23.344734 20681 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.359664 20838 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.358501 20678 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:23.349053 20500 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:23.362115 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 73687.3us
I20260709 13:20:23.359666 20692 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.362628 20259 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:23.364148 20690 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:23.377206 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.365309 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:23.380524 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3133) took 1186 ms. Trace:
I20260709 13:20:23.381055 14297 rpcz_store.cc:276] 0709 13:20:22.193970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.194968 (+   998us) service_pool.cc:224] Handling call
0709 13:20:23.380042 (+1185074us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400154ad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:23.380267 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588790656}
I20260709 13:20:23.360513 20681 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.362193 14125 catalog_manager.cc:5697] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 7 to 12, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 12 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
W20260709 13:20:23.372552 20396 consensus_meta.cc:287] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.943s	user 0.016s	sys 0.004s
I20260709 13:20:23.374107 20692 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.390959 20742 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.391319 20768 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.391955 20742 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.392203 20768 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.385637 20855 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:23.395510 20768 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:23.396541 14125 catalog_manager.cc:5697] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.397975 20142 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.399924 14125 catalog_manager.cc:5697] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 7 to 12, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 12 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:20:23.384840 20690 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.414079 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:23.415087 14898 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:20:23.415244 20742 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:23.418426 20568 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.776s	user 0.016s	sys 0.003s
I20260709 13:20:23.370889 20593 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 17.
I20260709 13:20:23.426173 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.424171 20500 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.434074 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.425981 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.435846 14226 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:23.435010 14373 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:23.438949 20737 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:23.439208 20745 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:23.439821 20745 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:23.442217 14896 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:20:23.443751 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.446473 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.449000 14894 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:23.450392 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:23.450839 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.451189 14378 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:23.451691 14892 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:23.452749 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.453038 20691 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:23.454618 14896 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:23.455374 20690 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.455638 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.456552 14373 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:23.456278 20690 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:23.459934 20813 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.901s	user 0.003s	sys 0.000s
W20260709 13:20:23.460929 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 211790us
I20260709 13:20:23.461257 20690 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.464432 20142 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.465330 20663 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:23.466074 20692 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.445658 20742 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.467379 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:23.469201 20663 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:23.469697 20663 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:23.470877 20663 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.472553 20663 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.472770 20837 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:23.468465 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.475086 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:23.475785 14372 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.455422 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:23.468660 14376 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:20:23.482100 14901 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:23.483240 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:23.483937 20383 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.004s
I20260709 13:20:23.484455 20383 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.484789 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:23.485671 14376 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:23.390158 20396 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.485725 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:23.486979 14897 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:23.441370 20745 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.488273 20745 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:23.469573 20728 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:23.489483 20728 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:23.489609 20396 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.453197 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.491091 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1262) took 1278 ms. Trace:
I20260709 13:20:23.490826 20728 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.492127 20728 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.491537 14295 rpcz_store.cc:276] 0709 13:20:22.212298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.280650 (+ 68352us) service_pool.cc:224] Handling call
0709 13:20:22.280970 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.281226 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:22.754212 (+472986us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.481000 (+726788us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b18004d66e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a
0709 13:20:23.481345 (+   345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.481429 (+    84us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:23.481557 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.481666 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.490872 (+  9206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":607735,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"spinlock_wait_cycles":8298240,"thread_start_us":631696,"threads_started":2,"wal-append.queue_time_us":279760}
I20260709 13:20:23.494835 14375 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:23.495810 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:23.496946 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1513) took 1110 ms. Trace:
I20260709 13:20:23.498005 20664 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.498170 20500 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:23.498685 20664 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:23.447392 14195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.020s	sys 0.040s
W20260709 13:20:23.501310 14195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.020s	sys 0.041s
I20260709 13:20:23.465373 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:23.502314 20766 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:23.502766 20766 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:23.502888 20500 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:23.503721 20500 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:23.504035 20766 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.504885 20500 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.469588 20742 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.510797 20742 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.499904 14125 catalog_manager.cc:5697] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 8 to 9, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 9 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.512331 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1402) took 1424 ms. Trace:
I20260709 13:20:23.512792 14898 rpcz_store.cc:276] 0709 13:20:22.088488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.088678 (+   190us) service_pool.cc:224] Handling call
0709 13:20:22.089182 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.433719 (+1344537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.511958 (+ 78239us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54004bfad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:23.512240 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3048114048}
I20260709 13:20:23.512540 14125 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 11 to 14, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 14 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.514735 14125 catalog_manager.cc:5697] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 4 to 12, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 12 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.516412 14125 catalog_manager.cc:5697] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
W20260709 13:20:23.517915 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 52650.6us
W20260709 13:20:23.448460 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 209996us
I20260709 13:20:23.497431 14375 rpcz_store.cc:276] 0709 13:20:22.386421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.386584 (+   163us) service_pool.cc:224] Handling call
0709 13:20:23.496653 (+1110069us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003c37d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:23.496853 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344011136}
I20260709 13:20:23.517648 14125 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 7 to 12, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 12 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.505605 20766 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:23.535909 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:23.537494 14372 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
W20260709 13:20:23.538211 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47208.6us
I20260709 13:20:23.539271 14378 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:23.541047 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:23.546731 20317 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:23.547483 20317 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.530193 20767 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.552088 20767 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.553153 14375 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:23.555065 14369 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:23.501431 20664 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:23.558331 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60934.9us
I20260709 13:20:23.437693 20568 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.557548 14369 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:23.546525 20752 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:20:23.536109 20691 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:23.538821 20501 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.565058 14376 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:20:23.570999 14375 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:23.572188 14370 raft_consensus.cc:2410] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:20:23.564648 14125 catalog_manager.cc:5697] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 8 to 10, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 10 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:20:23.573436 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.578238 14295 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:20:23.579234 14371 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:23.579402 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.581918 14125 catalog_manager.cc:5697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 12 to 17, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 17 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.589885 20830 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.590161 20589 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.590761 20830 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.592913 20589 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.593318 20830 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:23.594388 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.597213 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.597425 20855 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:23.598309 20855 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.601156 20855 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.601966 20792 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.602255 20785 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.602581 20792 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.602972 20785 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.603755 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:23.604331 20568 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.604432 14222 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:23.604777 20792 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.605309 20785 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.605973 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:23.606459 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:23.606879 14227 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:23.609336 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:23.610867 14125 catalog_manager.cc:5697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 9 to 14, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 14 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.607018 14220 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:20:23.589959 20691 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.633145 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:23.637065 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 72433.5us
I20260709 13:20:23.642937 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.644272 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.644515 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.644855 20501 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.645015 14896 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:23.645560 20501 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.645027 14894 raft_consensus.cc:2376] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15. Re-sending same reply.
I20260709 13:20:23.646162 20501 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.647028 14193 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:23.648226 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.649044 14895 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:23.650766 14378 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:23.662889 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.618770 20855 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:23.672107 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.661767 14221 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:23.674703 14372 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:23.605338 20792 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:23.678186 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:23.676376 14369 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:23.678865 14222 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:23.681252 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.656049 20431 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.686909 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1510) took 1298 ms. Trace:
I20260709 13:20:23.687269 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 3087) took 1305 ms. Trace:
I20260709 13:20:23.689479 20383 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:23.690038 20499 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.263s	user 0.012s	sys 0.008s
I20260709 13:20:23.690466 14224 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:23.690733 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:23.690791 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:23.673909 20830 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:23.691488 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:23.692358 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:23.685989 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.649601 20847 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:20:23.708935 14373 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:23.685885 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.648500 20501 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:23.694868 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.696528 14344 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:23.698421 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:23.706306 14376 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:23.700949 14226 rpcz_store.cc:276] 0709 13:20:22.376102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.376291 (+   189us) service_pool.cc:224] Handling call
0709 13:20:23.667633 (+1291342us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b540033e354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:23.681160 (+ 13527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717076864}
I20260709 13:20:23.696822 20855 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.695016 20647 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:20:23.696280 20792 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.711501 20741 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.711103 20499 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.701457 20728 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:23.712270 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.699572 20737 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:23.735155 14372 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:23.694689 14220 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:23.694948 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:23.672572 20317 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.735155 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:23.684742 20752 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:23.741535 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.739053 14221 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:23.741245 14895 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:23.745668 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:23.745986 14295 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:23.700737 14377 rpcz_store.cc:276] 0709 13:20:22.379640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.380364 (+   724us) service_pool.cc:224] Handling call
0709 13:20:22.380815 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.464594 (+ 83779us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:22.966461 (+501867us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.239469 (+273008us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.239578 (+   109us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:23.239682 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.667121 (+427439us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b54001b85d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:23.667194 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.677610 (+ 10416us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39783,"prepare.queue_time_us":85399,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"raft.queue_time_us":53617,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":32528,"spinlock_wait_cycles":191939840,"thread_start_us":697374,"threads_started":2,"wal-append.queue_time_us":187582}
W20260709 13:20:23.749894 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 102945us
I20260709 13:20:23.712358 20431 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.757062 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.738639 20568 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.738869 20663 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:23.754148 14894 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 12.
I20260709 13:20:23.754395 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1501) took 1602 ms. Trace:
I20260709 13:20:23.698297 20652 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.761201 14376 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:23.758275 14897 rpcz_store.cc:276] 0709 13:20:22.148493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.148617 (+   124us) service_pool.cc:224] Handling call
0709 13:20:23.732675 (+1584058us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540066ce54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:23.750532 (+ 17857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2908130560}
I20260709 13:20:23.762137 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:23.763499 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.764310 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.770428 14370 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:23.771413 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:23.772148 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 81554.5us
I20260709 13:20:23.774617 14378 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:20:23.783182 14897 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 13:20:23.784844 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:23.792552 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:23.787067 14893 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:23.795981 14374 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:23.693775 20678 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.789832 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:23.811705 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 61092.5us
I20260709 13:20:23.773777 14341 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:23.815512 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:23.818228 14373 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:23.812544 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:23.739391 20681 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:23.788545 20598 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.007s
I20260709 13:20:23.823967 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:23.829221 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.789837 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:23.825768 14370 raft_consensus.cc:2410] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:20:23.785499 20879 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:23.831662 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.832154 20879 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:23.833515 20879 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.834371 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:23.834892 20678 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.835191 14220 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:23.835789 20745 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:23.835938 14225 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:23.836284 20745 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.836436 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:23.836742 20745 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.837281 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:23.837977 14377 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:23.838609 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:23.840813 14302 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:20:23.841243 14302 pending_rounds.cc:85] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 8
I20260709 13:20:23.841483 14302 pending_rounds.cc:107] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 12.9
W20260709 13:20:23.827059 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 53415.2us
I20260709 13:20:23.841750 14302 raft_consensus.cc:2889] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:23.788678 20652 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.819393 20766 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.843174 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.843691 20766 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.844185 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:23.844638 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.846069 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:23.846722 14373 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:23.784077 20855 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:23.848563 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.835490 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.852602 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:23.778136 20817 raft_consensus.cc:2764] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:20:23.858410 14369 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:23.857366 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.859452 14377 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:23.864084 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:23.808688 20568 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.866629 20142 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:23.868299 20142 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:23.868695 20142 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.869051 20142 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:23.869673 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 79363.2us
I20260709 13:20:23.870592 14221 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:23.865450 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:23.858096 20647 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:23.878309 20647 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.813921 20520 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.878772 20647 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.843163 20792 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.872936 14298 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:23.880808 20520 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.881186 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.881673 14222 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:23.882231 14298 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:23.752821 20728 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.883205 20431 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:23.883978 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:23.866801 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 193026us
I20260709 13:20:23.885211 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.873466 14897 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:20:23.878520 20769 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:23.886379 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:23.886730 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c137013238f4b1dbae260e32cb316dc with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:47058
I20260709 13:20:23.887471 20678 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:23.873113 20691 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.824503 20383 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:23.889073 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:23.889353 20383 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:23.889835 20383 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:23.890404 20769 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:23.891745 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.891673 20769 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.892702 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:23.893065 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.894979 20396 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:23.895355 20730 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.896821 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:23.897982 20741 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:23.882153 20556 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.898371 20741 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.890134 20557 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:20:23.898730 20556 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.901217 20556 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:23.777992 20742 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.888422 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:23.875030 20499 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.902064 20742 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.904518 20742 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.905086 20742 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:23.905648 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:23.906103 20589 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:23.906684 20589 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:23.907892 20557 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:23.907727 20589 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.908413 20557 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:23.909525 20557 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.911679 20499 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:23.835117 20879 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.863876 20681 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.912325 20499 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:23.898785 20741 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:23.913468 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:23.912359 14373 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:23.918319 14227 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:23.870712 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:23.923991 14220 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:23.911002 20557 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.912225 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:23.923527 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:23.893740 14299 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:23.926173 14899 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:23.927600 14895 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
W20260709 13:20:23.937846 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 67290.1us
I20260709 13:20:23.938393 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:23.937454 20142 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.939683 14298 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:23.940834 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:23.942937 14892 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:23.857718 20663 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:23.949565 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:23.950160 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:23.913453 20742 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:20:23.942319 20598 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:23.984336 20598 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:23.960867 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:23.984951 20598 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:23.985285 14301 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:23.986212 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 114178us
I20260709 13:20:23.987039 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:23.987531 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:23.987891 20691 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:23.988515 20691 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:23.989043 20499 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:23.962219 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.990021 20520 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:23.990689 20520 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:23.991217 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.954231 20681 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:23.991832 20681 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.992106 14300 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:23.992293 20681 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:23.958591 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:23.993048 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.993405 14892 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 14: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:23.994467 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.995532 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.958250 20794 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 13:20:23.982975 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 94651.6us
I20260709 13:20:23.996239 20568 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:23.981992 20501 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:23.980608 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.997219 14295 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:23.989557 20691 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.998162 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.958141 20798 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:23.999595 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:23.999970 20798 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:23.996469 14296 raft_consensus.cc:2410] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:24.002053 14296 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:23.953091 20876 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:20:24.002379 20798 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:24.002947 20798 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:24.003062 20876 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:23.991634 20520 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:24.003736 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:24.003508 20798 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:24.004921 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:23.951277 20396 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:24.017369 14295 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:23.995494 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:23.977281 14302 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:24.006753 14299 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 12: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:24.007043 14300 raft_consensus.cc:2410] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:24.009069 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:24.010305 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:24.016954 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:24.018826 14892 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:24.003551 20876 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:24.005751 20798 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:24.024974 14220 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:24.025348 20798 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:24.025259 20876 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:24.026929 20876 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.028990 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:24.030617 14227 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:24.031575 20847 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:24.033437 20855 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:24.034032 20855 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:24.035185 20855 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:24.037617 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:23.946512 20556 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:24.038501 14298 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:24.046871 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:24.050474 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:24.050659 20855 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:24.051433 14900 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:24.028436 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:24.018632 14301 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:23.956554 20142 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:24.061625 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:24.066494 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:24.070565 14301 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:23.967702 20766 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:24.017565 20396 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:24.073186 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.965214 20728 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:24.096150 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:24.086984 14867 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:24.094421 14373 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:24.097415 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:24.099014 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:24.095005 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:24.099140 14899 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:24.101869 14295 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:24.032876 20847 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:20:24.092229 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:24.108429 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:24.058125 20652 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:24.112195 14376 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
W20260709 13:20:24.113765 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.113911 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:24.117444 14227 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:24.114729 14900 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:20:24.115129 14896 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:24.115952 14300 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:24.006057 20647 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:24.127840 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:24.128218 14374 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:24.096854 20396 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:24.131235 14375 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:20:24.131840 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.132639 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:24.134421 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 89158.7us
I20260709 13:20:24.094687 20556 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:24.138096 14376 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:24.138811 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.150482 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:24.155097 14373 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:20:24.158102 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.165433 14299 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:24.167174 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:24.090842 20737 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:20:24.170975 14298 raft_consensus.cc:2368] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15.
I20260709 13:20:24.172016 14229 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:24.173666 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 110543us
I20260709 13:20:24.128625 20501 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.128768 20766 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:24.130610 20831 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:24.182471 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:24.187681 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:24.179939 14301 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:24.197837 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:24.202574 14341 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:24.203227 14295 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:24.204591 14900 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:24.205554 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:24.208014 14374 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:24.202525 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:24.210525 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:24.188539 20853 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.218371 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:24.219312 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:24.224412 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:24.227955 14298 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:24.232978 14296 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:24.234061 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:24.237406 14896 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:24.236428 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:24.239625 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64868.7us
I20260709 13:20:24.240602 14376 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:24.169054 20317 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:20:24.248134 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:24.253749 14895 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:24.184410 20499 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:20:24.252604 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:24.291265 14220 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:24.212080 20431 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:24.255462 20830 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:24.256471 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:24.258324 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:24.264886 14867 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:24.265518 14897 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:24.164978 20383 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:24.223991 20766 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:24.310379 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 67381.9us
I20260709 13:20:24.306039 14298 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:24.230810 20792 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:24.324033 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:24.313982 14297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.015s	sys 0.056s
W20260709 13:20:24.314581 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 49785.3us
I20260709 13:20:24.237303 20647 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:24.323120 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:24.332953 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:24.333001 14297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.015s	sys 0.056s
I20260709 13:20:24.337248 20728 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:24.326941 20499 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:24.342659 14377 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 12.
I20260709 13:20:24.343927 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:24.344818 14377 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:24.346066 20556 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:24.345774 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:24.347496 14377 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.353173 14302 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:24.234563 20837 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:20:24.364224 14376 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:24.370983 14375 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:24.372206 14224 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:24.370829 14229 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:24.313463 20383 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:24.376843 14377 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:24.351435 20830 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:24.381358 20830 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:24.381875 20730 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:24.383128 20745 consensus_meta.cc:287] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.001s
I20260709 13:20:24.383555 20745 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:24.386169 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:24.386968 14301 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:24.388273 20678 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:24.388717 20678 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.389115 20678 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.389518 20730 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.385638 20745 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:24.390045 20730 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:24.405747 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:24.304423 20853 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:24.370922 20737 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:20:24.415529 14297 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:24.412017 14366 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.014s	sys 0.049s
W20260709 13:20:24.419091 14366 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.014s	sys 0.049s
I20260709 13:20:24.485692 14220 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:24.488025 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:24.492228 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.012s	sys 0.010s
W20260709 13:20:24.493870 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.013s	sys 0.010s
W20260709 13:20:24.552723 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.409904 20741 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:24.564105 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:24.569106 20142 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:24.569247 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:24.574057 14297 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.580641 20142 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:24.581215 20142 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:24.563108 20620 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:24.611488 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:24.615481 14267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.020s	sys 0.031s
W20260709 13:20:24.626899 14267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.020s	sys 0.031s
I20260709 13:20:24.627961 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:24.628979 14302 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
W20260709 13:20:24.633451 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 721365us
I20260709 13:20:24.634716 14267 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:24.553174 20766 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:24.617712 20879 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.705s	user 0.008s	sys 0.004s
I20260709 13:20:24.637975 20142 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:24.646672 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:24.638969 20598 consensus_meta.cc:287] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.000s
I20260709 13:20:24.631002 20769 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:24.656874 14303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.023s	sys 0.041s
W20260709 13:20:24.664669 14303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.023s	sys 0.041s
I20260709 13:20:24.646206 20501 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:24.662528 20598 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:24.669366 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.673108 14225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.003s	sys 0.024s
W20260709 13:20:24.728257 14226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.016s	sys 0.018s
W20260709 13:20:24.728325 14225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.003s	sys 0.025s
I20260709 13:20:24.699616 20142 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:24.733373 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.701836 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 67249us
W20260709 13:20:24.704903 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 534474us
W20260709 13:20:24.702829 14222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.021s
W20260709 13:20:24.728739 14226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.016s	sys 0.018s
W20260709 13:20:24.737824 14222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.010s	sys 0.021s
W20260709 13:20:24.744016 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.746235 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:24.676554 20742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.021s	sys 0.044s
W20260709 13:20:24.751058 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.009s	sys 0.025s
W20260709 13:20:24.751540 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.009s	sys 0.026s
W20260709 13:20:24.719113 20691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.021s	sys 0.014s
I20260709 13:20:24.718009 20431 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:24.689952 20520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.017s	sys 0.014s
W20260709 13:20:24.668087 20589 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.006s	sys 0.032s
W20260709 13:20:24.752266 14372 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.030s
W20260709 13:20:24.760597 14372 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.000s	sys 0.031s
W20260709 13:20:24.757262 14341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.010s	sys 0.021s
I20260709 13:20:24.713166 20730 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:24.762246 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 444406us
I20260709 13:20:24.741110 20568 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:24.754660 20691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.021s	sys 0.014s
W20260709 13:20:24.759917 20520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.017s	sys 0.014s
I20260709 13:20:24.741600 20847 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:24.751292 20742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.022s	sys 0.044s
I20260709 13:20:24.770651 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:24.753437 20737 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.791198 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:24.793892 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:24.815567 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 78531.9us
W20260709 13:20:24.760229 20589 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.006s	sys 0.032s
W20260709 13:20:24.761449 14223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.017s	sys 0.014s
W20260709 13:20:24.836329 14223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.017s	sys 0.014s
I20260709 13:20:24.759479 20830 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.816952 20886 tablet_replica.cc:333] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:20:24.817288 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:24.848101 14299 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:24.817535 20647 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:24.817934 20889 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:20:24.818320 20742 consensus_queue.cc:1243] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:20:24.818682 20887 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:20:24.818846 20383 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:24.819895 20847 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:24.821030 20431 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:24.822034 20317 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:24.825197 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:24.849579 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:24.817366 14193 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:24.761849 14341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.010s	sys 0.021s
W20260709 13:20:24.902681 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 685092us
W20260709 13:20:24.902781 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 53336.9us
I20260709 13:20:24.838665 14865 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:24.907702 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 69166.7us
I20260709 13:20:24.908689 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:24.769255 20855 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.001s
W20260709 13:20:24.817286 14228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.017s	sys 0.014s
W20260709 13:20:24.950105 14228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.017s	sys 0.014s
I20260709 13:20:24.857491 14304 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:24.805413 20598 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:24.861135 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:24.829425 20883 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:20:24.895954 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:24.916266 14344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.014s
W20260709 13:20:24.917066 14369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.009s	sys 0.005s
I20260709 13:20:24.841066 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:24.925102 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:24.924897 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:24.901470 14220 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
W20260709 13:20:24.857630 20792 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.016s	sys 0.039s
I20260709 13:20:24.936609 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:24.968652 14900 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.944866 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:24.962081 14344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.000s	sys 0.014s
W20260709 13:20:24.962890 14369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.009s	sys 0.005s
I20260709 13:20:24.849633 20520 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:24.961725 14225 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:24.980703 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:24.967203 14227 raft_consensus.cc:2410] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:20:24.869822 20568 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:24.977017 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:24.976950 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:24.991214 14375 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:24.977630 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:24.891151 20620 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.997001 20906 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:24.998534 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:24.999500 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:25.000339 20383 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.976914 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:25.000922 20383 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.001890 14220 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:24.997203 20620 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.002827 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:25.003507 20383 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:25.004016 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:25.004623 14220 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.991267 14370 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:24.977540 20853 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:25.006405 20853 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:24.900561 20847 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:24.995594 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:25.010766 14225 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:25.011435 20798 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:25.011850 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:24.985025 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2744) took 1275 ms. Trace:
I20260709 13:20:25.006562 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:25.017187 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:24.830542 20737 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:24.846452 20730 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:20:24.849542 20888 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.138s
I20260709 13:20:24.955770 20501 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:25.011920 20798 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:25.045315 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 100518us
I20260709 13:20:24.968333 20792 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:24.953833 20890 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:24.964541 20728 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:20:25.028038 20741 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:25.015540 20568 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:25.075233 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:25.014655 14228 rpcz_store.cc:276] 0709 13:20:23.688603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.691534 (+  2931us) service_pool.cc:224] Handling call
0709 13:20:23.691909 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.692238 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:23.745231 (+ 52993us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.963195 (+1217964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:24.963253 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:24.963302 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.963368 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.963513 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13262,"prepare.queue_time_us":195473,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":53574,"thread_start_us":1080807,"threads_started":2,"wal-append.queue_time_us":1160160}
I20260709 13:20:25.021675 20598 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:25.054615 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:20:25.062461 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 45162.9us
I20260709 13:20:25.105599 14376 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
W20260709 13:20:25.097020 20883 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:20:24.959231 20830 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.088675 20888 consensus_queue.cc:1243] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:20:25.122195 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 67693.2us
I20260709 13:20:25.088078 20879 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.110352 20557 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.167s	user 0.015s	sys 0.000s
I20260709 13:20:25.056397 20663 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:20:25.113619 20664 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:25.081734 20853 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:20:25.143019 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:25.047637 20520 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:25.142784 20396 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.978s	user 0.011s	sys 0.002s
I20260709 13:20:25.082893 20906 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:25.162375 20396 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.159483 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:25.171670 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.177510 14297 consensus_meta.cc:287] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
W20260709 13:20:25.181962 14296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.016s	sys 0.018s
I20260709 13:20:25.118340 20598 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.190310 14228 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:20:25.179838 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1273) took 1469 ms. Trace:
I20260709 13:20:25.185479 14297 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:25.156258 20664 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:25.157685 20741 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:25.204468 14375 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:25.202302 20792 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:25.161496 20896 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:20:25.156495 20879 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.210727 14895 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:25.212225 14901 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:20:25.212482 14224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.013s	sys 0.024s
I20260709 13:20:25.218531 14220 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:25.171712 20906 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:25.232905 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.044s	sys 0.083s
W20260709 13:20:25.238401 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 482735us
W20260709 13:20:25.209442 20681 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.217s	user 0.017s	sys 0.000s
I20260709 13:20:25.209523 20742 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:25.238828 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.045s	sys 0.083s
I20260709 13:20:25.211611 20664 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.242865 14228 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:20:25.243185 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 647255us
W20260709 13:20:25.241645 14343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.026s	sys 0.035s
W20260709 13:20:25.247457 14343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.027s	sys 0.036s
W20260709 13:20:25.244122 14224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.013s	sys 0.025s
W20260709 13:20:25.249678 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.210709 20737 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:25.191186 14303 rpcz_store.cc:276] 0709 13:20:23.710161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.747082 (+ 36921us) service_pool.cc:224] Handling call
0709 13:20:23.764366 (+ 17284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.764678 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:23.827488 (+ 62810us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.179430 (+1351942us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:25.179486 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:25.179535 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.179605 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.179752 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6742,"prepare.queue_time_us":1339,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":239989,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":47976,"spinlock_wait_cycles":152704,"thread_start_us":1271598,"threads_started":3,"wal-append.queue_time_us":704279}
I20260709 13:20:25.232136 20837 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:25.218711 20752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.007s	sys 0.031s
W20260709 13:20:25.295630 14229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.033s	sys 0.070s
W20260709 13:20:25.296561 14229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.033s	sys 0.070s
I20260709 13:20:25.240935 20906 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:25.252367 20769 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.012s	sys 0.028s
I20260709 13:20:25.242730 20742 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:25.313634 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 67735.1us
I20260709 13:20:25.243530 20910 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:25.301836 20752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.008s	sys 0.031s
W20260709 13:20:25.302086 20556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.023s	sys 0.025s
I20260709 13:20:25.292248 20837 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:25.291908 20890 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:25.318928 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.191640 20798 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:25.310051 20769 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.012s	sys 0.029s
I20260709 13:20:25.245589 20681 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:25.324239 20766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.009s	sys 0.015s
W20260709 13:20:25.328052 20556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.023s	sys 0.026s
I20260709 13:20:25.343947 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:25.323173 20910 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.296658 20912 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
W20260709 13:20:25.349859 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 388448us
I20260709 13:20:25.335068 20837 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.362648 14221 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:25.366815 20908 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.367622 20908 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:25.370924 20900 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:20:25.374243 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 3095) took 1204 ms. Trace:
W20260709 13:20:25.374414 20895 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:20:25.374711 14227 rpcz_store.cc:276] 0709 13:20:24.170147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.186912 (+ 16765us) service_pool.cc:224] Handling call
0709 13:20:25.374026 (+1187114us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b540026c5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:25.374170 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749438208}
W20260709 13:20:25.375684 20898 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:20:25.377390 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2747) took 1367 ms. Trace:
I20260709 13:20:25.377734 14226 rpcz_store.cc:276] 0709 13:20:24.010104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.010390 (+   286us) service_pool.cc:224] Handling call
0709 13:20:24.036980 (+ 26590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.051944 (+ 14964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.051998 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.082327 (+ 30329us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.738328 (+656001us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:24.738373 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.738452 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.377160 (+638708us) raft_consensus.cc:1685] finished
0709 13:20:25.377188 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.377331 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13092,"thread_start_us":594794,"threads_started":1,"wal-append.queue_time_us":1011648}
I20260709 13:20:25.388080 20909 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:25.388633 20909 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:25.389600 20909 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.391417 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 3097) took 1166 ms. Trace:
I20260709 13:20:25.391902 14221 rpcz_store.cc:276] 0709 13:20:24.224827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.225049 (+   222us) service_pool.cc:224] Handling call
0709 13:20:25.391166 (+1166117us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002bcfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:25.391343 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2430080768}
I20260709 13:20:25.399865 14900 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:25.403996 14295 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
W20260709 13:20:25.405931 20894 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
W20260709 13:20:25.349103 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 531777us
I20260709 13:20:25.355962 20910 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:25.349648 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 441056us
I20260709 13:20:25.450346 14865 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:25.321812 20892 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:20:25.407698 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 75045.9us
I20260709 13:20:25.414808 20742 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:25.346462 20890 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.336030 20769 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:25.358958 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:25.447075 20904 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 13:20:25.496829 14193 leader_election.cc:400] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15.
W20260709 13:20:25.500291 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50977.9us
I20260709 13:20:25.501194 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:25.502838 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:25.505374 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:25.506158 14229 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:25.446714 20557 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:25.506847 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44159us
W20260709 13:20:25.507541 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 148692us
I20260709 13:20:25.508682 14221 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:25.515149 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:25.516139 14193 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:25.508759 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:25.521489 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:25.338743 20905 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.351s
I20260709 13:20:25.458453 20919 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
W20260709 13:20:25.640527 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 452680us
I20260709 13:20:25.532002 14226 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:25.499305 20798 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:25.654763 14377 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.000s	sys 0.002s
W20260709 13:20:25.690089 14377 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.000s	sys 0.011s
W20260709 13:20:25.560999 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 499814us
W20260709 13:20:25.595166 14373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.008s	sys 0.016s
I20260709 13:20:25.541072 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:25.574744 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44617.8us
I20260709 13:20:25.563109 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3155) took 1249 ms. Trace:
I20260709 13:20:25.581683 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2874) took 1441 ms. Trace:
I20260709 13:20:25.520622 20317 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:25.715189 14373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.015s	sys 0.018s
I20260709 13:20:25.575505 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:25.666759 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:25.562031 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 389475us
I20260709 13:20:25.524582 20742 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.497972 20876 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:25.452685 20556 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.516036 20752 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:25.454128 20589 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:25.692363 20927 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:25.715124 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:25.651610 20879 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:25.672868 20598 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:25.714898 14295 rpcz_store.cc:276] 0709 13:20:24.314273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.314452 (+   179us) service_pool.cc:224] Handling call
0709 13:20:25.562826 (+1248374us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54000910d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:25.563008 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891350272}
I20260709 13:20:25.528544 20501 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:25.536350 20520 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:25.715044 14372 rpcz_store.cc:276] 0709 13:20:24.140184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.140335 (+   151us) service_pool.cc:224] Handling call
0709 13:20:24.168467 (+ 28132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.216436 (+ 47969us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:24.803366 (+586930us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.573583 (+770217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:25.573670 (+    87us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:25.573736 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.581415 (+  7679us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.581594 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":821547,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3779,"raft.queue_time_us":191294,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":10885,"thread_start_us":1270830,"threads_started":3,"wal-append.queue_time_us":857744}
I20260709 13:20:25.531455 20383 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:25.459331 20830 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:25.527621 20853 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:25.461269 20663 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:25.557296 20855 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:25.598292 20908 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:25.616590 20557 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:25.761493 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 220511us
I20260709 13:20:25.813810 14193 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:25.815035 20908 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:25.521595 20741 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.195s
I20260709 13:20:25.532087 20396 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:25.629995 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 97832.6us
I20260709 13:20:25.769274 20691 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.820392 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:25.820242 20691 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.823879 20691 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:25.759879 20431 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:25.803722 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 88673.7us
I20260709 13:20:25.817605 14193 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:25.825453 20431 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:25.825831 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:25.696491 20902 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.440s
I20260709 13:20:25.779798 20912 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.826864 20912 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:25.828209 20431 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:25.809266 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1488) took 1934 ms. Trace:
I20260709 13:20:25.779456 20737 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.791996 20911 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.135s	user 0.000s	sys 0.002s
I20260709 13:20:25.769670 20752 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.811290 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:25.800562 20678 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.411s	user 0.010s	sys 0.007s
I20260709 13:20:25.836030 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:25.793696 20927 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:25.801440 20879 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.776170 20888 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:20:25.830166 14892 rpcz_store.cc:276] 0709 13:20:23.875173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.061193 (+186020us) service_pool.cc:224] Handling call
0709 13:20:24.101600 (+ 40407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.149457 (+ 47857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.149508 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.185142 (+ 35634us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.720928 (+535786us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:24.720987 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.722504 (+  1517us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.808938 (+1086434us) raft_consensus.cc:1685] finished
0709 13:20:25.808975 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.809185 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9201,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":17514,"thread_start_us":426837,"threads_started":1,"wal-append.queue_time_us":808690}
I20260709 13:20:25.799983 20853 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.767028 20876 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:25.874396 20927 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:25.875288 20905 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:25.875627 20876 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:25.716845 20769 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.875931 20905 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.878196 20905 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:25.829618 20912 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:25.831441 20598 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:25.856086 20396 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.857018 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:25.857704 20663 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:25.844527 20890 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:25.775333 20926 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:20:25.770879 20556 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.832180 20520 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:25.924918 20556 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:25.850353 20664 consensus_meta.cc:287] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.004s
I20260709 13:20:25.785481 20589 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:25.871315 20915 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:20:25.871832 20929 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:25.873072 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1285) took 1253 ms. Trace:
I20260709 13:20:25.873277 20902 consensus_queue.cc:1243] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:25.873579 20853 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:25.863070 20830 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:25.857818 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 191141us
I20260709 13:20:25.882018 20431 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.881846 20923 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.256s
I20260709 13:20:25.945314 20431 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:25.952679 20910 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:25.884114 20914 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 13:20:25.883143 20924 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:20:25.879106 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1288) took 1062 ms. Trace:
W20260709 13:20:25.884965 20917 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:20:25.955015 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1540) took 1589 ms. Trace:
I20260709 13:20:25.954164 14300 rpcz_store.cc:276] 0709 13:20:24.816478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.817935 (+  1457us) service_pool.cc:224] Handling call
0709 13:20:24.818341 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:25.319515 (+501174us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:25.319563 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.358974 (+ 39411us) log.cc:844] Serialized 26 byte log entry
0709 13:20:25.779488 (+420514us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:25.779531 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.779607 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.878870 (+ 99263us) raft_consensus.cc:1685] finished
0709 13:20:25.878890 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.879044 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6619,"raft.queue_time_us":178084,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":657685,"threads_started":2,"wal-append.queue_time_us":314037}
I20260709 13:20:25.849014 20745 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:25.956079 20745 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:25.853129 20752 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:25.851908 20383 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:25.966667 20383 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:25.897042 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 223659us
I20260709 13:20:25.904575 20948 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:25.905025 20921 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:25.905563 20913 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.503s	user 0.002s	sys 0.000s
W20260709 13:20:25.905712 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.906041 20730 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:25.907330 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.976002 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.907051 20501 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:25.907894 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 107625us
I20260709 13:20:25.978626 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:25.909960 20918 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:25.911288 20922 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.250s	user 0.002s	sys 0.000s
W20260709 13:20:25.912179 20620 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.909s	user 0.012s	sys 0.000s
I20260709 13:20:25.892123 20598 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.850190 20737 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.894613 20396 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.917104 20557 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:25.918339 14901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1527) took 1731 ms (client timeout 2112 ms). Trace:
W20260709 13:20:25.919446 20847 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.910s	user 0.012s	sys 0.001s
I20260709 13:20:25.920109 14893 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:20:25.920014 20932 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.920275 20568 consensus_meta.cc:287] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.801s	user 0.013s	sys 0.000s
I20260709 13:20:25.863180 20681 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:25.861138 20678 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:25.922526 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:25.922930 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1542) took 1319 ms. Trace:
I20260709 13:20:26.034008 14220 rpcz_store.cc:276] 0709 13:20:24.603485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.237931 (+634446us) service_pool.cc:224] Handling call
0709 13:20:25.238362 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:25.243909 (+  5547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:25.243962 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.305854 (+ 61892us) log.cc:844] Serialized 26 byte log entry
0709 13:20:25.794484 (+488630us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:25.794540 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.794697 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.922725 (+128028us) raft_consensus.cc:1685] finished
0709 13:20:25.922743 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.922874 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1288,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":2443,"thread_start_us":454873,"threads_started":1,"wal-append.queue_time_us":594408}
I20260709 13:20:25.922567 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1533) took 1813 ms. Trace:
I20260709 13:20:26.035959 14369 rpcz_store.cc:276] 0709 13:20:24.109494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.118415 (+  8921us) service_pool.cc:224] Handling call
0709 13:20:24.144170 (+ 25755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.177591 (+ 33421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.177633 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.235784 (+ 58151us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.970414 (+734630us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:24.970447 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.970501 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.922347 (+951846us) raft_consensus.cc:1685] finished
0709 13:20:25.922367 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.922503 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":15505,"thread_start_us":615752,"threads_started":1,"wal-append.queue_time_us":985566}
I20260709 13:20:25.926075 20664 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:25.941933 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 121743us
I20260709 13:20:25.951061 20920 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:25.953187 20431 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:25.883215 20903 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:25.953438 20899 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.805s	user 0.000s	sys 0.006s
I20260709 13:20:25.954177 20929 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:25.855427 20741 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:25.862421 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62246.4us
I20260709 13:20:25.936162 14867 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:25.957121 20745 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.936143 14296 rpcz_store.cc:276] 0709 13:20:24.619746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.627300 (+  7554us) service_pool.cc:224] Handling call
0709 13:20:24.652347 (+ 25047us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:25.185867 (+533520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:25.185917 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.230815 (+ 44898us) log.cc:844] Serialized 26 byte log entry
0709 13:20:25.653457 (+422642us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:25.653512 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.653618 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.872811 (+219193us) raft_consensus.cc:1685] finished
0709 13:20:25.872829 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.873007 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":244553,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":27824,"thread_start_us":916545,"threads_started":2,"wal-append.queue_time_us":548036}
I20260709 13:20:25.957602 20589 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:26.028071 20520 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.955433 14224 rpcz_store.cc:276] 0709 13:20:24.365214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.396727 (+ 31513us) service_pool.cc:224] Handling call
0709 13:20:24.407036 (+ 10309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:24.474816 (+ 67780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.474852 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:24.491621 (+ 16769us) log.cc:844] Serialized 52 byte log entry
0709 13:20:25.248830 (+757209us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:25.248887 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.248979 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.954728 (+705749us) raft_consensus.cc:1685] finished
0709 13:20:25.954752 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.954949 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3431,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":60902,"thread_start_us":671163,"threads_started":1,"wal-append.queue_time_us":931151}
W20260709 13:20:26.060397 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 124339us
W20260709 13:20:26.056397 14193 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.130:44127 timed out after 1.817s (SENT) [suppressed 3 similar messages]
W20260709 13:20:25.972227 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.063076 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.063298 20879 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:26.043685 20920 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:26.064478 20925 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.970801 14341 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:26.065063 20925 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.065969 14226 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:20:26.066200 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 95471.6us
I20260709 13:20:26.067031 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:26.067826 20919 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:26.067961 20925 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:26.068392 20919 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:26.069223 20954 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:26.070828 20954 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:20:26.051190 20837 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.000s
W20260709 13:20:25.998693 14901 rpcz_store.cc:269] 0709 13:20:24.187295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.189767 (+  2472us) service_pool.cc:224] Handling call
0709 13:20:25.918110 (+1728343us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54007d0354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:25.918274 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301333376}
I20260709 13:20:26.002527 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:26.003259 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:26.076680 14895 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:26.003473 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:26.003695 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:26.004381 20942 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:20:26.004464 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:26.004634 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:26.005184 20944 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:25.994479 20620 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.005730 20737 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:26.009526 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1416) took 1806 ms. Trace:
I20260709 13:20:26.051043 20647 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:26.004061 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.980919 20926 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.980297 20921 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.011485 20598 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:25.999202 20730 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:26.041252 20728 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:26.048278 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48828us
I20260709 13:20:26.049288 20664 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:26.055565 14898 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:26.103106 20928 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:25.926874 20876 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.103641 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:26.104064 20935 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.103932 20876 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.104682 20935 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.105191 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:26.081888 20431 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:26.069593 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:26.065186 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2745) took 2055 ms. Trace:
I20260709 13:20:26.071254 20954 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:26.017772 20948 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:20:25.981228 20918 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:26.071416 20906 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.740s	user 0.012s	sys 0.000s
I20260709 13:20:26.085722 14893 rpcz_store.cc:276] 0709 13:20:24.203134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.203277 (+   143us) service_pool.cc:224] Handling call
0709 13:20:25.919840 (+1716563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.007676 (+ 87836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.009271 (+  1595us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54007d0350. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:26.009446 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3899814144}
I20260709 13:20:26.088480 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:26.092095 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:26.029687 20568 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.093972 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:26.094168 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:26.070850 20766 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:26.071201 20396 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:26.059866 20681 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.099617 14344 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:26.028623 20847 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.064956 20920 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:25.977298 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:26.078189 14896 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:26.112313 20142 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:26.111016 14222 rpcz_store.cc:276] 0709 13:20:24.009479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.009623 (+   144us) service_pool.cc:224] Handling call
0709 13:20:24.024725 (+ 15102us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.038044 (+ 13319us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:24.038090 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.096126 (+ 58036us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.738686 (+642560us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:24.738746 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.738930 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.952985 (+1214055us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b24001504e8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fde09d 00007f8decc1010e 00007f8decc2788c 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221
0709 13:20:26.064881 (+111896us) raft_consensus.cc:1685] finished
0709 13:20:26.064903 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.065115 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12848,"raft.queue_time_us":17570,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"spinlock_wait_cycles":115041792,"thread_start_us":595962,"threads_started":1,"wal-append.queue_time_us":944865}
I20260709 13:20:26.083961 20855 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:26.087556 20908 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:26.103740 20928 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.136060 20918 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.080354 20853 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:26.087116 20919 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.162146 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.162688 20933 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.163194 14372 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:26.163826 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.041538 20932 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.060750 20741 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.158748 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:26.193774 14301 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:26.166193 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:26.166689 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:26.165576 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.287521 14370 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.287966 14376 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:26.154348 14228 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: [14.9-16.10]
I20260709 13:20:26.108778 20728 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.091136 20930 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:26.193521 14299 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
W20260709 13:20:26.205119 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 116715us
I20260709 13:20:26.105989 20556 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.084297 20837 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.093575 20647 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:26.222853 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 123334us
I20260709 13:20:26.223177 20142 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.223409 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.302183 20142 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.075261 20520 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:26.229059 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.222239 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.158345 20910 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:26.238400 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:26.235477 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:26.165416 20903 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:26.236321 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:26.340214 14896 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:26.137722 20431 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:26.246168 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:26.200094 20766 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:26.266583 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.106745 20944 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.222972 20383 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:26.263216 14378 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:26.138293 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.364105 14374 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:26.104074 20926 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:26.241206 20905 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:26.298039 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.378356 14376 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:26.200565 20906 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:26.379487 20142 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.337036 14344 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:26.379882 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 221222us
I20260709 13:20:26.333562 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.338860 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:26.340274 14901 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
W20260709 13:20:26.256527 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 200115us
I20260709 13:20:26.380897 14372 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:26.380911 14298 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:26.381924 14193 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:26.382601 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:26.382949 14342 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:26.231199 20681 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.361258 14222 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:26.370152 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:26.251642 20752 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:26.333000 20769 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:26.375913 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:26.266469 20742 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:20:26.386670 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:26.343902 20903 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:26.394963 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58013us
I20260709 13:20:26.405311 14344 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:26.405514 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:26.406363 14376 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:26.320190 20876 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:26.412470 20142 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:26.423561 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:26.424782 14304 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:26.424805 20979 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:26.426384 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:26.427317 20980 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.428064 20980 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.430066 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:26.434782 14301 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:26.436203 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:26.438501 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.439613 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:26.365865 20960 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:26.440896 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.442173 14375 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 21: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:26.449347 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.385239 20950 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.460551 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.461400 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:26.426702 20979 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.462570 14376 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 13: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:26.378005 20383 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:26.471148 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:26.356683 20830 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:20:26.412127 20930 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:26.431142 20691 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:26.469166 20910 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:26.477213 20952 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.426s	user 0.001s	sys 0.000s
I20260709 13:20:26.468312 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:26.265878 20954 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.411613 20678 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:26.490814 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:26.516579 14299 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:20:26.344270 20730 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:26.492609 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 110756us
I20260709 13:20:26.451887 20960 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.489100 20691 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.381455 20556 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.470288 20945 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.466758 20939 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:26.303396 20933 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.475737 20916 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.514091 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:26.488622 20930 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.587052 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:26.588027 14299 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:26.513180 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44979.4us
I20260709 13:20:26.257624 20929 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.508330 20396 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:26.511399 20925 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:26.518472 20957 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.546708 20769 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:26.552875 20691 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:26.596293 14369 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
W20260709 13:20:26.603835 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.549602 20960 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.470189 20766 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:26.578661 14267 connection.cc:256] RPC call timeout handler was delayed by -2.5367984240001533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 13:20:26.504513 20959 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.365s
I20260709 13:20:26.560726 20939 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:26.630570 14224 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:26.590155 20910 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:26.638067 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45471.2us
I20260709 13:20:26.602916 20954 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:26.596877 20930 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:26.651432 20742 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:26.653818 14267 connection.cc:256] RPC call timeout handler was delayed by -2.4944984240000849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
W20260709 13:20:26.672451 14267 connection.cc:256] RPC call timeout handler was delayed by -2.3540984240000853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 13:20:26.654016 20976 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:20:26.654266 20973 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:26.672830 14267 connection.cc:256] RPC call timeout handler was delayed by -2.3531984240000838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 13:20:26.678067 14267 connection.cc:256] RPC call timeout handler was delayed by -2.267698424000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 13:20:26.678509 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.678771 14267 connection.cc:256] RPC call timeout handler was delayed by -2.1821984240000347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 13:20:26.679064 14267 connection.cc:256] RPC call timeout handler was delayed by -2.1713984240000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 13:20:26.679296 14267 connection.cc:256] RPC call timeout handler was delayed by -2.1650984240000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 13:20:26.679450 14267 connection.cc:256] RPC call timeout handler was delayed by -2.0318984240000191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
W20260709 13:20:26.679606 14267 connection.cc:256] RPC call timeout handler was delayed by -1.969798424000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 13:20:26.679752 14267 connection.cc:256] RPC call timeout handler was delayed by -1.8932984240000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 13:20:26.679903 14267 connection.cc:256] RPC call timeout handler was delayed by -1.6304984240000522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25070000000000003s for a response
I20260709 13:20:26.545298 20431 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:26.680145 14267 connection.cc:256] RPC call timeout handler was delayed by -1.461560985999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:20:26.684032 14267 connection.cc:256] RPC call timeout handler was delayed by -1.3789856359999249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 13:20:26.684337 14267 connection.cc:256] RPC call timeout handler was delayed by -1.275898424000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29009999999999997s for a response
I20260709 13:20:26.673394 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1293) took 1150 ms. Trace:
W20260709 13:20:26.686321 14303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.000s	sys 0.008s
W20260709 13:20:26.687614 14303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.000s	sys 0.008s
I20260709 13:20:26.634361 20921 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:26.600592 20902 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
W20260709 13:20:26.675453 20938 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.018s	sys 0.048s
I20260709 13:20:26.684897 14302 rpcz_store.cc:276] 0709 13:20:25.523196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.523448 (+   252us) service_pool.cc:224] Handling call
0709 13:20:25.574866 (+ 51418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:25.660152 (+ 85286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:25.660198 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.691103 (+ 30905us) log.cc:844] Serialized 26 byte log entry
0709 13:20:25.861732 (+170629us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:25.861773 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.861870 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:26.673093 (+811223us) raft_consensus.cc:1685] finished
0709 13:20:26.673125 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.673316 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55994,"raft.queue_time_us":39288,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":26036,"thread_start_us":63476,"threads_started":1,"wal-append.queue_time_us":213965}
W20260709 13:20:26.703473 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53216.6us
I20260709 13:20:26.647271 20939 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.602473 20396 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.594707 20916 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:26.593536 20945 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.708365 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:26.673316 20792 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.607628 20925 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.671904 20681 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:26.727149 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:26.597193 20383 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:26.654297 20557 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:26.477984 20950 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:26.703778 20938 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.019s	sys 0.048s
W20260709 13:20:26.799186 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 510472us
I20260709 13:20:26.726862 20766 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:26.714905 20520 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:26.681500 20742 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:26.623113 20957 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.740599 14302 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:26.819191 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:26.727234 20909 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:26.789022 20906 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:26.829802 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 121505us
I20260709 13:20:26.830235 20896 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:20:26.830295 20598 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:26.834702 20981 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:20:26.838115 20979 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:26.839011 21004 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:26.840596 21004 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:26.840876 20728 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:26.842037 20966 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.438s	user 0.001s	sys 0.000s
I20260709 13:20:26.843458 20890 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:26.843878 20890 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:26.793037 20501 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:26.846742 14370 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 13:20:26.728963 20932 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:26.716457 20837 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:26.800069 20557 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:26.875552 20962 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.372s	user 0.001s	sys 0.001s
W20260709 13:20:26.875962 20956 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.416s	user 0.000s	sys 0.002s
W20260709 13:20:26.878086 20970 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.395s	user 0.000s	sys 0.001s
W20260709 13:20:26.878613 20963 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
W20260709 13:20:26.879215 20971 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:20:26.880110 20945 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:26.885803 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.887246 14370 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:26.736058 20792 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:26.935109 20742 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:26.735718 20928 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:26.730360 20752 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:26.924661 20396 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:26.960242 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:26.912954 20556 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:26.961591 14297 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:20:26.927175 20982 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:20:26.810264 20769 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:26.931054 20950 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:26.932346 20933 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:20:26.933662 20916 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:26.936316 14299 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:26.734695 20921 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.179s
I20260709 13:20:26.798452 20678 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:20:26.695235 20973 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.954895 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:26.983841 14220 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:26.957016 14370 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:20:26.912916 20501 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:26.844676 20890 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:26.994426 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 278853us
I20260709 13:20:26.993083 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:26.996263 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:26.998693 20926 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:26.999935 20908 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:27.000634 20908 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:26.971310 14296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.017s	sys 0.039s
W20260709 13:20:26.977135 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 123211us
I20260709 13:20:26.944545 20589 raft_consensus.cc:2764] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:20:27.002760 14296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.017s	sys 0.039s
I20260709 13:20:27.004554 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:26.981362 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:26.925768 20902 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.005586 20902 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.006966 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:27.007879 14895 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:27.008267 20902 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:27.009248 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:27.039465 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:27.041265 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:27.041683 14223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2748) took 2545 ms (client timeout 3067 ms). Trace:
I20260709 13:20:27.016186 20741 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:27.018572 20920 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:27.042176 14223 rpcz_store.cc:269] 0709 13:20:24.496611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.998214 (+501603us) service_pool.cc:224] Handling call
0709 13:20:27.041487 (+2043273us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540026bbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:27.041623 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2426243328}
I20260709 13:20:27.021715 20142 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:27.045964 20142 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:27.046141 20999 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.165s	user 0.005s	sys 0.001s
I20260709 13:20:27.046862 20142 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:27.042194 14895 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:27.048130 20142 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:27.027519 20598 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:27.050318 20598 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:27.037599 20568 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:27.052485 20847 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:27.051509 20598 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.055699 20647 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:27.053435 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:27.057690 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2754) took 1553 ms. Trace:
I20260709 13:20:27.053840 20598 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.058135 14228 rpcz_store.cc:276] 0709 13:20:25.504416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.504604 (+   188us) service_pool.cc:224] Handling call
0709 13:20:25.527369 (+ 22765us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:26.292533 (+765164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.057389 (+764856us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b540033cf54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:27.057626 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398509824}
I20260709 13:20:27.059798 14895 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:27.062057 20853 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:27.073463 20620 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:27.076643 20963 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 13:20:27.083197 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 93408.5us
I20260709 13:20:27.077441 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:27.086694 14901 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:27.096835 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1548) took 1591 ms. Trace:
I20260709 13:20:27.097437 14229 rpcz_store.cc:276] 0709 13:20:25.505538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.516666 (+ 11128us) service_pool.cc:224] Handling call
0709 13:20:25.516988 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:25.558375 (+ 41387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:25.558429 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.593649 (+ 35220us) log.cc:844] Serialized 26 byte log entry
0709 13:20:25.976368 (+382719us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b18003feda0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:20:26.084382 (+108014us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:26.084429 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.084612 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:27.084238 (+999626us) raft_consensus.cc:1685] finished
0709 13:20:27.084269 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.096744 (+ 12475us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84383,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":42177,"spinlock_wait_cycles":4135296,"thread_start_us":107808,"threads_started":1,"wal-append.queue_time_us":598996}
I20260709 13:20:27.105473 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:27.109504 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:27.110471 14229 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:27.112851 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:27.113894 14229 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:27.074360 20892 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:27.120115 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.123703 14376 raft_consensus.cc:2410] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:20:27.110615 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:27.084412 20396 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.085714 20921 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:27.129879 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:27.130780 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3334) took 1028 ms. Trace:
I20260709 13:20:27.135074 14901 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:27.095896 20888 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:27.196694 20888 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.163594 14299 rpcz_store.cc:276] 0709 13:20:26.102253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.100119 (+997866us) service_pool.cc:224] Handling call
0709 13:20:27.130011 (+ 29892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:27.130276 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:27.130302 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:27.130365 (+    63us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:27.130430 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.130538 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.130682 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:27.139273 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.154271 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.155261 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:27.156307 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:27.157220 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.158627 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.161397 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:27.176661 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.186760 14864 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:27.195083 14227 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:27.195302 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:27.195662 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:27.196161 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:27.205139 14901 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:27.209208 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.118687 20890 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:27.219959 14896 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.020s	sys 0.014s
W20260709 13:20:27.222040 14896 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.020s	sys 0.014s
I20260709 13:20:27.212426 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2894) took 1052 ms. Trace:
I20260709 13:20:27.213757 14369 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:27.214910 14220 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:27.204275 14223 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:27.121555 20853 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:27.227926 14228 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:27.209467 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:27.249399 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:27.252477 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1534) took 1167 ms. Trace:
I20260709 13:20:27.127524 20892 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:27.088177 20830 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.129s
I20260709 13:20:27.299777 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:27.211653 20879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.015s	sys 0.016s
I20260709 13:20:27.253062 14896 rpcz_store.cc:276] 0709 13:20:26.084980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.374901 (+289921us) service_pool.cc:224] Handling call
0709 13:20:26.375334 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:26.427246 (+ 51912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.427303 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:26.428280 (+   977us) log.cc:844] Serialized 52 byte log entry
0709 13:20:26.602256 (+173976us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:27.251728 (+649472us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.252035 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.252153 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:27.252214 (+    61us) raft_consensus.cc:1685] finished
0709 13:20:27.252233 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.252396 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26762,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":3062,"raft.queue_time_us":61323,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":25001,"thread_start_us":829463,"threads_started":3,"wal-append.queue_time_us":248713}
I20260709 13:20:27.223675 14371 rpcz_store.cc:276] 0709 13:20:26.159986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.166906 (+  6920us) service_pool.cc:224] Handling call
0709 13:20:26.167484 (+   578us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:26.168116 (+   632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.168163 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:26.169104 (+   941us) log.cc:844] Serialized 52 byte log entry
0709 13:20:26.368135 (+199031us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:26.526836 (+158701us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.586503 (+ 59667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.586630 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:27.212157 (+625527us) raft_consensus.cc:1685] finished
0709 13:20:27.212183 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.212359 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":308402,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":3059,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":7660,"thread_start_us":313762,"threads_started":2,"wal-append.queue_time_us":340164}
I20260709 13:20:27.216735 20888 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:27.199034 20847 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:27.344025 14229 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:27.271448 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:27.331401 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3167) took 1267 ms. Trace:
I20260709 13:20:27.345679 14296 rpcz_store.cc:276] 0709 13:20:26.063801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.072328 (+  8527us) service_pool.cc:224] Handling call
0709 13:20:26.089520 (+ 17192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.089943 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.089973 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:26.122904 (+ 32931us) log.cc:844] Serialized 26 byte log entry
0709 13:20:27.003570 (+880666us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:27.003611 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.003701 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:27.331121 (+327420us) raft_consensus.cc:1685] finished
0709 13:20:27.331150 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.331319 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":749040,"threads_started":1,"wal-append.queue_time_us":1030500}
I20260709 13:20:27.331946 20730 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.256196 20737 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:27.335999 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:27.351089 14227 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:27.207870 20925 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:27.099105 20939 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:27.334218 20988 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.511s	user 0.000s	sys 0.001s
I20260709 13:20:27.296730 20620 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.347630 14901 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:27.251657 20853 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.199841 20396 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.296408 20589 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:27.312009 20879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.022s	sys 0.027s
I20260709 13:20:27.373064 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1424) took 1370 ms. Trace:
I20260709 13:20:27.340247 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.374158 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1425) took 1371 ms. Trace:
I20260709 13:20:27.379607 14371 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:27.218456 20908 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.410454 14898 rpcz_store.cc:276] 0709 13:20:26.002423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.002533 (+   110us) service_pool.cc:224] Handling call
0709 13:20:26.002833 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.103491 (+100658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.373625 (+1270134us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b54007e7cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:27.374080 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104328448}
I20260709 13:20:27.373239 20557 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:27.411883 14377 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:27.414623 14897 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:27.412194 14900 rpcz_store.cc:276] 0709 13:20:26.002124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.002239 (+   115us) service_pool.cc:224] Handling call
0709 13:20:26.002618 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.012229 (+  9611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.012264 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.012353 (+    89us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:26.012385 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.372726 (+1360341us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b54007468d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:27.372804 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.372967 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21638656}
W20260709 13:20:27.351883 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 347445us
I20260709 13:20:27.351539 20647 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:27.382848 20971 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:27.344760 20847 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:27.442076 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 57767.8us
W20260709 13:20:27.464105 14222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.073s	sys 0.119s
I20260709 13:20:27.442469 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:27.464715 14222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.073s	sys 0.119s
I20260709 13:20:27.396142 20853 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:27.387698 20798 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.676s	user 0.008s	sys 0.007s
I20260709 13:20:27.462338 20792 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:27.406860 20886 raft_consensus.cc:2243] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:27.444166 14370 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:27.442369 14227 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:20:27.411406 20589 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.374251 20730 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.498672 14295 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
W20260709 13:20:27.499854 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57511.5us
I20260709 13:20:27.500057 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1555) took 1008 ms. Trace:
I20260709 13:20:27.408560 20737 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:27.501983 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:27.502812 14295 pending_rounds.cc:85] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 12
I20260709 13:20:27.508596 14295 pending_rounds.cc:107] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:20:27.508937 14295 raft_consensus.cc:2889] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.503348 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:27.502976 14222 rpcz_store.cc:276] 0709 13:20:26.492107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.492846 (+   739us) service_pool.cc:224] Handling call
0709 13:20:26.514121 (+ 21275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.514407 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:26.941297 (+426890us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.499678 (+558381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:27.499734 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:27.499776 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.499845 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.499997 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34220,"prepare.queue_time_us":424697,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"thread_start_us":878850,"threads_started":2}
I20260709 13:20:27.469811 20847 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:27.522083 14377 pending_rounds.cc:85] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 13
I20260709 13:20:27.526448 14377 pending_rounds.cc:107] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:20:27.526741 14377 raft_consensus.cc:2889] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.444391 20568 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:27.465029 20942 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.532316 14371 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:27.376411 14896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f44936b303148f4848621766631d925"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:27.536350 14896 raft_consensus.cc:606] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:27.536902 14896 raft_consensus.cc:614] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:27.521281 20752 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:27.501519 20589 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:27.515683 20798 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:27.578953 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:27.579771 14371 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:27.528503 20879 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:27.580221 14897 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
W20260709 13:20:27.556450 20918 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.305s	user 0.010s	sys 0.004s
I20260709 13:20:27.444615 20892 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.611183 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1545) took 1449 ms. Trace:
W20260709 13:20:27.565578 20964 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.195s	user 0.004s	sys 0.001s
W20260709 13:20:27.558492 20996 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.564s	user 0.000s	sys 0.002s
W20260709 13:20:27.612274 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 123401us
I20260709 13:20:27.552071 20752 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:27.615833 14374 rpcz_store.cc:276] 0709 13:20:26.161552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.364911 (+203359us) service_pool.cc:224] Handling call
0709 13:20:26.365355 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:26.385564 (+ 20209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.385609 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:26.386245 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 13:20:26.601270 (+215025us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:26.935521 (+334251us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.935729 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.935803 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:27.610903 (+675100us) raft_consensus.cc:1685] finished
0709 13:20:27.610930 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.611108 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24433,"prepare.queue_time_us":133916,"prepare.run_cpu_time_us":4453,"prepare.run_wall_time_us":15265,"raft.queue_time_us":29804,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":52013,"thread_start_us":411996,"threads_started":2,"wal-append.queue_time_us":272290}
I20260709 13:20:27.629436 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.558657 20955 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.586855 20501 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:27.564752 20926 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:27.624596 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.567621 20792 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:27.648272 20886 raft_consensus.cc:2272] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:27.552862 20942 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:27.629854 20909 consensus_meta.cc:287] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.793s	user 0.007s	sys 0.004s
I20260709 13:20:27.629525 20752 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:27.647893 20737 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.659188 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:27.606389 20991 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.032s	sys 0.045s
I20260709 13:20:27.549168 20568 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:27.675979 21014 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:20:27.676819 21001 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
W20260709 13:20:27.683236 20954 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.011s	user 0.011s	sys 0.000s
W20260709 13:20:27.685130 20598 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.004s
I20260709 13:20:27.686200 20921 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:27.686766 20908 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:27.687935 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:27.672840 20955 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.689204 20620 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:27.631839 20892 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:27.701318 14378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.028s	sys 0.030s
I20260709 13:20:27.622249 20918 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:27.722257 20766 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.900s	user 0.015s	sys 0.000s
W20260709 13:20:27.738699 20991 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.033s	sys 0.050s
I20260709 13:20:27.729853 20792 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:27.755699 14302 raft_consensus.cc:2410] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
W20260709 13:20:27.756263 14378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.028s	sys 0.030s
W20260709 13:20:27.758219 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.762758 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.739051 20855 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.736289 20926 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.770475 14304 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:27.759797 20886 ts_tablet_manager.cc:1916] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:20:27.765558 21016 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:20:27.790548 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:27.791570 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.898761 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.758735 20798 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:27.900462 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 110012us
I20260709 13:20:27.801432 20918 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:27.768908 20954 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.803431 20903 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.365s	user 0.012s	sys 0.001s
I20260709 13:20:27.812387 20939 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:27.813552 20957 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:27.814949 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:27.922052 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.818254 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.820298 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:27.926962 14372 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:27.765117 20396 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:27.773288 20960 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.121s	user 0.012s	sys 0.001s
I20260709 13:20:27.766997 20921 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.796769 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 126751us
I20260709 13:20:27.901890 14374 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
W20260709 13:20:27.899722 21018 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.003s
W20260709 13:20:27.899402 20691 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.259s	user 0.010s	sys 0.008s
I20260709 13:20:27.771807 20855 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:27.938706 20890 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
I20260709 13:20:27.896703 20730 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:27.900110 20557 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:27.911535 20598 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:27.955653 20598 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:27.956209 20598 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:27.956902 14892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:27.957533 14892 raft_consensus.cc:606] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:27.920464 20930 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.239s	user 0.013s	sys 0.004s
I20260709 13:20:27.969856 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:27.976643 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 473362us
I20260709 13:20:27.929623 20903 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:27.928856 20954 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.979913 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:27.991788 20954 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:27.994621 20903 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:27.953048 20921 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:27.999557 20921 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:27.960546 20557 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:27.975247 21023 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:20:28.001884 20557 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:28.002501 20557 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.002821 20955 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.003185 20557 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.948119 20960 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:27.952765 20691 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.006129 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3331) took 2029 ms. Trace:
I20260709 13:20:28.006765 14226 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:28.002856 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1294) took 1925 ms. Trace:
I20260709 13:20:28.007649 20691 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:27.974845 20957 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:28.006513 14295 rpcz_store.cc:276] 0709 13:20:25.977156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.978064 (+   908us) service_pool.cc:224] Handling call
0709 13:20:25.978426 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:27.509418 (+1530992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.005902 (+496484us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540020b554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:28.006072 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3495216896}
I20260709 13:20:27.988639 20663 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:28.009081 20957 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.010823 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3333) took 1909 ms. Trace:
I20260709 13:20:28.011226 14298 rpcz_store.cc:276] 0709 13:20:26.101933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.003189 (+901256us) service_pool.cc:224] Handling call
0709 13:20:27.003568 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:27.099807 (+ 96239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:27.099847 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:27.154106 (+ 54259us) log.cc:844] Serialized 26 byte log entry
0709 13:20:27.614439 (+460333us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:27.614499 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.614612 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:28.010602 (+395990us) raft_consensus.cc:1685] finished
0709 13:20:28.010623 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:28.010765 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81365,"raft.queue_time_us":96028,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":28573,"spinlock_wait_cycles":2304,"thread_start_us":451274,"threads_started":1,"wal-append.queue_time_us":601247}
I20260709 13:20:28.012677 20957 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:28.007933 14297 rpcz_store.cc:276] 0709 13:20:26.077698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.962655 (+884957us) service_pool.cc:224] Handling call
0709 13:20:26.976244 (+ 13589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:27.078612 (+102368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:27.078641 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:27.087836 (+  9195us) log.cc:844] Serialized 26 byte log entry
0709 13:20:27.627939 (+540103us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:27.627986 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.628101 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:28.002568 (+374467us) raft_consensus.cc:1685] finished
0709 13:20:28.002608 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:28.002772 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9906,"raft.queue_time_us":97250,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":19617,"thread_start_us":378705,"threads_started":1,"wal-append.queue_time_us":602346}
I20260709 13:20:28.005833 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3168) took 1941 ms. Trace:
I20260709 13:20:28.016364 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1298) took 1862 ms. Trace:
I20260709 13:20:28.016597 20589 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.016796 14302 rpcz_store.cc:276] 0709 13:20:26.154173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.859831 (+705658us) service_pool.cc:224] Handling call
0709 13:20:28.016144 (+1156313us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54001f7f54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:28.016303 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713335040}
I20260709 13:20:28.014971 14303 rpcz_store.cc:276] 0709 13:20:26.064183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.069571 (+  5388us) service_pool.cc:224] Handling call
0709 13:20:26.069985 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.070321 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.070349 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:26.070826 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:20:26.688744 (+617918us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:26.715777 (+ 27033us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.045653 (+329876us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b24000d6f28. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fde09d 00007f8decc1010e 00007f8decc2788c 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221
0709 13:20:28.005121 (+959468us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18004d6740. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287
0709 13:20:28.005337 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.005449 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:28.005515 (+    66us) raft_consensus.cc:1685] finished
0709 13:20:28.005547 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:28.005727 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11523,"prepare.queue_time_us":27057,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":53740,"raft.queue_time_us":125979,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":205,"spinlock_wait_cycles":37582592,"thread_start_us":702438,"threads_started":2,"wal-append.queue_time_us":762303}
W20260709 13:20:28.002233 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.019569 20921 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:28.020364 20921 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.021201 20973 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:28.023195 20921 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:28.026118 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 46349.2us
I20260709 13:20:28.026474 20691 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:28.026933 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:28.027206 20691 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.027868 20691 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:28.028264 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:28.029891 14899 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:28.030452 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:28.030939 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1428) took 2027 ms. Trace:
I20260709 13:20:28.031313 14899 rpcz_store.cc:276] 0709 13:20:26.003312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.003429 (+   117us) service_pool.cc:224] Handling call
0709 13:20:28.030735 (+2027306us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b54008674d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:28.030878 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4488224512}
I20260709 13:20:28.031776 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:28.033358 20986 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:28.033864 20921 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:28.034214 20879 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:20:28.034657 20853 consensus_meta.cc:287] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 13:20:28.034883 20879 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.035104 20853 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.037127 20853 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.037335 20908 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:28.037855 20908 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.038251 20908 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:28.020044 14304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3338) took 1916 ms (client timeout 1895 ms). Trace:
I20260709 13:20:28.048149 14374 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:28.052121 14899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:28.052796 14899 raft_consensus.cc:606] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:28.053208 14899 raft_consensus.cc:614] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:28.046424 14304 rpcz_store.cc:269] 0709 13:20:26.103422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.425993 (+322571us) service_pool.cc:224] Handling call
0709 13:20:28.019820 (+1593827us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54001a1b54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:28.019946 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3089297792}
I20260709 13:20:28.057257 14374 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:28.044912 20691 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.059091 20909 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:28.059986 20691 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.061587 20973 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.061829 20957 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:28.060050 20909 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:28.062870 20909 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:27.948271 20792 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.064000 20792 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.063751 20909 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.065759 20830 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.066813 20830 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.067396 20942 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.069059 20830 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.065030 20909 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:28.072052 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.072400 20855 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.073485 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:28.062202 20973 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:27.987890 21022 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:20:28.077440 20935 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.096971 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:28.037145 20879 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:27.968999 20930 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:28.112032 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 433942us
I20260709 13:20:28.081708 20396 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:28.079499 20950 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.083565 20980 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:28.116868 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:28.098927 20663 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.099695 20589 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:28.100903 20752 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.100961 20792 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:28.116950 20942 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:20:28.142184 20745 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.048249 20853 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:28.146170 20853 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:28.146641 20853 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.101862 20557 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.102630 20960 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:28.103116 20926 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.103734 20568 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.110785 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:28.152086 14299 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:28.078472 20912 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:28.158795 20912 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.112480 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:28.078079 21020 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.317s	user 0.003s	sys 0.000s
I20260709 13:20:28.161302 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:28.082690 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:28.162796 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:28.096256 20847 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.002s
I20260709 13:20:28.164062 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:28.163901 20847 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.166162 20847 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.115382 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:28.167155 14298 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:28.168036 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:28.168258 14226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1553) took 1738 ms (client timeout 1920 ms). Trace:
W20260709 13:20:28.168685 14226 rpcz_store.cc:269] 0709 13:20:26.430033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.430320 (+   287us) service_pool.cc:224] Handling call
0709 13:20:28.168083 (+1737763us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400052154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:28.168204 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3528945920}
I20260709 13:20:28.169198 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:28.079013 20925 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:28.170075 20925 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.172222 20925 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.120988 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:28.172842 14374 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:28.178468 20930 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.178997 14375 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 22: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:28.179159 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.107280 20383 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:28.180779 14298 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
W20260709 13:20:28.108668 20929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.008s	sys 0.042s
I20260709 13:20:28.130889 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:28.134048 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:28.136410 20663 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.202181 14303 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.137162 14296 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:20:28.139091 20752 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:28.152632 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:28.202786 14296 pending_rounds.cc:85] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 13
I20260709 13:20:28.153409 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:28.154147 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:28.206327 14296 pending_rounds.cc:107] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:20:28.206655 14295 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.206708 14296 raft_consensus.cc:2889] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:28.203076 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 72290.2us
I20260709 13:20:28.206328 14301 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.208418 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:28.154745 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:28.154809 20647 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:28.209928 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3117) took 1097 ms. Trace:
I20260709 13:20:28.154915 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.156031 14223 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:28.156634 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.152537 14376 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:28.152570 14299 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:28.179913 14226 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:28.110459 20892 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:28.188239 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.161340 20912 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.200218 20986 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:28.154296 14225 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:28.192698 21022 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:20:28.194427 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 81997.3us
I20260709 13:20:28.283967 14222 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:28.334352 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:28.233980 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 107177us
I20260709 13:20:28.215720 14228 rpcz_store.cc:276] 0709 13:20:27.112841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.113020 (+   179us) service_pool.cc:224] Handling call
0709 13:20:27.134783 (+ 21763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:27.228393 (+ 93610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.208616 (+980223us) spinlock_profiling.cc:243] Waited 92.7 ms on lock 0x7b5400277ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:28.209859 (+  1243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213169408}
W20260709 13:20:28.208983 20888 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.852s	user 0.011s	sys 0.000s
I20260709 13:20:28.284619 14221 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:28.299608 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.344633 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.345518 14228 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:28.195698 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:28.312027 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.203917 20967 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:28.312765 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.346972 14302 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:28.215116 20647 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.356746 14892 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:28.313978 14893 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:28.314636 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.315323 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:28.315848 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 100006us
I20260709 13:20:28.131608 20950 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.206931 20383 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:28.200846 20939 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.117s
I20260709 13:20:28.210548 20879 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:28.319252 20944 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.319131 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:28.321411 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 140111us
I20260709 13:20:28.326087 20925 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:28.199116 21005 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:20:28.325503 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 161508us
I20260709 13:20:28.334300 14295 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:28.336552 14226 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:28.337913 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:28.202126 20929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.008s	sys 0.042s
I20260709 13:20:28.344883 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1551) took 1225 ms. Trace:
I20260709 13:20:28.390055 14375 rpcz_store.cc:276] 0709 13:20:27.119888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.130499 (+ 10611us) service_pool.cc:224] Handling call
0709 13:20:28.344706 (+1214207us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54001ba3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:28.344822 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2249812736}
I20260709 13:20:28.302086 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:28.391001 14897 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.351999 14896 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:20:28.359606 14301 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:28.202397 20921 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:28.358119 14894 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:28.281071 20847 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:28.368319 14270 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:28.368438 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 3123) took 1240 ms. Trace:
W20260709 13:20:28.424111 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55879.6us
I20260709 13:20:28.424010 14229 rpcz_store.cc:276] 0709 13:20:27.128380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.154920 (+ 26540us) service_pool.cc:224] Handling call
0709 13:20:28.368246 (+1213326us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54002779d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:28.368371 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329242496}
W20260709 13:20:28.425146 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.425669 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.422572 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.426756 14229 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:28.362849 20396 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.374713 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.426898 14226 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:28.386006 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.395213 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:28.386399 20902 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:20:28.435004 20663 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:28.435299 20902 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:28.435848 20902 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:28.376113 20910 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.438613 20910 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:28.440729 21021 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.531s	user 0.001s	sys 0.001s
W20260709 13:20:28.397361 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.440959 20383 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.444067 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.445143 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:28.446075 14377 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:28.446003 20955 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:28.446552 20955 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.446868 20955 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.367509 20855 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:20:28.447365 14377 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:28.429291 20847 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.449522 20847 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:28.421875 20947 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:28.449733 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:28.372341 20879 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.450786 20879 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.452591 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1541) took 2292 ms. Trace:
I20260709 13:20:28.452937 14373 rpcz_store.cc:276] 0709 13:20:26.160587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.363942 (+203355us) service_pool.cc:224] Handling call
0709 13:20:27.042394 (+678452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:27.101133 (+ 58739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:27.101178 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:27.137361 (+ 36183us) log.cc:844] Serialized 26 byte log entry
0709 13:20:27.629542 (+492181us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:27.629581 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.629644 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:28.440024 (+810380us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:28.451507 (+ 11483us) raft_consensus.cc:1685] finished
0709 13:20:28.451528 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:28.452402 (+   874us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b540027a6d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:28.452540 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108508,"raft.queue_time_us":64133,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6918,"spinlock_wait_cycles":1570181760,"thread_start_us":328848,"threads_started":1,"wal-append.queue_time_us":541391}
I20260709 13:20:28.437009 20902 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.455489 20902 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:28.457064 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:28.445096 14228 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:28.457881 14375 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:28.440768 20910 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:28.460338 20396 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.343870 20888 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.358946 20967 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.392011 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:28.449656 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:28.467794 14897 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
W20260709 13:20:28.471377 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 79451.3us
W20260709 13:20:28.399186 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 61407.5us
I20260709 13:20:28.422533 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.431284 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.474324 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:28.463351 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:28.470315 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.473054 14223 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:28.479423 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:28.480183 14901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.032s	sys 0.031s
W20260709 13:20:28.480581 14901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.032s	sys 0.031s
I20260709 13:20:28.482534 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.368001 20986 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:28.376024 20930 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.503139 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:28.483822 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:28.487519 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:28.491918 14222 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:28.476292 14299 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.505357 14299 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.493516 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:28.506261 14304 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:28.491493 14192 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:28.492755 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.470500 20967 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.515790 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:28.477825 20910 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.518836 21025 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:28.526036 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:28.519030 20925 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:20:28.528088 20663 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:28.528795 20944 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:28.489042 20741 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:28.489251 21005 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:28.485762 20892 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:28.534758 14375 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:20:28.542883 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.596817 14376 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:28.598423 20905 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:28.599048 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 63030.7us
I20260709 13:20:28.599586 20947 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:28.621373 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:28.635172 14897 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:28.524376 20745 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:28.499442 20678 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.499637 20918 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.088s
I20260709 13:20:28.534612 21025 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.657294 14303 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:28.659296 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:28.667820 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.505930 20930 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.676544 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.680159 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:28.702344 14376 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:28.641746 20973 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:28.679811 20737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.025s	sys 0.037s
I20260709 13:20:28.681007 21005 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:20:28.689951 20769 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.021s	sys 0.022s
W20260709 13:20:28.675632 20598 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.715s	user 0.007s	sys 0.003s
I20260709 13:20:28.692494 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:28.699386 14867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.005s	sys 0.028s
W20260709 13:20:28.699747 14269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.016s	sys 0.045s
W20260709 13:20:28.746697 14269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.016s	sys 0.045s
I20260709 13:20:28.673686 20741 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:28.752543 14867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.005s	sys 0.028s
I20260709 13:20:28.713989 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:28.763064 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 793290us
W20260709 13:20:28.763145 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 49266.2us
I20260709 13:20:28.764711 14867 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:28.673846 20908 consensus_meta.cc:287] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.007s
I20260709 13:20:28.545771 20910 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.677224 20663 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.776068 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:28.777107 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:28.740916 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:28.777709 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:28.778229 14897 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:28.779148 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:28.741690 14372 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.013s	sys 0.021s
I20260709 13:20:28.684229 20925 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:28.676570 20752 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:20:28.685195 20944 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:28.748360 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:28.800925 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.801158 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:28.801764 14892 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:28.752221 20892 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:28.754418 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:28.736299 20737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.025s	sys 0.037s
I20260709 13:20:28.698536 21025 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.760288 14298 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:28.818528 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:28.819253 14298 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:28.819087 14369 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:28.802592 20925 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.820250 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:28.820449 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.820802 14298 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:28.821287 14892 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:28.681413 14864 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:28.710583 20745 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:28.817216 20892 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.822968 20745 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.823573 20930 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.824488 14295 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:28.761282 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:28.720745 14375 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:28.826818 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:28.827266 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.827948 14896 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
I20260709 13:20:28.828438 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:28.828831 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.736673 20997 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:28.749321 20769 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.022s	sys 0.022s
I20260709 13:20:28.770726 20960 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:28.745088 21005 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:28.751832 20598 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.785204 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.694325 20947 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.787302 14297 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:28.793708 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.755523 20741 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.712589 20986 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.795308 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.752816 14376 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:28.799866 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:28.808666 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:28.814060 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:28.826746 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:28.830502 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.830744 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:28.821681 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:28.831473 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 150168us
I20260709 13:20:28.886684 14298 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 21: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:28.835085 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:28.889169 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.889513 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.830397 20888 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:28.784660 20903 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:28.753661 20647 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:28.901826 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:28.905211 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:28.907689 14297 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:28.909520 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:28.912405 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.913985 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:28.914692 14892 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:28.916395 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:28.896682 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.918202 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:28.918855 14898 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
W20260709 13:20:28.805676 20876 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.015s	sys 0.011s
W20260709 13:20:28.849344 14193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.004s	sys 0.024s
W20260709 13:20:28.783646 14372 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.013s	sys 0.021s
W20260709 13:20:28.919983 14193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.004s	sys 0.024s
W20260709 13:20:28.920338 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 824930us
I20260709 13:20:28.866503 14897 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:20:28.867302 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:28.837093 20957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.004s	sys 0.039s
W20260709 13:20:28.891520 20853 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.744s	user 0.012s	sys 0.000s
I20260709 13:20:28.874290 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:28.776966 14296 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:28.929352 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:28.891067 20960 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:28.935019 14225 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:28.837565 20997 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.806684 20950 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:28.885113 14895 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:28.845417 14295 raft_consensus.cc:2410] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:20:28.887768 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:28.942042 14298 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:28.881943 14302 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:28.824523 20892 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:28.847244 14374 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.005s	sys 0.045s
I20260709 13:20:28.921986 14303 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
W20260709 13:20:28.836699 20557 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.010s	sys 0.015s
I20260709 13:20:28.923513 14897 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:20:28.924124 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:29.011790 14375 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:29.013059 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:28.863435 14177 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.017s	sys 0.018s
I20260709 13:20:28.879935 20925 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:28.937897 14297 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:28.938858 14899 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:28.902514 20939 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:28.925384 20876 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.016s	sys 0.012s
W20260709 13:20:28.925246 20957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.004s	sys 0.039s
I20260709 13:20:28.786151 20908 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:29.068724 20908 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:28.943800 14296 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:20:28.952531 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:29.070207 14296 pending_rounds.cc:85] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 9
I20260709 13:20:29.070472 14296 pending_rounds.cc:107] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:20:29.070675 14296 raft_consensus.cc:2889] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:29.071298 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:28.956262 20967 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:28.961339 14378 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.198s	user 0.028s	sys 0.071s
W20260709 13:20:29.072844 14378 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.028s	sys 0.071s
I20260709 13:20:29.073668 20902 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:29.074420 20967 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:29.075470 14377 raft_consensus.cc:2368] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17.
I20260709 13:20:29.092818 14892 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:28.883371 20879 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:28.980408 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:28.882238 20730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.016s	sys 0.021s
I20260709 13:20:29.000062 14895 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:28.910480 20903 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:29.099274 14223 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:28.979821 21007 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.012s	sys 0.014s
W20260709 13:20:29.017845 21028 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:20:29.018322 20930 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:29.038852 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:28.931576 20944 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:29.009588 14374 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.007s	sys 0.047s
I20260709 13:20:29.049535 20910 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:29.030494 14177 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.017s	sys 0.018s
W20260709 13:20:29.058228 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.892056 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 92310.1us
I20260709 13:20:29.158793 14341 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:29.160390 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:29.069475 14228 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:29.073860 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2720) took 2665 ms. Trace:
W20260709 13:20:28.998680 14227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.016s	sys 0.015s
W20260709 13:20:29.161953 14227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.016s	sys 0.015s
I20260709 13:20:29.096486 14303 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:29.162477 14373 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.018s	sys 0.055s
W20260709 13:20:29.036036 20557 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.011s	sys 0.016s
I20260709 13:20:29.005228 20892 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:29.014808 14375 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:29.111455 14224 raft_consensus.cc:2368] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17.
W20260709 13:20:29.113332 14268 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.027s	sys 0.020s
W20260709 13:20:29.100746 21007 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.012s	sys 0.015s
W20260709 13:20:29.119441 20691 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.058s	user 0.009s	sys 0.052s
I20260709 13:20:29.176013 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:29.129988 14221 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.016s	sys 0.047s
W20260709 13:20:29.176949 14221 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.016s	sys 0.047s
I20260709 13:20:29.132164 20663 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:29.074414 20902 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:29.139036 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.127080 20926 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.021s	sys 0.031s
W20260709 13:20:29.097749 20730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.016s	sys 0.022s
I20260709 13:20:29.000910 20960 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:28.934906 20853 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:29.164160 14373 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.019s	sys 0.055s
W20260709 13:20:29.167419 14268 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.028s	sys 0.020s
I20260709 13:20:29.167194 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:29.168629 20647 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:29.170620 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1540) took 2381 ms. Trace:
I20260709 13:20:29.200649 14901 rpcz_store.cc:276] 0709 13:20:26.789236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.386255 (+597019us) service_pool.cc:224] Handling call
0709 13:20:27.451040 (+ 64785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:27.475548 (+ 24508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:27.475596 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:27.497146 (+ 21550us) log.cc:844] Serialized 26 byte log entry
0709 13:20:28.481049 (+983903us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:28.481105 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.481194 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:29.170364 (+689170us) raft_consensus.cc:1685] finished
0709 13:20:29.170385 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.170541 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23793,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":26282,"thread_start_us":857667,"threads_started":1,"wal-append.queue_time_us":1274288}
W20260709 13:20:29.126238 21032 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:20:29.109998 20909 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:29.176664 20910 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260709 13:20:29.191020 14193 leader_election.cc:336] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Timed out: RequestConsensusVote RPC to 127.12.208.130:44127 timed out after 1.817s (SENT)
W20260709 13:20:29.170763 20847 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.721s	user 0.010s	sys 0.001s
I20260709 13:20:29.191998 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:29.179415 20598 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:29.199069 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:29.208186 20909 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:29.176453 20691 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.009s	sys 0.052s
I20260709 13:20:29.161731 14378 rpcz_store.cc:276] 0709 13:20:26.408664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.577727 (+169063us) service_pool.cc:224] Handling call
0709 13:20:26.602793 (+ 25066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.852415 (+249622us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:26.951933 (+ 99518us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.762391 (+810458us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:27.762905 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:20:27.763051 (+   146us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:29.073219 (+1310168us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.073493 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.073588 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:29.073639 (+    51us) raft_consensus.cc:1685] finished
0709 13:20:29.073650 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.073761 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1365633,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":104,"raft.queue_time_us":108865,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":7240,"thread_start_us":2321553,"threads_started":3,"wal-append.queue_time_us":924186}
I20260709 13:20:29.170527 20892 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:29.214160 14371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.026s	sys 0.072s
I20260709 13:20:29.163761 20678 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:29.196826 20926 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.022s	sys 0.031s
I20260709 13:20:29.211969 14223 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:29.210834 14193 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:29.175307 20939 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 13:20:29.214538 14371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.026s	sys 0.072s
I20260709 13:20:29.206655 20905 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:29.236691 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2765) took 1084 ms. Trace:
I20260709 13:20:29.237004 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:29.237370 14224 rpcz_store.cc:276] 0709 13:20:28.152168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.153171 (+  1003us) service_pool.cc:224] Handling call
0709 13:20:29.230032 (+1076861us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b5400341554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:29.236571 (+  6539us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080453888}
I20260709 13:20:29.238771 14223 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:29.250968 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 59991us
I20260709 13:20:29.253563 14375 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:29.217180 20383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.017s	sys 0.061s
I20260709 13:20:29.264647 20678 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:29.286827 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 87114.2us
W20260709 13:20:29.287382 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.289242 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.280877 20886 ts_tablet_manager.cc:1929] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.7
I20260709 13:20:29.280694 20741 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:29.282413 20853 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:29.282853 20960 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:29.310931 20741 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:29.311265 20396 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:29.252013 20905 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.293429 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:29.256639 20730 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:29.255465 20908 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:29.302376 14192 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.018s	sys 0.012s
I20260709 13:20:29.214229 20847 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:29.287678 20383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.018s	sys 0.062s
I20260709 13:20:29.216583 20892 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.335285 14297 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:20:29.338694 14299 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.007s	sys 0.024s
I20260709 13:20:29.338846 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:29.316718 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.007s	sys 0.026s
I20260709 13:20:29.325309 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.326325 14298 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:29.340859 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.294656 20678 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:20:29.342605 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.008s	sys 0.026s
W20260709 13:20:29.343907 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.316187 20886 log.cc:1199] T 8c137013238f4b1dbae260e32cb316dc P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/8c137013238f4b1dbae260e32cb316dc
I20260709 13:20:29.349126 14296 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
W20260709 13:20:29.319931 14192 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.018s	sys 0.012s
I20260709 13:20:29.350658 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:29.350837 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 648649us
I20260709 13:20:29.351708 14298 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
W20260709 13:20:29.346257 20918 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.009s	sys 0.018s
I20260709 13:20:29.354445 14901 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:29.361410 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:29.317698 20905 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.358875 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:29.339188 14299 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.007s	sys 0.024s
W20260709 13:20:29.366807 14893 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.014s	sys 0.006s
W20260709 13:20:29.367210 14893 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.014s	sys 0.006s
I20260709 13:20:29.367619 14220 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:29.316428 20730 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:29.371202 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2772) took 1210 ms. Trace:
W20260709 13:20:29.323047 20921 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.013s	sys 0.017s
I20260709 13:20:29.379232 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:29.383262 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.374787 14225 rpcz_store.cc:276] 0709 13:20:28.160955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.460669 (+299714us) service_pool.cc:224] Handling call
0709 13:20:28.460955 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.935540 (+474585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.370883 (+435343us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54002774d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:29.371136 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089802496}
I20260709 13:20:29.345079 20678 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:29.355957 20396 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:29.296232 20909 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:29.439416 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:29.441322 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:29.473809 14895 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:29.484364 14894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.006s	sys 0.030s
W20260709 13:20:29.484985 14894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.006s	sys 0.030s
I20260709 13:20:29.371845 20947 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:29.432940 20921 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.014s	sys 0.018s
W20260709 13:20:29.436867 20918 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.010s	sys 0.019s
I20260709 13:20:29.373757 20908 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.490661 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.494879 14297 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:29.495726 14867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.003s	sys 0.031s
W20260709 13:20:29.496272 14867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.003s	sys 0.031s
W20260709 13:20:29.496656 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 689421us
I20260709 13:20:29.498360 14867 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:29.503741 14895 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:29.442235 20396 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.533412 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:29.477334 20903 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:29.542043 14372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.015s	sys 0.027s
I20260709 13:20:29.477185 20879 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:29.544595 14867 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:20:29.544661 14372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.015s	sys 0.027s
I20260709 13:20:29.546219 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:20:29.540484 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.551357 14297 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:29.540980 20745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.006s	sys 0.028s
I20260709 13:20:29.551107 20598 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:29.648864 20598 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.556710 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1564) took 1397 ms. Trace:
I20260709 13:20:29.678085 14220 rpcz_store.cc:276] 0709 13:20:28.159526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.427991 (+268465us) service_pool.cc:224] Handling call
0709 13:20:28.479305 (+ 51314us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67eee 0000000000375939 00007f8df1fdb1e0 00007f8df20a40c4 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:20:29.556434 (+1077129us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b540026c5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:29.556624 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045041664}
W20260709 13:20:29.557508 21046 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:20:29.558432 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1565) took 1398 ms. Trace:
I20260709 13:20:29.566911 20918 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.680819 20918 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:29.681300 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3127) took 2470 ms. Trace:
I20260709 13:20:29.680524 14228 rpcz_store.cc:276] 0709 13:20:28.159781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.458372 (+298591us) service_pool.cc:224] Handling call
0709 13:20:28.458715 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.161723 (+703008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.558130 (+396407us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b540026d9d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:29.558361 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404022016}
W20260709 13:20:29.569303 21005 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.000s
I20260709 13:20:29.570338 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.570987 20997 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:29.572039 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.693770 14298 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:20:29.694893 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.695621 14298 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 13.
I20260709 13:20:29.696509 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.574076 20902 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:29.577658 20847 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:29.539719 20396 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.535233 20954 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.079s
W20260709 13:20:29.581512 21042 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
W20260709 13:20:29.593946 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.612600 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2898) took 2111 ms. Trace:
I20260709 13:20:29.532532 20929 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:29.619210 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73098.6us
W20260709 13:20:29.637643 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.556548 20886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47058 (request call id 111) took 5670 ms. Trace:
I20260709 13:20:29.789201 20886 rpcz_store.cc:276] 0709 13:20:23.885898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.886333 (+   435us) service_pool.cc:224] Handling call
0709 13:20:24.693860 (+807527us) ts_tablet_manager.cc:1151] Deleting tablet 8c137013238f4b1dbae260e32cb316dc
0709 13:20:24.712867 (+ 19007us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:20:28.443152 (+3730285us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:29.280726 (+837574us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:29.556457 (+275731us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2005312,"tablet-delete.queue_time_us":776424,"thread_start_us":531604,"threads_started":1}
W20260709 13:20:29.645244 20745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.007s	sys 0.028s
I20260709 13:20:29.647737 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:29.652400 20678 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:29.794756 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:29.654800 21037 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.342s	user 0.003s	sys 0.000s
I20260709 13:20:29.795459 20678 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:29.552109 20663 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:29.796330 20663 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:29.657558 21030 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.654s	user 0.004s	sys 0.000s
I20260709 13:20:29.796785 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet 8c137013238f4b1dbae260e32cb316dc (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:20:29.658528 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1565) took 1125 ms. Trace:
I20260709 13:20:29.796833 20663 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.797936 14375 rpcz_store.cc:276] 0709 13:20:28.533592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.195171 (+661579us) service_pool.cc:224] Handling call
0709 13:20:29.195595 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.254045 (+ 58450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.658227 (+404182us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b54003c41d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:29.658461 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132820864}
I20260709 13:20:29.799979 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2724) took 1016 ms. Trace:
I20260709 13:20:29.800323 14375 rpcz_store.cc:276] 0709 13:20:28.783488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.799136 (+1015648us) service_pool.cc:224] Handling call
0709 13:20:29.799453 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.799640 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:29.799667 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:29.799713 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:29.799751 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.799810 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.799923 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:29.801172 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:29.659138 20921 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.802139 14220 raft_consensus.cc:2393] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:29.802088 20921 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:29.795459 14302 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:29.804570 20921 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:29.648043 14377 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:29.805469 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1569) took 1132 ms. Trace:
I20260709 13:20:29.805816 14377 rpcz_store.cc:276] 0709 13:20:28.679595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.647549 (+967954us) service_pool.cc:224] Handling call
0709 13:20:29.647865 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.805211 (+157346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.805415 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:29.807183 14377 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:29.807457 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.807905 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2735) took 1008 ms. Trace:
W20260709 13:20:29.719780 21025 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.873s	user 0.007s	sys 0.005s
I20260709 13:20:29.808465 14377 rpcz_store.cc:276] 0709 13:20:28.799196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.806668 (+1007472us) service_pool.cc:224] Handling call
0709 13:20:29.806954 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.807629 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.807843 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:29.797355 21031 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:29.668938 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.671178 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1563) took 1511 ms. Trace:
W20260709 13:20:29.644166 21043 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.431s	user 0.000s	sys 0.001s
I20260709 13:20:29.681892 14227 rpcz_store.cc:276] 0709 13:20:27.210850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.505230 (+294380us) service_pool.cc:224] Handling call
0709 13:20:27.528606 (+ 23376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:27.538179 (+  9573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:27.538224 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:27.551044 (+ 12820us) log.cc:844] Serialized 26 byte log entry
0709 13:20:28.008715 (+457671us) spinlock_profiling.cc:243] Waited 9.88 ms on lock 0x7b18003193c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8df0f6058f 00007f8de9f9f571 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd
0709 13:20:28.178874 (+170159us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b18003193c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:20:29.162342 (+983468us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:29.162383 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.162486 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:29.680920 (+518434us) raft_consensus.cc:1685] finished
0709 13:20:29.680963 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.681160 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7631,"raft.queue_time_us":382,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":13308,"spinlock_wait_cycles":25379328,"thread_start_us":983273,"threads_started":1,"wal-append.queue_time_us":1786391}
I20260709 13:20:29.669870 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.548802 20730 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:29.701222 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.820142 14298 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 11.
I20260709 13:20:29.821669 14298 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:29.701953 14222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.012s	sys 0.011s
I20260709 13:20:29.823268 14193 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:29.823928 14222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.013s	sys 0.011s
I20260709 13:20:29.825480 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:29.702469 14374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.011s	sys 0.012s
W20260709 13:20:29.828006 14374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.012s	sys 0.012s
I20260709 13:20:29.829036 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1562) took 1730 ms. Trace:
I20260709 13:20:29.829492 14374 rpcz_store.cc:276] 0709 13:20:28.098181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.173487 (+ 75306us) service_pool.cc:224] Handling call
0709 13:20:28.173776 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.174005 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:29.136451 (+962446us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.828566 (+692115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:29.828655 (+    89us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:29.828719 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.828807 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.828963 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":885164,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"thread_start_us":1653754,"threads_started":2}
I20260709 13:20:29.693186 20910 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:29.701305 20876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.015s	sys 0.021s
W20260709 13:20:29.773617 14865 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.033s	sys 0.085s
W20260709 13:20:29.693770 20955 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.246s	user 0.012s	sys 0.003s
I20260709 13:20:29.774586 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:29.678089 20598 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.655783 20737 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:29.804716 14302 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:29.806289 20918 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:29.851874 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77434.4us
I20260709 13:20:29.808328 14296 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
W20260709 13:20:29.854183 14373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.023s	sys 0.098s
I20260709 13:20:29.696394 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:29.854564 14373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.024s	sys 0.098s
I20260709 13:20:29.838467 14295 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:20:29.855130 14295 pending_rounds.cc:85] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 9
I20260709 13:20:29.855368 14295 pending_rounds.cc:107] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 17.10
W20260709 13:20:29.855276 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 158958us
I20260709 13:20:29.855990 14295 raft_consensus.cc:2889] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:29.857023 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:29.707999 14372 rpcz_store.cc:276] 0709 13:20:27.501609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.952085 (+450476us) service_pool.cc:224] Handling call
0709 13:20:27.961473 (+  9388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:27.961674 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:28.919774 (+958100us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.611892 (+692118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:29.611973 (+    81us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:29.612038 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.612360 (+   322us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.612523 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1097266,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":119,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":44685,"thread_start_us":1624458,"threads_started":2}
W20260709 13:20:29.834543 14865 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.034s	sys 0.085s
I20260709 13:20:29.832126 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:29.812047 20929 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:29.857870 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 834398us
I20260709 13:20:29.813330 14221 rpcz_store.cc:276] 0709 13:20:28.159282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.448212 (+288930us) service_pool.cc:224] Handling call
0709 13:20:28.448698 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.448867 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:29.177354 (+728487us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.670499 (+493145us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.670785 (+   286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:29.670855 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:29.670902 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.670975 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.671113 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":810951,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":2181,"raft.queue_time_us":246,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10266,"spinlock_wait_cycles":24746240,"thread_start_us":1220533,"threads_started":2}
I20260709 13:20:29.643380 20967 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.855391 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2916) took 1377 ms. Trace:
I20260709 13:20:29.849924 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:29.811733 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.005s	sys 0.021s
W20260709 13:20:29.862190 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.006s	sys 0.022s
W20260709 13:20:29.862910 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 663923us
I20260709 13:20:29.532176 20908 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:29.801674 14375 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:29.813010 21031 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:29.700469 21005 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:29.876322 20903 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:29.876525 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:29.877038 20903 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.877592 20903 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:29.878208 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:29.882154 20930 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:29.884618 20930 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:29.852311 14378 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.002s	sys 0.025s
W20260709 13:20:29.886375 14378 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.002s	sys 0.026s
I20260709 13:20:29.887353 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1567) took 1330 ms. Trace:
I20260709 13:20:29.887781 14378 rpcz_store.cc:276] 0709 13:20:28.557507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.223982 (+666475us) service_pool.cc:224] Handling call
0709 13:20:29.257121 (+ 33139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.886875 (+629754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:29.886922 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:29.886992 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:29.887039 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.887122 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.887282 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99866,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":17621,"thread_start_us":629209,"threads_started":1}
W20260709 13:20:29.818789 14267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.011s	sys 0.020s
W20260709 13:20:29.889460 14267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.011s	sys 0.021s
I20260709 13:20:29.890255 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:29.870464 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:29.891198 14297 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.871270 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2730) took 1079 ms. Trace:
I20260709 13:20:29.892082 14375 rpcz_store.cc:276] 0709 13:20:28.791813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.801220 (+1009407us) service_pool.cc:224] Handling call
0709 13:20:29.801493 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.871035 (+ 69542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.871217 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:29.846391 20876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.016s	sys 0.021s
I20260709 13:20:29.865316 20955 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:29.818142 21025 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:29.854583 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:29.849107 20737 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:29.895823 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.857340 20745 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:29.834021 20879 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:20:29.898754 14268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.005s	sys 0.022s
W20260709 13:20:29.837082 20691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.011s	sys 0.019s
I20260709 13:20:29.961829 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2902) took 2445 ms. Trace:
I20260709 13:20:29.958207 14304 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:29.903038 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.014s	sys 0.014s
I20260709 13:20:29.903191 14295 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:29.906572 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:29.915109 14893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.025s
W20260709 13:20:29.967283 14893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.005s	sys 0.026s
I20260709 13:20:29.848728 20910 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:29.967684 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 61204.5us
I20260709 13:20:29.968920 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:29.970275 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.015s	sys 0.014s
W20260709 13:20:29.970942 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.962080 20691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.011s	sys 0.021s
W20260709 13:20:29.978006 21047 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:20:29.978152 20921 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:29.978801 14268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.008s	sys 0.026s
I20260709 13:20:29.978320 14270 leader_election.cc:400] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17.
I20260709 13:20:29.979384 14270 leader_election.cc:403] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:20:29.979931 20921 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.980472 20921 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:29.980999 20910 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:29.982985 14297 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:29.983995 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:29.984030 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:29.898341 20926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.007s	sys 0.024s
I20260709 13:20:29.982105 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1561) took 1884 ms. Trace:
I20260709 13:20:29.988198 14371 rpcz_store.cc:276] 0709 13:20:28.097877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.163037 (+ 65160us) service_pool.cc:224] Handling call
0709 13:20:28.163386 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:28.202626 (+ 39240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:28.202655 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:28.210103 (+  7448us) log.cc:844] Serialized 52 byte log entry
0709 13:20:29.235493 (+1025390us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:29.235549 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.235695 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:29.981844 (+746149us) raft_consensus.cc:1685] finished
0709 13:20:29.981886 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.982035 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31332,"raft.queue_time_us":41683,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":118778,"thread_start_us":905327,"threads_started":1,"wal-append.queue_time_us":1351080}
I20260709 13:20:29.962344 14370 rpcz_store.cc:276] 0709 13:20:27.516064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.046179 (+530115us) service_pool.cc:224] Handling call
0709 13:20:28.058382 (+ 12203us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:28.109346 (+ 50964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:28.109387 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:28.118917 (+  9530us) log.cc:844] Serialized 52 byte log entry
0709 13:20:28.782265 (+663348us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:28.782305 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.782375 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:29.961522 (+1179147us) raft_consensus.cc:1685] finished
0709 13:20:29.961548 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.961723 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38088,"raft.queue_time_us":51650,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":499175,"threads_started":1,"wal-append.queue_time_us":960594}
I20260709 13:20:29.986378 14301 raft_consensus.cc:2368] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 13. Current term is 14.
I20260709 13:20:29.986582 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:29.992722 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:29.901257 20902 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:29.904583 20847 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:20:29.899175 20986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.022s	sys 0.024s
I20260709 13:20:29.914481 20737 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:29.986909 14229 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:29.998651 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:29.961228 21007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.019s	sys 0.025s
I20260709 13:20:29.870332 20929 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.002000 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:30.004172 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:29.914381 21052 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:29.925866 20853 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:30.011286 14295 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:30.011739 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:30.006966 14228 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
W20260709 13:20:30.030707 21060 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:20:30.034765 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1560) took 1271 ms. Trace:
I20260709 13:20:30.035815 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:30.036427 14295 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:30.037592 14369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.008s	sys 0.046s
I20260709 13:20:29.987768 20876 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:30.009604 21007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.020s	sys 0.025s
I20260709 13:20:29.985548 21057 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:30.039287 14267 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:30.034184 20769 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:30.007319 20986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.023s	sys 0.025s
I20260709 13:20:30.046255 21052 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:29.924431 20930 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
W20260709 13:20:29.987561 20926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.009s	sys 0.029s
I20260709 13:20:30.053696 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:30.093818 14297 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
W20260709 13:20:30.005125 21051 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.297s	user 0.001s	sys 0.001s
I20260709 13:20:30.057076 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:30.035197 14894 rpcz_store.cc:276] 0709 13:20:28.763150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.763281 (+   131us) service_pool.cc:224] Handling call
0709 13:20:28.767918 (+  4637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:28.781249 (+ 13331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:28.781296 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:28.787139 (+  5843us) log.cc:844] Serialized 26 byte log entry
0709 13:20:29.495518 (+708379us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:29.495565 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.495634 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.034526 (+538892us) raft_consensus.cc:1685] finished
0709 13:20:30.034548 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.034703 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12836,"raft.queue_time_us":21562,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":4486,"thread_start_us":637172,"threads_started":1,"wal-append.queue_time_us":1022464}
W20260709 13:20:30.038708 14369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.009s	sys 0.046s
I20260709 13:20:30.017657 20921 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:30.038203 21055 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17.
I20260709 13:20:30.065066 20598 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:30.122779 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 65781.3us
I20260709 13:20:30.126543 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:30.128082 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:30.037684 20902 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:30.058372 20847 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:30.137631 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:30.139156 14341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.025s	sys 0.014s
W20260709 13:20:30.141141 14341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.025s	sys 0.014s
I20260709 13:20:30.122973 21058 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:30.123195 20930 consensus_queue.cc:1243] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:30.146413 14267 leader_election.cc:400] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17.
I20260709 13:20:30.092492 20918 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:20:30.059634 20876 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.070879 21057 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:30.155206 14376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.010s	sys 0.013s
I20260709 13:20:30.134037 20847 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:30.139638 20960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.011s	sys 0.027s
I20260709 13:20:30.145886 20986 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:30.156250 20769 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:30.142597 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 854564us
I20260709 13:20:30.210273 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:30.210876 14299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.009s	sys 0.017s
W20260709 13:20:30.211520 14299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.009s	sys 0.017s
W20260709 13:20:30.170610 20944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.011s	sys 0.028s
I20260709 13:20:30.179593 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3193) took 1283 ms. Trace:
W20260709 13:20:30.180967 20905 consensus_meta.cc:287] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.797s	user 0.009s	sys 0.000s
I20260709 13:20:30.181756 21005 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:29.861496 14373 rpcz_store.cc:276] 0709 13:20:28.478207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.478328 (+   121us) service_pool.cc:224] Handling call
0709 13:20:28.478632 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.478831 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:29.200598 (+721767us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.855053 (+654455us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:29.855106 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:29.855160 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.855227 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.855343 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6,"prepare.queue_time_us":580766,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":3989,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":7148,"thread_start_us":1371696,"threads_started":2}
W20260709 13:20:30.191649 21065 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:20:30.192369 21066 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:20:30.227541 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.192505 14295 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
W20260709 13:20:30.193298 21069 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:20:30.194674 21068 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:20:30.195070 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1557) took 2037 ms. Trace:
I20260709 13:20:30.250561 14229 rpcz_store.cc:276] 0709 13:20:28.157693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.430108 (+272415us) service_pool.cc:224] Handling call
0709 13:20:30.194848 (+1764740us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540019afd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:30.194991 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3399291648}
W20260709 13:20:30.198356 14376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.011s	sys 0.013s
W20260709 13:20:30.205308 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.176331 14300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3336) took 4073 ms (client timeout 1574 ms). Trace:
W20260709 13:20:30.217867 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.219964 14304 rpcz_store.cc:276] 0709 13:20:28.895841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.901348 (+  5507us) service_pool.cc:224] Handling call
0709 13:20:30.179312 (+1277964us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000dcfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:30.179517 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309754624}
W20260709 13:20:30.220788 14303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.010s	sys 0.046s
W20260709 13:20:30.252172 14300 rpcz_store.cc:269] 0709 13:20:26.102830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.235137 (+132307us) service_pool.cc:224] Handling call
0709 13:20:30.176079 (+3940942us) spinlock_profiling.cc:243] Waited 3.7 s on lock 0x7b540020ab54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:30.176232 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8509404416}
W20260709 13:20:30.252692 14303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.011s	sys 0.046s
I20260709 13:20:30.219475 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:30.153020 21058 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:30.176538 20892 consensus_meta.cc:287] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.810s	user 0.009s	sys 0.000s
I20260709 13:20:30.207942 20986 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:30.201205 20960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.012s	sys 0.028s
W20260709 13:20:30.218981 20944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.011s	sys 0.029s
I20260709 13:20:30.219041 20769 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:30.226554 20910 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:30.265964 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:30.266388 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:30.267771 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:30.294888 20663 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.171510 20902 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:30.300011 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.300832 20909 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.286779 20955 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:30.295607 20730 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.240324 20903 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:30.307132 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 483938us
I20260709 13:20:30.321430 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:30.289027 20769 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.312403 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3134) took 1357 ms. Trace:
I20260709 13:20:30.285876 20892 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.320488 20921 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:30.260519 21007 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:20:30.309234 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 477190us
I20260709 13:20:30.322328 21052 consensus_queue.cc:1059] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:20:30.340265 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:30.306787 14901 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:30.238202 20905 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.289343 20908 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:30.343659 20905 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:30.288465 20986 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:30.317656 21062 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.306s	user 0.003s	sys 0.000s
I20260709 13:20:30.318341 21077 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:30.344795 21077 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:30.345654 21077 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.346462 20876 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:30.334028 14222 rpcz_store.cc:276] 0709 13:20:28.955118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.101659 (+146541us) service_pool.cc:224] Handling call
0709 13:20:29.115812 (+ 14153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:29.128962 (+ 13150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:29.129009 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:29.152451 (+ 23442us) log.cc:844] Serialized 26 byte log entry
0709 13:20:29.824456 (+672005us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:29.824516 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.824618 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.311674 (+487056us) raft_consensus.cc:1685] finished
0709 13:20:30.311695 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.312335 (+   640us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3550,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":6696,"thread_start_us":630582,"threads_started":1,"wal-append.queue_time_us":848211}
I20260709 13:20:30.347918 20967 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:30.329478 21025 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:30.288888 20847 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:30.344404 21070 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:30.261298 21058 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:30.350250 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:30.350930 14304 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:30.336548 20926 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:30.337898 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 457187us
W20260709 13:20:30.354071 21081 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:20:30.359424 14193 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:30.350274 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:30.362063 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:30.376461 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:30.378813 14342 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:30.349598 21007 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:30.381018 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.381138 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.403219 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.387466 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:30.354053 20876 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:30.402102 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 51920.5us
I20260709 13:20:30.362938 20908 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:30.356760 20929 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:30.405397 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:30.404011 14193 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:30.408588 21087 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:30.402221 21073 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:30.374698 21067 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:30.429160 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2921) took 1773 ms. Trace:
W20260709 13:20:30.412959 21082 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:20:30.413841 21078 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:20:30.367178 20598 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:30.375537 20847 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.417687 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:30.406695 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:30.402388 20905 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:30.425380 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:30.415105 20396 consensus_meta.cc:287] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
I20260709 13:20:30.406169 21025 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:30.409291 20853 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:20:30.405903 20944 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:30.481246 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 495339us
I20260709 13:20:30.465488 20663 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:30.404604 21085 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:30.414999 20903 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:30.452090 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3351) took 2276 ms. Trace:
I20260709 13:20:30.415319 20910 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:30.347282 21031 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.423789 21057 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:30.426317 20876 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:30.459668 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 53077.5us
I20260709 13:20:30.486168 20853 consensus_queue.cc:1243] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:30.433416 14369 rpcz_store.cc:276] 0709 13:20:28.660184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.314693 (+654509us) service_pool.cc:224] Handling call
0709 13:20:29.315003 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.315241 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:29.355140 (+ 39899us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.428573 (+1073433us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.428789 (+   216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.428844 (+    55us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:30.428891 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.428966 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.429101 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84880,"prepare.queue_time_us":51315,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":34586,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6962,"thread_start_us":1032957,"threads_started":2,"wal-append.queue_time_us":967530}
I20260709 13:20:30.428742 20383 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:30.472796 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 55212.6us
I20260709 13:20:30.478821 21088 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:30.506433 21072 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 13:20:30.479825 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 307872us
W20260709 13:20:30.488168 14893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.009s	sys 0.021s
W20260709 13:20:30.538110 14893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.009s	sys 0.022s
I20260709 13:20:30.540325 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:30.404778 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 550328us
I20260709 13:20:30.542642 14375 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:20:30.543182 14375 pending_rounds.cc:85] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 9
I20260709 13:20:30.543470 14375 pending_rounds.cc:107] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:20:30.543346 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:30.544093 14375 raft_consensus.cc:2889] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:30.489894 14270 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:30.409032 21007 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.475472 20598 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:30.502514 21091 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:30.505532 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 101248us
I20260709 13:20:30.495348 14299 rpcz_store.cc:276] 0709 13:20:28.150189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.151641 (+  1452us) service_pool.cc:224] Handling call
0709 13:20:28.151943 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.475923 (+323980us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b4c0024f640. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb358a20 00007f8deb369a29 00007f8deb32f644 00007f8deb356f2d 00007f8deb356b93 00007f8ded08718b 00007f8ded087cb5 00007f8ded082f30 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416
0709 13:20:28.677639 (+201716us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:29.368202 (+690563us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.425816 (+1057614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.425865 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:30.425919 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.425994 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.426150 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":614807,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":3231,"raft.queue_time_us":128700,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":30328,"spinlock_wait_cycles":53504384,"thread_start_us":1708263,"threads_started":3,"wal-append.queue_time_us":1045369}
I20260709 13:20:30.473934 21025 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:30.425668 21056 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:30.477176 20908 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:30.519587 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:30.482160 20944 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.526880 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:30.545130 21085 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:30.472769 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 224655us
I20260709 13:20:30.492878 20905 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:30.531929 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:30.541342 14373 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
W20260709 13:20:30.546895 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57092.6us
I20260709 13:20:30.550241 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:30.479804 20396 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.589448 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:30.590157 14374 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:30.590994 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:30.591754 20396 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:30.592073 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:30.550308 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:30.593253 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:30.592375 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:30.593677 14369 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:30.594396 20955 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.594959 20955 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:30.595157 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:30.596006 14369 raft_consensus.cc:2368] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:30.596843 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:30.555316 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:30.482996 21087 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:20:30.522392 21076 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:30.529953 21031 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:30.532330 20903 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.529910 20876 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:30.567492 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:30.632732 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:30.632887 14378 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:30.569576 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:30.571075 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:30.550836 20910 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.577062 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:20:30.563460 21083 log.cc:927] Time spent T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:20:30.580277 21089 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:20:30.580475 21093 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:30.580356 21005 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.557219 21091 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.582158 21085 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:30.583858 21105 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:30.587540 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.588739 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:30.725539 14375 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.551425 14867 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:30.555394 14370 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:30.597327 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:30.552795 21104 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:30.563732 21025 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.556861 20892 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:30.600178 14341 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:30.614048 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:30.619378 14301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3177) took 1869 ms (client timeout 1817 ms). Trace:
I20260709 13:20:30.603013 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:30.709609 21098 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:20:30.737239 14301 rpcz_store.cc:269] 0709 13:20:28.749839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.758584 (+  8745us) service_pool.cc:224] Handling call
0709 13:20:28.813695 (+ 55111us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67eee 0000000000375939 00007f8df1fdb1e0 00007f8df20a40c4 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:20:30.619098 (+1805403us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000910d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:30.619282 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534527232}
I20260709 13:20:30.617473 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1304) took 1307 ms. Trace:
I20260709 13:20:30.571956 20944 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:30.472986 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48104.7us
I20260709 13:20:30.702395 20929 raft_consensus.cc:2764] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:20:30.751962 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:30.568823 14193 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:30.754293 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 185543us
I20260709 13:20:30.755610 14193 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:30.639398 14299 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:30.638728 14894 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:30.571429 20691 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:30.604166 20557 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:30.647068 21102 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:30.601184 21086 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:20:30.605615 21071 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:30.558990 20598 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.699834 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:30.631201 20955 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:30.706825 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:30.701530 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 124547us
I20260709 13:20:30.714643 21005 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:30.708580 21079 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:20:30.722167 20876 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.573117 21106 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260709 13:20:30.737495 14900 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:30.607920 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1559) took 1853 ms. Trace:
I20260709 13:20:30.780813 20892 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.742048 14303 rpcz_store.cc:276] 0709 13:20:29.309820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.311699 (+  1879us) service_pool.cc:224] Handling call
0709 13:20:29.324708 (+ 13009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.324977 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:29.372370 (+ 47393us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.253397 (+881027us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.616426 (+363029us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b18000a8b80. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:20:30.616692 (+   266us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.616899 (+   207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.616962 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:30.617024 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.617126 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.617395 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":315159,"prepare.queue_time_us":397281,"prepare.run_cpu_time_us":177,"prepare.run_wall_time_us":3440,"raft.queue_time_us":184384,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":3553,"spinlock_wait_cycles":10646912,"thread_start_us":880445,"threads_started":1,"wal-append.queue_time_us":1037119}
W20260709 13:20:30.759624 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 159531us
I20260709 13:20:30.761400 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:30.701586 21092 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.170s	user 0.001s	sys 0.006s
I20260709 13:20:30.648296 20903 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.767910 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:30.768512 20908 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:30.768958 20792 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:30.769379 21090 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:30.769995 20853 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:30.774523 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.914366 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.768136 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:30.795526 14375 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
W20260709 13:20:30.915266 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 147186us
I20260709 13:20:30.733539 21104 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.711839 21091 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:30.916165 14193 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:30.639015 21076 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.927441 21076 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:30.698891 20910 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.929884 20910 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:30.923885 20383 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:30.930729 20383 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:30.932008 20383 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:30.865324 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:20:30.848876 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 297506us
I20260709 13:20:30.935113 14867 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:30.868911 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 255277us
W20260709 13:20:30.939227 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.940414 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:30.941059 21121 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:30.871680 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:30.942502 21121 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.942997 21121 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.944411 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:30.945207 21121 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:30.942997 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:30.946900 14299 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:30.950572 14222 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:30.952210 14267 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:30.952628 14229 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:30.953086 21099 raft_consensus.cc:2764] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:20:30.954155 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:30.954952 14221 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
W20260709 13:20:30.701495 21084 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.241s	user 0.000s	sys 0.006s
I20260709 13:20:30.956247 21091 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:30.899641 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.736349 21105 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:30.854360 21103 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:30.848841 21102 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:30.854658 21071 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:30.911473 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:31.007301 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:30.864261 20557 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:30.907040 20902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.010s	sys 0.047s
I20260709 13:20:31.015551 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:30.923837 21104 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:30.925293 21097 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:20:30.864956 14374 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:30.965039 21121 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:30.878378 14893 rpcz_store.cc:276] 0709 13:20:28.754484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.754713 (+   229us) service_pool.cc:224] Handling call
0709 13:20:28.770352 (+ 15639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.817851 (+ 47499us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:29.367577 (+549726us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.538550 (+1170973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.538626 (+    76us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:30.538704 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.607668 (+ 68964us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b5400624b54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:30.607718 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.607857 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1048796,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":5292,"raft.queue_time_us":441603,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":2391,"spinlock_wait_cycles":108572928,"thread_start_us":1719924,"threads_started":3,"wal-append.queue_time_us":922475}
I20260709 13:20:30.875777 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:30.963114 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 97873.8us
I20260709 13:20:31.024140 14295 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.025020 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:31.026513 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:30.965216 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:31.027875 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 62739.9us
I20260709 13:20:31.000406 21093 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:30.900856 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 139523us
I20260709 13:20:30.878539 21101 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:30.969485 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:30.988868 14228 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:31.003964 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:30.897766 20745 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:31.006348 14303 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:30.897264 20955 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:30.903704 20908 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.007851 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.008158 14222 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.008500 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:30.763439 20905 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:30.907891 21090 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.012755 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:30.918344 20691 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:31.013505 14370 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:20:30.909493 20792 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:30.954247 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:30.999655 21112 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:20:30.917657 21111 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:31.029435 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.077780 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:30.966980 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50942.5us
I20260709 13:20:31.078682 14303 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:20:31.078685 14226 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:30.987855 21106 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:31.013219 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:30.988897 20879 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.026793 14900 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
W20260709 13:20:31.035840 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.016093 20902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.011s	sys 0.048s
I20260709 13:20:31.044155 14342 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:31.049208 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:31.049993 14225 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:31.098133 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54087.6us
I20260709 13:20:30.909735 20892 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:31.101843 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88706.8us
I20260709 13:20:31.037354 20929 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:31.054566 14224 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:31.065243 20908 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.015440 21076 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:31.080327 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 195271us
I20260709 13:20:31.075908 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:31.077822 20792 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:31.032953 21107 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:31.088042 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:31.006050 21110 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:20:31.097602 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:31.007465 21102 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.099107 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2920) took 2444 ms. Trace:
I20260709 13:20:31.032366 20918 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:20:31.022768 20557 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.108173 14225 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:31.064157 20678 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:31.109648 14373 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:31.077812 21090 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.117553 14864 leader_election.cc:400] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:31.064535 21088 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.063s
I20260709 13:20:31.105644 21007 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:31.064419 20745 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:31.073730 20955 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.129834 14376 rpcz_store.cc:276] 0709 13:20:28.655013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.229164 (+574151us) service_pool.cc:224] Handling call
0709 13:20:29.256866 (+ 27702us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:29.298621 (+ 41755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:29.298683 (+    62us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:29.315443 (+ 16760us) log.cc:844] Serialized 78 byte log entry
0709 13:20:30.260570 (+945127us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:30.492790 (+232220us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.500052 (+  7262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.500215 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.098796 (+598581us) raft_consensus.cc:1685] finished
0709 13:20:31.098827 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.099032 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7284,"prepare.queue_time_us":666748,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":240382,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":15277,"thread_start_us":1079163,"threads_started":2,"wal-append.queue_time_us":1018007}
I20260709 13:20:31.085592 21106 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:31.148990 14864 leader_election.cc:403] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:20:31.147498 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3204) took 1296 ms. Trace:
W20260709 13:20:31.153359 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.149000 20678 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.162599 20557 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:31.163132 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3364) took 1102 ms. Trace:
I20260709 13:20:31.277025 20678 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.277252 14304 rpcz_store.cc:276] 0709 13:20:30.060476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.285146 (+224670us) service_pool.cc:224] Handling call
0709 13:20:30.285492 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.358104 (+ 72612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.162839 (+804735us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b540022c9d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:31.163063 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146210176}
W20260709 13:20:31.164113 21120 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:31.164956 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:31.149930 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47291.6us
I20260709 13:20:31.108353 21121 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:31.172734 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 138830us
I20260709 13:20:31.172608 14374 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:31.134886 20910 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:31.177475 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 98139.9us
I20260709 13:20:31.314446 20557 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 13:20:31.244769 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 131684us
I20260709 13:20:31.166714 21103 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:31.100564 21114 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:20:31.160166 14295 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:31.121767 21076 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.174311 21007 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.337729 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.315917 21005 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:31.169174 20929 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:31.350948 20888 raft_consensus.cc:3055] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:31.351425 20888 raft_consensus.cc:740] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:31.359035 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:31.265434 14344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 1.559s (SENT) [suppressed 14 similar messages]
I20260709 13:20:31.266906 14222 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
W20260709 13:20:31.239349 21079 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:20:31.361632 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 96229.8us
W20260709 13:20:31.241540 20909 consensus_meta.cc:287] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.940s	user 0.009s	sys 0.005s
I20260709 13:20:31.370260 14301 pending_rounds.cc:85] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 13
I20260709 13:20:31.370777 14301 pending_rounds.cc:107] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 13:20:31.371140 14301 raft_consensus.cc:2889] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:31.284489 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 196564us
I20260709 13:20:31.284955 14892 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:31.312606 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:31.100754 21071 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:31.340024 21007 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.247349 20598 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:31.237020 21106 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.282850 14270 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:31.384383 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 101599us
I20260709 13:20:31.326552 14304 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:31.328295 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:31.331025 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:31.385632 14303 raft_consensus.cc:2376] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17. Re-sending same reply.
I20260709 13:20:31.386886 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:31.387001 21122 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:31.387310 20745 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:31.387476 21122 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.387887 21122 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.331733 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:31.388490 14295 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:31.389380 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:31.333745 21113 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:20:31.390806 20892 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:31.285297 21121 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.283941 21107 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
W20260709 13:20:31.391446 20769 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.052s	user 0.011s	sys 0.000s
I20260709 13:20:31.318495 20903 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:31.392198 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1566) took 1125 ms. Trace:
W20260709 13:20:31.392604 21132 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:20:31.392660 14899 rpcz_store.cc:276] 0709 13:20:30.266992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.267163 (+   171us) service_pool.cc:224] Handling call
0709 13:20:30.267481 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:30.455884 (+188403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.455913 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:30.459324 (+  3411us) log.cc:844] Serialized 52 byte log entry
0709 13:20:30.568604 (+109280us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:30.743694 (+175090us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.867586 (+123892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.867665 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.391906 (+524241us) raft_consensus.cc:1685] finished
0709 13:20:31.391931 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.392117 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157456,"prepare.queue_time_us":333344,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":280739,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":36229,"thread_start_us":421563,"threads_started":3,"wal-append.queue_time_us":484812}
I20260709 13:20:31.171648 20691 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:31.391508 21121 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.395219 20691 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.396775 21122 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.318192 21133 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:31.398066 21133 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:31.360530 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:31.399088 21133 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.400341 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:31.329140 21103 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.401109 21103 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.401762 21124 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:31.402275 21124 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:31.402652 21124 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.404079 21123 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:31.404971 21057 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:31.405642 21057 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:31.178800 14296 rpcz_store.cc:276] 0709 13:20:29.850884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.853596 (+  2712us) service_pool.cc:224] Handling call
0709 13:20:29.869025 (+ 15429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:29.870914 (+  1889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:29.870947 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:29.890830 (+ 19883us) log.cc:844] Serialized 52 byte log entry
0709 13:20:30.425397 (+534567us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:30.425446 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.425540 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.147268 (+721728us) raft_consensus.cc:1685] finished
0709 13:20:31.147289 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.147435 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1470,"raft.queue_time_us":2061,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":18177,"thread_start_us":436460,"threads_started":1,"wal-append.queue_time_us":663520}
I20260709 13:20:31.375881 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.405839 20955 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:31.406025 21057 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:31.315062 14371 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:31.406663 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:31.407346 14296 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:31.338320 21091 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:31.348842 20929 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:31.407886 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:31.408339 20929 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.408712 21122 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:31.409166 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:31.409966 14222 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 14: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:31.410727 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.411258 14222 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:31.412092 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.412304 21067 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:31.412799 14222 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:31.370404 20926 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.995s	user 0.011s	sys 0.001s
I20260709 13:20:31.413445 14295 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.378093 14378 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:20:31.416486 21125 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:20:31.416594 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:31.417275 14378 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:31.391395 20892 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:20:31.418354 21128 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:20:31.418534 20892 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.419476 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.420542 14226 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:31.379438 20902 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:20:31.422664 20902 consensus_queue.cc:1243] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:20:31.376780 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 64246.5us
I20260709 13:20:31.389513 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:31.407001 21057 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.412744 21067 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:31.427476 21057 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:31.427882 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:31.410916 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:31.400472 21133 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.429220 14298 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:31.429873 21071 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.430471 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:31.382462 20909 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:31.431669 20909 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:31.435099 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:31.435778 14892 raft_consensus.cc:2376] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17. Re-sending same reply.
I20260709 13:20:31.436816 20926 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.370692 21105 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:31.352316 20888 consensus_queue.cc:260] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:31.438194 20888 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.438796 21076 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:31.427788 21067 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:31.379908 21131 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:20:31.442876 20892 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:31.443393 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:31.444269 14300 raft_consensus.cc:2410] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:20:31.432854 20909 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.421574 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.453936 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.454682 14222 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:31.457690 14374 raft_consensus.cc:1240] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:20:31.478834 14270 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:31.455672 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.392473 20769 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.457854 14892 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:20:31.461344 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:31.471591 14192 connection.cc:256] RPC call timeout handler was delayed by -1.7089771520002159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 13:20:31.471215 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:31.501451 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:31.502123 14192 connection.cc:256] RPC call timeout handler was delayed by -1.08707715200012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:20:31.502727 14192 connection.cc:256] RPC call timeout handler was delayed by -1.0771771520001039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 13:20:31.505131 14270 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:31.506600 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.507344 14222 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
W20260709 13:20:31.508579 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 432748us
I20260709 13:20:31.510612 14865 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:31.512099 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:31.498930 20986 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.152s	user 0.010s	sys 0.002s
I20260709 13:20:31.461710 21067 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.463085 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:31.345621 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.484226 14193 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:31.471824 20926 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:31.472354 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:31.485744 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.555182 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:31.465312 21124 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.487972 21055 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:31.461684 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:31.562495 14894 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.334820 20910 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:31.491783 14896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1445) took 2694 ms (client timeout 2199 ms). Trace:
W20260709 13:20:31.492803 20737 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.456s	user 0.014s	sys 0.000s
W20260709 13:20:31.493515 20847 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.033s	user 0.009s	sys 0.002s
I20260709 13:20:31.578653 20847 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:31.462838 20741 raft_consensus.cc:3055] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:31.493932 21052 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:31.494429 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:31.580920 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 86569.7us
I20260709 13:20:31.581307 21077 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.495455 21111 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:31.582425 21105 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:31.582940 21105 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:31.583014 21052 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.583932 21105 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.585979 21091 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:31.524215 21135 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.482559 14295 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:31.580055 20741 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:31.560998 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.380522 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.608050 14344 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:31.562353 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.609093 14227 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
W20260709 13:20:31.488516 21058 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.124s	user 0.006s	sys 0.006s
I20260709 13:20:31.489691 20908 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.524544 21107 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:31.561523 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:31.566210 14896 rpcz_store.cc:269] 0709 13:20:28.797420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.893429 (+ 96009us) service_pool.cc:224] Handling call
0709 13:20:31.491541 (+2598112us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54008674d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:31.491680 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3168638208}
I20260709 13:20:31.615095 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:31.562153 21055 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:31.557066 20986 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:31.621254 14222 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:20:31.575053 20944 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.793s	user 0.006s	sys 0.002s
I20260709 13:20:31.569314 14901 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:31.623705 14295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:48252
I20260709 13:20:31.576421 20792 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:31.576903 20910 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:31.577571 20737 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.588673 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:31.526098 21123 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:31.505198 21074 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.183s	user 0.005s	sys 0.000s
I20260709 13:20:31.586408 21091 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:31.641624 14296 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: [15.9-17.10]
I20260709 13:20:31.600266 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:31.538478 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.599292 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.505144 21096 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 13:20:31.528554 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:31.585639 21052 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:31.625363 14295 raft_consensus.cc:606] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:31.617334 20902 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:20:31.630147 14375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.014s	sys 0.016s
I20260709 13:20:31.634579 14227 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:20:31.617141 20741 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.652168 20741 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:31.654744 21025 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.889s	user 0.000s	sys 0.010s
I20260709 13:20:31.655200 21025 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.617587 21058 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.657946 14900 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:31.604287 21135 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.661077 21135 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:31.644691 14295 raft_consensus.cc:614] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:31.630102 14369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.015s	sys 0.021s
W20260709 13:20:31.664582 14369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.016s	sys 0.021s
I20260709 13:20:31.665347 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2927) took 1077 ms. Trace:
I20260709 13:20:31.665702 14369 rpcz_store.cc:276] 0709 13:20:30.587509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.762109 (+174600us) service_pool.cc:224] Handling call
0709 13:20:30.762463 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.785361 (+ 22898us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:31.057764 (+272403us) log.cc:844] Serialized 14 byte log entry
0709 13:20:31.664999 (+607235us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:31.665051 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:31.665127 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.665190 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.665295 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22414,"prepare.queue_time_us":142328,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":99691,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":29145,"thread_start_us":724890,"threads_started":2}
I20260709 13:20:31.671485 20792 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:31.672837 20929 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.676491 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2926) took 1089 ms. Trace:
I20260709 13:20:31.677006 14370 rpcz_store.cc:276] 0709 13:20:30.587250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.728235 (+140985us) service_pool.cc:224] Handling call
0709 13:20:30.751607 (+ 23372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.073255 (+321648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.676131 (+602876us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54000b9854. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:31.676402 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601674496}
W20260709 13:20:31.680186 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.644707 14228 raft_consensus.cc:2368] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:31.564399 20926 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.525718 21137 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:31.649298 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 120835us
I20260709 13:20:31.661124 14225 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
W20260709 13:20:31.624857 20879 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.004s
I20260709 13:20:31.629712 20944 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.693485 14898 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:31.603924 21110 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:20:31.741200 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 152613us
W20260709 13:20:31.741875 14375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.015s	sys 0.016s
I20260709 13:20:31.744030 14270 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:31.636806 21103 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.752679 20986 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:31.772666 21102 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.608s	user 0.004s	sys 0.005s
I20260709 13:20:31.758665 14894 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:31.760124 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:31.761003 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.753326 20853 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:31.785251 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:31.788514 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 107124us
I20260709 13:20:31.754012 20910 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.755931 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1570) took 1167 ms. Trace:
I20260709 13:20:31.817589 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:31.817611 14371 rpcz_store.cc:276] 0709 13:20:30.588924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.887158 (+298234us) service_pool.cc:224] Handling call
0709 13:20:31.286077 (+398919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.406880 (+120803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.755698 (+348818us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b540027a6d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:31.755857 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839699840}
I20260709 13:20:31.820276 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:31.821504 14227 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:31.775946 21104 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.729s	user 0.000s	sys 0.011s
I20260709 13:20:31.777226 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:31.799628 14344 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 1.929s (SENT)
I20260709 13:20:31.843183 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:31.775700 21090 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.612s	user 0.005s	sys 0.007s
W20260709 13:20:31.775452 21031 consensus_meta.cc:287] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.137s	user 0.001s	sys 0.012s
I20260709 13:20:31.806054 14270 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:31.792160 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.809428 21052 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:31.812115 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 327962us
I20260709 13:20:31.836594 14220 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:31.783567 21136 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:31.787791 21114 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.648465 21121 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:31.858556 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 73410.4us
I20260709 13:20:31.795053 20930 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:31.865278 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:31.845889 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:31.866333 14894 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:31.792153 20879 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:31.791644 20939 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:31.852689 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46765.3us
I20260709 13:20:31.867522 14896 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:20:31.799384 21123 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:31.844595 21025 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:31.813235 21101 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:31.884773 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:31.872525 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.874243 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:31.874764 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.869635 14193 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:31.883095 14901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "181bbac22422408c87cd13b7fe3008f9"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:31.887387 14901 raft_consensus.cc:606] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Received request to transfer leadership to TS 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:31.887765 14901 raft_consensus.cc:614] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:31.803254 20598 raft_consensus.cc:2764] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:20:31.896339 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:31.897740 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:31.892835 14303 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:31.852584 21136 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:31.863193 20396 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:31.919548 14301 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:31.921285 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:31.863613 20986 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:31.922751 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 53203.7us
I20260709 13:20:31.924150 14897 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: [15.15-17.16]
I20260709 13:20:31.925091 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:31.956005 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:31.956149 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:31.956730 14301 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.957063 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:31.929590 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:31.864262 20853 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:31.965389 14193 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:31.928932 21135 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:31.880401 20383 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:20:31.862349 21052 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.880445 21137 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:31.881906 21123 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:31.986948 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 212444us
I20260709 13:20:31.900484 14304 raft_consensus.cc:2368] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20.
W20260709 13:20:31.944182 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.952910 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:31.815474 21102 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.929543 14892 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:31.989297 14894 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.957717 14895 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:31.990149 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:31.990370 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:31.991329 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:31.991997 14892 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:31.958039 14371 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.992811 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:31.899973 21129 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.791996 21007 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.993350 14892 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.859491 21090 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:31.967643 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:31.931542 21111 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:31.968221 14901 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:31.848222 20910 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:31.969365 20888 consensus_meta.cc:287] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.001s
I20260709 13:20:31.971581 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:31.972297 21133 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:31.955482 20986 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:31.777016 21091 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.975648 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:31.931740 20847 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:31.998919 14229 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
W20260709 13:20:32.051792 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 80323.4us
I20260709 13:20:32.052902 14892 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
W20260709 13:20:31.999269 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 222103us
I20260709 13:20:31.953917 21136 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:31.975131 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:32.005107 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:31.852933 21104 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:31.883062 20939 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:31.968163 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:32.062779 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 87737.9us
I20260709 13:20:32.063700 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:32.007895 14301 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:32.065003 14897 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:31.806553 21055 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:32.049503 21106 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.000s
I20260709 13:20:31.899927 21101 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:32.013660 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:32.058738 21077 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:32.066443 20741 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:32.015455 21071 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.585s	user 0.003s	sys 0.008s
I20260709 13:20:32.008690 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:31.967562 21135 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:32.019328 14894 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:32.027629 21007 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.028417 14376 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 15: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:31.955260 21025 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:32.029465 20944 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.030740 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:32.031494 14300 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21. Ops: [17.13-20.14]
W20260709 13:20:32.031720 21144 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:32.032058 21102 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.002710 21123 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.974294 20792 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:20:32.034971 20678 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.757s	user 0.009s	sys 0.002s
I20260709 13:20:32.037039 14298 raft_consensus.cc:2410] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:20:32.038156 14299 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:32.040918 20926 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.043107 20910 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:31.961534 21124 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.048799 14224 raft_consensus.cc:2368] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20.
W20260709 13:20:32.051349 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 75783.9us
I20260709 13:20:32.055895 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:32.107694 20909 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:20:31.936079 20903 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:32.044646 21133 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.065564 14301 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:32.170270 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:32.171025 14301 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:32.077678 21106 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.071276 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:32.073060 14227 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.015108 20769 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.073565 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:32.175019 14897 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:32.047662 20986 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:32.058996 21093 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.006s	user 0.010s	sys 0.004s
W20260709 13:20:32.075975 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 81517.2us
I20260709 13:20:32.157260 21121 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.132284 21025 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.063231 20383 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:32.066262 21091 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.006225 21129 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.075910 20663 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:32.139935 14300 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:32.142351 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2787) took 1159 ms. Trace:
W20260709 13:20:32.144897 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.120034 21135 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.108600 21139 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:32.151410 14302 raft_consensus.cc:2368] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20.
I20260709 13:20:32.058100 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:32.165321 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:32.167423 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:32.162881 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:32.175895 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 104693us
I20260709 13:20:32.179953 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:31.868813 21114 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:32.202425 14894 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:32.203087 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 145078us
I20260709 13:20:32.203562 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:32.204180 14300 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.204349 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:32.204914 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:32.205569 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:32.206275 14895 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:32.203253 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:32.181327 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 381720us
I20260709 13:20:32.113365 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:32.180382 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:32.188798 14900 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:32.121006 20853 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.175554 21133 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.146409 20678 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:32.192696 14220 rpcz_store.cc:276] 0709 13:20:30.983192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.983366 (+   174us) service_pool.cc:224] Handling call
0709 13:20:31.012900 (+ 29534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.862473 (+849573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.142091 (+279618us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b5400135bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:32.142290 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1841083648}
I20260709 13:20:32.172472 21103 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:32.234417 21154 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:32.180858 21096 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:32.235163 21096 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:32.184769 21093 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:32.156663 20847 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:32.236057 21149 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:20:32.239611 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:32.240831 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:32.242110 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3373) took 1713 ms. Trace:
I20260709 13:20:32.242523 14299 rpcz_store.cc:276] 0709 13:20:30.528997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.947683 (+418686us) service_pool.cc:224] Handling call
0709 13:20:30.947980 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.147999 (+1200019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.241817 (+ 93818us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003afa54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:32.242049 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506703616}
I20260709 13:20:32.243789 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:32.244354 14299 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:32.222291 21156 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:20:32.245059 21156 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:32.245198 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:32.245441 21156 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:32.246331 21156 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.247574 21156 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.248281 21085 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:32.217494 21153 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:32.249435 21153 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:32.250000 21130 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.889s	user 0.003s	sys 0.002s
I20260709 13:20:32.195266 21052 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.231438 21102 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:32.227514 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:32.223888 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:32.253899 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:32.217269 21090 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.254523 14370 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:32.254709 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:32.255807 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:32.256800 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:32.257109 21148 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:32.257674 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:32.249933 21153 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.258294 14375 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:32.234154 21161 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:32.260838 21161 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:32.261258 21161 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:32.262127 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:32.262809 14369 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:32.263015 21161 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.264496 21161 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.203176 20383 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:32.266494 20383 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.267756 21056 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:32.268518 21056 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.269120 21056 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:32.269578 21056 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:32.270381 21056 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.272075 21077 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:32.272281 21096 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:32.247653 21145 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:20:32.279193 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1579) took 1164 ms. Trace:
I20260709 13:20:32.279600 14378 rpcz_store.cc:276] 0709 13:20:31.114763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.423401 (+308638us) service_pool.cc:224] Handling call
0709 13:20:31.423741 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.423969 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.423996 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.424485 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.793003 (+368518us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:31.793053 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.793148 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.278985 (+485837us) raft_consensus.cc:1685] finished
0709 13:20:32.279007 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.279134 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":368105,"threads_started":1,"wal-append.queue_time_us":643815}
I20260709 13:20:32.214530 20663 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:20:32.284035 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:32.286398 20737 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.287029 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:32.287907 14899 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:32.288538 21114 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:32.290371 20678 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:32.291148 21104 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.294776 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:32.207345 21124 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.301079 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:32.258134 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:32.226395 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:32.304757 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:32.301859 14375 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:32.281807 20598 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.212073 20997 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:32.213845 20769 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.211138 21121 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:32.307301 14372 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:32.308441 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:32.319979 14899 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:32.321558 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:32.313153 14227 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:32.323549 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:32.325891 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.192873 14301 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 12.
I20260709 13:20:32.314427 21052 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.318322 20939 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.295849 21153 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:32.442987 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:32.443301 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 126904us
I20260709 13:20:32.330560 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:32.331403 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 120691us
I20260709 13:20:32.297928 21104 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:32.390738 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:32.412911 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:32.461931 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.460441 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:32.462641 14301 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:32.467096 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:32.468080 14301 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:20:32.470916 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:32.464056 20691 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.302747 21129 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.474478 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:32.474535 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:32.306169 20903 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:32.223138 20741 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.112s
I20260709 13:20:32.207742 21139 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.476418 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:32.465703 14193 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:32.478567 14299 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:32.315099 20892 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.481688 14371 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:32.492821 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:32.422845 21031 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:32.489499 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:32.529531 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:32.531742 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:32.532325 14227 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:32.489442 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:32.460834 21077 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:32.332739 20909 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:32.532781 14301 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:32.569057 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:32.569885 14301 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 13.
I20260709 13:20:32.533208 14373 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:32.486902 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:32.416311 21103 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:32.530951 14299 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:32.318713 20598 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:32.491115 21067 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.867s	user 0.007s	sys 0.004s
I20260709 13:20:32.473186 21104 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.710076 21104 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:32.315709 21124 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.473486 20888 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:32.328770 20678 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.202s
I20260709 13:20:32.715013 20678 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:32.715463 20678 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:32.715662 21124 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.716202 21124 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.716377 20678 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:32.492729 21150 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 13:20:32.478796 21088 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:32.718382 21088 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.718256 21104 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.718863 21088 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:32.717772 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:32.478192 20691 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:32.721813 14228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1575) took 1701 ms (client timeout 1583 ms). Trace:
I20260709 13:20:32.720549 21104 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.723414 21104 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.723716 20691 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.723918 21104 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:32.726394 14303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3209) took 1402 ms (client timeout 1670 ms). Trace:
I20260709 13:20:32.726504 21104 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.726579 21067 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:32.479105 21161 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:32.727582 21104 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:32.728107 21104 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:32.528888 21090 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:32.728796 21090 raft_consensus.cc:697] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:32.333819 20997 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:32.701442 21106 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.528637 21114 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.210s
I20260709 13:20:32.702226 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:32.491922 21073 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.489617 20939 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:32.337251 20769 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:32.704396 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:32.716665 21124 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:32.695411 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 208637us
W20260709 13:20:32.722390 14228 rpcz_store.cc:269] 0709 13:20:31.020451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.048857 (+ 28406us) service_pool.cc:224] Handling call
0709 13:20:32.721587 (+1672730us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b540033ed54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:32.721718 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242061696}
I20260709 13:20:32.727633 21161 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.529337 21148 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:32.531376 21163 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.170s
I20260709 13:20:32.693470 14301 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:20:32.488389 21165 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:32.535820 21031 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.871023 21031 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:32.872375 14300 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.668s	user 0.006s	sys 0.002s
W20260709 13:20:32.872504 21135 consensus_meta.cc:287] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.000s
I20260709 13:20:32.872768 14300 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:32.874295 20997 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.851459 20939 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:32.876497 20939 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:32.792799 14303 rpcz_store.cc:269] 0709 13:20:31.324351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.386608 (+ 62257us) service_pool.cc:224] Handling call
0709 13:20:32.726209 (+1339601us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540022ddd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:32.726335 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085378944}
I20260709 13:20:32.878571 14303 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:32.878650 21156 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.002s
I20260709 13:20:32.879405 21129 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.731765 14298 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.881294 21139 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.735407 14378 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:32.882417 21124 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.413391 21121 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.882764 21153 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.883495 21163 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:32.883878 21163 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:32.884545 21121 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.799736 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:32.885193 21171 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:20:32.534657 20905 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:32.813825 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.886160 21025 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.690279 20902 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:32.886757 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:32.730710 21101 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.873072 21135 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.890002 20769 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.730080 21103 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:32.691797 21052 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.890897 21052 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:32.891225 21103 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.891949 21135 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.893066 21052 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.850620 14375 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:32.882910 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:32.894686 20939 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:32.792593 20926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.036s	sys 0.046s
I20260709 13:20:32.792256 21085 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:32.896538 14304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3210) took 1571 ms (client timeout 1773 ms). Trace:
I20260709 13:20:32.696743 20909 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:32.897037 14304 rpcz_store.cc:269] 0709 13:20:31.324646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.389272 (+ 64626us) service_pool.cc:224] Handling call
0709 13:20:32.896336 (+1507064us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54001a1154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:32.896476 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080184192}
I20260709 13:20:32.807132 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:32.860420 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:32.860723 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:32.898944 20909 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.900188 21087 raft_consensus.cc:3055] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:32.900218 14228 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:32.868575 21161 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.869052 21148 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.901367 21114 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:32.897042 21085 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:32.884712 21163 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.904246 21085 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:32.885950 20905 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:32.904695 21163 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.905412 14298 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:32.855914 14299 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:32.895478 14378 raft_consensus.cc:2410] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 17 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:20:32.717757 20678 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.801497 20888 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:32.900808 21087 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:32.731323 21159 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:32.723704 20598 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:32.733239 14373 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:20:32.730722 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:32.902081 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:32.890226 14303 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:20:32.900192 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:32.915681 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:32.903702 21148 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:32.916687 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:32.918697 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:32.919304 14228 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:32.811210 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:32.907188 14300 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:32.721966 21102 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.911684 14220 raft_consensus.cc:2410] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:20:32.920922 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.922154 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1333) took 1042 ms. Trace:
I20260709 13:20:32.927822 14300 rpcz_store.cc:276] 0709 13:20:31.879537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.873535 (+993998us) service_pool.cc:224] Handling call
0709 13:20:32.907031 (+ 33496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.921855 (+ 14824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.922101 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:32.729184 21104 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.906412 20745 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:32.870460 21165 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:32.954107 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:32.954774 14300 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
W20260709 13:20:32.951057 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.934551 21114 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:32.926609 21161 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:32.863926 21073 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:32.919355 21031 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:32.972198 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:32.969034 14371 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:32.997251 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:32.953712 21052 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:33.006016 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 430961us
I20260709 13:20:32.934885 21085 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:20:32.970844 21133 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.000s
I20260709 13:20:32.930378 21102 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.013494 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1573) took 2004 ms. Trace:
I20260709 13:20:32.956964 21067 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:32.969273 21104 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:32.999668 21161 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.965066 20939 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:33.000329 21114 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.913308 21090 consensus_queue.cc:237] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.035729 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:33.028745 14297 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:33.018985 14223 rpcz_store.cc:276] 0709 13:20:31.009193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.078275 (+ 69082us) service_pool.cc:224] Handling call
0709 13:20:31.099633 (+ 21358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.099993 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.100019 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:31.100059 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:31.100102 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.100166 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.013288 (+1913122us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b54002760d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:33.013425 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30338,"raft.queue_time_us":147064,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":14219,"spinlock_wait_cycles":48411904}
I20260709 13:20:32.961535 20745 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.012475 21158 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:33.051666 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1577) took 1937 ms. Trace:
I20260709 13:20:33.029655 21085 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:33.042788 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3217) took 1715 ms. Trace:
I20260709 13:20:33.052244 14376 rpcz_store.cc:276] 0709 13:20:31.114270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.243250 (+128980us) service_pool.cc:224] Handling call
0709 13:20:33.051371 (+1808121us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54003985d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:33.051585 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478554240}
I20260709 13:20:33.056741 14296 rpcz_store.cc:276] 0709 13:20:31.327769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.450583 (+122814us) service_pool.cc:224] Handling call
0709 13:20:31.451019 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:31.642246 (+191227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.042466 (+1400220us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54003d95d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:33.042706 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437424512}
I20260709 13:20:33.063755 20745 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:33.027165 21133 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.035300 21114 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:33.065569 14227 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:33.056143 21158 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:33.066380 21158 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.066761 21133 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.044747 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:33.075251 21031 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:33.076933 21136 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.008s	user 0.011s	sys 0.001s
I20260709 13:20:33.077454 21136 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.077762 21058 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.078594 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2790) took 1601 ms. Trace:
I20260709 13:20:33.089098 14225 rpcz_store.cc:276] 0709 13:20:31.476773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.598982 (+122209us) service_pool.cc:224] Handling call
0709 13:20:33.078361 (+1479379us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5400051754. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:33.078519 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41870720}
I20260709 13:20:33.090070 21139 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:33.090168 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:33.090332 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:33.090605 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1578) took 1274 ms. Trace:
I20260709 13:20:33.090968 14225 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:33.090698 21139 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.091078 14900 rpcz_store.cc:276] 0709 13:20:31.816534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.817009 (+   475us) service_pool.cc:224] Handling call
0709 13:20:31.837180 (+ 20171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.208367 (+371187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.090359 (+881992us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54005212d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:33.090547 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808204544}
I20260709 13:20:33.091984 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:33.092787 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:33.093312 14225 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:33.089424 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1512) took 1195 ms. Trace:
I20260709 13:20:33.093503 21156 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:33.093909 14901 rpcz_store.cc:276] 0709 13:20:31.893854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.933569 (+ 39715us) service_pool.cc:224] Handling call
0709 13:20:31.933919 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.005867 (+ 71948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.089210 (+1083343us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b54007e7054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:33.089369 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69950848}
I20260709 13:20:33.094574 21156 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:33.094820 21165 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.094951 21156 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:33.095976 21156 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:33.096724 14302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3365) took 2578 ms (client timeout 2080 ms). Trace:
I20260709 13:20:33.097154 21156 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:33.098344 21169 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:20:33.092976 21139 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
W20260709 13:20:33.099313 21172 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:20:33.100203 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3147) took 1770 ms. Trace:
I20260709 13:20:33.100611 14222 rpcz_store.cc:276] 0709 13:20:31.330093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.625116 (+295023us) service_pool.cc:224] Handling call
0709 13:20:31.632547 (+  7431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.792049 (+159502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.792084 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:31.792132 (+    48us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:31.792164 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.099953 (+1307789us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540026d4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:33.100001 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.100142 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366327680}
I20260709 13:20:33.107203 21102 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.109594 21073 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:32.971248 21087 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.110805 20930 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:33.111366 20930 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:33.112576 21168 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:33.025475 21052 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.114635 20888 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.115592 21148 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.115944 21052 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.116173 21148 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.116534 20905 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:33.117630 14193 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:33.148125 14228 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:33.149979 14193 leader_election.cc:400] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20.
I20260709 13:20:33.150312 14193 leader_election.cc:403] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:20:33.097278 14302 rpcz_store.cc:269] 0709 13:20:30.518236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.519168 (+   932us) service_pool.cc:224] Handling call
0709 13:20:33.096499 (+2577331us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54000dc5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:33.096650 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3456933632}
I20260709 13:20:33.081473 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:33.082540 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:33.083353 14893 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:33.084352 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:33.086251 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.152285 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3151) took 1791 ms. Trace:
I20260709 13:20:33.152820 14225 rpcz_store.cc:276] 0709 13:20:31.361079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.092868 (+1731789us) service_pool.cc:224] Handling call
0709 13:20:33.093151 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.093705 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.152208 (+ 58503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:33.153355 14897 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:33.154141 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:33.086455 14892 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:33.086761 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:33.038475 21161 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.157636 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:33.158215 14228 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:33.159591 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:33.159754 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:33.160346 14892 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:33.095208 21107 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:33.160274 14899 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:33.161413 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:33.164677 14897 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:33.164975 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:33.166334 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:33.166929 14892 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:33.086421 21085 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.170254 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:33.027920 21067 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.079970 21136 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.171147 20926 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:33.136271 21123 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.980s	user 0.002s	sys 0.008s
I20260709 13:20:33.195061 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:33.161082 20879 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:33.158902 20888 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.191392 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:33.205737 14899 raft_consensus.cc:2410] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 23 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:20:33.183529 14892 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:33.187055 14228 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:33.209247 14897 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:33.164052 21107 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:33.116976 21088 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.188534 21165 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:33.158466 21134 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:20:33.224138 21067 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.218407 20876 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:33.213999 20986 consensus_meta.cc:287] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.028s	user 0.010s	sys 0.001s
W20260709 13:20:33.214269 21091 consensus_meta.cc:287] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.021s	user 0.008s	sys 0.003s
I20260709 13:20:33.210722 21031 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:33.196883 21153 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:20:33.236939 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:33.239545 14893 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:33.240178 14370 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:33.240643 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:33.187978 20905 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.045s
W20260709 13:20:33.238667 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.218525 21165 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:33.244575 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 333255us
W20260709 13:20:33.247301 14195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.015s	sys 0.011s
W20260709 13:20:33.249018 14195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.015s	sys 0.012s
I20260709 13:20:33.251504 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:33.252285 14373 raft_consensus.cc:2376] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19. Re-sending same reply.
I20260709 13:20:33.204430 21123 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.255507 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:33.233969 21136 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.215448 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:33.254853 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.241246 21052 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:33.250075 21165 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:33.215014 20888 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.271901 20888 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.280869 20888 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:33.244434 21025 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:33.282271 21025 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:33.281708 20888 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.283164 21025 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.285477 20888 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.286633 21123 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:33.257692 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.292959 21158 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.244640 21031 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.235961 20986 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.264839 14373 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:20:33.261766 21134 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.303056 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1519) took 1376 ms. Trace:
I20260709 13:20:33.352186 14894 rpcz_store.cc:276] 0709 13:20:31.926383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.115217 (+188834us) service_pool.cc:224] Handling call
0709 13:20:32.115530 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.202865 (+ 87335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.302794 (+1099929us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b540030c5d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:33.302993 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199415680}
I20260709 13:20:33.295328 14270 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:33.301385 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.355206 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59993.9us
I20260709 13:20:33.356212 14270 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:33.357658 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:33.302282 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1571) took 2703 ms. Trace:
I20260709 13:20:33.245503 21153 consensus_queue.cc:1243] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:33.312285 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:20:33.346855 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 86403.8us
I20260709 13:20:33.363937 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:33.364291 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:33.364675 14373 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:20:33.365037 14228 raft_consensus.cc:2368] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:33.366295 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:33.359841 14898 rpcz_store.cc:276] 0709 13:20:30.598902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.599134 (+   232us) service_pool.cc:224] Handling call
0709 13:20:30.599436 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.788018 (+1188582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.301989 (+1513971us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54005014d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:33.302187 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413420288}
W20260709 13:20:33.302428 14229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2782) took 2348 ms (client timeout 1948 ms). Trace:
W20260709 13:20:33.368863 14229 rpcz_store.cc:269] 0709 13:20:30.953719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.953969 (+   250us) service_pool.cc:224] Handling call
0709 13:20:33.302140 (+2348171us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54003e0154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:33.302313 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866591488}
I20260709 13:20:33.369887 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:33.371228 21123 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:33.235090 20876 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.377115 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:33.255040 20853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.013s	sys 0.014s
I20260709 13:20:33.302917 14221 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:33.374627 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 62397.9us
I20260709 13:20:33.379243 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:33.449970 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:33.503253 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:33.298728 21148 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.288333 21088 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.390575 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:33.294559 20909 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:33.445325 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:33.573238 14894 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:33.295567 20888 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.377099 21102 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:33.509908 14369 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
W20260709 13:20:33.518038 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.523034 21106 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.444340 21093 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.140s
I20260709 13:20:33.529451 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:33.584095 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 54732.8us
I20260709 13:20:33.530350 21176 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:33.297062 21165 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.505951 20905 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:33.538825 20876 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.372095 21134 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.543186 21161 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.545769 14373 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:33.600759 14894 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:33.602190 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:33.547377 21031 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:33.553038 21104 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.519s	user 0.003s	sys 0.004s
I20260709 13:20:33.360464 20598 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.150s
W20260709 13:20:33.605803 14901 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.014s	sys 0.013s
I20260709 13:20:33.336661 21136 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.293852 21107 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.338587 21052 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.557199 20926 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20.
I20260709 13:20:33.559257 21158 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.393846 21067 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:33.293601 20930 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.560005 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:33.562851 20986 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.567404 14896 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:33.371280 21114 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:33.577620 20847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.020s	sys 0.026s
I20260709 13:20:33.579023 21102 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:33.572723 20909 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.635779 20909 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:33.636720 21142 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.576s	user 0.036s	sys 0.030s
I20260709 13:20:33.591320 21177 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:33.603394 20939 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:20:33.637527 20908 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.608778 21093 consensus_queue.cc:1243] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:33.638517 20939 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:33.638931 20939 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:33.640059 20939 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.617178 20879 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:33.641546 21102 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:33.642760 20879 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.645208 20792 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:33.645637 20792 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:33.646533 20792 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.647430 21134 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.591993 21106 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.626858 21067 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:33.650244 21067 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.653065 20929 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:33.619390 20997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.019s	sys 0.045s
W20260709 13:20:33.654202 20997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.019s	sys 0.045s
I20260709 13:20:33.654814 21136 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.603776 21091 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:20:33.655963 21091 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:33.656347 21091 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:33.656904 21087 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:33.658907 21161 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:33.660653 21052 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.662386 20930 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:33.662961 21165 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.663391 21102 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.604388 21163 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:20:33.633278 21114 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.619916 21156 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:20:33.687611 21159 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:33.695214 21159 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:33.696384 21159 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.698457 21159 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:33.706177 21103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.006s	sys 0.009s
W20260709 13:20:33.706751 21103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.006s	sys 0.009s
W20260709 13:20:33.751394 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.004s	sys 0.011s
W20260709 13:20:33.752331 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.004s	sys 0.011s
I20260709 13:20:33.757397 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:33.759224 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:33.762771 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:33.399314 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:33.371070 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:33.581765 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:33.572062 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:33.773744 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:33.782326 14300 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.016s	sys 0.007s
W20260709 13:20:33.804343 14300 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.016s	sys 0.008s
I20260709 13:20:33.571910 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:33.790544 14371 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:33.791890 14372 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:33.782327 14304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.008s	sys 0.025s
W20260709 13:20:33.808260 14304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.009s	sys 0.025s
I20260709 13:20:33.808971 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:33.792897 14373 raft_consensus.cc:2393] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:33.607194 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:33.811954 14894 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:33.800974 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:33.774358 14225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.011s	sys 0.031s
W20260709 13:20:33.815277 14225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.011s	sys 0.031s
I20260709 13:20:33.816881 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2792) took 2339 ms. Trace:
I20260709 13:20:33.817514 14225 rpcz_store.cc:276] 0709 13:20:31.481282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.155371 (+1674089us) service_pool.cc:224] Handling call
0709 13:20:33.155733 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:33.161535 (+  5802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:33.161580 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:33.164051 (+  2471us) log.cc:844] Serialized 26 byte log entry
0709 13:20:33.816074 (+652023us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:33.816200 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.816345 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.816429 (+    84us) raft_consensus.cc:1685] finished
0709 13:20:33.816441 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.816730 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5344,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":11673,"thread_start_us":599340,"threads_started":1,"wal-append.queue_time_us":487171}
I20260709 13:20:33.805346 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:33.822662 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:33.823575 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:33.824785 14229 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.825037 14372 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:33.825062 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:33.606135 14901 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.014s	sys 0.013s
I20260709 13:20:33.831254 14898 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:33.833333 20691 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.834920 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:33.834731 20691 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:33.839655 20678 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.926s	user 0.012s	sys 0.000s
I20260709 13:20:33.647503 20792 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:33.628230 20847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.021s	sys 0.027s
I20260709 13:20:33.583416 20888 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.603652 20905 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.641489 20939 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:33.657166 21091 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.822964 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:33.837409 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:33.839655 20691 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.895480 20909 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:33.910065 14898 raft_consensus.cc:2410] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:33.893441 20876 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:33.909157 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:33.910534 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.912025 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.906004 20944 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:33.900256 20908 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:33.920989 20944 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:33.921816 20944 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:33.930495 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:33.927575 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1578) took 2852 ms. Trace:
W20260709 13:20:33.899299 21090 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.002s	sys 0.007s
I20260709 13:20:33.936196 20908 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:33.917732 20926 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:20:33.938014 20908 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.938746 20905 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.939494 21147 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.940315 21148 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.941259 21148 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.900214 21163 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.945634 21163 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:33.948825 21163 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.949069 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3220) took 2620 ms. Trace:
W20260709 13:20:33.954881 21090 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.003s	sys 0.007s
I20260709 13:20:33.955076 20888 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:33.902740 21102 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.956182 14223 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:33.956741 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.958772 20598 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:33.959403 20598 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:33.949625 14295 rpcz_store.cc:276] 0709 13:20:31.328436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.663374 (+334938us) service_pool.cc:224] Handling call
0709 13:20:31.663714 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.737502 (+ 73788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.737550 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.754694 (+ 17144us) log.cc:844] Serialized 26 byte log entry
0709 13:20:32.727940 (+973246us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b18000c6400. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:20:33.157986 (+430046us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:33.158031 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.948379 (+790348us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b5400090bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:33.948457 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.948541 (+    84us) raft_consensus.cc:1685] finished
0709 13:20:33.948559 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.948836 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1167,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":24011,"spinlock_wait_cycles":53351808,"thread_start_us":429839,"threads_started":1,"wal-append.queue_time_us":1748383}
I20260709 13:20:33.940361 21147 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:33.964779 14369 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:33.964612 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3227) took 1815 ms. Trace:
I20260709 13:20:33.933825 14221 rpcz_store.cc:276] 0709 13:20:31.075058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.090865 (+ 15807us) service_pool.cc:224] Handling call
0709 13:20:33.302665 (+2211800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.510687 (+208022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.927085 (+416398us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54003e0150. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:33.927352 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5085762304}
W20260709 13:20:33.967540 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.968448 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:33.966660 14304 rpcz_store.cc:276] 0709 13:20:32.148700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.898327 (+749627us) service_pool.cc:224] Handling call
0709 13:20:32.898707 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:32.899148 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:33.170184 (+271036us) log.cc:844] Serialized 14 byte log entry
0709 13:20:33.809236 (+639052us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:33.810460 (+  1224us) log.cc:844] Serialized 26 byte log entry
0709 13:20:33.810746 (+   286us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:33.810791 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.810965 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.961588 (+150623us) raft_consensus.cc:1685] finished
0709 13:20:33.961610 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.964516 (+  2906us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":576935,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":34572,"raft.run_cpu_time_us":755,"raft.run_wall_time_us":43118,"thread_start_us":850922,"threads_started":2,"wal-append.queue_time_us":505129}
I20260709 13:20:33.907749 21091 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:33.970376 14898 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:33.971107 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:33.973011 14898 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: [15.15-18.17]
I20260709 13:20:33.972973 14304 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:33.935271 20876 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:33.962764 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 52340.6us
W20260709 13:20:33.977474 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.981137 14894 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:33.989221 21148 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:33.966090 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:33.999028 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:34.002290 14369 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:34.004592 14372 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:34.011019 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.031378 20876 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:34.015151 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:34.065516 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 686200us
I20260709 13:20:34.066386 14302 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:34.059649 21025 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:34.067099 14864 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:34.065548 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:34.072592 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:34.075798 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1332) took 2196 ms. Trace:
I20260709 13:20:34.076342 14301 rpcz_store.cc:276] 0709 13:20:31.878984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.570673 (+691689us) service_pool.cc:224] Handling call
0709 13:20:32.571044 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:32.870005 (+298961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.075191 (+1205186us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54003ee4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:34.075604 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280450816}
I20260709 13:20:34.076107 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:34.079453 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.080754 14301 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:34.027351 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.082922 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:34.083421 14295 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:34.083947 14892 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:34.030946 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3226) took 1882 ms. Trace:
W20260709 13:20:34.013962 14220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 3165) took 1426 ms (client timeout 1629 ms). Trace:
W20260709 13:20:34.085017 14220 rpcz_store.cc:269] 0709 13:20:32.537164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.690151 (+152987us) service_pool.cc:224] Handling call
0709 13:20:33.925596 (+1235445us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54002a1cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:33.963371 (+ 37775us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237082496}
I20260709 13:20:34.084939 14303 rpcz_store.cc:276] 0709 13:20:32.148425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.879467 (+731042us) service_pool.cc:224] Handling call
0709 13:20:32.879743 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.914905 (+ 35162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.017431 (+1102526us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b54001a1b54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:34.030760 (+ 13329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23260032}
I20260709 13:20:34.086756 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:34.086952 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:34.087504 14220 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:34.032490 14296 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
W20260709 13:20:34.032876 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55848.4us
I20260709 13:20:34.033411 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1588) took 1227 ms. Trace:
I20260709 13:20:34.089318 14374 rpcz_store.cc:276] 0709 13:20:32.805624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.805801 (+   177us) service_pool.cc:224] Handling call
0709 13:20:32.806181 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.885653 (+ 79472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:32.885680 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:32.885729 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:32.885762 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.032834 (+1147072us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b54001b85d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:34.032922 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.033165 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182328064}
I20260709 13:20:34.034329 14221 raft_consensus.cc:2368] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18.
W20260709 13:20:34.039124 14370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1580) took 1755 ms (client timeout 2213 ms). Trace:
I20260709 13:20:34.078161 14896 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:34.042760 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.046167 21199 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:33.961233 20598 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.058668 21096 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:20:34.059796 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.060472 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.062870 21106 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:34.006772 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.099857 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:20:34.073160 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.016095 14898 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:20:34.087975 14303 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:34.098412 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:34.098734 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:34.099949 21147 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:34.102068 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1583) took 1014 ms. Trace:
I20260709 13:20:34.102547 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:34.103266 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.103340 21193 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:34.090790 14370 rpcz_store.cc:269] 0709 13:20:32.283678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.283783 (+   105us) service_pool.cc:224] Handling call
0709 13:20:34.032020 (+1748237us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54003c05d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.038886 (+  6866us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197454720}
I20260709 13:20:34.110483 14302 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:34.111657 14229 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:34.127700 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3236) took 1008 ms. Trace:
I20260709 13:20:34.115808 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3230) took 1911 ms. Trace:
I20260709 13:20:34.098430 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.116592 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:34.128089 14302 rpcz_store.cc:276] 0709 13:20:33.119311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.014559 (+895248us) service_pool.cc:224] Handling call
0709 13:20:34.127635 (+113076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.130223 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3402) took 1010 ms. Trace:
I20260709 13:20:34.138964 14299 rpcz_store.cc:276] 0709 13:20:33.119484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.006164 (+886680us) service_pool.cc:224] Handling call
0709 13:20:34.130162 (+123998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.142784 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.118268 21096 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:34.146903 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 48765.2us
I20260709 13:20:34.144212 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.140596 14369 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:34.149062 14373 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:34.151482 14270 leader_election.cc:400] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18.
I20260709 13:20:34.154131 14270 leader_election.cc:403] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:20:34.159345 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:34.162715 14295 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:34.163939 14377 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:34.167338 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1336) took 1068 ms. Trace:
I20260709 13:20:34.164266 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.167861 14295 rpcz_store.cc:276] 0709 13:20:33.098581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.098250 (+999669us) service_pool.cc:224] Handling call
0709 13:20:34.167269 (+ 69019us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:34.167236 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 64889.6us
I20260709 13:20:34.169379 14898 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:34.155318 21147 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:34.181187 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.178360 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.219434 21156 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.181826 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 45088.7us
I20260709 13:20:34.178117 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:34.191406 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:34.209494 14226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2794) took 2727 ms (client timeout 1860 ms). Trace:
W20260709 13:20:34.212247 21087 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.555s	user 0.014s	sys 0.005s
I20260709 13:20:34.214210 21158 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.214594 14224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 3140) took 2887 ms (client timeout 2080 ms). Trace:
I20260709 13:20:34.209496 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.216622 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3150) took 2882 ms. Trace:
W20260709 13:20:34.217864 14227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53824 (request call id 3162) took 2050 ms (client timeout 2036 ms). Trace:
I20260709 13:20:34.218361 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3218) took 2890 ms. Trace:
I20260709 13:20:34.121960 14901 rpcz_store.cc:276] 0709 13:20:33.087042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.094836 (+  7794us) service_pool.cc:224] Handling call
0709 13:20:33.095100 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.095285 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:33.828513 (+733228us) log.cc:844] Serialized 14 byte log entry
0709 13:20:33.895477 (+ 66964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:33.920189 (+ 24712us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:33.963978 (+ 43789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.000712 (+ 36734us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.101880 (+101168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4887,"prepare.queue_time_us":586837,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":1096,"raft.queue_time_us":7173,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":31959,"thread_start_us":785626,"threads_started":2,"wal-append.queue_time_us":107688}
I20260709 13:20:34.159153 21163 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.188855 14301 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
W20260709 13:20:34.230520 14224 rpcz_store.cc:269] 0709 13:20:31.326923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.327064 (+   141us) service_pool.cc:224] Handling call
0709 13:20:34.214142 (+2887078us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b540014a0d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.214370 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633096576}
I20260709 13:20:34.171057 21067 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.221628 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.140098 21199 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:34.179443 21135 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:34.188097 14296 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:34.227296 14372 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:34.231132 14223 rpcz_store.cc:276] 0709 13:20:31.334447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.045247 (+1710800us) service_pool.cc:224] Handling call
0709 13:20:33.045628 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.956781 (+911153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.216284 (+259503us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54002a17d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:34.216544 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092971776}
I20260709 13:20:34.229403 14304 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:34.171455 20905 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:34.231262 14227 rpcz_store.cc:269] 0709 13:20:32.167082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.859929 (+692847us) service_pool.cc:224] Handling call
0709 13:20:34.217341 (+1357412us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540026bbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.217627 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408952704}
I20260709 13:20:34.233733 14220 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
W20260709 13:20:34.228338 14226 rpcz_store.cc:269] 0709 13:20:31.481886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.560943 (+ 79057us) service_pool.cc:224] Handling call
0709 13:20:34.209039 (+2648096us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54002a21d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.209249 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5216107264}
I20260709 13:20:34.171594 21106 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.231602 14297 rpcz_store.cc:276] 0709 13:20:31.327993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.490588 (+162595us) service_pool.cc:224] Handling call
0709 13:20:32.726977 (+1236389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.036644 (+309667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.217253 (+1180609us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540022ddd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:34.217966 (+   713us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540022ddd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.218152 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3536160000}
W20260709 13:20:34.237541 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 107433us
I20260709 13:20:34.169651 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:34.157647 20598 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:34.235468 20908 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:34.247149 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:34.247776 21165 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.248432 21165 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.248785 21156 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.249975 20888 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.250831 20888 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.251726 21156 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:34.254798 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:34.257037 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:34.258076 21104 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:34.258102 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.258852 21104 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.260082 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.128271 14300 rpcz_store.cc:276] 0709 13:20:32.190863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.095892 (+905029us) service_pool.cc:224] Handling call
0709 13:20:33.096246 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.096475 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:33.805056 (+708581us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.101105 (+296049us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.101323 (+   218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.101393 (+    70us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:34.101518 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.101603 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.101766 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12568,"prepare.queue_time_us":639803,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":11529,"raft.run_cpu_time_us":561,"raft.run_wall_time_us":26105,"spinlock_wait_cycles":5315328,"thread_start_us":781325,"threads_started":2,"wal-append.queue_time_us":229472}
I20260709 13:20:34.260959 14374 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:34.261087 21104 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:34.237521 21158 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.227332 21147 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:34.262432 14270 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:34.267263 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:34.266486 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.286749 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:34.264952 14303 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:34.261462 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:34.280381 14302 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:34.275839 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.262951 14370 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:34.287668 14300 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:34.261988 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.287705 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3233) took 1169 ms. Trace:
I20260709 13:20:34.285548 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.264135 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.283167 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3400) took 1124 ms. Trace:
I20260709 13:20:34.288281 14303 rpcz_store.cc:276] 0709 13:20:33.118440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.086520 (+968080us) service_pool.cc:224] Handling call
0709 13:20:34.287645 (+201125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:34.284906 14304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1339) took 1140 ms (client timeout 1507 ms). Trace:
I20260709 13:20:34.290146 14299 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:34.290335 14304 rpcz_store.cc:269] 0709 13:20:33.099426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.970639 (+871213us) service_pool.cc:224] Handling call
0709 13:20:34.239375 (+268736us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.291276 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:34.291742 14372 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:34.289347 14296 rpcz_store.cc:276] 0709 13:20:33.118888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.097975 (+979087us) service_pool.cc:224] Handling call
0709 13:20:34.243595 (+145620us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:34.295601 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 195857us
I20260709 13:20:34.296995 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.240124 21135 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:34.265163 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:34.295442 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:34.295445 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.242511 20905 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.299443 14223 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:20:34.299300 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.253542 20888 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:34.295442 14226 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:34.171926 21148 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:20:34.302685 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.303772 21052 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.310155 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2807) took 1109 ms. Trace:
I20260709 13:20:34.299163 14220 raft_consensus.cc:2376] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18. Re-sending same reply.
I20260709 13:20:34.262071 21129 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.315270 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:34.266242 20908 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:34.261715 21104 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:34.310324 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48067.9us
I20260709 13:20:34.323514 21135 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:34.325274 21135 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.314584 21156 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:20:34.326661 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:34.320497 20908 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.333153 14376 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:34.307813 14193 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:34.334367 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 45384.4us
I20260709 13:20:34.323558 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.335964 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.336634 14296 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:34.336848 14376 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:20:34.337010 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.326705 21156 consensus_queue.cc:1243] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:34.338003 21025 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:34.338829 21025 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:34.339607 21087 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:34.340060 21087 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:34.340101 21025 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:34.310799 14223 rpcz_store.cc:276] 0709 13:20:33.200309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.242313 (+1042004us) service_pool.cc:224] Handling call
0709 13:20:34.310069 (+ 67756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.343298 14223 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:34.344388 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2796) took 2862 ms. Trace:
I20260709 13:20:34.344851 14223 rpcz_store.cc:276] 0709 13:20:31.482426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.342636 (+2860210us) service_pool.cc:224] Handling call
0709 13:20:34.343080 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.343770 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.343975 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.334301 14375 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:34.346103 14867 leader_election.cc:400] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:34.346683 14223 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:20:34.347582 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1580) took 2843 ms. Trace:
I20260709 13:20:34.347973 14223 rpcz_store.cc:276] 0709 13:20:31.504475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.345888 (+2841413us) service_pool.cc:224] Handling call
0709 13:20:34.346334 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.347241 (+   907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.347518 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.263741 21102 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.349359 21156 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.349316 21102 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:34.350317 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49288.3us
I20260709 13:20:34.337548 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.350979 14301 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:34.351671 21195 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.351826 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:34.352263 21195 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.318077 14370 raft_consensus.cc:2410] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:34.337896 21052 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.355288 14296 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: [17.13-19.14]
I20260709 13:20:34.326016 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2791) took 2848 ms. Trace:
I20260709 13:20:34.357110 21102 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:34.316157 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:34.357313 14222 rpcz_store.cc:276] 0709 13:20:31.477008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.119514 (+1642506us) service_pool.cc:224] Handling call
0709 13:20:33.926105 (+806591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.926656 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:34.104899 (+178243us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.231386 (+126487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.231441 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:34.231496 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.231563 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.325656 (+ 94093us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54002a1cd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.325807 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4917,"prepare.queue_time_us":323325,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":44,"raft.queue_time_us":5043,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":5266,"spinlock_wait_cycles":1845392640,"thread_start_us":263447,"threads_started":2,"wal-append.queue_time_us":215617}
I20260709 13:20:34.359632 21133 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:34.360545 14222 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:34.361104 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.361348 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1581) took 2680 ms. Trace:
I20260709 13:20:34.362041 14370 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:34.341110 21087 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.355818 21139 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:34.264195 20903 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.363481 21139 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:34.364163 21139 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.356784 21195 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:34.363756 20903 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.263391 21163 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.367369 20903 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:34.367784 21163 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:34.358853 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49963.8us
I20260709 13:20:34.368700 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.369391 14226 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:34.369942 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2809) took 1155 ms. Trace:
I20260709 13:20:34.370239 14226 rpcz_store.cc:276] 0709 13:20:33.214458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.317965 (+1103507us) service_pool.cc:224] Handling call
0709 13:20:34.369871 (+ 51906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.372298 21133 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:34.369195 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:34.349574 14895 raft_consensus.cc:2410] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:20:34.375012 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:34.375727 14297 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:34.377126 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2759) took 1021 ms. Trace:
I20260709 13:20:34.377305 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:34.305222 20905 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.399681 21165 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:34.400269 20888 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:34.401263 14304 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:34.378036 21133 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:34.237895 21096 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.402310 21133 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:34.403048 21096 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.403491 21133 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:34.406270 21193 consensus_queue.cc:1175] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" responder_term: 18 status { last_received { term: 17 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:34.377691 14371 rpcz_store.cc:276] 0709 13:20:33.355894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.356209 (+   315us) service_pool.cc:224] Handling call
0709 13:20:33.507688 (+151479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.806999 (+299311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.376764 (+569765us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b540004bfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:34.377048 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648859904}
I20260709 13:20:34.401180 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.379132 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2799) took 2636 ms. Trace:
I20260709 13:20:34.379498 21087 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:34.375751 14298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1335) took 2170 ms (client timeout 1880 ms). Trace:
I20260709 13:20:34.383672 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.248833 21199 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:34.385844 14299 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:34.416337 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3384) took 2086 ms. Trace:
I20260709 13:20:34.416761 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3385) took 1997 ms. Trace:
W20260709 13:20:34.417845 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 92070.3us
I20260709 13:20:34.417454 14304 rpcz_store.cc:276] 0709 13:20:32.414172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.400290 (+1986118us) service_pool.cc:224] Handling call
0709 13:20:34.400802 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.410935 (+ 10133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.411220 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.418634 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:34.386021 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 67027.5us
I20260709 13:20:34.388823 20383 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.421590 14298 rpcz_store.cc:269] 0709 13:20:32.205625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.240606 (+ 34981us) service_pool.cc:224] Handling call
0709 13:20:34.375280 (+2134674us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b540022c4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.375483 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127789824}
I20260709 13:20:34.416831 14299 rpcz_store.cc:276] 0709 13:20:32.329857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.385072 (+2055215us) service_pool.cc:224] Handling call
0709 13:20:34.385575 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.415936 (+ 30361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.416227 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.380635 21052 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:34.391247 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1589) took 1580 ms. Trace:
I20260709 13:20:34.389696 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1584) took 1242 ms. Trace:
I20260709 13:20:34.353447 14301 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:34.391709 21158 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:34.393044 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3382) took 2088 ms. Trace:
I20260709 13:20:34.392565 21147 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.361768 14222 rpcz_store.cc:276] 0709 13:20:31.681094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.359616 (+2678522us) service_pool.cc:224] Handling call
0709 13:20:34.360029 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.361109 (+  1080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.361297 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.350417 21156 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.395906 21107 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:34.366942 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.412134 14295 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:34.413702 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2812) took 1101 ms. Trace:
I20260709 13:20:34.410810 14226 rpcz_store.cc:276] 0709 13:20:31.742598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.370958 (+2628360us) service_pool.cc:224] Handling call
0709 13:20:34.371372 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.371580 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.371606 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.371650 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:34.371681 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.371742 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.379054 (+  7312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.419174 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2808) took 1215 ms. Trace:
I20260709 13:20:34.439152 14221 rpcz_store.cc:276] 0709 13:20:33.204252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.383236 (+1178984us) service_pool.cc:224] Handling call
0709 13:20:34.419105 (+ 35869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.426952 14377 rpcz_store.cc:276] 0709 13:20:32.810606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.810886 (+   280us) service_pool.cc:224] Handling call
0709 13:20:34.390968 (+1580082us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b540034a3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.391167 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2161343744}
I20260709 13:20:34.430375 14296 rpcz_store.cc:276] 0709 13:20:32.304828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.354435 (+2049607us) service_pool.cc:224] Handling call
0709 13:20:34.355000 (+   565us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:34.379879 (+ 24879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.392902 (+ 13023us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.433413 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1334) took 2222 ms. Trace:
W20260709 13:20:34.434099 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.432667 14228 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:34.438405 14298 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:34.440919 14301 rpcz_store.cc:276] 0709 13:20:32.205347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.352691 (+2147344us) service_pool.cc:224] Handling call
0709 13:20:34.353181 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.427671 (+ 74490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.427876 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.438701 14229 rpcz_store.cc:276] 0709 13:20:33.312510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.301276 (+988766us) service_pool.cc:224] Handling call
0709 13:20:34.413438 (+112162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.442603 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:34.443042 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3388) took 1991 ms. Trace:
I20260709 13:20:34.443420 14298 rpcz_store.cc:276] 0709 13:20:32.451204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.432690 (+1981486us) service_pool.cc:224] Handling call
0709 13:20:34.433156 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.441636 (+  8480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.442981 (+  1345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.442313 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:34.439625 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 62395.3us
I20260709 13:20:34.448426 14223 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:34.450719 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.453474 14220 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:34.457760 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2803) took 1300 ms. Trace:
I20260709 13:20:34.424394 20888 raft_consensus.cc:697] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:34.458279 14220 rpcz_store.cc:276] 0709 13:20:33.157624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.318836 (+1161212us) service_pool.cc:224] Handling call
0709 13:20:34.457691 (+138855us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.184295 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:34.462206 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.463413 14229 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:34.465361 14229 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:34.466741 14295 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:34.467828 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3390) took 2016 ms. Trace:
I20260709 13:20:34.468324 14295 rpcz_store.cc:276] 0709 13:20:32.451782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.446178 (+1994396us) service_pool.cc:224] Handling call
0709 13:20:34.466369 (+ 20191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.467392 (+  1023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.467733 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.442164 21129 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:34.458035 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2814) took 1086 ms. Trace:
I20260709 13:20:34.470985 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1585) took 2573 ms. Trace:
I20260709 13:20:34.471698 14299 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:34.471808 14229 rpcz_store.cc:276] 0709 13:20:31.897751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.464628 (+2566877us) service_pool.cc:224] Handling call
0709 13:20:34.465131 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.470641 (+  5510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.470900 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.472646 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.471264 14227 rpcz_store.cc:276] 0709 13:20:33.371426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.366536 (+995110us) service_pool.cc:224] Handling call
0709 13:20:34.457961 (+ 91425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.427542 14900 rpcz_store.cc:276] 0709 13:20:33.087287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.149047 (+ 61760us) service_pool.cc:224] Handling call
0709 13:20:33.172609 (+ 23562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.172876 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:33.613972 (+441096us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.328721 (+714749us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18003a7740. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a
0709 13:20:34.329082 (+   361us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.329177 (+    95us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:34.329284 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.329382 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.329557 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":513662,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":4010,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"spinlock_wait_cycles":23984000,"thread_start_us":723595,"threads_started":2,"wal-append.queue_time_us":303432}
I20260709 13:20:34.479245 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.478490 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.482960 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3387) took 2032 ms. Trace:
I20260709 13:20:34.483408 14299 rpcz_store.cc:276] 0709 13:20:32.450878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.425073 (+1974195us) service_pool.cc:224] Handling call
0709 13:20:34.450015 (+ 24942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.480291 (+ 30276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.482899 (+  2608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.479959 14226 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:34.410153 21106 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.470266 21129 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.448424 21135 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:34.482502 14221 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:34.480808 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:34.472434 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:34.496763 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.497862 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:34.502049 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:34.505544 14220 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:20:34.513628 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1582) took 2735 ms. Trace:
I20260709 13:20:34.493614 21129 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:34.498944 21195 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.518646 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:34.478044 20383 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:34.521992 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 265137us
I20260709 13:20:34.524631 14229 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:34.515569 14220 rpcz_store.cc:276] 0709 13:20:31.770718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.476897 (+2706179us) service_pool.cc:224] Handling call
0709 13:20:34.495605 (+ 18708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.506198 (+ 10593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.506441 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.527314 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3161) took 2360 ms. Trace:
I20260709 13:20:34.527997 14229 rpcz_store.cc:276] 0709 13:20:32.166802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.486974 (+2320172us) service_pool.cc:224] Handling call
0709 13:20:34.517292 (+ 30318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.527048 (+  9756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.527262 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.529510 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:34.524171 14301 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:20:34.533221 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3389) took 2081 ms. Trace:
I20260709 13:20:34.534325 14221 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: [17.13-19.14]
I20260709 13:20:34.535562 14296 raft_consensus.cc:2410] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:20:34.533766 14301 rpcz_store.cc:276] 0709 13:20:32.451494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.441778 (+1990284us) service_pool.cc:224] Handling call
0709 13:20:34.489684 (+ 47906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.531165 (+ 41481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.533105 (+  1940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.538641 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3168) took 1366 ms. Trace:
I20260709 13:20:34.539184 14221 rpcz_store.cc:276] 0709 13:20:33.172381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.499757 (+1327376us) service_pool.cc:224] Handling call
0709 13:20:34.531811 (+ 32054us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:34.538261 (+  6450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.538566 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.542891 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.544274 14224 raft_consensus.cc:2410] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:34.535614 21199 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.539259 14226 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:34.546838 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:34.548617 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2810) took 1322 ms. Trace:
I20260709 13:20:34.549937 14224 rpcz_store.cc:276] 0709 13:20:33.226197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.522518 (+1296321us) service_pool.cc:224] Handling call
0709 13:20:34.548524 (+ 26006us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.546706 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:34.555227 14900 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.552284 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:34.557960 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1589) took 1508 ms. Trace:
I20260709 13:20:34.558143 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.554908 14227 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:34.558429 14226 rpcz_store.cc:276] 0709 13:20:33.044777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.489458 (+1444681us) service_pool.cc:224] Handling call
0709 13:20:34.516603 (+ 27145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.553276 (+ 36673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.553532 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.536428 21165 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:34.558925 14227 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:34.562567 14302 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:34.563119 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3404) took 1003 ms. Trace:
I20260709 13:20:34.523118 21158 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:20:34.548410 21091 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:20:34.563335 14220 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 13:20:34.569247 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.563385 14302 rpcz_store.cc:276] 0709 13:20:33.559706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.157592 (+597886us) service_pool.cc:224] Handling call
0709 13:20:34.563071 (+405479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.569628 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.576470 21156 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:34.578411 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.564191 21216 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:34.580937 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:34.581734 20383 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:34.582237 21091 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:20:34.582674 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 143329us
I20260709 13:20:34.582971 21106 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:34.583537 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:34.583971 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:34.584568 21159 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:34.584681 14296 raft_consensus.cc:2376] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15. Re-sending same reply.
I20260709 13:20:34.585040 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:34.585698 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.586050 20903 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:34.574044 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1582) took 1477 ms. Trace:
I20260709 13:20:34.583007 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1589) took 1002 ms. Trace:
I20260709 13:20:34.528703 21195 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.573956 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:34.563413 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 126243us
I20260709 13:20:34.582687 21091 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:34.587568 14867 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:34.581676 14901 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:34.588912 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2943) took 1107 ms. Trace:
I20260709 13:20:34.579447 21216 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.586746 14296 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:34.590644 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:34.588863 20903 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.580966 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:34.598027 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50371.8us
I20260709 13:20:34.589541 14895 rpcz_store.cc:276] 0709 13:20:33.084623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.086535 (+  1912us) service_pool.cc:224] Handling call
0709 13:20:34.553227 (+1466692us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400440554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.562390 (+  9163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2486701312}
I20260709 13:20:34.601312 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:34.602170 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.598778 14341 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:34.602473 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:34.564386 21148 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:34.621579 14224 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:34.636077 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:34.637077 14893 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:34.639212 14222 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:34.636225 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:34.640118 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55220.9us
W20260709 13:20:34.612601 20944 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.005s
I20260709 13:20:34.607534 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.644552 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:34.645102 14296 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:34.646320 14297 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 14.
I20260709 13:20:34.642763 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:34.559775 20908 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:34.589953 14896 rpcz_store.cc:276] 0709 13:20:33.581002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.117854 (+536852us) service_pool.cc:224] Handling call
0709 13:20:34.166182 (+ 48328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.210057 (+ 43875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.210099 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:34.210778 (+   679us) log.cc:844] Serialized 26 byte log entry
0709 13:20:34.413151 (+202373us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:34.413202 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.413307 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:34.582780 (+169473us) raft_consensus.cc:1685] finished
0709 13:20:34.582800 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.582928 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5113,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":201944,"threads_started":1,"wal-append.queue_time_us":310668}
I20260709 13:20:34.606293 20903 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:34.666980 14228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2816) took 1289 ms (client timeout 1541 ms). Trace:
W20260709 13:20:34.667434 14228 rpcz_store.cc:269] 0709 13:20:33.377821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.391931 (+ 14110us) service_pool.cc:224] Handling call
0709 13:20:34.666746 (+1274815us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400332054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.666909 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477835008}
I20260709 13:20:34.654894 20944 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.672709 14225 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:34.614323 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:34.674340 21158 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:34.607843 14227 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.674846 21158 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.675239 14227 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.675345 21158 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:34.675766 21217 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:20:34.676321 21102 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:34.656241 14226 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:34.662658 14297 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:34.610498 21067 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18.
I20260709 13:20:34.677924 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1337) took 1579 ms. Trace:
I20260709 13:20:34.678270 14297 rpcz_store.cc:276] 0709 13:20:33.098890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.654286 (+1555396us) service_pool.cc:224] Handling call
0709 13:20:34.662466 (+  8180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.677660 (+ 15194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.677870 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.664515 14299 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21. Ops: [17.13-20.14]
I20260709 13:20:34.679544 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1338) took 1580 ms. Trace:
I20260709 13:20:34.679865 14299 rpcz_store.cc:276] 0709 13:20:33.099171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.663879 (+1564708us) service_pool.cc:224] Handling call
0709 13:20:34.664285 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:34.679263 (+ 14978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.679493 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.613214 20888 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.665304 14894 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:34.682035 21094 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:34.682687 21094 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:34.682904 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1587) took 1460 ms. Trace:
I20260709 13:20:34.682837 14298 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:34.592252 21165 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:34.629308 21214 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.289s	user 0.005s	sys 0.000s
I20260709 13:20:34.689410 14295 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:34.610504 21156 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:34.691469 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3237) took 1533 ms. Trace:
W20260709 13:20:34.674252 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 60022.6us
I20260709 13:20:34.603605 21216 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.683305 14894 rpcz_store.cc:276] 0709 13:20:33.222437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.984334 (+761897us) service_pool.cc:224] Handling call
0709 13:20:33.984759 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.681953 (+697194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.682656 (+   703us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54007add54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:34.682841 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564210432}
W20260709 13:20:34.690539 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54441.1us
I20260709 13:20:34.687856 14303 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:34.696880 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3386) took 2240 ms. Trace:
I20260709 13:20:34.697417 14304 rpcz_store.cc:276] 0709 13:20:32.450504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.419056 (+1968552us) service_pool.cc:224] Handling call
0709 13:20:34.455238 (+ 36182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.479321 (+ 24083us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:34.500817 (+ 21496us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.690669 (+189852us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.690738 (+    69us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:34.690800 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.690883 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.691032 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37402,"prepare.queue_time_us":21320,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"thread_start_us":110282,"threads_started":1}
I20260709 13:20:34.691994 14298 rpcz_store.cc:276] 0709 13:20:33.157667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.682203 (+1524536us) service_pool.cc:224] Handling call
0709 13:20:34.682573 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.691175 (+  8602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.691398 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.596370 14378 rpcz_store.cc:276] 0709 13:20:33.380276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.380454 (+   178us) service_pool.cc:224] Handling call
0709 13:20:33.380849 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.381147 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:33.963696 (+582549us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.307855 (+344159us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.321159 (+ 13304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.371459 (+ 50300us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b18004a57e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f522 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:34.413734 (+ 42275us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:34.416138 (+  2404us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b18004a57e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f522 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:34.444561 (+ 28423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.475143 (+ 30582us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b18004a57e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:34.475723 (+   580us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.487258 (+ 11535us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58825,"prepare.queue_time_us":587573,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":132,"raft.queue_time_us":85635,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":20489,"spinlock_wait_cycles":251789824,"thread_start_us":512564,"threads_started":2,"wal-append.queue_time_us":239750}
W20260709 13:20:34.700922 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48384.1us
W20260709 13:20:34.701238 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.701844 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:34.703406 14223 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:34.653981 21159 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.673344 21139 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.722294 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1590) took 1475 ms. Trace:
I20260709 13:20:34.725137 14225 rpcz_store.cc:276] 0709 13:20:33.227616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.908716 (+681100us) service_pool.cc:224] Handling call
0709 13:20:34.702849 (+794133us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b5400094f54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.703048 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733229440}
W20260709 13:20:34.725485 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 150739us
I20260709 13:20:34.698908 21156 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.742043 14900 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:34.691572 21148 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:34.743297 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 52002.7us
W20260709 13:20:34.744702 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 155558us
I20260709 13:20:34.746529 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2944) took 1339 ms. Trace:
I20260709 13:20:34.706797 21102 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:34.704394 21195 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:34.757124 14304 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 13:20:34.753476 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51396.5us
I20260709 13:20:34.751264 14372 rpcz_store.cc:276] 0709 13:20:33.390829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.301735 (+910906us) service_pool.cc:224] Handling call
0709 13:20:34.429749 (+128014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.486849 (+ 57100us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:34.526493 (+ 39644us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.706914 (+180421us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.720201 (+ 13287us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.720282 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:34.729597 (+  9315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.729685 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.729849 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12986,"prepare.queue_time_us":37550,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":91,"raft.queue_time_us":40809,"spinlock_wait_cycles":41214208,"thread_start_us":109091,"threads_started":1}
I20260709 13:20:34.752729 21102 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.759900 14296 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:34.732249 21135 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:34.720491 21106 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:20:34.743660 21052 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.777704 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3160) took 2601 ms. Trace:
I20260709 13:20:34.762759 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:34.765393 14298 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:34.778195 14223 rpcz_store.cc:276] 0709 13:20:32.166527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.477156 (+2310629us) service_pool.cc:224] Handling call
0709 13:20:34.703164 (+226008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.703965 (+   801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.767287 (+ 63322us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400094f50. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.767488 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518665600}
I20260709 13:20:34.751593 21156 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:34.766055 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1340) took 1576 ms. Trace:
I20260709 13:20:34.759552 21102 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.781536 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3401) took 1662 ms. Trace:
I20260709 13:20:34.790562 14295 rpcz_store.cc:276] 0709 13:20:33.119204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.674306 (+1555102us) service_pool.cc:224] Handling call
0709 13:20:34.683239 (+  8933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.689848 (+  6609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.771527 (+ 81679us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b54000fdcd0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:34.781480 (+  9953us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19585408}
I20260709 13:20:34.781896 14296 rpcz_store.cc:276] 0709 13:20:33.189757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.698813 (+1509056us) service_pool.cc:224] Handling call
0709 13:20:34.749987 (+ 51174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.760315 (+ 10328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.765972 (+  5657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.788101 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3238) took 1558 ms. Trace:
I20260709 13:20:34.793038 14298 rpcz_store.cc:276] 0709 13:20:33.230121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.700149 (+1470028us) service_pool.cc:224] Handling call
0709 13:20:34.749772 (+ 49623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.787725 (+ 37953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.788021 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:34.798096 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 105852us
I20260709 13:20:34.753005 20598 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:20:34.800230 14297 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: [15.9-17.10]
I20260709 13:20:34.762383 21135 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.806116 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3240) took 1029 ms. Trace:
I20260709 13:20:34.807451 14298 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:34.806576 14302 rpcz_store.cc:276] 0709 13:20:33.776814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.773577 (+996763us) service_pool.cc:224] Handling call
0709 13:20:34.799793 (+ 26216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.805727 (+  5934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.805756 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.805825 (+    69us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:34.805860 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.805932 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.806056 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:34.775184 21025 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 13:20:34.797049 21195 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.815524 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:34.816767 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:34.821830 14896 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:34.822671 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:34.817490 20939 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:34.823015 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:34.815676 21052 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.821122 14894 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:34.811220 21135 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.822276 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:34.856002 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:34.866855 14901 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
W20260709 13:20:34.866847 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 108272us
I20260709 13:20:34.823805 14899 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:34.813153 21025 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:34.856796 21163 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:34.844010 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:34.809129 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 123165us
W20260709 13:20:34.862223 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 117730us
I20260709 13:20:34.874742 14900 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.864337 14893 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:34.801949 21104 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.866416 14193 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:34.873543 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 112971us
I20260709 13:20:34.882488 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:34.872470 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3232) took 2554 ms. Trace:
I20260709 13:20:34.831058 20598 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:34.911863 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 52848.5us
I20260709 13:20:34.761314 21091 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:34.921432 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:34.889674 14300 rpcz_store.cc:276] 0709 13:20:32.317588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.381672 (+2064084us) service_pool.cc:224] Handling call
0709 13:20:34.390934 (+  9262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.391257 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:34.561749 (+170492us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.872134 (+310385us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.872195 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:34.872240 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.872303 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.872414 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35188,"prepare.queue_time_us":7784,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"spinlock_wait_cycles":98316672,"thread_start_us":326291,"threads_started":3,"wal-append.queue_time_us":188086}
I20260709 13:20:34.925446 14302 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:34.872917 21193 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.932806 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:34.870740 21025 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:34.935140 14867 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:34.939522 14267 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:34.941126 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:34.881013 20908 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:34.911602 20598 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:34.925248 20383 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:34.948292 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3393) took 2495 ms. Trace:
I20260709 13:20:34.924800 21133 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.796448 21094 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.806763 21165 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.954578 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3246) took 1116 ms. Trace:
I20260709 13:20:34.957964 14304 rpcz_store.cc:276] 0709 13:20:33.835231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.781028 (+945797us) service_pool.cc:224] Handling call
0709 13:20:34.798561 (+ 17533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.951355 (+152794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.951402 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.951455 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:34.951490 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.951562 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.951681 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75396,"thread_start_us":70449,"threads_started":1}
I20260709 13:20:34.870000 21195 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.966228 14901 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:34.963158 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 146521us
I20260709 13:20:34.952203 14301 rpcz_store.cc:276] 0709 13:20:32.452721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.542895 (+2090174us) service_pool.cc:224] Handling call
0709 13:20:34.572905 (+ 30010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.595073 (+ 22168us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:34.653420 (+ 58347us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.942508 (+289088us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.942565 (+    57us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:34.947999 (+  5434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.948088 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.948233 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10961,"prepare.queue_time_us":50188,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":65,"raft.queue_time_us":127499,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":22766,"thread_start_us":230566,"threads_started":2,"wal-append.queue_time_us":199377}
I20260709 13:20:34.913398 21104 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:34.971273 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50754.3us
I20260709 13:20:34.869365 21148 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.973685 14227 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
W20260709 13:20:34.979823 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.948945 20944 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:34.983072 14227 pending_rounds.cc:85] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 14
I20260709 13:20:34.937568 20939 consensus_queue.cc:1059] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:20:34.984609 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.951493 21234 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:34.987397 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:34.985392 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:34.988616 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 67277.5us
W20260709 13:20:34.990121 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50691.6us
I20260709 13:20:34.943655 21193 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:34.990136 14900 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:34.995777 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2945) took 1484 ms. Trace:
I20260709 13:20:34.944772 21106 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:20:35.005385 20888 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:35.010895 20888 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.011767 20888 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:35.016674 21226 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.199s	user 0.000s	sys 0.002s
W20260709 13:20:35.007865 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 65949.9us
I20260709 13:20:34.974781 21067 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:34.974261 20383 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:34.978109 20908 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:35.060105 20908 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.060535 20908 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:34.986106 21133 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.063807 21133 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:35.065459 21193 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:35.066902 21193 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.067451 21193 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.021103 21091 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.070734 21067 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:35.071687 21067 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.007283 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:35.004432 14369 rpcz_store.cc:276] 0709 13:20:33.511608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.412991 (+901383us) service_pool.cc:224] Handling call
0709 13:20:34.457346 (+ 44355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.505344 (+ 47998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.505371 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:34.547503 (+ 42132us) log.cc:844] Serialized 26 byte log entry
0709 13:20:34.787571 (+240068us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:34.787609 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.787678 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:34.995491 (+207813us) raft_consensus.cc:1685] finished
0709 13:20:34.995518 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.995703 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":165774,"threads_started":1,"wal-append.queue_time_us":391862}
I20260709 13:20:34.982208 21139 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:35.041775 14373 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.596s	user 0.005s	sys 0.005s
I20260709 13:20:35.069536 21193 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:35.042582 14296 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:35.050462 21241 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:35.051432 21104 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:35.052631 21225 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:20:35.050490 21223 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:20:35.053960 21230 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:35.055083 21106 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:35.056576 21229 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:35.057907 21025 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.059228 20383 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:35.075421 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 68217.6us
W20260709 13:20:35.005357 14192 connection.cc:256] RPC call timeout handler was delayed by -1.0197233530000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 13:20:35.096125 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 105289us
I20260709 13:20:35.097239 14373 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:34.985865 14227 pending_rounds.cc:107] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 17.15
W20260709 13:20:35.098646 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 283252us
W20260709 13:20:35.099159 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 170216us
W20260709 13:20:35.101632 21107 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.004s
I20260709 13:20:35.106033 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:35.107329 21238 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:35.107966 21158 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.110968 14900 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:20:35.112020 21227 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:20:35.112763 21220 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:20:35.114303 21199 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:20:35.115121 14893 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:35.027139 21147 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:35.115979 21129 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
I20260709 13:20:35.215651 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:35.112057 21228 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
I20260709 13:20:35.098340 21133 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:35.154409 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:35.040988 21234 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:35.152467 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3250) took 1111 ms. Trace:
W20260709 13:20:35.154014 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 204421us
W20260709 13:20:35.115245 20905 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.716s	user 0.012s	sys 0.000s
I20260709 13:20:35.117165 21241 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:35.203346 14227 raft_consensus.cc:2889] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:35.222544 21219 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:20:35.106038 21231 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:35.117666 21159 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:35.214442 14892 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
W20260709 13:20:35.220881 21222 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
W20260709 13:20:35.220775 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 114869us
I20260709 13:20:35.256495 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:35.221372 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:35.228487 21025 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.234023 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:35.237777 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2817) took 1784 ms. Trace:
I20260709 13:20:35.228900 21240 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:35.235802 20905 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.238255 21241 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.241708 21232 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:35.211483 21090 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260709 13:20:35.243714 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.244114 21193 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:35.244575 21139 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:35.226140 21199 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:35.246124 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:35.246392 14225 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:20:35.246863 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:35.222957 21147 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.253196 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:35.231300 20944 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:20:35.229342 21129 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.301716 21107 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.302492 21107 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.255963 21231 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:35.304777 21107 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.304867 21231 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.305927 21239 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:20:35.306977 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:35.308310 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:35.211613 20908 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.259713 14227 rpcz_store.cc:276] 0709 13:20:33.453151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.523791 (+1070640us) service_pool.cc:224] Handling call
0709 13:20:34.554816 (+ 31025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:35.237476 (+682660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.237708 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:35.239715 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:35.117452 20903 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:35.249663 21216 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 13:20:35.215281 21106 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:35.271091 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 62128us
W20260709 13:20:35.371546 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 131950us
I20260709 13:20:35.238818 14299 rpcz_store.cc:276] 0709 13:20:34.041035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.793414 (+752379us) service_pool.cc:224] Handling call
0709 13:20:34.808203 (+ 14789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.808463 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:34.863546 (+ 55083us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.019303 (+155757us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b18002d52c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:20:35.149436 (+130133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:35.149493 (+    57us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:35.149548 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.151863 (+  2315us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.152403 (+   540us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7079,"prepare.queue_time_us":53428,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":93198,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":10286,"spinlock_wait_cycles":4189568,"thread_start_us":129989,"threads_started":1}
I20260709 13:20:35.262831 21104 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:35.309020 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:35.322580 21193 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:35.323000 21222 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:20:35.324695 21195 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:35.294504 21247 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:20:35.282022 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:35.395957 14301 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:35.301393 14223 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
W20260709 13:20:35.339701 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 129298us
I20260709 13:20:35.340222 14228 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:35.340356 21239 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:35.339771 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 118510us
I20260709 13:20:35.410596 21239 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:35.410935 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3410) took 1150 ms. Trace:
I20260709 13:20:35.411864 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:35.411646 21239 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.341598 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:35.341882 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1592) took 1540 ms. Trace:
I20260709 13:20:35.414383 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:35.414952 21247 consensus_queue.cc:1243] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:35.415341 21229 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:35.414623 21195 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:35.415923 21229 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.416356 21229 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.342370 20902 raft_consensus.cc:3055] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:35.343852 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:35.417970 20902 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:35.418228 14222 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:35.415930 21107 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:20:35.419140 20902 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.414420 14220 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:35.420919 20902 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:35.414563 14229 rpcz_store.cc:276] 0709 13:20:33.801588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.529377 (+727789us) service_pool.cc:224] Handling call
0709 13:20:34.550073 (+ 20696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.559622 (+  9549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.559653 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:34.573742 (+ 14089us) log.cc:844] Serialized 26 byte log entry
0709 13:20:34.762160 (+188418us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:34.762282 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.762416 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:35.331909 (+569493us) raft_consensus.cc:1685] finished
0709 13:20:35.331943 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.341779 (+  9836us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":90496,"threads_started":1,"wal-append.queue_time_us":327628}
I20260709 13:20:35.423444 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:35.424111 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1597) took 1041 ms. Trace:
I20260709 13:20:35.424376 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:35.424669 14892 rpcz_store.cc:276] 0709 13:20:34.382410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.553516 (+171106us) service_pool.cc:224] Handling call
0709 13:20:35.423868 (+870352us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54004a06d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:35.424023 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427329792}
I20260709 13:20:35.425530 21247 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:35.425591 21107 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:35.426090 21247 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.426281 21107 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.426558 21247 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.426743 21107 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:35.428030 21102 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.001s
I20260709 13:20:35.428481 21102 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.429571 14298 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:20:35.322101 21244 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
W20260709 13:20:35.258569 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 137951us
I20260709 13:20:35.431651 21106 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.431798 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:35.433252 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:35.348093 20598 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.434445 20598 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.435026 20908 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.436429 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:35.348115 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 91731.2us
I20260709 13:20:35.351922 21240 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:35.438717 21240 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:35.440335 21135 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.000s
I20260709 13:20:35.440762 21135 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.440992 21159 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:35.442378 21235 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:35.442858 21235 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:35.443423 21238 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.387856 21163 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:35.443974 21238 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.444013 21235 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.444682 21163 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.445163 21163 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.445447 21235 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.351382 20879 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:35.361009 14303 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 14: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:35.362272 14226 raft_consensus.cc:2410] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 19 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:20:35.362581 14374 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 22: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:35.250170 21133 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.251650 21052 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:35.387310 14295 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:35.470003 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.471174 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:35.387404 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:35.473706 21133 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:35.474310 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 77827us
I20260709 13:20:35.474795 21243 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:35.365952 21087 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.943s	user 0.007s	sys 0.006s
I20260709 13:20:35.397902 21158 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:35.364764 21139 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.389708 21104 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.391811 21193 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.414080 21231 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.344178 21248 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:35.433531 21251 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:35.442785 21242 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:35.446547 21238 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:35.330475 21234 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.447857 21107 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.447722 21247 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.448913 21229 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.378234 20939 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:35.386411 21067 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:35.450109 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:35.450476 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 220531us
I20260709 13:20:35.411577 14296 rpcz_store.cc:276] 0709 13:20:34.260269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.791796 (+531527us) service_pool.cc:224] Handling call
0709 13:20:34.842805 (+ 51009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:35.099316 (+256511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.410562 (+311246us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54000db1d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:35.410844 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411088768}
I20260709 13:20:35.455360 21129 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.455830 14267 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:35.456703 21236 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:35.457288 21232 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:35.457922 20905 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:35.308117 21096 raft_consensus.cc:3055] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:35.472816 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:35.473941 14304 raft_consensus.cc:2410] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:20:35.392753 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:35.481324 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:35.512928 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 44007.5us
I20260709 13:20:35.513296 21246 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.513723 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:35.514262 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:35.514801 21241 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.515328 21096 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:35.516010 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.425752 20903 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:35.516343 21096 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.517097 20939 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:35.517354 21102 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.518169 20939 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.516979 21241 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.520663 20879 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:35.538553 21135 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.519048 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:35.539556 14226 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:35.523002 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 151122us
I20260709 13:20:35.523811 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:35.542387 14296 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:35.520413 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47714.1us
I20260709 13:20:35.546060 20383 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:35.547189 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:35.547308 21135 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:35.548480 21135 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:35.523371 21257 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:35.549945 21148 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:35.522197 21239 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.551545 21247 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.551787 21148 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:35.512945 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57225us
W20260709 13:20:35.490599 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 237527us
I20260709 13:20:35.520540 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2767) took 1997 ms. Trace:
I20260709 13:20:35.556102 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:35.556063 14374 rpcz_store.cc:276] 0709 13:20:33.522752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.261639 (+738887us) service_pool.cc:224] Handling call
0709 13:20:35.520358 (+1258719us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540039b7d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:35.520486 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2439673728}
I20260709 13:20:35.530006 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:35.557979 21232 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:35.519558 21087 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:35.377718 21216 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.558928 21087 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:35.559350 21096 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.559895 21087 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.560616 21216 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.561256 21216 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:35.467974 21090 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:35.499470 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:35.488452 20944 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:35.488096 21104 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.562341 21248 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:35.562747 21248 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.563102 21248 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.495152 21243 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.564606 21243 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.564953 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:35.565891 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 66503.6us
I20260709 13:20:35.566215 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:35.566591 20888 consensus_meta.cc:287] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 13:20:35.566952 21243 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:35.562350 20944 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.554921 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:35.567679 20944 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.567785 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:35.568071 21139 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.568459 14227 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:20:35.519889 21245 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.569322 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:35.570138 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:35.558764 21232 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.571352 21232 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.558099 14220 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.573338 14224 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:35.364537 21147 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.501910 21231 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.521800 21107 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:35.575101 14227 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:35.567013 20888 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.567013 14223 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:35.570212 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:35.576473 21231 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.576874 20888 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:35.577780 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.567374 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:35.578447 21229 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:35.509598 21242 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.530416 20903 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:35.580598 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:35.584828 21156 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.774s	user 0.008s	sys 0.004s
I20260709 13:20:35.585309 21236 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:35.585259 21156 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.585842 21236 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.586229 21236 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.586654 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:35.587577 21156 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:35.588349 14895 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:35.588654 14121 catalog_manager.cc:5697] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 12 to 13, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 13 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:35.495704 21251 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:35.589995 21232 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:35.590749 21251 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.591307 14121 catalog_manager.cc:5697] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.592275 21251 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.504940 21067 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:35.594144 21067 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.594324 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:35.594995 14224 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.598138 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:35.598763 14892 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:35.598937 14893 pending_rounds.cc:85] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 12
I20260709 13:20:35.599300 14893 pending_rounds.cc:107] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:20:35.599540 14893 raft_consensus.cc:2889] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:35.600286 14896 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:35.603772 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:35.604444 14301 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:35.568004 14222 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.582885 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:35.583621 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:35.581113 21242 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:35.617177 14224 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:35.609608 14296 raft_consensus.cc:2410] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:20:35.635012 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:35.636420 14299 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.636940 14296 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:20:35.635654 14226 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:35.638463 14304 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:35.638657 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:35.645290 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.651049 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:35.653394 14220 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:35.653951 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:35.651870 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:35.655774 14297 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:35.657325 14867 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:35.660297 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:35.651754 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:35.502143 21238 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.124s
W20260709 13:20:35.627758 21091 consensus_meta.cc:287] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.003s
I20260709 13:20:35.667690 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:35.665959 14369 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:20:35.670940 14898 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:35.663879 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:35.680882 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:35.674559 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1342) took 1146 ms. Trace:
W20260709 13:20:35.681568 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47710us
I20260709 13:20:35.682010 14297 rpcz_store.cc:276] 0709 13:20:34.528115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.803320 (+275205us) service_pool.cc:224] Handling call
0709 13:20:34.864321 (+ 61001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:35.656552 (+792231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.674225 (+ 17673us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54000dcfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:35.674484 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1819638656}
I20260709 13:20:35.683158 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:35.685189 14304 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:35.685086 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61755us
I20260709 13:20:35.685626 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:35.686411 14227 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:35.671886 14270 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:35.686305 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:35.690780 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 104227us
I20260709 13:20:35.634832 21246 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:35.682478 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:35.647450 20888 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:35.652480 21241 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.696496 14301 raft_consensus.cc:2368] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19.
I20260709 13:20:35.699937 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.702385 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:35.680357 21156 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:35.746326 14374 raft_consensus.cc:1217] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Deduplicated request from leader. Original: 16.12->[17.13-20.14]   Dedup: 20.14->[]
I20260709 13:20:35.748543 14301 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: [18.17-18.17]
I20260709 13:20:35.757539 14374 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21. Ops: [17.13-20.14]
I20260709 13:20:35.761833 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:35.748545 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 66165.8us
W20260709 13:20:35.749419 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.763207 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:35.750154 14303 raft_consensus.cc:2393] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:35.625722 21216 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:20:35.765110 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:35.768887 14372 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:35.679051 21231 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:20:35.770982 14369 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
W20260709 13:20:35.776250 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 90040.7us
I20260709 13:20:35.777693 14295 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.778918 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:35.755218 21165 raft_consensus.cc:2804] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:35.746980 21091 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:35.763322 21090 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:35.793438 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:35.801659 14301 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:35.795644 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:35.700062 21163 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.693970 21236 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.800855 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.806939 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:35.808318 14370 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:35.808830 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:35.819958 14376 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.810300 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.810721 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.811311 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:35.812031 14372 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:20:35.822784 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 47042.5us
I20260709 13:20:35.769405 21156 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:35.818095 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:35.786263 21240 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.816524 14222 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:35.826045 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.827806 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.829876 14370 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:35.797516 20939 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:35.798533 21229 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:35.757079 21241 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.770821 20383 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:20:35.804427 21090 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.894531 21090 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.829001 21232 raft_consensus.cc:2764] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:20:35.898265 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:35.899366 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 237969us
I20260709 13:20:35.900163 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:35.897514 14376 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:35.816511 21165 raft_consensus.cc:697] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:35.888490 21252 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
I20260709 13:20:35.889088 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:35.890062 20903 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.890910 21091 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:35.923660 20903 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.924535 21129 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:35.925755 21129 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:35.926118 21129 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:35.926939 21129 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.928376 21129 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.930073 21242 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:35.930636 21242 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.932031 21248 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.932901 21242 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:35.934388 21163 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:35.833422 21195 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.935388 21195 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.891722 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.936427 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.937992 21165 consensus_queue.cc:237] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.905339 21133 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.939815 21156 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:35.892339 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 63051.4us
I20260709 13:20:35.943228 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:35.798079 20905 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:20:35.944664 20905 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:35.944741 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.945128 20905 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:35.946116 20905 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:35.897563 21104 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:35.947738 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.948076 14371 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:35.948544 14370 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:35.904850 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:35.884316 21255 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:20:35.897871 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:35.873020 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50593.9us
I20260709 13:20:35.918010 14376 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:35.904793 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:35.919073 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:35.872396 21225 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:20:35.967715 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62991.9us
I20260709 13:20:35.921679 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:35.990358 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:35.968103 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49118.3us
I20260709 13:20:35.834017 20939 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:35.968094 14302 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:35.969271 14899 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:20:35.979705 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 161731us
W20260709 13:20:35.993496 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50352.8us
W20260709 13:20:35.991569 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.996049 14375 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:36.007535 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:35.919699 20598 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:36.016682 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:36.017385 14376 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 13.
I20260709 13:20:36.013396 14375 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 22: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:35.846033 21158 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.138s
W20260709 13:20:36.019675 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 98109.1us
I20260709 13:20:35.991257 20905 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.989858 21244 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:35.874142 21240 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:36.012070 21193 consensus_meta.cc:287] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260709 13:20:36.029937 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:36.029937 14370 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:20:36.027293 21235 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 13:20:36.028141 21242 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.009392 20939 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:36.006804 21239 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:36.004401 21133 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:36.042304 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:36.018720 21247 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:36.060293 20908 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.069672 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:36.070981 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:36.071877 21244 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:36.072324 21244 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.072674 21244 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:36.056067 21260 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:20:36.069444 20908 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.083185 14373 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:36.090060 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:36.075590 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1484) took 1200 ms. Trace:
I20260709 13:20:36.092310 14901 rpcz_store.cc:276] 0709 13:20:34.874819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.982486 (+107667us) service_pool.cc:224] Handling call
0709 13:20:35.004958 (+ 22472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:35.153428 (+148470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.153458 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:35.210017 (+ 56559us) log.cc:844] Serialized 52 byte log entry
0709 13:20:35.365224 (+155207us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:35.365274 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.365338 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.075352 (+710014us) raft_consensus.cc:1685] finished
0709 13:20:36.075371 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.075532 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24515,"raft.queue_time_us":88978,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":29929,"thread_start_us":231146,"threads_started":2,"wal-append.queue_time_us":282482}
I20260709 13:20:36.034552 20903 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:36.101862 14342 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:36.095288 21094 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:36.105049 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:36.106428 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:36.109392 14894 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:36.110116 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:36.110747 14900 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
W20260709 13:20:36.111330 14267 connection.cc:256] RPC call timeout handler was delayed by -1.4134245229997759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 13:20:36.037570 20598 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:36.032961 21139 consensus_queue.cc:1059] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:20:36.138605 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:36.139276 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:36.139591 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:36.037158 21243 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 13:20:36.111829 14267 connection.cc:256] RPC call timeout handler was delayed by -1.1595615059998181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 13:20:36.062021 21248 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:36.113624 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:36.044087 21193 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.149209 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:36.146327 14370 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:36.110761 21094 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:36.105767 21238 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.141896 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:36.111792 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.151419 14900 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:36.113993 21102 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.155495 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:36.150550 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 147069us
I20260709 13:20:36.105849 21232 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:36.142133 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 52162.1us
W20260709 13:20:36.137281 20902 consensus_meta.cc:287] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
I20260709 13:20:36.153734 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:36.065675 21067 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:36.113478 21247 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:36.157572 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:36.167685 14224 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:36.162719 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:36.140784 21158 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:36.182111 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:36.089563 21242 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.185708 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:36.190804 14229 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:36.185927 14372 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:36.186754 14227 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:36.193589 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:36.194749 14371 raft_consensus.cc:2393] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:36.114331 21133 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:20:36.198184 14900 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:36.155763 21094 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:36.160037 21052 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.206565 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:36.210543 14224 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:20:36.159482 21259 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:36.189779 21158 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:36.201059 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:36.212605 14376 raft_consensus.cc:3060] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:36.213887 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:36.215107 14304 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 20: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:36.197515 21096 consensus_meta.cc:287] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.001s
I20260709 13:20:36.183020 21195 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:36.227768 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:36.253435 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:36.219856 21158 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:36.168543 21238 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.222415 21236 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:36.253435 20598 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.266637 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:36.184796 21232 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.179958 21102 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.269030 21259 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:20:36.231673 21246 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:36.271103 14299 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.634s	user 0.013s	sys 0.000s
I20260709 13:20:36.264851 14376 raft_consensus.cc:2468] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
W20260709 13:20:36.259033 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 102012us
I20260709 13:20:36.289846 14299 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:36.297302 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:36.273238 14372 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:36.272054 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:36.227037 20902 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:20:36.310357 21087 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.311002 21087 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.311465 21102 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:36.314102 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:36.315025 14223 raft_consensus.cc:2393] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 22: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:36.306500 20908 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:36.315968 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:36.313517 21087 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:36.317314 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:36.221199 21052 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:36.306499 21067 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:36.307199 21245 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.738s	user 0.002s	sys 0.009s
I20260709 13:20:36.308218 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:36.319494 21193 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:36.230687 21090 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.272990 21241 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:36.330349 21246 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:36.332763 21274 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:20:36.334733 21238 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:36.338956 20944 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.771s	user 0.009s	sys 0.001s
I20260709 13:20:36.338740 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:36.340561 21229 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:36.272253 21262 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
I20260709 13:20:36.342936 21242 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:36.343703 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:36.343961 21261 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:20:36.284688 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:36.351943 14295 consensus_meta.cc:287] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.002s
I20260709 13:20:36.567166 14295 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:20:36.347694 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:36.414232 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:36.418843 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:36.568877 14300 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:36.419732 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:36.419934 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:36.445957 14224 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:36.570258 14896 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:36.409957 20908 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:36.448272 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:36.450335 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:36.442441 14220 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:36.445565 21090 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:36.451296 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:36.449630 14378 consensus_meta.cc:287] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.000s
I20260709 13:20:36.573352 14378 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
W20260709 13:20:36.425063 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 171262us
I20260709 13:20:36.575055 14229 raft_consensus.cc:2393] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:36.541357 14371 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:36.566860 14376 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:36.571460 14299 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:36.571480 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:36.441609 21245 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:36.556370 20905 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
I20260709 13:20:36.597765 14295 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:36.601366 14376 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
W20260709 13:20:36.603479 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 255872us
I20260709 13:20:36.593854 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:36.607331 14378 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:36.609591 14378 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:36.611259 14378 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:36.613247 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:36.556684 21229 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:36.620101 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 457446us
W20260709 13:20:36.616899 14867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.009s	sys 0.009s
W20260709 13:20:36.622320 14867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.009s	sys 0.009s
I20260709 13:20:36.622416 14300 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:20:36.617038 14301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.005s	sys 0.010s
W20260709 13:20:36.623854 14301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.005s	sys 0.010s
I20260709 13:20:36.624960 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:36.576351 14864 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:36.606050 14376 pending_rounds.cc:85] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 12
I20260709 13:20:36.626673 14376 pending_rounds.cc:107] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:20:36.404306 21247 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.579123 21238 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.626976 14376 raft_consensus.cc:2889] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:36.635116 14376 pending_rounds.cc:107] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:20:36.453975 21246 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:36.622773 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 515419us
I20260709 13:20:36.620257 21193 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.578367 21216 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:36.632145 14900 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:36.632918 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 56660.8us
I20260709 13:20:36.626014 21241 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:36.627926 14372 raft_consensus.cc:2410] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:36.636288 14193 leader_election.cc:400] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19.
I20260709 13:20:36.614534 21242 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:36.637326 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1492) took 1039 ms. Trace:
I20260709 13:20:36.556958 20944 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.672164 14300 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:36.630919 21234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.034s	sys 0.046s
I20260709 13:20:36.656143 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:36.670552 14892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.002s	sys 0.021s
W20260709 13:20:36.733419 14892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.002s	sys 0.021s
I20260709 13:20:36.618189 20903 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:36.635454 14376 raft_consensus.cc:2889] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:36.702724 14304 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:36.705085 14193 leader_election.cc:403] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:20:36.660207 21147 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.086s	user 0.012s	sys 0.000s
I20260709 13:20:36.655102 21288 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:36.634588 21195 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:36.594395 20908 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:36.712980 14898 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:36.652936 21287 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.737238 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1353) took 1288 ms. Trace:
I20260709 13:20:36.714361 14893 rpcz_store.cc:276] 0709 13:20:35.598245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.598414 (+   169us) service_pool.cc:224] Handling call
0709 13:20:35.598745 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.600030 (+  1285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.600075 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:35.600492 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:20:36.000752 (+400260us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:36.000794 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.000882 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.637038 (+636156us) raft_consensus.cc:1685] finished
0709 13:20:36.637077 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.637255 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":399894,"threads_started":1,"wal-append.queue_time_us":465673}
I20260709 13:20:36.709082 14864 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:36.733065 21234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.035s	sys 0.047s
I20260709 13:20:36.765820 14221 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [14.14-14.14]
W20260709 13:20:36.710963 21251 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.118s	user 0.008s	sys 0.009s
W20260709 13:20:36.766003 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 56994.6us
I20260709 13:20:36.767237 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:36.730891 21163 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.657595 21238 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.735159 20903 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.755546 21288 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.784554 21288 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:36.785168 21094 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
I20260709 13:20:36.759215 21147 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.734795 21241 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:36.765192 14298 rpcz_store.cc:276] 0709 13:20:35.449197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.453483 (+  4286us) service_pool.cc:224] Handling call
0709 13:20:35.454622 (+  1139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.463108 (+  8486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.463153 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:35.495460 (+ 32307us) log.cc:844] Serialized 26 byte log entry
0709 13:20:35.696850 (+201390us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:35.696893 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.696973 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.736992 (+1040019us) raft_consensus.cc:1685] finished
0709 13:20:36.737024 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.737173 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4192,"raft.queue_time_us":8095,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5795,"thread_start_us":188232,"threads_started":1,"wal-append.queue_time_us":413232}
I20260709 13:20:36.757321 21242 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:36.703442 21193 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.776959 20903 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.783766 20908 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:36.759027 21135 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.208s	user 0.021s	sys 0.033s
I20260709 13:20:36.758345 21290 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:36.774214 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 118193us
I20260709 13:20:36.737007 21087 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:20:36.786130 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3261) took 1134 ms. Trace:
I20260709 13:20:36.846586 14301 rpcz_store.cc:276] 0709 13:20:35.651270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.817047 (+165777us) service_pool.cc:224] Handling call
0709 13:20:35.826986 (+  9939us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.827202 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.827230 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:35.827755 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:20:36.624295 (+796540us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:36.624334 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.624395 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.785867 (+161472us) raft_consensus.cc:1685] finished
0709 13:20:36.785890 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.786061 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":631957,"threads_started":1,"wal-append.queue_time_us":873150}
I20260709 13:20:36.825369 14896 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:36.766281 20888 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:36.792832 21266 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.989s	user 0.016s	sys 0.011s
W20260709 13:20:36.777704 21277 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:20:36.795725 21246 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:36.791070 21280 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.485s	user 0.003s	sys 0.003s
I20260709 13:20:36.794914 21133 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19.
I20260709 13:20:36.841589 14225 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:36.794035 20598 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:36.796173 20944 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:36.795801 21238 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:36.878778 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:36.794281 21245 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.909088 21104 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:36.911013 21299 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:20:36.916368 21273 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.646s	user 0.000s	sys 0.005s
I20260709 13:20:36.922132 20888 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:36.923487 20888 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:36.924151 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 79092.1us
I20260709 13:20:36.924527 21238 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:36.926118 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3414) took 1229 ms. Trace:
W20260709 13:20:36.927372 21286 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:20:36.926131 21216 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:36.927601 21234 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:36.928436 21216 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:36.930286 21300 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:20:36.930871 21295 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:36.926585 14296 rpcz_store.cc:276] 0709 13:20:35.696492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.872031 (+175539us) service_pool.cc:224] Handling call
0709 13:20:35.872416 (+   385us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:35.890097 (+ 17681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.890133 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:35.890820 (+   687us) log.cc:844] Serialized 78 byte log entry
0709 13:20:36.004720 (+113900us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:36.004758 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.004817 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.915667 (+910850us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:36.925706 (+ 10039us) raft_consensus.cc:1685] finished
0709 13:20:36.925730 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.926058 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17903,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"spinlock_wait_cycles":6638976,"thread_start_us":113496,"threads_started":1,"wal-append.queue_time_us":270730}
I20260709 13:20:36.785707 21094 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.827710 21232 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:36.841112 21135 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.291s	user 0.021s	sys 0.034s
W20260709 13:20:36.935202 14341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.003s
W20260709 13:20:36.850023 21244 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.777s	user 0.013s	sys 0.000s
I20260709 13:20:36.786870 21285 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:20:36.830716 21240 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:36.769057 21195 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:36.880897 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 254285us
I20260709 13:20:36.770442 21287 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.774279 21163 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:36.935568 14341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.007s	sys 0.003s
W20260709 13:20:36.904572 21279 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.566s	user 0.000s	sys 0.002s
I20260709 13:20:36.938320 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:36.938922 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:36.936292 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:36.849251 21052 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:36.880874 20905 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.951803 14377 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:36.955470 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:36.947471 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.002s
W20260709 13:20:36.945423 21257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.395s	user 0.010s	sys 0.034s
I20260709 13:20:36.957412 14298 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:36.929422 21216 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:36.931420 21295 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:36.991276 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1604) took 1573 ms. Trace:
I20260709 13:20:36.961043 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2958) took 1014 ms. Trace:
I20260709 13:20:36.964782 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:36.994772 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.011s	sys 0.002s
I20260709 13:20:36.998080 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:37.035064 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:36.998226 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:36.942951 21232 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:36.981426 21276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.004s	sys 0.010s
I20260709 13:20:37.052726 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1363) took 1034 ms. Trace:
I20260709 13:20:37.053210 14297 rpcz_store.cc:276] 0709 13:20:36.018175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.018616 (+   441us) service_pool.cc:224] Handling call
0709 13:20:36.036013 (+ 17397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.038341 (+  2328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:36.038387 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:36.095813 (+ 57426us) log.cc:844] Serialized 26 byte log entry
0709 13:20:36.261751 (+165938us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:36.261845 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.261921 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:37.052488 (+790567us) raft_consensus.cc:1685] finished
0709 13:20:37.052510 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.052662 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":660,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":22555,"thread_start_us":118392,"threads_started":1,"wal-append.queue_time_us":480483}
W20260709 13:20:37.055652 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 103562us
I20260709 13:20:36.943581 21244 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.032308 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:37.032423 21193 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:37.033397 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:37.034068 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:37.034173 21052 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:37.033710 14373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1595) took 1466 ms (client timeout 1775 ms). Trace:
I20260709 13:20:37.033677 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:37.077874 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 153725us
I20260709 13:20:37.031054 14270 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:37.037941 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 73301.4us
I20260709 13:20:37.029646 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:37.036358 14369 rpcz_store.cc:276] 0709 13:20:35.946525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.949651 (+  3126us) service_pool.cc:224] Handling call
0709 13:20:35.949953 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:36.188736 (+238783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:36.188779 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:36.188837 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:36.188889 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.960691 (+771802us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54000b9354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:36.960761 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.960959 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4208,"raft.queue_time_us":4846,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10978,"spinlock_wait_cycles":532079360}
W20260709 13:20:37.035064 21257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.478s	user 0.011s	sys 0.034s
W20260709 13:20:37.052981 21276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.004s	sys 0.010s
W20260709 13:20:37.099601 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 802343us
I20260709 13:20:37.100023 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:37.084867 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:37.077504 14373 rpcz_store.cc:269] 0709 13:20:35.566984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.569926 (+  2942us) service_pool.cc:224] Handling call
0709 13:20:37.033562 (+1463636us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54002ec054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:37.033657 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112509312}
W20260709 13:20:37.087419 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56461.1us
W20260709 13:20:37.079298 21156 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.011s	sys 0.011s
I20260709 13:20:37.036290 14228 rpcz_store.cc:276] 0709 13:20:35.417528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.417690 (+   162us) service_pool.cc:224] Handling call
0709 13:20:35.418053 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.460617 (+ 42564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.460662 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:35.583369 (+122707us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b2c000edf88. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8deb985a11 00007f8deb995372 00007f8ded0c7a01 00007f8ded08c43a 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2
0709 13:20:35.583799 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:20:35.673462 (+ 89663us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:35.673514 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.673593 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.792050 (+1118457us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:36.991031 (+198981us) raft_consensus.cc:1685] finished
0709 13:20:36.991052 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.991206 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42707,"raft.queue_time_us":42629,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":16395,"spinlock_wait_cycles":11840128,"thread_start_us":89310,"threads_started":1,"wal-append.queue_time_us":171528}
W20260709 13:20:37.109387 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 342207us
I20260709 13:20:37.110576 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:37.099457 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:36.949558 21240 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.110s
I20260709 13:20:37.120465 14894 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:37.052663 21025 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.051977 21285 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:20:37.111181 21156 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.011s	sys 0.011s
I20260709 13:20:37.066685 21294 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:36.949621 21241 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.125528 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:37.127902 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:37.130059 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.130287 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:37.155134 14895 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:37.131263 14220 raft_consensus.cc:2393] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:37.126019 14298 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:37.122785 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:37.156473 14896 raft_consensus.cc:2393] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:37.136534 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:37.121280 14192 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.557s (SENT) [suppressed 10 similar messages]
I20260709 13:20:37.157078 14229 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:37.029810 20905 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.086004 21257 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:37.194331 21289 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:37.194969 21289 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.110754 21104 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:37.157174 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.197218 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.197415 21289 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:37.148208 21294 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.198134 14227 raft_consensus.cc:2410] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:37.143882 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:37.199294 14899 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:37.066656 21232 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:37.141583 21279 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:20:37.084412 21305 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:20:37.201673 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2841) took 1603 ms. Trace:
I20260709 13:20:37.201923 21232 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:37.193135 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:37.194829 21257 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.198050 21294 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.158035 14898 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:37.202086 14226 rpcz_store.cc:276] 0709 13:20:35.598263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.652675 (+ 54412us) service_pool.cc:224] Handling call
0709 13:20:35.688243 (+ 35568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.695503 (+  7260us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:35.979504 (+284001us) log.cc:844] Serialized 14 byte log entry
0709 13:20:36.571892 (+592388us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:36.572533 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 13:20:36.572824 (+   291us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:36.572864 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.572934 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.903983 (+331049us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:37.201354 (+297371us) raft_consensus.cc:1685] finished
0709 13:20:37.201484 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.201613 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20175,"prepare.queue_time_us":313383,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3008,"raft.queue_time_us":378651,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":39283,"spinlock_wait_cycles":15577856,"thread_start_us":749025,"threads_started":3,"wal-append.queue_time_us":267522}
I20260709 13:20:37.218595 14227 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:20:37.119688 21067 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:20:37.220065 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.203189 14301 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:37.237162 14376 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
W20260709 13:20:37.239149 21272 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.048s	user 0.008s	sys 0.022s
I20260709 13:20:37.117762 14224 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:37.056723 21242 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:37.226390 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.227761 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:37.147462 21025 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:37.247555 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54518.3us
I20260709 13:20:37.248039 14298 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:37.247628 14228 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:37.252669 14897 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:20:37.255853 21234 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:37.256295 21234 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:37.257057 21234 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.257872 21317 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:37.260754 14297 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:20:37.261502 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2834) took 1697 ms. Trace:
I20260709 13:20:37.271970 14221 rpcz_store.cc:276] 0709 13:20:35.563797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.571251 (+  7454us) service_pool.cc:224] Handling call
0709 13:20:35.571580 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.766429 (+1194849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.261256 (+494827us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540026cad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:37.261445 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2745865984}
I20260709 13:20:37.263821 14220 raft_consensus.cc:2410] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 20 because replica has last-logged OpId of term: 18 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
W20260709 13:20:37.262300 21302 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:20:37.274171 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3259) took 1624 ms. Trace:
I20260709 13:20:37.278986 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3262) took 1060 ms. Trace:
I20260709 13:20:37.262728 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1552) took 1162 ms. Trace:
W20260709 13:20:37.271483 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 273331us
I20260709 13:20:37.261587 21025 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:37.279498 14299 rpcz_store.cc:276] 0709 13:20:36.218610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.594707 (+376097us) service_pool.cc:224] Handling call
0709 13:20:36.624387 (+ 29680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.634916 (+ 10529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:36.634947 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:36.676795 (+ 41848us) log.cc:844] Serialized 26 byte log entry
0709 13:20:36.938547 (+261752us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:36.940597 (+  2050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.941499 (+   902us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:37.278700 (+337201us) raft_consensus.cc:1685] finished
0709 13:20:37.278729 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.278913 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1129,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6423,"thread_start_us":180329,"threads_started":1,"wal-append.queue_time_us":334971}
W20260709 13:20:37.246727 20939 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.137s	user 0.008s	sys 0.004s
I20260709 13:20:37.291985 14371 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:37.270856 21317 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:37.281291 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 210398us
I20260709 13:20:37.281037 14894 rpcz_store.cc:276] 0709 13:20:36.112164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.159975 (+ 47811us) service_pool.cc:224] Handling call
0709 13:20:36.190487 (+ 30512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:37.130139 (+939652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.262354 (+132215us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54004c0ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:37.262666 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2138328960}
I20260709 13:20:37.284504 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:37.274559 14303 rpcz_store.cc:276] 0709 13:20:35.649976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.777371 (+127395us) service_pool.cc:224] Handling call
0709 13:20:35.777769 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:35.811887 (+ 34118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.811940 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:35.812949 (+  1009us) log.cc:844] Serialized 52 byte log entry
0709 13:20:35.948108 (+135159us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b4800241ed8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
0709 13:20:35.996629 (+ 48521us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:35.996660 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.996708 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:37.238821 (+1242113us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b24000d6fb8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fde09d 00007f8decc1010e 00007f8decc2788c 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221
0709 13:20:37.273960 (+ 35139us) raft_consensus.cc:1685] finished
0709 13:20:37.273984 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.274116 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1370,"raft.queue_time_us":8787,"raft.run_cpu_time_us":2640,"raft.run_wall_time_us":144669,"spinlock_wait_cycles":87088256,"thread_start_us":183188,"threads_started":1,"wal-append.queue_time_us":304993}
I20260709 13:20:37.303076 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.264547 21289 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:37.304535 14224 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:20:37.262377 21238 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:37.339922 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55490.2us
I20260709 13:20:37.342864 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.346946 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:37.344148 14299 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:20:37.262903 21094 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:37.350018 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:37.350504 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:37.263379 21234 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:37.351764 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:37.343321 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 264259us
W20260709 13:20:37.354947 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 231786us
W20260709 13:20:37.354387 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 397571us
I20260709 13:20:37.352317 21241 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.356773 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:37.347059 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:37.357334 21241 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:37.355195 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 250466us
I20260709 13:20:37.270936 21052 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 13:20:37.348951 21094 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:37.363023 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.363091 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:37.366248 14303 raft_consensus.cc:2410] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:37.363023 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:37.351174 21025 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.372174 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.343972 21289 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:37.387009 14895 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:37.355193 21244 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:37.296880 20939 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:37.359788 21104 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:37.369345 21195 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:37.409652 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46709.6us
I20260709 13:20:37.361297 21067 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:37.303855 21307 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.089s
I20260709 13:20:37.366039 21163 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:37.418452 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:37.388216 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.371402 21287 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:37.381431 21238 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.427583 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.410286 21295 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:37.430330 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 302531us
I20260709 13:20:37.385437 21289 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.411187 21242 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:37.441306 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 89611.7us
I20260709 13:20:37.442440 14344 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:37.450412 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.451319 14224 raft_consensus.cc:2410] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:37.388186 21025 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:37.437639 21229 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.004s
I20260709 13:20:37.428125 21165 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:37.474341 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 55932.5us
I20260709 13:20:37.490720 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:37.492580 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.493287 14221 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:37.433398 21067 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:37.436731 21163 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:37.499707 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:37.504307 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 144623us
I20260709 13:20:37.513180 21067 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.518368 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:37.475486 21295 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:37.527812 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:37.528139 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:37.431677 21238 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.475978 21320 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:37.516323 21094 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.514914 21216 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:37.566813 21316 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:37.566931 21216 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.567543 21316 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:37.568452 21323 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:37.569890 21314 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:20:37.447213 21319 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.109s
I20260709 13:20:37.563154 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:37.566018 21287 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.566466 21321 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:37.577337 14221 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:37.567384 21216 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.538651 21052 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.497149 21229 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:37.599164 14304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.001s	sys 0.009s
W20260709 13:20:37.600823 14304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.001s	sys 0.009s
I20260709 13:20:37.602178 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3425) took 1194 ms. Trace:
I20260709 13:20:37.551512 21320 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:37.508085 21165 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:37.559314 21307 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:37.576843 21163 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.576208 20888 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:37.579463 20905 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:37.623667 14892 raft_consensus.cc:1240] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:37.586710 20598 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:37.626173 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 98491.1us
I20260709 13:20:37.581610 21094 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:37.641630 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 520324us
I20260709 13:20:37.615221 21320 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:37.557284 21104 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:37.605679 21052 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:37.630846 21288 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.846s	user 0.009s	sys 0.008s
I20260709 13:20:37.590289 21287 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.586517 21321 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:37.655550 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55873.4us
I20260709 13:20:37.659889 21329 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:37.660815 21338 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.661347 21338 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.663666 21338 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:37.664304 21337 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 13:20:37.631101 21307 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.665287 21229 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:37.665761 21337 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.666090 20888 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.666656 21343 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:37.666620 20888 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:37.667520 21343 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:37.668817 21248 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:20:37.669171 21282 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.202s	user 0.000s	sys 0.008s
I20260709 13:20:37.669250 21248 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:37.670573 21284 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.338s	user 0.000s	sys 0.009s
I20260709 13:20:37.672825 21216 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.673305 21307 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:37.674036 14296 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:20:37.674443 14296 pending_rounds.cc:85] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 13
W20260709 13:20:37.674543 21331 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:37.674681 14296 pending_rounds.cc:107] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:20:37.674938 21094 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:37.675611 21216 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:37.676280 21216 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:37.676478 21158 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.393s	user 0.013s	sys 0.000s
I20260709 13:20:37.676683 21216 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:37.676926 21158 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:37.679066 21287 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:37.656587 21288 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.677583 21216 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:37.683000 21283 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.344s	user 0.005s	sys 0.007s
I20260709 13:20:37.675040 14296 raft_consensus.cc:2889] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:37.673409 21335 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:20:37.694497 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1603) took 1809 ms. Trace:
I20260709 13:20:37.695030 14897 rpcz_store.cc:276] 0709 13:20:35.885211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.885677 (+   466us) service_pool.cc:224] Handling call
0709 13:20:35.943881 (+ 58204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:37.253241 (+1309360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.684278 (+431037us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400268ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:37.694411 (+ 10133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2793960704}
I20260709 13:20:37.687512 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:37.630250 21163 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:37.710193 20888 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:37.711035 21165 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:37.711665 21165 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:37.712124 21165 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:37.714548 21158 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:37.682380 21288 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:37.717639 21248 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.718943 21248 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:37.640522 20598 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.711974 20888 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:37.713104 21165 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:37.740797 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 203095us
W20260709 13:20:37.738727 21107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.582s	user 0.008s	sys 0.033s
I20260709 13:20:37.747460 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:37.727029 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:37.696059 21147 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:37.752216 14373 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:37.708141 21285 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.753650 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:37.753747 14378 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
W20260709 13:20:37.761592 21346 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:20:37.743261 20903 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.898s	user 0.014s	sys 0.001s
I20260709 13:20:37.769212 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2842) took 1907 ms. Trace:
I20260709 13:20:37.769688 14222 rpcz_store.cc:276] 0709 13:20:35.862382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.866024 (+  3642us) service_pool.cc:224] Handling call
0709 13:20:35.866388 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.922684 (+ 56296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.922801 (+   117us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:35.951359 (+ 28558us) log.cc:844] Serialized 26 byte log entry
0709 13:20:36.188127 (+236768us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:36.188175 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.188252 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:37.668444 (+1480192us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:37.763939 (+ 95495us) raft_consensus.cc:1685] finished
0709 13:20:37.763959 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.769134 (+  5175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7140,"raft.queue_time_us":68745,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":96,"spinlock_wait_cycles":21062016,"thread_start_us":147828,"threads_started":1,"wal-append.queue_time_us":264438}
W20260709 13:20:37.756049 21107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.599s	user 0.009s	sys 0.034s
W20260709 13:20:37.772274 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 138007us
I20260709 13:20:37.741487 21238 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:37.660485 21329 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.720467 21148 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:20:37.787114 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:37.806782 21241 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:37.808477 21163 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:37.766235 21285 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:37.809749 21327 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:37.810263 21278 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:37.840301 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.810932 21349 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:37.811142 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.814038 21096 raft_consensus.cc:3055] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:37.815088 21245 consensus_meta.cc:287] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.907s	user 0.011s	sys 0.000s
I20260709 13:20:37.815387 21147 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:37.741204 21336 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:20:37.694720 21337 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:37.822139 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:37.824288 20888 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:37.824076 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:37.775554 20903 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.827107 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:37.828617 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:37.833701 14897 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:37.837299 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:37.835868 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:37.817659 21290 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.935s	user 0.009s	sys 0.003s
I20260709 13:20:37.839979 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:37.845088 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:37.844982 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:37.892810 14901 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:37.848220 21349 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:37.847478 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:37.845942 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:37.845811 21096 raft_consensus.cc:740] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:37.866848 14899 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:20:37.871914 21245 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:37.872179 21147 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.822242 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:37.882437 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:37.826805 14896 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:37.949198 14378 raft_consensus.cc:2393] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:37.875829 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:37.836429 21345 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.809258 21317 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:37.845938 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:37.895236 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:37.960255 14300 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:37.895331 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:37.895648 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:37.896126 14369 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:37.840627 21278 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:37.903115 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 176158us
I20260709 13:20:37.962889 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:37.856971 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.945657 14375 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:37.946452 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:37.947952 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 220020us
I20260709 13:20:37.977313 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:37.978216 14899 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:37.900942 21290 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:37.980427 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:37.991894 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:37.992301 14373 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
W20260709 13:20:37.967983 21259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.623s	user 0.013s	sys 0.024s
I20260709 13:20:37.837519 21289 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:37.925900 21327 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:37.960572 21147 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:37.883870 21308 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.228s
I20260709 13:20:38.028291 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.047078 14372 raft_consensus.cc:2410] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:38.048185 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:38.048841 14372 raft_consensus.cc:2376] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18. Re-sending same reply.
I20260709 13:20:38.023221 14302 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:20:38.049913 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:38.050490 14369 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:38.036623 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:38.039579 21285 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:38.039592 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:38.043471 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:38.044162 21332 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.045854 21025 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:38.053465 14895 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:38.077973 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:38.053956 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:38.080739 14372 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.971004 21238 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.971297 21158 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.897034 20888 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.060628 14378 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.075866 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:38.092533 14898 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:38.090384 14369 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:20:38.014245 21245 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:38.030591 21309 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:38.115608 21349 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.117316 21349 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:38.118793 21329 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:38.093152 21279 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:38.124779 21096 consensus_queue.cc:260] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:37.969681 21345 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.126062 14898 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:38.126410 21096 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.126998 14378 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:38.127851 21345 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:38.082736 21317 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:38.128881 14378 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:38.120260 20598 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:38.130576 14898 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:20:38.130975 14898 pending_rounds.cc:85] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 9
I20260709 13:20:38.131194 14898 pending_rounds.cc:107] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:20:38.131422 14898 raft_consensus.cc:2889] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:38.033152 21231 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:38.132989 21231 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.061851 21276 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:20:38.135823 21327 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:38.106091 21294 consensus_meta.cc:287] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.858s	user 0.009s	sys 0.004s
I20260709 13:20:38.137177 21294 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.092845 21332 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:38.112588 21344 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 13:20:38.142068 21312 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.994s	user 0.002s	sys 0.002s
I20260709 13:20:38.106930 21238 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.142932 14893 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:38.107657 21245 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.144337 21245 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:38.096937 21357 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 13:20:38.134792 21052 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:38.018392 21339 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:38.150172 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1497) took 1047 ms. Trace:
I20260709 13:20:38.112119 21158 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:38.167487 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 203408us
I20260709 13:20:38.168486 14192 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:38.171720 14295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.013s	sys 0.030s
W20260709 13:20:38.173920 14295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.013s	sys 0.031s
I20260709 13:20:38.106503 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.180176 14369 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:38.181936 14369 raft_consensus.cc:1240] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:20:38.192879 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:38.157047 21259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.812s	user 0.013s	sys 0.025s
I20260709 13:20:38.136422 14378 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:38.162196 14900 rpcz_store.cc:276] 0709 13:20:37.102294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.120041 (+ 17747us) service_pool.cc:224] Handling call
0709 13:20:37.144477 (+ 24436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:37.394533 (+250056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:37.394562 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:37.395294 (+   732us) log.cc:844] Serialized 52 byte log entry
0709 13:20:37.506005 (+110711us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:37.724913 (+218908us) log.cc:844] Serialized 14 byte log entry
0709 13:20:37.728350 (+  3437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.728640 (+   290us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:38.149867 (+421227us) raft_consensus.cc:1685] finished
0709 13:20:38.149895 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.150099 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":642708,"raft.queue_time_us":206120,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":12876,"thread_start_us":520529,"threads_started":3,"wal-append.queue_time_us":468627}
I20260709 13:20:38.218272 14372 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:38.248481 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:38.249168 14303 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:38.261886 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 46728.1us
I20260709 13:20:38.263100 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:38.210647 21290 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:38.292207 21333 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:20:38.291888 21365 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:38.292709 21158 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:38.293829 21341 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:20:38.295066 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1366) took 1356 ms. Trace:
I20260709 13:20:38.300287 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:38.302402 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:38.305640 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:38.295457 14295 rpcz_store.cc:276] 0709 13:20:36.938266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.938750 (+   484us) service_pool.cc:224] Handling call
0709 13:20:36.942985 (+  4235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.943328 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:37.383165 (+439837us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.176171 (+793006us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:38.176834 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 13:20:38.180931 (+  4097us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:38.180987 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.181059 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:38.294829 (+113770us) raft_consensus.cc:1685] finished
0709 13:20:38.294851 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.295001 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7672,"prepare.queue_time_us":291842,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":40224,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":45924,"thread_start_us":1182270,"threads_started":3,"wal-append.queue_time_us":372578}
I20260709 13:20:38.255937 20888 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:38.310055 21302 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:38.258997 21294 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:38.239753 21025 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:20:38.241307 21308 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:20:38.188634 21339 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.303943 20879 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:38.310570 21320 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.000s
I20260709 13:20:38.295542 21290 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:38.348304 21290 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.304323 21365 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:38.335281 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:38.312263 21238 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:38.317598 20903 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:38.332834 21248 consensus_meta.cc:287] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.006s
I20260709 13:20:38.325209 21367 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:38.368830 14369 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:20:38.369261 14369 pending_rounds.cc:85] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 13
I20260709 13:20:38.369480 14369 pending_rounds.cc:107] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:20:38.369738 14369 raft_consensus.cc:2889] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:38.370673 14303 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:38.378979 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:38.332304 21231 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:38.335598 21337 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:38.336194 20879 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:38.354269 21320 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.396754 21310 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:38.397511 21364 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 13:20:38.400436 21311 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.181s
I20260709 13:20:38.414739 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:38.431360 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 108880us
W20260709 13:20:38.401702 21351 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:20:38.375483 21332 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:38.449937 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:38.431881 20879 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.374650 21308 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:20:38.373056 21369 consensus_queue.cc:1059] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:20:38.477356 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2853) took 1108 ms. Trace:
W20260709 13:20:38.468952 21350 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.103s	user 0.001s	sys 0.001s
I20260709 13:20:38.477852 14228 rpcz_store.cc:276] 0709 13:20:37.368569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.369058 (+   489us) service_pool.cc:224] Handling call
0709 13:20:37.389870 (+ 20812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:37.424175 (+ 34305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:37.424221 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:37.430544 (+  6323us) log.cc:844] Serialized 26 byte log entry
0709 13:20:37.614506 (+183962us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:37.614845 (+   339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.624459 (+  9614us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:38.477130 (+852671us) raft_consensus.cc:1685] finished
0709 13:20:38.477153 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.477294 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5086,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":7042,"thread_start_us":83458,"threads_started":1,"wal-append.queue_time_us":704494}
I20260709 13:20:38.483918 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1614) took 1529 ms. Trace:
I20260709 13:20:38.468133 21289 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:38.484448 14376 rpcz_store.cc:276] 0709 13:20:36.954935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.955111 (+   176us) service_pool.cc:224] Handling call
0709 13:20:38.483724 (+1528613us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400171454. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:38.483854 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559996672}
I20260709 13:20:38.489182 21297 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:38.489694 21297 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:38.490692 21297 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.492089 21297 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.493724 14371 raft_consensus.cc:2410] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:20:38.493642 21369 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:38.498967 21320 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:38.513518 21355 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:38.514079 21375 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:38.514605 21375 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:38.514282 21355 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.515615 21375 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.521534 21375 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.524120 20939 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:37.612686 14304 rpcz_store.cc:276] 0709 13:20:36.407979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.763673 (+355694us) service_pool.cc:224] Handling call
0709 13:20:36.763929 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:36.764131 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:20:36.950233 (+186102us) log.cc:844] Serialized 14 byte log entry
0709 13:20:37.601696 (+651463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:37.601768 (+    72us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:20:37.601848 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.601935 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.602101 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":402631,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":15771,"raft.queue_time_us":14188,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":10451,"thread_start_us":836877,"threads_started":2}
I20260709 13:20:38.476876 21310 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:38.527578 21339 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:38.528477 21363 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.392s	user 0.000s	sys 0.001s
I20260709 13:20:38.517458 21355 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:38.529618 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.534272 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:38.534519 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1500) took 1431 ms. Trace:
I20260709 13:20:38.535048 14892 rpcz_store.cc:276] 0709 13:20:37.103191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.103521 (+   330us) service_pool.cc:224] Handling call
0709 13:20:37.127188 (+ 23667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:37.633594 (+506406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.534270 (+900676us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54005abc54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:38.534450 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123657088}
I20260709 13:20:38.535804 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:38.537846 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.542076 21355 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:38.542680 21355 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.544241 14867 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:38.544978 21355 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:38.545405 21247 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:38.547303 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:38.547726 21245 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.550055 21247 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:38.552057 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:38.553864 21368 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:38.554469 21368 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.554795 21317 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.555385 21317 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.555672 21278 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.556758 21278 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:38.556967 21368 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:38.557341 21247 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:38.557662 21368 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.559365 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:38.519789 21281 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 2.177s	user 0.000s	sys 0.011s
I20260709 13:20:38.561208 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:38.513563 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.562608 21247 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:20:38.598337 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:38.598544 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.599359 14226 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:38.596503 20879 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.604243 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.605175 14224 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:38.610023 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:38.619086 21387 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:20:38.584453 21317 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:38.601917 21147 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
I20260709 13:20:38.622143 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.584731 21289 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:38.624814 14227 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:38.617424 14222 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:38.563163 21368 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.628113 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.629022 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.631927 14224 raft_consensus.cc:2410] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 17 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 13:20:38.641304 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2967) took 2600 ms. Trace:
I20260709 13:20:38.641916 14374 rpcz_store.cc:276] 0709 13:20:36.029660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.029767 (+   107us) service_pool.cc:224] Handling call
0709 13:20:36.030150 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.030422 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:36.030471 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:36.031065 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:20:36.227614 (+196549us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:36.227651 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.227727 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:38.519090 (+2291363us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:38.625510 (+106420us) raft_consensus.cc:1685] finished
0709 13:20:38.625544 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:38.629907 (+  4363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142746368,"thread_start_us":196134,"threads_started":1,"wal-append.queue_time_us":311658}
I20260709 13:20:38.647727 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.626533 21245 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:38.651472 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:38.651952 14222 raft_consensus.cc:2410] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:38.653599 20879 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:38.654255 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.654932 21368 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:38.630322 21147 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.663597 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1612) took 1713 ms. Trace:
I20260709 13:20:38.664093 14375 rpcz_store.cc:276] 0709 13:20:36.950615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.950797 (+   182us) service_pool.cc:224] Handling call
0709 13:20:36.951262 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:37.979451 (+1028189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.663297 (+683846us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b540028c654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:38.663525 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286347520}
I20260709 13:20:38.664661 21147 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:38.639979 21289 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.672286 14226 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
W20260709 13:20:38.672437 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 191928us
I20260709 13:20:38.674970 14192 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:38.677996 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:38.682530 21374 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:38.690112 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.691076 14375 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:38.683591 21147 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:20:38.693022 21216 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.695349 14221 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:38.698136 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:38.698807 14221 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:38.703121 14892 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:38.683422 21289 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:38.713765 14375 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:38.714568 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.716117 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.717584 14369 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: [19.13-21.14]
I20260709 13:20:38.722615 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:38.723199 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:38.723511 14373 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:38.723942 14378 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.726691 21289 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.726910 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.727566 14374 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:38.727314 21289 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.729594 21289 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:38.731410 21289 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:38.732440 21386 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:38.732864 21386 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:38.733765 21386 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.735071 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:38.735687 14295 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:38.735992 14296 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:38.736955 14221 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
W20260709 13:20:38.737530 14225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2830) took 3174 ms (client timeout 3050 ms). Trace:
W20260709 13:20:38.737984 14225 rpcz_store.cc:269] 0709 13:20:35.562676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.567125 (+  4449us) service_pool.cc:224] Handling call
0709 13:20:38.737337 (+3170212us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540026ded4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:38.737473 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2903549696}
I20260709 13:20:38.738497 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:38.739359 14299 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:38.740201 14220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1617) took 1635 ms (client timeout 1964 ms). Trace:
I20260709 13:20:38.740283 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:38.740686 14220 rpcz_store.cc:269] 0709 13:20:37.104346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.219809 (+115463us) service_pool.cc:224] Handling call
0709 13:20:38.740000 (+1520191us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54000415d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:38.740145 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78991744}
I20260709 13:20:38.742117 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.739221 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.742690 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.743319 14220 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 15.
I20260709 13:20:38.744094 14369 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:20:38.744206 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.744447 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:38.744650 14378 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 14.
I20260709 13:20:38.746639 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.746737 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:38.747220 14229 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 17. (term mismatch)
I20260709 13:20:38.747637 14370 raft_consensus.cc:2410] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:38.747699 14229 pending_rounds.cc:85] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 16
I20260709 13:20:38.748509 14229 pending_rounds.cc:107] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 18.17
I20260709 13:20:38.748843 14229 raft_consensus.cc:2889] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:38.748705 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.749557 14224 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:38.750420 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:38.745779 14220 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:38.750833 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:38.751214 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.751621 14302 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:38.752887 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:38.753556 14296 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:38.747514 14901 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:38.756078 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.756731 14369 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:38.759570 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:38.760684 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.761387 14369 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:38.763617 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:38.781122 14224 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:20:38.781507 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:38.782521 14299 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:38.745504 21216 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.787992 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:38.786504 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:38.792032 14296 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:38.797093 14297 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:38.798430 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:38.799149 14892 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:38.801203 14221 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:20:38.801609 14221 pending_rounds.cc:85] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Aborting all ops after (but not including) 13
I20260709 13:20:38.801844 14221 pending_rounds.cc:107] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:20:38.802085 14221 raft_consensus.cc:2889] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:38.803333 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:38.764837 21240 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:38.803751 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:38.807091 14299 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:38.773133 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.779412 21231 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:38.813225 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:38.813953 14296 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:38.759425 21301 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.822273 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:38.826915 14893 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:38.823232 14901 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:38.754362 21327 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:38.836349 14302 raft_consensus.cc:2410] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:38.794277 21216 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.847237 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:38.816205 21305 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:38.849189 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.848902 14304 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:38.817761 21231 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.809278 21240 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.853273 21231 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:38.853875 21305 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.855394 21240 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:38.856073 21305 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:38.829699 21301 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.859849 21301 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:38.860558 21216 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:38.861886 21390 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:38.862440 21390 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:38.849515 21349 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.687s	user 0.008s	sys 0.004s
I20260709 13:20:38.862802 21390 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:38.867272 14301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1367) took 1928 ms (client timeout 1512 ms). Trace:
W20260709 13:20:38.867722 14301 rpcz_store.cc:269] 0709 13:20:36.938558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.938691 (+   133us) service_pool.cc:224] Handling call
0709 13:20:38.867053 (+1928362us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54001a0ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:38.867179 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575275904}
I20260709 13:20:38.872182 21321 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:38.872790 20383 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:20:38.874023 20383 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:38.874193 14298 raft_consensus.cc:1275] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:38.874423 20383 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:38.875563 20383 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.876463 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3270) took 1822 ms. Trace:
I20260709 13:20:38.877116 20383 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:38.878425 20903 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:38.828692 21356 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.879483 21356 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.876860 14298 rpcz_store.cc:276] 0709 13:20:37.053867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.255047 (+201180us) service_pool.cc:224] Handling call
0709 13:20:38.873874 (+1618827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.874652 (+   778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.876245 (+  1593us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54001a0ed0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:38.876401 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3722237824}
I20260709 13:20:38.882321 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:38.887450 14893 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:38.850904 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:38.892563 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:38.894874 21289 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:38.895475 21289 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:38.896522 21289 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.899096 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.881651 21356 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:38.907397 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.911115 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.911341 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:38.913158 14375 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:38.848119 21327 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:38.918924 14893 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:20:38.921492 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 197694us
I20260709 13:20:38.935211 14220 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:38.932163 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:38.889626 21147 consensus_queue.cc:1048] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:20:38.941044 14377 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:38.941519 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.945272 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.949378 14370 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:38.956489 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:38.949671 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:38.957453 14893 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:38.960191 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.967576 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:38.975795 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:38.961127 14220 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:38.978221 14370 raft_consensus.cc:2368] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
W20260709 13:20:38.978442 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 161629us
I20260709 13:20:38.933655 21305 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:38.980926 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:38.981853 14370 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:38.983311 14864 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:38.985016 14864 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:38.975533 21243 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.986155 20598 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:38.986465 21243 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:38.988145 21327 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:38.975559 21368 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:38.988734 21243 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:38.996104 21386 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:39.007431 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:38.989104 21368 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.990551 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:39.036551 14374 raft_consensus.cc:2410] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:20:38.978299 21156 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:20:38.992471 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:39.036859 14297 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 20: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:39.032044 14295 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:39.034868 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:39.038300 14303 raft_consensus.cc:2410] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 21 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
W20260709 13:20:39.001622 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.040536 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:39.040578 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:38.966418 21374 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:39.047349 14370 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:39.065550 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:38.986423 21245 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:39.061563 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:39.076224 14302 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:39.042023 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:38.976406 21231 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:39.065148 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.061347 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:38.981449 21305 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:39.048285 21368 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:39.060592 21327 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:39.091078 14220 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:39.089418 14302 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:39.063098 21374 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:39.098685 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 113771us
I20260709 13:20:39.103160 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:39.100039 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:39.063115 21243 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:39.105057 14295 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:39.136250 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:39.137612 14295 raft_consensus.cc:2410] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:39.080101 21096 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:39.096022 21316 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:39.156698 14297 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:39.099525 21231 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:39.131978 21374 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:39.166561 21397 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:20:39.100407 21327 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:39.170929 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.091612 21305 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:39.172612 14376 raft_consensus.cc:1240] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:20:39.138322 21336 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:39.096266 21240 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:20:39.182915 14300 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:20:39.198920 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:39.203549 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:39.156349 21243 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:39.206607 21336 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:39.197435 14300 pending_rounds.cc:85] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 15
I20260709 13:20:39.207903 14300 pending_rounds.cc:107] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 13:20:39.186662 21316 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:39.208421 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:39.209312 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:39.220072 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:39.208889 14893 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:39.208230 14300 raft_consensus.cc:2889] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:39.232652 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:39.217485 21316 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:39.235263 21243 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:39.240991 21337 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:39.245046 21378 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.871s	user 0.001s	sys 0.001s
I20260709 13:20:39.245843 21337 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:39.246408 21337 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.247017 21337 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:39.248278 21096 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:39.249060 21096 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:39.193377 21327 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:39.251658 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:39.253087 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:39.204902 21240 consensus_queue.cc:1243] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:39.265616 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:39.266920 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:39.269773 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:39.207432 21104 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:39.271826 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:39.270498 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:39.275482 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:39.275652 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:39.280833 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:39.276607 14223 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:39.284926 20903 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:39.281663 21104 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:39.285390 20903 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:39.285807 20903 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:39.287132 21104 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:39.287747 21104 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:39.288780 21216 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:39.289312 21216 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:39.291326 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:39.294313 14300 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:39.263330 21246 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:39.271975 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 227526us
I20260709 13:20:39.266528 21301 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:39.282210 21349 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:39.283341 21356 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:39.282446 21321 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:39.309038 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:39.302513 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:39.321967 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 243207us
I20260709 13:20:39.290629 21339 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:39.314291 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:39.326184 20383 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:39.366083 20383 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:39.368341 20383 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:39.371142 14300 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:39.373477 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 270428us
I20260709 13:20:39.375608 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:39.391855 14300 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:39.313971 21366 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:39.375123 21378 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:20:39.365309 21321 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:39.391419 21301 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:39.306265 21096 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:39.404471 21390 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.000s
W20260709 13:20:39.405115 21415 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.090s	user 0.001s	sys 0.004s
I20260709 13:20:39.397146 21245 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:39.424204 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 149545us
I20260709 13:20:39.425140 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:39.427042 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1561) took 1599 ms. Trace:
I20260709 13:20:39.365324 21336 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:39.427629 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:39.404788 21366 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:39.427497 14894 rpcz_store.cc:276] 0709 13:20:37.827344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.827583 (+   239us) service_pool.cc:224] Handling call
0709 13:20:37.844856 (+ 17273us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:37.872190 (+ 27334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:37.872226 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:37.901950 (+ 29724us) log.cc:844] Serialized 78 byte log entry
0709 13:20:38.270544 (+368594us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:38.316583 (+ 46039us) log.cc:844] Serialized 14 byte log entry
0709 13:20:38.667174 (+350591us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b18000c54a0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:39.244240 (+577066us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:39.298567 (+ 54327us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b18000c54a0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:20:39.298774 (+   207us) log.cc:844] Serialized 14 byte log entry
0709 13:20:39.298993 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.299084 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:39.426802 (+127718us) raft_consensus.cc:1685] finished
0709 13:20:39.426822 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.426969 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7461,"prepare.queue_time_us":1031607,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":30227,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":8859,"spinlock_wait_cycles":23176192,"thread_start_us":267670,"threads_started":1,"wal-append.queue_time_us":350357}
I20260709 13:20:39.464663 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:39.466415 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:39.468458 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:39.490996 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.429605 21231 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
W20260709 13:20:39.435137 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 159773us
I20260709 13:20:39.528800 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:39.438053 21216 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:39.443202 21246 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:39.425459 21390 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:39.558008 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:39.561441 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:39.552944 21246 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:39.575248 21246 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:39.575779 21246 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:39.575892 14344 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:39.581648 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 258867us
W20260709 13:20:39.557243 21378 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:39.581777 21339 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:39.580549 21386 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.584s	user 0.014s	sys 0.000s
W20260709 13:20:39.594485 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 126114us
I20260709 13:20:39.578153 21240 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:39.526342 21316 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:39.589105 21301 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:39.598518 14267 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:39.592372 21231 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:39.596827 21240 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.551251 21321 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:39.628635 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 201071us
I20260709 13:20:39.615795 21301 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.580852 21317 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:20:39.588263 21245 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:39.622069 21240 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:39.630374 21231 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:39.625417 21424 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.668749 21366 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:39.670322 21407 log.cc:927] Time spent T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:20:39.629660 21419 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:39.671245 21368 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.004s
I20260709 13:20:39.672051 21422 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.672869 21339 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:39.675042 21316 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:39.664932 21348 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.566s	user 0.000s	sys 0.006s
W20260709 13:20:39.675032 21405 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:20:39.682067 21431 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:39.651191 21301 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:39.687587 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 89159.7us
I20260709 13:20:39.625519 21416 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:20:39.666746 21423 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:39.701869 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:39.684368 21427 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:39.664665 21420 consensus_queue.cc:1059] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:20:39.683133 20903 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:39.688764 21366 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:39.723740 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:39.725323 14297 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:20:39.694875 21368 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:39.685663 21424 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:39.729908 21366 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.699965 21422 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:39.728730 21133 consensus_queue.cc:1059] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:20:39.735455 21390 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:39.712404 21430 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.092s
I20260709 13:20:39.799279 21366 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:39.710466 21231 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:39.838387 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1510) took 1020 ms. Trace:
I20260709 13:20:39.833884 21431 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:39.840237 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 138472us
I20260709 13:20:39.840875 14892 rpcz_store.cc:276] 0709 13:20:38.817622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.828355 (+ 10733us) service_pool.cc:224] Handling call
0709 13:20:38.841896 (+ 13541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.842282 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:39.707360 (+865078us) log.cc:844] Serialized 14 byte log entry
0709 13:20:39.837986 (+130626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:39.838057 (+    71us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:39.838110 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.838177 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.838321 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":597908,"thread_start_us":385563,"threads_started":2}
W20260709 13:20:39.851620 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 187735us
I20260709 13:20:39.850557 14897 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:39.853989 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:39.856232 14371 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:39.854224 14894 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:39.857442 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:39.856192 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:39.836297 21440 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:39.861512 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:39.862673 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:39.870002 14896 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:20:39.865105 14375 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 21: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:39.871359 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:39.874305 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:39.876048 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:39.875104 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:39.879495 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:39.880648 14370 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:39.864468 21416 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:39.890878 14864 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:39.887547 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 312088us
I20260709 13:20:39.890305 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:39.893256 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:39.892446 14894 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:39.902709 20903 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:39.907612 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:39.908376 14899 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:39.908878 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1504) took 1207 ms. Trace:
W20260709 13:20:39.909058 14304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3437) took 1159 ms (client timeout 1543 ms). Trace:
W20260709 13:20:39.910141 14304 rpcz_store.cc:269] 0709 13:20:38.750050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.750182 (+   132us) service_pool.cc:224] Handling call
0709 13:20:39.908827 (+1158645us) spinlock_profiling.cc:243] Waited 97.8 ms on lock 0x7b5400333954. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:39.908979 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224927488}
I20260709 13:20:39.912024 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:39.909657 21374 consensus_meta.cc:287] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.706s	user 0.012s	sys 0.000s
I20260709 13:20:39.851151 21431 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:39.916090 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:39.916864 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:39.905478 21305 consensus_meta.cc:287] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 13:20:39.917394 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:39.937987 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:39.946635 14375 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:39.909215 14899 rpcz_store.cc:276] 0709 13:20:38.701940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.702596 (+   656us) service_pool.cc:224] Handling call
0709 13:20:39.907432 (+1204836us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:20:39.908821 (+  1389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667776}
I20260709 13:20:39.889123 21411 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:39.949682 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:39.955289 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:39.958515 14894 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:39.884387 21440 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:39.876648 21096 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:20:39.960512 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:39.936502 21337 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.000s
W20260709 13:20:39.942297 21327 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.669s	user 0.010s	sys 0.004s
W20260709 13:20:39.919029 21290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.566s	user 0.007s	sys 0.025s
I20260709 13:20:39.968784 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:39.887737 21336 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:20:39.987766 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:39.981607 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:39.955952 21446 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.954918 21356 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:39.990047 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 266420us
I20260709 13:20:39.991619 14220 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:39.994210 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:39.957263 21452 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.948714 21420 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:39.984107 21290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.631s	user 0.007s	sys 0.028s
I20260709 13:20:39.972568 21438 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:40.028218 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 137492us
I20260709 13:20:39.913826 21416 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:39.944334 21374 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.022125 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:40.026464 21456 raft_consensus.cc:3055] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:40.026552 21464 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:39.986970 21247 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:40.032051 21431 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:39.986575 21327 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.032375 21349 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:40.032748 21452 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.034386 21321 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:40.023576 21133 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:40.035351 21246 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.036549 14220 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:40.036652 21422 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:40.023242 21446 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.039614 21356 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:40.040719 21355 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:40.041530 21445 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:40.042744 14894 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:20:40.044366 21424 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:40.044497 21435 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:20:40.045321 21429 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.333s	user 0.002s	sys 0.000s
I20260709 13:20:40.045704 21440 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.098652 21349 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.049052 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:40.049592 14864 leader_election.cc:400] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:39.954939 21305 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.058712 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:39.986111 21444 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:40.023483 21336 consensus_queue.cc:1243] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:20:40.067993 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.022778 14375 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:40.072306 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:39.985318 21337 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.029542 21438 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:40.100620 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:40.103281 14899 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:40.060292 21456 raft_consensus.cc:740] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:40.108634 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1511) took 1290 ms. Trace:
I20260709 13:20:40.023428 21433 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:20:40.046675 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:40.152719 14897 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:40.130815 14864 leader_election.cc:403] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:20:40.148195 14895 rpcz_store.cc:276] 0709 13:20:38.818041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.820356 (+  2315us) service_pool.cc:224] Handling call
0709 13:20:38.820626 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.820822 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:39.873494 (+1052672us) log.cc:844] Serialized 14 byte log entry
0709 13:20:40.107032 (+233538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:40.107103 (+    71us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:40.107157 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.107245 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.108539 (+  1294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":605121,"raft.queue_time_us":126658,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"thread_start_us":658359,"threads_started":3,"wal-append.queue_time_us":152570}
W20260709 13:20:40.154850 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 124990us
I20260709 13:20:40.155715 14864 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:40.120340 14295 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:40.126645 14300 pending_rounds.cc:85] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 11
I20260709 13:20:40.157119 14300 pending_rounds.cc:107] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:20:40.157505 14300 raft_consensus.cc:2889] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:40.127825 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:40.114804 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:40.118705 14371 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:20:40.158385 14371 pending_rounds.cc:85] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 11
I20260709 13:20:40.158862 14371 pending_rounds.cc:107] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 21.12
W20260709 13:20:40.158792 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 44150.3us
I20260709 13:20:40.159240 14371 raft_consensus.cc:2889] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:40.049695 21420 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.117636 21451 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:40.138223 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 79642.6us
I20260709 13:20:40.117734 21452 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:40.120141 21246 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:40.125819 21327 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:40.147194 14369 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:40.107537 21133 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:40.150168 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77984.4us
I20260709 13:20:40.158376 14220 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:40.134313 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 85360us
I20260709 13:20:40.159727 14341 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:40.159871 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:40.113605 21461 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:40.136065 20383 raft_consensus.cc:3055] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:40.118316 21446 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.151081 21438 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:40.143529 21431 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:40.215410 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 59779.2us
I20260709 13:20:40.151895 21375 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:40.147143 21337 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:40.222970 14222 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:40.223317 20383 raft_consensus.cc:740] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:40.219826 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:40.221776 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 62128.7us
I20260709 13:20:40.246276 20383 consensus_queue.cc:260] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.246548 14341 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:40.247242 20383 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:40.248131 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:40.221299 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:40.155748 21409 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:40.239883 14220 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:40.240777 20902 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:40.216759 21243 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:40.244181 21362 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 2.126s	user 0.005s	sys 0.000s
W20260709 13:20:40.241319 21457 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:20:40.253100 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:40.219736 14192 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:40.233551 21452 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:20:40.255107 14222 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:40.224081 21461 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.232446 20903 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:40.250918 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:40.219882 21339 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:40.223950 21133 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:40.217288 21467 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
W20260709 13:20:40.254020 21289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.076s	user 0.011s	sys 0.018s
I20260709 13:20:40.258896 21242 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:40.258056 21245 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:40.266842 21356 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:20:40.261754 21456 consensus_queue.cc:260] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.291610 21456 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:40.284802 21289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.011s	sys 0.018s
I20260709 13:20:40.294628 21289 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:40.295254 21289 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:40.296191 21289 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.252115 21386 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:20:40.300231 21386 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:40.300770 21386 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:40.301980 21416 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:40.303539 21441 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:40.306798 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3294) took 1035 ms. Trace:
I20260709 13:20:40.307081 21246 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:40.307585 21246 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:40.308545 21246 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.307420 14297 rpcz_store.cc:276] 0709 13:20:39.271484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.728742 (+457258us) service_pool.cc:224] Handling call
0709 13:20:39.789376 (+ 60634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:39.789853 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:39.789898 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:39.816346 (+ 26448us) log.cc:844] Serialized 26 byte log entry
0709 13:20:39.917881 (+101535us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:39.917939 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.918036 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:40.306486 (+388450us) raft_consensus.cc:1685] finished
0709 13:20:40.306515 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.306713 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2788,"raft.queue_time_us":52057,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":12697,"thread_start_us":78550,"threads_started":1,"wal-append.queue_time_us":198664}
I20260709 13:20:40.312057 21374 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.269685 21461 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:40.270617 21446 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:20:40.318187 14121 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 14 to 16, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 16 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:40.319469 21374 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:40.320152 21374 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.321170 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c137013238f4b1dbae260e32cb316dc with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:47058
I20260709 13:20:40.222414 21451 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:40.323364 21362 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:20:40.325111 21460 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:20:40.280462 21390 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.325759 21456 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.350500 21456 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.352867 21456 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:40.334064 21438 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.332162 21133 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.343082 21386 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.333832 21390 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.333362 21243 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:40.359292 21438 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:40.363567 21476 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 13:20:40.284909 21327 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:40.269960 20903 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.366328 20903 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.367918 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:40.368953 21366 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 13:20:40.369827 21349 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.327929 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2856) took 2507 ms. Trace:
I20260709 13:20:40.371716 14229 rpcz_store.cc:276] 0709 13:20:37.820066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.820189 (+   123us) service_pool.cc:224] Handling call
0709 13:20:38.741294 (+921105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.749452 (+  8158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.327724 (+1578272us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54000415d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:40.327868 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072593152}
I20260709 13:20:40.374130 21305 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.375818 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2997) took 1423 ms. Trace:
I20260709 13:20:40.376227 14376 rpcz_store.cc:276] 0709 13:20:38.952097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.074090 (+121993us) service_pool.cc:224] Handling call
0709 13:20:39.172377 (+ 98287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:39.193224 (+ 20847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.375608 (+1182384us) spinlock_profiling.cc:243] Waited 72.8 ms on lock 0x7b540027a6d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:40.375756 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167464704}
W20260709 13:20:40.378466 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:40.379045 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:40.381965 21240 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.698s	user 0.013s	sys 0.001s
I20260709 13:20:40.382571 21240 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.285205 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:40.320171 14121 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 10 to 13, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 13 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:40.385176 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 100062us
I20260709 13:20:40.385986 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:40.255198 21337 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:40.387279 21452 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:40.254274 20902 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:40.260154 21431 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:40.381865 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3289) took 1141 ms. Trace:
I20260709 13:20:40.388700 14295 rpcz_store.cc:276] 0709 13:20:39.240166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.678469 (+438303us) service_pool.cc:224] Handling call
0709 13:20:39.686795 (+  8326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.160664 (+473869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.381580 (+220916us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400154ad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:40.381776 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996582272}
I20260709 13:20:40.389477 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:40.388931 20902 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.390331 20902 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:40.388036 21452 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:40.386158 14121 catalog_manager.cc:5697] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 10 to 16, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 16 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:20:40.397022 21431 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:40.397697 21437 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.539s	user 0.001s	sys 0.000s
I20260709 13:20:40.377456 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:40.398643 14376 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.401003 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1629) took 1326 ms. Trace:
I20260709 13:20:40.401517 14893 rpcz_store.cc:276] 0709 13:20:39.074302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.078074 (+  3772us) service_pool.cc:224] Handling call
0709 13:20:39.101945 (+ 23871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:39.226589 (+124644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.400697 (+1174108us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54005f64d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:40.400918 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245319040}
I20260709 13:20:40.407194 21311 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.369526 21366 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.407966 21311 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.283298 20383 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.419160 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:40.421994 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:20:40.417117 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 183948us
I20260709 13:20:40.449622 14296 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:40.424037 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:40.418769 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:40.449472 20383 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.451821 14304 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:40.418695 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.468298 14229 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:40.475138 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.480372 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1516) took 1660 ms. Trace:
I20260709 13:20:40.458601 14376 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:20:40.480888 14901 rpcz_store.cc:276] 0709 13:20:38.819747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.890148 (+ 70401us) service_pool.cc:224] Handling call
0709 13:20:40.423866 (+1533718us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800003998. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:20:40.480300 (+ 56434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25907456}
I20260709 13:20:40.478085 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:40.475690 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.482295 14295 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:40.482738 14220 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:40.457175 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3286) took 1217 ms. Trace:
I20260709 13:20:40.484694 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:40.458285 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.458926 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1512) took 1640 ms. Trace:
I20260709 13:20:40.459478 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:40.485599 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 265916us
W20260709 13:20:40.421401 21474 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:20:40.492388 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.504176 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:40.495224 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:40.417052 21401 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.241s	user 0.001s	sys 0.001s
W20260709 13:20:40.488245 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 237428us
W20260709 13:20:40.484153 21301 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.773s	user 0.006s	sys 0.006s
I20260709 13:20:40.516801 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:40.411064 21410 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.040s	user 0.002s	sys 0.000s
I20260709 13:20:40.423354 21452 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 13:20:40.520104 21456 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:40.527009 21294 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:40.528743 21459 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:40.529361 21459 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:40.453819 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:40.420375 21403 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.246s	user 0.000s	sys 0.012s
I20260709 13:20:40.490911 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:40.487803 21367 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.510133 21156 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 13:20:40.500861 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.539279 21461 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.539731 14226 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:40.541078 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.491765 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.542946 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.543752 14229 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:20:40.545974 21290 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:40.550161 21311 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.500383 21305 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.551017 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1513) took 1732 ms. Trace:
I20260709 13:20:40.551455 21367 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.535511 21459 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.505587 21336 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:40.553807 21459 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:40.553653 14125 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37096 (request call id 356) took 36655 ms (client timeout 15000 ms). Trace:
I20260709 13:20:40.521270 21301 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.556123 21133 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.501343 21470 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.509213 21468 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:40.557170 21349 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.557533 21470 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.560565 21470 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:40.554911 14125 rpcz_store.cc:269] 0709 13:20:03.898479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.898907 (+   428us) service_pool.cc:224] Handling call
0709 13:20:40.553387 (+36654480us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:24.561969 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:24.562941 (+   972us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:24.563026 (+    85us) write_op.cc:435] Acquired schema lock
0709 13:20:24.567086 (+  4060us) tablet.cc:662] Decoding operations
0709 13:20:24.592041 (+ 24955us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:24.592185 (+   144us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:24.592226 (+    41us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:20:24.762272 (+170046us) tablet.cc:701] Row locks acquired
0709 13:20:24.790502 (+ 28230us) write_op.cc:260] PREPARE: finished
0709 13:20:24.849036 (+ 58534us) write_op.cc:270] Start()
0709 13:20:24.963268 (+114232us) write_op.cc:276] Timestamp: P: 1783603224830847 usec, L: 0
0709 13:20:24.977768 (+ 14500us) op_driver.cc:348] REPLICATION: starting
0709 13:20:25.181364 (+203596us) log.cc:844] Serialized 7999 byte log entry
0709 13:20:25.945930 (+764566us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b5400152054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded087e28 00007f8df0ac2581 00007f8df0ac1d58 00007f8df0ac69f1 00007f8df0ac69a9 00007f8df0ac6939 00007f8df0ac6901 00007f8df0ac5b2d 000000000038f354 000000000038f199
0709 13:20:26.934817 (+988887us) op_driver.cc:464] REPLICATION: finished
0709 13:20:28.174890 (+1240073us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b1800342280. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:28.175080 (+   190us) write_op.cc:301] APPLY: starting
0709 13:20:28.175189 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:29.212672 (+1037483us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:29.217484 (+  4812us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:30.770852 (+1553368us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:30.771317 (+   465us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:20:30.771375 (+    58us) write_op.cc:312] APPLY: finished
0709 13:20:30.771892 (+   517us) log.cc:844] Serialized 180 byte log entry
0709 13:20:31.129867 (+357975us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:31.164596 (+ 34729us) write_op.cc:454] Released schema lock
0709 13:20:31.237457 (+ 72861us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:31.376162 (+138705us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:31.380726 (+  4564us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2559508,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":834001,"apply.run_cpu_time_us":71205,"apply.run_wall_time_us":3157940,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87767,"num_ops":20,"prepare.queue_time_us":651905,"prepare.run_cpu_time_us":40121,"prepare.run_wall_time_us":1402636,"raft.queue_time_us":922967,"raft.run_cpu_time_us":83970,"raft.run_wall_time_us":832786,"replication_time_us":1946148,"spinlock_wait_cycles":69423232,"thread_start_us":2499153,"threads_started":5,"wal-append.queue_time_us":1135965,"wal-append.run_cpu_time_us":83845,"wal-append.run_wall_time_us":3212572}]]}
I20260709 13:20:40.514076 21245 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:40.562717 21245 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.567800 20903 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.569039 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:40.570308 21349 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:40.570569 21374 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.572686 21451 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.500638 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.574066 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:40.505949 14296 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:40.488397 20383 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.423108 21446 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:40.416818 21246 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:40.421375 21419 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.480178 21386 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:40.510109 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:40.577034 14374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1628) took 1672 ms. Trace:
I20260709 13:20:40.453502 20939 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.420717 21337 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.409754 21366 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:40.483695 21438 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:40.519101 14228 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:20:40.520787 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 61432.9us
W20260709 13:20:40.531634 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 77914.9us
I20260709 13:20:40.493881 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:40.533085 14304 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:40.541509 21461 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.575433 21367 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:40.486569 14898 rpcz_store.cc:276] 0709 13:20:38.818435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.818568 (+   133us) service_pool.cc:224] Handling call
0709 13:20:38.818879 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.819088 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:39.430363 (+611275us) log.cc:844] Serialized 14 byte log entry
0709 13:20:40.356512 (+926149us) log.cc:844] Serialized 14 byte log entry
0709 13:20:40.458440 (+101928us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:40.458513 (+    73us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:40.458573 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.458678 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.458848 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1340362,"prepare.queue_time_us":2181715,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":133478,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":13515,"spinlock_wait_cycles":62547328,"thread_start_us":277312,"threads_started":1,"wal-append.queue_time_us":418597}
I20260709 13:20:40.590852 14270 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:40.551553 14900 rpcz_store.cc:276] 0709 13:20:38.818732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.820993 (+  2261us) service_pool.cc:224] Handling call
0709 13:20:38.821320 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:38.821673 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:38.821696 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:38.824198 (+  2502us) log.cc:844] Serialized 26 byte log entry
0709 13:20:38.959325 (+135127us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:38.959382 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.959488 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:40.416454 (+1456966us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:40.550674 (+134220us) raft_consensus.cc:1685] finished
0709 13:20:40.550695 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.550952 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":27072896,"thread_start_us":126073,"threads_started":1,"wal-append.queue_time_us":275221}
I20260709 13:20:40.554049 21336 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.554440 21452 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:40.556978 21301 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.417418 21390 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:40.507356 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.603327 14221 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:40.509680 14222 raft_consensus.cc:1275] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:20:40.604049 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 110258us
I20260709 13:20:40.604789 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.605368 14222 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:40.606256 14864 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:40.606752 14222 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:40.612864 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.574692 14225 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:40.478080 21423 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.577430 14374 rpcz_store.cc:276] 0709 13:20:38.904599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.060463 (+155864us) service_pool.cc:224] Handling call
0709 13:20:39.062454 (+  1991us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:39.062711 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:39.062741 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:39.065667 (+  2926us) log.cc:844] Serialized 26 byte log entry
0709 13:20:39.251804 (+186137us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:39.251839 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.251902 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:40.410382 (+1158480us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:40.575003 (+164621us) raft_consensus.cc:1685] finished
0709 13:20:40.575024 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.576969 (+  1945us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6382848,"thread_start_us":155915,"threads_started":1,"wal-append.queue_time_us":222925}
I20260709 13:20:40.486136 14301 rpcz_store.cc:276] 0709 13:20:39.239296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.653252 (+413956us) service_pool.cc:224] Handling call
0709 13:20:39.653674 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:39.665069 (+ 11395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:39.665113 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:39.665674 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:20:39.970624 (+304950us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:39.970666 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.970736 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:40.456888 (+486152us) raft_consensus.cc:1685] finished
0709 13:20:40.456909 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.457093 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10906,"raft.queue_time_us":72507,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":8262,"thread_start_us":272421,"threads_started":1,"wal-append.queue_time_us":441565}
I20260709 13:20:40.577351 20383 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:40.583204 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:40.565613 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.600314 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:40.551085 21305 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.586651 21104 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:40.632411 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:40.633827 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:40.586053 21438 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:40.601976 21336 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:40.622094 14228 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 20: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:40.621205 14226 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 19: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:40.617185 20903 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.585449 20939 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.602003 21452 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:40.640520 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2864) took 2113 ms. Trace:
I20260709 13:20:40.582671 21419 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.644946 14224 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.670946 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:40.637161 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 127123us
I20260709 13:20:40.638566 21433 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:40.576529 21446 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.586061 21337 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.663152 14227 rpcz_store.cc:276] 0709 13:20:38.527404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.530830 (+  3426us) service_pool.cc:224] Handling call
0709 13:20:38.531113 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:38.630234 (+ 99121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.640289 (+2010055us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b54001496d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:40.640464 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213729152}
I20260709 13:20:40.647661 14225 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:20:40.640511 21438 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:40.602274 21366 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:20:40.602850 21431 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:20:40.639413 21356 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:20:40.626879 21349 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:40.631666 21423 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.645557 21467 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:40.695600 14221 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260709 13:20:40.695604 14296 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:40.730114 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.694658 14369 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.660068 21473 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:40.707499 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:40.748759 14224 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:40.716414 20383 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:40.771767 20383 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:40.695217 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:40.660374 21424 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:40.665316 21452 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:40.618666 21470 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:40.732841 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 479765us
I20260709 13:20:40.755906 14867 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:40.678265 21475 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:40.647692 21104 consensus_queue.cc:1048] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:20:40.676935 21433 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:40.691987 21456 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.690637 21355 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:40.726312 21467 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:40.790580 14227 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:20:40.802031 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:40.753649 21468 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:40.751952 21473 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:40.813827 14300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.083s	sys 0.067s
I20260709 13:20:40.697212 21321 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
W20260709 13:20:40.814096 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58280.7us
W20260709 13:20:40.820421 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 259802us
I20260709 13:20:40.820854 14369 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:40.822945 14221 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:40.753279 21349 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:40.860040 14901 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:40.862104 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:40.824337 20383 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:40.866539 14300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.088s	sys 0.072s
W20260709 13:20:40.825484 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 180852us
I20260709 13:20:40.869956 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:40.868670 14867 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:40.869352 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:40.878533 14341 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:40.880007 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:40.778264 21470 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:40.884701 14892 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:40.811787 21433 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.887727 14867 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:40.803042 21475 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:40.892280 20383 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.622575 14121 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 9 to 12, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 12 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:40.902741 14121 catalog_manager.cc:5697] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:40.906270 20903 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:40.906960 20903 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.907936 20902 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:40.909132 20903 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:40.863945 21422 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:40.814249 21355 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:40.910729 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2815) took 1015 ms. Trace:
I20260709 13:20:40.900285 20383 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.822727 21467 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:40.869297 21473 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.909536 20939 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:40.924220 14371 rpcz_store.cc:276] 0709 13:20:39.896000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.246187 (+350187us) service_pool.cc:224] Handling call
0709 13:20:40.257314 (+ 11127us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:40.257699 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.257727 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:40.258309 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 13:20:40.667629 (+409320us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:40.667693 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.667803 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:40.910493 (+242690us) raft_consensus.cc:1685] finished
0709 13:20:40.910515 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.910669 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1861,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2131,"thread_start_us":330521,"threads_started":1,"wal-append.queue_time_us":590148}
I20260709 13:20:40.975929 14221 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:20:40.886225 21468 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:40.896020 21472 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:40.921134 21422 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.932284 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:40.935520 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.822436 21451 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:20:40.893306 21470 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:40.861055 21456 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:40.889657 21481 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:40.952075 21294 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:40.968489 21431 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:41.026896 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:41.009099 21305 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:40.989558 21472 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.993433 21375 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.062314 14371 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:41.047399 20383 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:41.066413 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 134253us
I20260709 13:20:41.098834 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:40.882814 21349 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:41.048705 21466 log.cc:927] Time spent T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.688s	user 0.002s	sys 0.000s
I20260709 13:20:41.104096 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:41.106511 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 226565us
I20260709 13:20:41.034469 21423 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:41.044060 21446 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:41.053251 21456 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:41.066797 21431 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:41.028551 21422 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:41.097429 21472 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:41.067492 21489 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:41.110059 21399 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.938s	user 0.006s	sys 0.009s
I20260709 13:20:40.926118 14867 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:41.167032 14229 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:41.169663 21336 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.507s	user 0.000s	sys 0.009s
I20260709 13:20:41.170182 21336 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.172448 21336 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:41.106041 21356 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:41.032778 21452 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:41.189687 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 263653us
I20260709 13:20:41.141633 21431 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.103669 21375 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.221331 21337 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:41.240108 21424 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:41.142824 21481 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.079s
I20260709 13:20:40.917578 14121 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 5 to 14, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 14 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.044384 21355 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:41.242166 21246 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.663s	user 0.005s	sys 0.009s
I20260709 13:20:41.137200 21366 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:20:41.136197 21485 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:20:41.214418 21336 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.294620 14867 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:41.215855 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet 8c137013238f4b1dbae260e32cb316dc (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:20:41.324898 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2992) took 2571 ms. Trace:
I20260709 13:20:41.042359 21468 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.362278 14371 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:41.308791 21216 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:41.382704 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 2994) took 2627 ms. Trace:
W20260709 13:20:41.390273 14111 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 470776us
W20260709 13:20:41.394411 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:41.361831 21459 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.807s	user 0.015s	sys 0.001s
W20260709 13:20:41.362306 21386 consensus_meta.cc:287] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.780s	user 0.012s	sys 0.004s
I20260709 13:20:41.390825 14378 rpcz_store.cc:276] 0709 13:20:38.753314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.754070 (+   756us) service_pool.cc:224] Handling call
0709 13:20:38.754405 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:38.938827 (+184422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:38.938858 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:38.940864 (+  2006us) log.cc:844] Serialized 26 byte log entry
0709 13:20:39.293276 (+352412us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:39.313070 (+ 19794us) log.cc:844] Serialized 14 byte log entry
0709 13:20:39.553779 (+240709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.299023 (+1745244us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000b9354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:41.299083 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.299128 (+    45us) raft_consensus.cc:1685] finished
0709 13:20:41.324575 (+ 25447us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.324803 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15402,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":87482,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3420,"spinlock_wait_cycles":423893120,"thread_start_us":501769,"threads_started":2,"wal-append.queue_time_us":458488,"wal-append.run_cpu_time_us":4037,"wal-append.run_wall_time_us":1423743}
I20260709 13:20:41.395346 14373 rpcz_store.cc:276] 0709 13:20:38.755072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.755193 (+   121us) service_pool.cc:224] Handling call
0709 13:20:38.755542 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:38.758615 (+  3073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:38.758650 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:38.786393 (+ 27743us) log.cc:844] Serialized 52 byte log entry
0709 13:20:39.062639 (+276246us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:39.062681 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.062751 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:40.884245 (+1821494us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:41.359337 (+475092us) raft_consensus.cc:1685] finished
0709 13:20:41.359372 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.382630 (+ 23258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2590,"raft.queue_time_us":2799,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":20096,"spinlock_wait_cycles":34210688,"thread_start_us":240468,"threads_started":1,"wal-append.queue_time_us":361680}
I20260709 13:20:41.402354 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.403411 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:41.245770 21470 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.407126 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:41.407753 14378 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.409803 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2816) took 1496 ms. Trace:
I20260709 13:20:41.411229 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.412501 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.413045 14373 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:20:41.414351 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.410315 14372 rpcz_store.cc:276] 0709 13:20:39.914296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.390566 (+476270us) service_pool.cc:224] Handling call
0709 13:20:40.390897 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:40.391315 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.391342 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:40.391852 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:20:40.740166 (+348314us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:40.800942 (+ 60776us) log.cc:844] Serialized 14 byte log entry
0709 13:20:40.801297 (+   355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.801397 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.409531 (+608134us) raft_consensus.cc:1685] finished
0709 13:20:41.409554 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.409720 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58912,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":518,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":12020992,"thread_start_us":347833,"threads_started":1,"wal-append.queue_time_us":613182}
I20260709 13:20:41.416005 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.416738 14372 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:41.399643 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:41.419528 14371 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.394858 21424 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:41.436412 14377 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 20. Current term is 21. Ops: [20.9-20.9]
I20260709 13:20:41.437748 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.441273 14373 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:41.438597 14372 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:41.445233 14378 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:41.396723 21366 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:41.390638 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 96226us
W20260709 13:20:41.451241 14269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.008s	sys 0.025s
I20260709 13:20:41.451102 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:41.451876 14269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.025s
W20260709 13:20:41.453161 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.409890 21390 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:41.454475 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:41.455410 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:41.460942 14296 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:41.461150 14371 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:41.456116 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:41.462931 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:41.463642 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:41.464344 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:41.464920 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:41.465364 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3453) took 1687 ms. Trace:
I20260709 13:20:41.456408 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:41.465971 14370 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
W20260709 13:20:41.466867 21426 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 1.761s	user 0.001s	sys 0.004s
I20260709 13:20:41.469313 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3278) took 2271 ms. Trace:
I20260709 13:20:41.470196 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:41.470345 21414 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:41.471475 21414 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:41.471834 21414 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:41.472031 14892 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:41.472473 21444 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:41.472937 21444 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:41.472646 21414 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.473886 21444 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.475235 21444 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:41.476269 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.477706 21414 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:41.483767 21433 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.005s
I20260709 13:20:41.484163 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:41.484272 21433 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.484933 21234 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:41.485809 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:41.483808 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:41.491346 21309 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:20:41.489768 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:41.493955 21486 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.476s	user 0.002s	sys 0.000s
I20260709 13:20:41.495046 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:41.492388 21469 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.131s	user 0.003s	sys 0.000s
I20260709 13:20:41.496127 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:41.499402 14299 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:41.478626 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:41.481884 21436 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.604s	user 0.002s	sys 0.002s
I20260709 13:20:41.482918 14296 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:41.465763 14300 rpcz_store.cc:276] 0709 13:20:39.778399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.041760 (+263361us) service_pool.cc:224] Handling call
0709 13:20:40.042115 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:40.161284 (+119169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.161315 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:40.161953 (+   638us) log.cc:844] Serialized 52 byte log entry
0709 13:20:40.871200 (+709247us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:40.871258 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.464951 (+593693us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b54000dd4d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:41.465011 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.465063 (+    52us) raft_consensus.cc:1685] finished
0709 13:20:41.465078 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.465305 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":424,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":50670,"spinlock_wait_cycles":193857280,"thread_start_us":627292,"threads_started":1,"wal-append.queue_time_us":813603}
I20260709 13:20:41.504154 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:41.513367 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.520458 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:41.521760 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:41.522653 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.469684 14298 rpcz_store.cc:276] 0709 13:20:39.197847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.365935 (+168088us) service_pool.cc:224] Handling call
0709 13:20:39.366297 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:39.366659 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:39.379117 (+ 12458us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.297226 (+1918109us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b180048a780. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287
0709 13:20:41.297369 (+   143us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:41.308314 (+ 10945us) log.cc:844] Serialized 52 byte log entry
0709 13:20:41.308503 (+   189us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:41.308552 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.308649 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.447012 (+138363us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:41.469077 (+ 22065us) raft_consensus.cc:1685] finished
0709 13:20:41.469103 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.469257 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33161,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":87391,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":24790,"spinlock_wait_cycles":503766272,"thread_start_us":247301,"threads_started":2,"wal-append.queue_time_us":293279}
I20260709 13:20:41.528434 14897 raft_consensus.cc:2410] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:20:41.529218 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:41.530275 14374 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:41.531960 14227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.017s	sys 0.029s
I20260709 13:20:41.528482 14898 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:20:41.537281 14227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.018s	sys 0.029s
I20260709 13:20:41.533134 14298 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:41.534314 14301 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
W20260709 13:20:41.534878 14223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.002s	sys 0.014s
I20260709 13:20:41.535650 14221 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:41.535022 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:41.540897 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:41.541909 14227 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:41.547194 14223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.002s	sys 0.014s
I20260709 13:20:41.547340 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.548332 14374 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:41.549628 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:41.550238 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:41.549674 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:41.552301 14298 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:41.523407 21246 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:41.553489 14301 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 19 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:41.559463 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:41.560056 14221 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:41.560438 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:41.561389 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:41.562366 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:41.535136 21349 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:41.569605 20598 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:41.570533 14301 raft_consensus.cc:1240] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:41.570221 20598 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.572129 14301 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:41.573371 14371 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:41.511278 21459 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:20:41.511955 21390 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:41.553347 21242 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.548233 21327 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:41.583534 21492 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:20:41.559023 20902 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:41.596112 20598 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:41.596442 21496 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:20:41.673964 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2884) took 1052 ms. Trace:
I20260709 13:20:41.674433 14225 rpcz_store.cc:276] 0709 13:20:40.622027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.627008 (+  4981us) service_pool.cc:224] Handling call
0709 13:20:40.644529 (+ 17521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:40.735148 (+ 90619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.673723 (+938575us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b54002774d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:41.673902 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39136512}
I20260709 13:20:41.580492 21311 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:41.597875 21438 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.844s	user 0.012s	sys 0.010s
I20260709 13:20:41.598294 21452 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:41.681649 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2821) took 1047 ms. Trace:
I20260709 13:20:41.592269 21309 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.682310 14376 rpcz_store.cc:276] 0709 13:20:40.634471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.634603 (+   132us) service_pool.cc:224] Handling call
0709 13:20:40.648944 (+ 14341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:40.764545 (+115601us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:40.764595 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:40.765154 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:20:40.980606 (+215452us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:40.980664 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.675654 (+694990us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400170cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:41.675698 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.675744 (+    46us) raft_consensus.cc:1685] finished
0709 13:20:41.675759 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.681552 (+  5793us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":874,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":28174,"spinlock_wait_cycles":264672512,"thread_start_us":155232,"threads_started":1,"wal-append.queue_time_us":251464}
I20260709 13:20:41.683817 21309 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:41.681697 14299 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:20:41.685704 14299 pending_rounds.cc:85] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 12
I20260709 13:20:41.686133 14299 pending_rounds.cc:107] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:20:41.686574 14299 raft_consensus.cc:2889] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:41.602349 21497 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:20:41.604604 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:41.610136 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.611394 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:41.614876 21475 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:41.622820 21332 consensus_queue.cc:1059] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:41.623181 21243 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:41.624325 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:41.621476 21368 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:41.624379 14227 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:41.709566 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:41.626679 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2883) took 1121 ms. Trace:
I20260709 13:20:41.710742 14224 rpcz_store.cc:276] 0709 13:20:40.505412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.518798 (+ 13386us) service_pool.cc:224] Handling call
0709 13:20:41.626495 (+1107697us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b540033de54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:41.626617 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161559424}
I20260709 13:20:41.628067 21420 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:41.628201 21431 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:41.628389 21422 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.629540 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.631479 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:41.632692 21467 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.655s	user 0.006s	sys 0.002s
I20260709 13:20:41.690274 21375 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:41.675679 21327 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.574595 21481 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:41.662688 14378 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:41.661623 14193 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:41.648041 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:20:41.644634 21478 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.005s	sys 0.025s
I20260709 13:20:41.554207 21446 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:20:41.675750 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:41.685009 21438 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:41.689316 21473 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.680s	user 0.005s	sys 0.005s
I20260709 13:20:41.689755 14299 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:41.751693 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 103739us
I20260709 13:20:41.752945 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:41.691263 14222 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:41.691656 14377 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
W20260709 13:20:41.693956 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 82671.5us
W20260709 13:20:41.698424 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.016s	sys 0.024s
I20260709 13:20:41.703567 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:41.710387 14227 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 20: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:41.754521 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.017s	sys 0.024s
I20260709 13:20:41.685380 20902 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:41.762581 20902 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:41.763980 21355 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.738821 21452 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:41.766243 21452 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.766742 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:41.767655 14227 raft_consensus.cc:2410] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:41.746307 21467 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.768162 14221 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:41.768565 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:41.726310 21475 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:41.723390 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:41.771435 14227 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:41.772961 14298 raft_consensus.cc:2410] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 16 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:20:41.776300 14224 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:20:41.724949 21309 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:41.671599 21242 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:41.724943 21431 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:41.727694 14369 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:41.693508 21311 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:41.633134 14899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1569) took 1767 ms (client timeout 2180 ms). Trace:
I20260709 13:20:41.633021 21366 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:41.799639 21311 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:41.678925 14304 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:20:41.801841 14304 pending_rounds.cc:85] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 11
I20260709 13:20:41.802131 14304 pending_rounds.cc:107] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:20:41.802379 14304 raft_consensus.cc:2889] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:41.802860 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2877) took 1319 ms. Trace:
I20260709 13:20:41.747555 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:41.746537 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.037s	sys 0.079s
I20260709 13:20:41.803272 14229 rpcz_store.cc:276] 0709 13:20:40.483342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.544531 (+ 61189us) service_pool.cc:224] Handling call
0709 13:20:40.544929 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.180009 (+635080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.802592 (+622583us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400052154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:41.802801 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1430191872}
W20260709 13:20:41.803963 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.037s	sys 0.080s
I20260709 13:20:41.557489 14121 catalog_manager.cc:5697] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 8 to 15, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 15 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:20:41.751642 20383 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:41.751001 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 89485.3us
I20260709 13:20:41.819069 20383 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.819474 14193 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:41.819677 20383 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:41.753980 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:41.755072 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 885129us
I20260709 13:20:41.755362 14267 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:41.757970 21216 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:41.759305 21414 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:41.761224 21506 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:20:41.761057 21332 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:41.766587 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:41.835100 14222 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.718289 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:41.836825 14226 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:41.838377 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:41.695035 21433 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:41.769938 14901 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 22: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:41.778334 14227 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:20:41.769166 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:41.841181 14221 raft_consensus.cc:2410] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:20:41.781935 14896 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.011s	sys 0.043s
W20260709 13:20:41.842080 14896 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.012s	sys 0.043s
I20260709 13:20:41.734723 21504 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:41.746567 21478 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.006s	sys 0.025s
I20260709 13:20:41.793840 21459 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:41.794467 21411 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:41.795461 14899 rpcz_store.cc:269] 0709 13:20:39.865851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.987360 (+121509us) service_pool.cc:224] Handling call
0709 13:20:41.632912 (+1645552us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54005d07d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:41.633061 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263568768}
I20260709 13:20:41.797830 14297 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:41.804574 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.752570 21375 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:41.818135 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:41.821144 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 65838.6us
I20260709 13:20:41.796268 21309 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.823776 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:41.768471 21452 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:41.824617 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 70759.8us
I20260709 13:20:41.821703 21104 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.828042 14224 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:41.828164 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47074 (request call id 2818) took 1562 ms. Trace:
I20260709 13:20:41.854166 14370 rpcz_store.cc:276] 0709 13:20:40.265399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.367612 (+102213us) service_pool.cc:224] Handling call
0709 13:20:41.827935 (+1460323us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003c37d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:41.828087 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2523522816}
I20260709 13:20:41.789503 21193 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:20:41.827575 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:41.777892 21481 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:41.830672 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.877683 14376 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:20:41.831521 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.832809 14371 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: [19.14-19.14]
W20260709 13:20:41.805838 21148 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.013s	sys 0.050s
I20260709 13:20:41.807601 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.886699 14226 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:41.886961 14372 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:41.846161 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:41.791113 21240 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:41.876088 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:41.849251 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:41.858757 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:41.890638 14892 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:41.858560 21504 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.848701 21243 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:41.859491 21459 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.860288 21411 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.872685 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:41.826716 21431 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:41.826648 21374 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:41.875321 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51658.4us
I20260709 13:20:41.955628 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:41.875946 14373 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: [17.15-17.15]
W20260709 13:20:41.876890 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49396.8us
I20260709 13:20:41.957609 14222 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:41.830312 21456 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:41.888208 14899 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:41.775449 21473 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.892359 20383 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.889170 21452 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:20:41.876376 21104 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:41.891734 21301 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:41.891891 21148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.014s	sys 0.050s
I20260709 13:20:41.930397 14378 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:41.933331 14372 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:20:41.922109 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 104120us
I20260709 13:20:41.934015 14371 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:41.926680 14370 raft_consensus.cc:1240] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:20:41.925328 14376 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:41.941500 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:41.838644 21216 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:41.941717 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:41.882967 21440 consensus_queue.cc:1059] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:20:41.943161 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:41.945564 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1646) took 1174 ms. Trace:
I20260709 13:20:41.953233 14227 raft_consensus.cc:2393] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:41.976917 20383 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:41.959088 14342 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:41.927248 21332 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:20:41.885846 21309 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:41.938321 21390 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:41.958603 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:41.980878 20383 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:41.926887 21433 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:20:41.927376 21375 consensus_queue.cc:1059] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:20:41.953094 21243 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:41.955148 21414 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:41.998646 21414 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:41.999193 21414 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:41.986768 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:41.999853 21309 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:41.957194 21509 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:42.001608 21414 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:42.002753 21243 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:42.004124 20598 raft_consensus.cc:3055] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:42.004715 20598 raft_consensus.cc:740] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:42.006062 20598 consensus_queue.cc:260] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:42.007668 20598 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:42.017400 21501 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.436s	user 0.003s	sys 0.001s
I20260709 13:20:41.993180 21193 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:41.994040 21327 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:41.966363 21301 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:41.993057 21242 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:41.975893 14223 rpcz_store.cc:276] 0709 13:20:40.771121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.877164 (+106043us) service_pool.cc:224] Handling call
0709 13:20:40.895607 (+ 18443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:40.910961 (+ 15354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.911017 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:40.967275 (+ 56258us) log.cc:844] Serialized 26 byte log entry
0709 13:20:41.550249 (+582974us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:20:41.564213 (+ 13964us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.564408 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.564480 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.945230 (+380750us) raft_consensus.cc:1685] finished
0709 13:20:41.945266 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.945478 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39281,"prepare.queue_time_us":13704,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":3917,"raft.queue_time_us":19854,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":28617,"thread_start_us":522567,"threads_started":1,"wal-append.queue_time_us":834032}
I20260709 13:20:41.966190 21478 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:42.022706 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:42.023533 21104 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:41.978845 21481 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:42.044363 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:42.046269 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:41.993199 21375 raft_consensus.cc:3055] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:42.069371 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:42.068666 21478 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.045572 21420 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:20:42.032992 21337 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.068387 21301 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:42.004175 21243 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:42.162922 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 116840us
I20260709 13:20:42.170869 14892 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:20:42.167863 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:42.175431 14374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.014s	sys 0.010s
I20260709 13:20:42.042258 21500 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:42.176374 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2814) took 2285 ms. Trace:
W20260709 13:20:42.176916 14374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.015s	sys 0.010s
I20260709 13:20:42.034138 21156 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:20:42.058288 21438 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:42.197165 14224 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:42.057883 21422 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:20:41.992970 21216 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:42.192730 14222 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:20:42.045512 21240 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.128s
I20260709 13:20:42.110893 21375 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:42.172055 21327 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.171705 21478 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:42.184079 14375 rpcz_store.cc:276] 0709 13:20:39.891960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.155430 (+263470us) service_pool.cc:224] Handling call
0709 13:20:40.217713 (+ 62283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:40.322872 (+105159us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:40.322903 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:40.417720 (+ 94817us) log.cc:844] Serialized 26 byte log entry
0709 13:20:40.766092 (+348372us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:40.766154 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.493329 (+727175us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:42.175961 (+682632us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002599d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:42.176022 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:42.176070 (+    48us) raft_consensus.cc:1685] finished
0709 13:20:42.176086 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.176293 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250852480,"thread_start_us":347849,"threads_started":1,"wal-append.queue_time_us":472759}
I20260709 13:20:42.176831 21451 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:42.239158 14224 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
W20260709 13:20:42.187956 21234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.002s	sys 0.016s
I20260709 13:20:42.243361 20598 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.243937 20598 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:42.209657 14220 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:20:42.212633 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1576) took 1414 ms. Trace:
I20260709 13:20:42.255025 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:42.258139 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:42.261946 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:42.263511 20598 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:42.253870 14896 rpcz_store.cc:276] 0709 13:20:40.799013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.799250 (+   237us) service_pool.cc:224] Handling call
0709 13:20:40.799632 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:40.800007 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.800036 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:40.804461 (+  4425us) log.cc:844] Serialized 26 byte log entry
0709 13:20:41.164160 (+359699us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:41.844690 (+680530us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.846575 (+  1885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.846660 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:42.016952 (+170292us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b2400330f68. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9e259c4 00007f8de9e23acb 00007f8de9fdedc9 00007f8de9fdea55 00007f8de9fde09d 00007f8decc1010e 00007f8decc2788c 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221
0709 13:20:42.205211 (+188259us) raft_consensus.cc:1685] finished
0709 13:20:42.212356 (+  7145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.212553 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10246,"prepare.queue_time_us":825292,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":7581,"raft.queue_time_us":7331,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":32464,"spinlock_wait_cycles":52850432,"thread_start_us":888489,"threads_started":2,"wal-append.queue_time_us":637558}
I20260709 13:20:42.179764 21337 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:42.243077 21500 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:42.244486 21438 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.250053 21234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.002s	sys 0.017s
W20260709 13:20:42.279495 21444 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.003s
I20260709 13:20:42.263182 21193 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:42.357890 14300 raft_consensus.cc:2410] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:20:42.357023 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 480978us
I20260709 13:20:42.305171 21504 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:42.242910 21327 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:42.351984 21501 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:20:42.355468 21336 consensus_meta.cc:287] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.953s	user 0.003s	sys 0.010s
I20260709 13:20:42.367415 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:42.375801 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 520378us
I20260709 13:20:42.378644 14192 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:42.381443 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:42.382145 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:42.382951 14298 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:20:42.384356 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:42.385074 14298 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:42.387863 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:42.382421 14295 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:42.369309 21444 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:42.513732 14228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.008s	sys 0.024s
W20260709 13:20:42.515954 14228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.009s	sys 0.024s
W20260709 13:20:42.517599 14895 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.020s	sys 0.023s
W20260709 13:20:42.518216 14195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.013s	sys 0.020s
W20260709 13:20:42.530314 14195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.013s	sys 0.020s
I20260709 13:20:42.372004 21473 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:42.532753 14895 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.020s	sys 0.023s
I20260709 13:20:42.532807 20383 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.377099 21193 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:42.305043 21375 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:42.375202 21459 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:42.396967 21468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.030s
W20260709 13:20:42.414374 21355 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.001s
I20260709 13:20:42.351552 21438 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:42.346786 21500 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:42.389607 21504 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:42.525986 14377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.013s	sys 0.021s
I20260709 13:20:42.394435 21475 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:42.389763 21336 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:42.528237 14267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.010s	sys 0.026s
W20260709 13:20:42.528316 14373 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.013s	sys 0.030s
I20260709 13:20:42.513873 21444 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:20:42.397430 21446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.009s	sys 0.029s
I20260709 13:20:42.533342 20383 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:42.394241 21290 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:42.533952 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1521) took 1064 ms. Trace:
I20260709 13:20:42.413796 21419 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:42.623163 14900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.011s	sys 0.035s
I20260709 13:20:42.600631 20902 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.731189 14900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.012s	sys 0.036s
W20260709 13:20:42.548363 21431 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.020s	sys 0.029s
I20260709 13:20:42.394436 21374 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 13:20:42.214684 14121 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 9 to 12, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 12 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.638306 14303 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:20:42.647758 21422 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.748957 14303 pending_rounds.cc:85] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 12
I20260709 13:20:42.749476 14303 pending_rounds.cc:107] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:20:42.749817 14303 raft_consensus.cc:2889] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:42.641162 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:42.645596 14377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.014s	sys 0.021s
W20260709 13:20:42.649542 14270 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 2.238s (SENT) [suppressed 12 similar messages]
W20260709 13:20:42.650636 14267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.010s	sys 0.026s
W20260709 13:20:42.650789 14373 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.013s	sys 0.030s
W20260709 13:20:42.601274 21468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.008s	sys 0.030s
W20260709 13:20:42.665575 14223 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.000s
I20260709 13:20:42.758458 14223 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:42.674067 14895 rpcz_store.cc:276] 0709 13:20:41.469331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.472916 (+  3585us) service_pool.cc:224] Handling call
0709 13:20:41.473184 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.473390 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:20:41.953657 (+480267us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.533472 (+579815us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.533608 (+   136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.533647 (+    39us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:42.533695 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.533760 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.533895 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":615119,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":106,"thread_start_us":1054411,"threads_started":2}
I20260709 13:20:42.733105 20598 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:42.732069 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1518) took 1263 ms. Trace:
I20260709 13:20:42.741925 14893 raft_consensus.cc:1240] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: [15.15-19.17]
W20260709 13:20:42.751466 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 854932us
I20260709 13:20:42.761833 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:42.760842 14900 rpcz_store.cc:276] 0709 13:20:41.468457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.480255 (+ 11798us) service_pool.cc:224] Handling call
0709 13:20:41.480563 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.480758 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:41.954674 (+473916us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.731707 (+777033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.731761 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:42.731809 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.731885 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.732012 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31945,"prepare.queue_time_us":710221,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":8870,"thread_start_us":1249779,"threads_started":2}
I20260709 13:20:42.747478 21375 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:42.742523 21433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.013s	sys 0.049s
W20260709 13:20:42.738142 21311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.016s	sys 0.018s
W20260709 13:20:42.738466 21240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.012s	sys 0.018s
W20260709 13:20:42.672516 21446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.009s	sys 0.030s
I20260709 13:20:42.650214 21355 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:42.672196 21444 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:42.737116 21431 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.020s	sys 0.029s
I20260709 13:20:42.773624 20383 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:42.808596 20383 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.809182 20383 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:42.791102 21433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.014s	sys 0.049s
I20260709 13:20:42.743924 20902 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:42.774338 14892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.018s	sys 0.021s
W20260709 13:20:42.827122 14892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.018s	sys 0.021s
W20260709 13:20:42.774058 14229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.017s	sys 0.018s
W20260709 13:20:42.827950 14229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.017s	sys 0.018s
W20260709 13:20:42.786811 21424 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.339s	user 0.011s	sys 0.001s
I20260709 13:20:42.829352 21424 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:42.828048 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1532) took 1327 ms. Trace:
I20260709 13:20:42.830207 14121 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.830803 14892 rpcz_store.cc:276] 0709 13:20:41.500569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.183547 (+682978us) service_pool.cc:224] Handling call
0709 13:20:42.205903 (+ 22356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.206165 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:42.245030 (+ 38865us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.827659 (+582629us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.827726 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:42.827783 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.827855 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.827993 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1316,"prepare.queue_time_us":45079,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4890,"raft.queue_time_us":814,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":1474,"thread_start_us":582262,"threads_started":1}
I20260709 13:20:42.633352 21459 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:42.740366 21419 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.794958 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:42.804821 21240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.012s	sys 0.018s
I20260709 13:20:42.731609 21290 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.771457 21422 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:42.831123 21515 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:20:42.813920 21431 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:42.868530 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1640) took 1098 ms. Trace:
I20260709 13:20:42.858177 21290 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:42.813019 21355 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:42.876900 21536 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.856389 14894 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:42.869096 21337 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:42.916246 14892 rpcz_store.cc:276] 0709 13:20:41.770547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.834930 (+1064383us) service_pool.cc:224] Handling call
0709 13:20:42.867878 (+ 32948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.868114 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.868149 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.868204 (+    55us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:20:42.868249 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.868319 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.868456 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:42.923929 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1649) took 1006 ms. Trace:
W20260709 13:20:42.935990 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.022s
I20260709 13:20:42.936384 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:42.939986 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.006s	sys 0.022s
I20260709 13:20:42.942955 14372 raft_consensus.cc:2393] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:42.900512 21472 consensus_meta.cc:287] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.693s	user 0.016s	sys 0.000s
I20260709 13:20:42.939800 14373 rpcz_store.cc:276] 0709 13:20:41.917368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.957063 (+ 39695us) service_pool.cc:224] Handling call
0709 13:20:41.957348 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.957550 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:20:42.751351 (+793801us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.923454 (+172103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.923530 (+    76us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:42.923589 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.923696 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.923854 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1258,"prepare.queue_time_us":23625,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1405,"thread_start_us":941389,"threads_started":2}
I20260709 13:20:42.966291 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:42.966668 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:42.966887 14373 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:20:42.863490 21459 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:42.945536 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:42.947036 21522 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.947902 21468 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.949534 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:42.881511 21374 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:42.915548 20383 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:42.976557 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:42.863780 21419 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:42.978075 14375 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:42.984726 14892 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:20:42.989457 20383 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:42.990198 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:42.983816 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:42.992481 14865 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:42.993955 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:43.013019 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:42.999104 21446 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:42.986085 21522 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:42.994493 21515 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:20:42.987498 21438 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:42.983723 21327 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:43.025765 14193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.015s	sys 0.032s
W20260709 13:20:43.039543 14193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.016s	sys 0.032s
W20260709 13:20:43.040264 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 1.08464e+06us
I20260709 13:20:43.041157 14193 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:20:43.043509 21289 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.014s	sys 0.033s
W20260709 13:20:43.044091 21289 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.014s	sys 0.034s
I20260709 13:20:43.044893 21289 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:43.045610 21289 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:43.046996 14268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.007s	sys 0.012s
W20260709 13:20:43.047434 14268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.007s	sys 0.012s
W20260709 13:20:43.048532 21452 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.010s	sys 0.009s
W20260709 13:20:43.049032 21452 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.010s	sys 0.009s
W20260709 13:20:43.049685 14864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.009s	sys 0.028s
I20260709 13:20:43.021814 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:42.979069 21472 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:42.999779 21500 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:42.997488 14267 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:43.050065 14193 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:43.056811 14864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.009s	sys 0.028s
I20260709 13:20:42.944473 21536 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:43.059046 14867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.005s	sys 0.024s
I20260709 13:20:43.024108 21424 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:43.000626 21374 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.026221 21336 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:42.995609 21468 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.027130 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:43.031929 21446 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:43.067128 14867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.005s	sys 0.024s
W20260709 13:20:43.064373 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 291311us
I20260709 13:20:43.036762 21470 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:43.076834 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 435758us
I20260709 13:20:43.090668 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.081619 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:43.086395 14899 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:20:43.086352 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 88940.6us
I20260709 13:20:43.097689 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:43.075671 21336 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.006937 21431 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.104022 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.120325 14301 raft_consensus.cc:2376] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19. Re-sending same reply.
I20260709 13:20:43.104548 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.105280 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.121364 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:43.108114 14193 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:43.108716 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 459187us
I20260709 13:20:43.070971 21424 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:43.112669 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.119699 14892 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:43.122412 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:43.124150 21516 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
I20260709 13:20:43.124962 21540 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:43.125185 14176 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.002s	sys 0.098s
I20260709 13:20:43.125141 21528 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:43.125953 14176 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.003s	sys 0.098s
I20260709 13:20:43.126534 21549 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:43.126137 21528 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.125916 21540 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.127388 21549 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.129304 21540 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:43.129880 21535 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:20:43.125732 21525 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:43.125125 21534 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.164155 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:43.165477 14298 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:43.129321 21528 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.132232 14295 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:43.126170 21517 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:20:43.089934 21446 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:43.134537 20383 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:43.064559 21504 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:43.138291 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.187070 14301 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:43.137652 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:43.188383 14299 raft_consensus.cc:2410] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:43.101703 21234 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:43.094791 21500 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:43.098040 21327 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:43.112864 21470 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:43.174386 21422 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.113576 20902 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:43.120007 21336 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:43.164062 21530 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.270s	user 0.000s	sys 0.002s
W20260709 13:20:43.186198 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 64898.7us
I20260709 13:20:43.140302 21424 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:43.189569 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:43.194495 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.290277 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:43.227033 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 119000us
I20260709 13:20:43.236720 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:43.291411 14898 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:43.187680 21529 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.297s	user 0.001s	sys 0.001s
I20260709 13:20:43.194494 21234 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.177624 21527 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:43.237118 21548 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:20:43.189359 21355 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:43.237402 21547 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:20:43.238243 21543 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 13:20:43.237803 21555 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:20:43.290664 14892 raft_consensus.cc:2393] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:43.177816 21538 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.314532 21527 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.315277 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:43.292057 14193 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:43.316607 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:43.238811 21433 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:43.227680 21561 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.238677 21419 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.317899 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2889) took 1441 ms. Trace:
I20260709 13:20:43.318267 21419 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.318552 21528 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:43.064148 21475 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:43.283950 21526 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
W20260709 13:20:43.308530 21532 log.cc:927] Time spent T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:20:43.320533 21525 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:43.309118 21459 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:43.236656 21500 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.322328 20383 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:43.323253 21470 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:43.323647 21470 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:43.323998 21500 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:43.324563 21470 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.317931 21561 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.248977 21327 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.318369 14228 rpcz_store.cc:276] 0709 13:20:41.876785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.879063 (+  2278us) service_pool.cc:224] Handling call
0709 13:20:41.922621 (+ 43558us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:41.924035 (+  1414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.924079 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:41.928824 (+  4745us) log.cc:844] Serialized 52 byte log entry
0709 13:20:42.517695 (+588871us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:42.517754 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.519146 (+  1392us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.317655 (+798509us) raft_consensus.cc:1685] finished
0709 13:20:43.317678 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.317841 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":948,"raft.queue_time_us":54783,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":3092,"thread_start_us":562124,"threads_started":1,"wal-append.queue_time_us":861826}
I20260709 13:20:43.321687 21557 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:43.327744 21327 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.314817 21538 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:43.328795 21243 consensus_meta.cc:287] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.145s	user 0.010s	sys 0.003s
W20260709 13:20:43.329916 21533 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:20:43.334419 21468 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.325641 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1533) took 1824 ms. Trace:
I20260709 13:20:43.336266 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:43.335513 14896 rpcz_store.cc:276] 0709 13:20:41.500924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.265505 (+764581us) service_pool.cc:224] Handling call
0709 13:20:42.289709 (+ 24204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.290201 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.290242 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:42.306716 (+ 16474us) log.cc:844] Serialized 26 byte log entry
0709 13:20:42.808505 (+501789us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:42.808547 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.808616 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.325409 (+516793us) raft_consensus.cc:1685] finished
0709 13:20:43.325448 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.325584 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":239999,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":52711,"thread_start_us":429773,"threads_started":1,"wal-append.queue_time_us":648764}
I20260709 13:20:43.338675 21327 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:43.318881 21419 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.344559 14344 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:43.238844 21549 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:43.325405 21478 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.075s	user 0.004s	sys 0.005s
I20260709 13:20:43.339260 21327 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:43.346604 21500 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:43.301306 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.347316 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1523) took 1862 ms. Trace:
I20260709 13:20:43.347700 14299 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:43.347379 21523 consensus_queue.cc:1059] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:20:43.348325 21522 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.349225 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1637) took 1710 ms. Trace:
W20260709 13:20:43.341828 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.283217 21422 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.346951 21327 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:43.333504 21301 consensus_meta.cc:287] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.147s	user 0.007s	sys 0.003s
I20260709 13:20:43.347703 14901 rpcz_store.cc:276] 0709 13:20:41.485129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.520139 (+ 35010us) service_pool.cc:224] Handling call
0709 13:20:43.347120 (+1826981us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54005f64d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:43.347263 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571578752}
W20260709 13:20:43.301749 21517 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:43.179154 21534 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.338922 21374 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.317773 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:43.351322 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:43.426860 14227 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:43.073055 21289 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.349650 14897 rpcz_store.cc:276] 0709 13:20:41.638632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.277064 (+638432us) service_pool.cc:224] Handling call
0709 13:20:42.277545 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.278077 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.278111 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:42.279769 (+  1658us) log.cc:844] Serialized 26 byte log entry
0709 13:20:42.808667 (+528898us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:42.808930 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.809153 (+   223us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.349022 (+539869us) raft_consensus.cc:1685] finished
0709 13:20:43.349043 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.349173 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":228492,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":11875,"thread_start_us":424377,"threads_started":1,"wal-append.queue_time_us":715794}
I20260709 13:20:43.430915 14299 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:43.428532 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:43.432238 14897 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: [16.12-19.13]
I20260709 13:20:43.341747 14898 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:43.282804 21541 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:20:43.355592 21500 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:43.365892 21530 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:43.368775 21290 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.467914 21290 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.371744 21419 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.376511 21456 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:43.469133 21456 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:43.378238 14300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3459) took 1904 ms (client timeout 1905 ms). Trace:
W20260709 13:20:43.472489 14300 rpcz_store.cc:269] 0709 13:20:41.473712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.503816 (+ 30104us) service_pool.cc:224] Handling call
0709 13:20:43.378004 (+1874188us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54001a1654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:43.378177 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953980672}
I20260709 13:20:43.473899 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.474524 14300 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:43.475441 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.354686 21478 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.478104 21541 consensus_queue.cc:1243] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:43.478695 21541 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:43.479027 21541 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:43.479815 21541 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.480505 21411 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.379084 21422 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.481088 21541 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:43.481594 14892 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:43.482745 21422 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.380381 21472 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.302250 21234 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:43.381191 21519 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 13:20:43.302654 21452 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:43.331607 21475 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:43.381699 21539 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:20:43.382596 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1581) took 1902 ms. Trace:
I20260709 13:20:43.499558 14893 rpcz_store.cc:276] 0709 13:20:41.480126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.481253 (+  1127us) service_pool.cc:224] Handling call
0709 13:20:41.481615 (+   362us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:42.761066 (+1279451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.382321 (+621255us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003dac54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:43.382535 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2897486208}
I20260709 13:20:43.381819 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3314) took 1844 ms. Trace:
I20260709 13:20:43.500792 14303 rpcz_store.cc:276] 0709 13:20:41.537644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.572842 (+ 35198us) service_pool.cc:224] Handling call
0709 13:20:41.594194 (+ 21352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.750308 (+1156114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.381515 (+631207us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000db6d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:43.381731 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2400127360}
W20260709 13:20:43.384162 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:43.333535 21444 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.000s
W20260709 13:20:43.397107 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.504761 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:43.398844 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.373484 21536 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.419301 21467 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.477662 21478 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.425221 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:43.387286 21375 consensus_meta.cc:287] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.004s
I20260709 13:20:43.487933 21452 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:43.522647 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:43.350631 21535 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:43.435817 21332 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.417208 21301 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.440923 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1639) took 1780 ms. Trace:
I20260709 13:20:43.525964 14900 rpcz_store.cc:276] 0709 13:20:41.660662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.766961 (+1106299us) service_pool.cc:224] Handling call
0709 13:20:42.771519 (+  4558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.779415 (+  7896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.779456 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:42.783053 (+  3597us) log.cc:844] Serialized 26 byte log entry
0709 13:20:43.080433 (+297380us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:43.080485 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.080562 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.440691 (+360129us) raft_consensus.cc:1685] finished
0709 13:20:43.440714 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.440861 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7450,"raft.queue_time_us":34810,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":18606,"thread_start_us":256914,"threads_started":1,"wal-append.queue_time_us":634401}
I20260709 13:20:43.441442 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1412) took 1061 ms. Trace:
I20260709 13:20:43.441833 21504 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.448570 21424 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.527794 14304 rpcz_store.cc:276] 0709 13:20:42.380262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.380409 (+   147us) service_pool.cc:224] Handling call
0709 13:20:42.380757 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.381096 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:42.945045 (+563949us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.226799 (+281754us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:43.227290 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:20:43.227421 (+   131us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:43.227453 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.227535 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.441223 (+213688us) raft_consensus.cc:1685] finished
0709 13:20:43.441244 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.441370 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121215,"prepare.queue_time_us":693979,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":577983,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":26819,"thread_start_us":674292,"threads_started":2,"wal-append.queue_time_us":494157}
I20260709 13:20:43.517989 21419 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:43.445392 21336 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.456341 21552 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:20:43.457579 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.462296 14296 raft_consensus.cc:2410] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 21 because replica has last-logged OpId of term: 20 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:20:43.463323 21534 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.464167 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.541308 14299 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:43.465386 21500 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:43.486486 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 393476us
I20260709 13:20:43.488272 14300 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:43.502611 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:43.502686 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.543804 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:43.506107 14301 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:20:43.505445 14897 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:43.423161 21246 raft_consensus.cc:3055] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:43.545212 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:43.519703 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.348824 21523 consensus_queue.cc:1243] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:43.503127 21456 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.452747 21446 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.521742 21536 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.532271 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.554165 14304 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:43.453495 21481 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:43.533676 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:43.524271 21452 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:43.538932 14193 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:43.516649 21444 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.524158 21571 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:43.546911 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.529866 20902 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:43.518548 14298 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:43.551543 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2887) took 1679 ms. Trace:
I20260709 13:20:43.534775 21576 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:43.570683 14221 rpcz_store.cc:276] 0709 13:20:41.871862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.872388 (+   526us) service_pool.cc:224] Handling call
0709 13:20:41.872724 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.043239 (+170515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.043288 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:42.043856 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:20:42.578475 (+534619us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:42.578539 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.380984 (+802445us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400332054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:43.381042 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.541504 (+160462us) raft_consensus.cc:1685] finished
0709 13:20:43.541524 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.551481 (+  9957us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40913,"raft.queue_time_us":41330,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11006,"spinlock_wait_cycles":273553792,"thread_start_us":478247,"threads_started":1,"wal-append.queue_time_us":845351}
I20260709 13:20:43.530042 21535 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.530562 21332 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.557946 14222 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:20:43.560119 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:43.560355 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.565711 14223 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:43.573194 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:43.552909 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.574613 14224 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: [16.11-17.12]
W20260709 13:20:43.575475 21366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.774s	user 0.007s	sys 0.014s
I20260709 13:20:43.548292 21472 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.604990 21472 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.581970 21576 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.556905 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:43.607239 14227 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 22: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:43.548256 21246 raft_consensus.cc:740] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:43.578713 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.593142 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:43.574741 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48037.9us
I20260709 13:20:43.554507 21422 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:43.595746 14301 raft_consensus.cc:2410] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:20:43.538206 21419 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.576596 21374 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:43.567257 21522 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:43.559278 21481 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.558976 21523 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.597766 21545 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:43.597996 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.629837 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:43.630367 14303 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
W20260709 13:20:43.599051 21503 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.798s	user 0.010s	sys 0.014s
I20260709 13:20:43.581768 21571 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.592120 21431 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:43.601861 21289 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:43.602698 21560 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:43.603078 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3456) took 3185 ms. Trace:
I20260709 13:20:43.603081 21568 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:43.604242 21473 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:43.605296 21332 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:43.577806 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 44176.1us
I20260709 13:20:43.595963 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:43.615104 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.594101 14221 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:43.617512 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.622952 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:43.608626 21366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.807s	user 0.007s	sys 0.015s
I20260709 13:20:43.651306 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:43.649626 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:43.569198 21375 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:43.566514 21411 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:20:43.612321 21243 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:20:43.638839 14297 rpcz_store.cc:276] 0709 13:20:40.417752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.446746 (+ 28994us) service_pool.cc:224] Handling call
0709 13:20:40.487553 (+ 40807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.846072 (+1358519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.602827 (+1756755us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540022d8d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:43.603015 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3012640512}
I20260709 13:20:43.665371 14302 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:43.665652 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.633703 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:43.667955 14342 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:43.668375 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:43.576841 21478 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:20:43.675841 21478 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:43.676517 21478 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.676970 21478 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:43.679394 21538 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:43.681289 14894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1524) took 2195 ms (client timeout 1725 ms). Trace:
I20260709 13:20:43.636675 21545 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.682727 14896 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: [15.12-18.14]
I20260709 13:20:43.685447 21545 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.686437 21472 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:43.686932 21446 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.570089 21536 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.690398 21536 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.691854 14300 raft_consensus.cc:2410] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:20:43.655964 21459 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:20:43.694250 21411 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:43.647454 21578 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:43.694737 21411 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:43.695226 21411 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:43.696107 21336 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.696750 21336 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:43.697091 21336 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:43.698791 21444 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.704916 21571 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.705190 21332 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.706887 21535 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.709977 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:43.711581 21518 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.854s	user 0.000s	sys 0.002s
I20260709 13:20:43.713519 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1636) took 1909 ms. Trace:
I20260709 13:20:43.714843 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.713913 14377 rpcz_store.cc:276] 0709 13:20:41.804380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.804539 (+   159us) service_pool.cc:224] Handling call
0709 13:20:41.804966 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:41.825885 (+ 20919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.825926 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:41.826429 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:20:42.750904 (+924475us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:42.757585 (+  6681us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.757863 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.757960 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.710947 (+952987us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:43.713211 (+  2264us) raft_consensus.cc:1685] finished
0709 13:20:43.713314 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.713450 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20422,"prepare.queue_time_us":215344,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":54779,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":9697,"spinlock_wait_cycles":15129216,"thread_start_us":919911,"threads_started":1,"wal-append.queue_time_us":1004208}
I20260709 13:20:43.715497 14296 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:43.716655 21536 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.718871 21536 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.719473 21433 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:43.720166 21433 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:43.721344 21536 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.641914 21522 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:43.626559 21481 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:43.723675 21522 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.726101 21499 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:43.726823 21499 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.730193 21556 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:43.730777 21556 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:43.731240 21556 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:43.734941 21582 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:43.737533 21419 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.738029 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2891) took 1860 ms. Trace:
I20260709 13:20:43.738440 14229 rpcz_store.cc:276] 0709 13:20:41.877376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.880645 (+  3269us) service_pool.cc:224] Handling call
0709 13:20:41.881041 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:41.979974 (+ 98933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.980004 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:41.980483 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:20:42.828365 (+847882us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:42.828404 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.737599 (+909195us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x7b54002a1cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:43.737650 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.737697 (+    47us) raft_consensus.cc:1685] finished
0709 13:20:43.737710 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.737965 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2425,"raft.queue_time_us":5901,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":220896512,"thread_start_us":847595,"threads_started":1,"wal-append.queue_time_us":1092867}
I20260709 13:20:43.648815 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:43.639075 21289 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:43.681732 14894 rpcz_store.cc:269] 0709 13:20:41.485431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.485548 (+   117us) service_pool.cc:224] Handling call
0709 13:20:43.681034 (+2195486us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54006bcbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:43.681183 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3090273664}
I20260709 13:20:43.717352 21414 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:43.821394 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:43.718226 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:43.739718 21424 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:43.740546 21301 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:43.644937 21473 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:43.741670 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:43.743363 21576 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.633070 21246 consensus_queue.cc:260] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.617873 21374 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.652622 21156 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:20:43.661190 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:43.646510 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:43.751498 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:43.750813 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:43.810551 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:43.911552 14303 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:43.912158 14894 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:43.828085 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:43.911880 14377 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 12.
W20260709 13:20:43.747929 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 80031.4us
W20260709 13:20:43.704905 14220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2880) took 3219 ms (client timeout 2238 ms). Trace:
I20260709 13:20:43.729472 21499 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:43.822747 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.817646 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:43.821298 21414 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:43.825256 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:43.923331 14378 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:20:43.826680 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 108537us
I20260709 13:20:43.923647 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:43.924505 14270 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:43.827378 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:43.925132 14896 raft_consensus.cc:2376] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19. Re-sending same reply.
W20260709 13:20:43.827878 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 179127us
I20260709 13:20:43.896347 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:43.897241 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:43.899466 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:43.629381 21523 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.670125 21456 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:43.905628 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:43.825322 21322 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:43.902841 21446 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:43.666487 21375 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.921118 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:43.826956 20902 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.928647 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:43.931095 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.946024 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:43.946724 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:43.919337 14229 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:43.932554 14374 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
W20260709 13:20:43.919018 14220 rpcz_store.cc:269] 0709 13:20:40.485052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.631079 (+1146027us) service_pool.cc:224] Handling call
0709 13:20:43.704718 (+2073639us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540026cfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:43.704833 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827218688}
I20260709 13:20:43.949322 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:43.938194 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 269904us
I20260709 13:20:43.650213 21587 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:43.940454 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:43.903149 21571 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:43.806993 21451 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:43.910156 21374 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:43.963824 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:43.962508 14228 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:43.822510 21289 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:43.980103 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:43.982743 14369 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 22: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:43.952327 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.985239 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:43.822089 21193 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:43.963572 14221 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:43.695187 21578 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.920971 21423 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.980100 21446 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:43.962352 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:44.021733 14373 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: [19.11-19.11]
W20260709 13:20:44.025561 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 63285us
I20260709 13:20:43.980248 20902 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.028602 21386 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.940119 21456 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.964792 21473 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:43.979321 21523 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:43.809335 21332 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.934060 21322 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:43.820730 21552 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.140s
I20260709 13:20:43.944692 21431 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:43.821012 21336 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:43.961880 21535 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:43.965332 21587 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:43.988492 21327 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.003s
I20260709 13:20:44.028640 21576 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:44.065330 21468 consensus_queue.cc:1175] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "181bbac22422408c87cd13b7fe3008f9" responder_term: 22 status { last_received { term: 17 index: 12 } last_committed_idx: 12 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 22 index: 15. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:44.017726 21423 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:44.012207 21414 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.035111 21500 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.046577 21422 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:44.050370 21419 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:20:44.076567 21502 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:44.077011 21502 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:44.069546 21446 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.077924 21502 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.078956 21502 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.078855 21481 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:44.050935 21386 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:44.081934 21386 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:44.060770 21587 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.084479 21456 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:44.085387 21414 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:44.073243 21375 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:44.073258 21527 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:44.076015 21578 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:44.093616 21500 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.097051 21423 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:44.098414 21500 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:44.101293 21561 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:44.102200 21422 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.124889 21557 raft_consensus.cc:3055] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:44.125566 21557 raft_consensus.cc:740] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:44.126741 21557 consensus_queue.cc:260] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.128149 21587 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:44.128086 21556 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:44.128121 21557 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.136107 21556 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:44.140125 21587 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:44.174183 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 354687us
I20260709 13:20:43.969810 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:44.180030 14220 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:43.998308 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:43.992960 14229 raft_consensus.cc:2410] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 19 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:20:44.188241 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:43.989045 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54798.3us
I20260709 13:20:44.195248 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:44.027216 14267 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:44.202735 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 175472us
W20260709 13:20:44.203950 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:44.242946 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.208084 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.250058 14228 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:44.251508 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.253366 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.254380 14228 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:20:44.255479 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.211328 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:44.276786 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.276914 14225 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:20:44.211916 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:44.212070 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3315) took 2670 ms. Trace:
I20260709 13:20:44.278333 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:44.278522 14302 rpcz_store.cc:276] 0709 13:20:41.541673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.603300 (+ 61627us) service_pool.cc:224] Handling call
0709 13:20:41.603592 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.666249 (+2062657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.211498 (+545249us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b5400154ad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:44.211856 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4741250432}
I20260709 13:20:44.279120 14225 raft_consensus.cc:2376] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22. Re-sending same reply.
I20260709 13:20:44.280268 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:44.280418 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.214098 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:44.283146 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.284143 14225 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:44.218484 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:44.218883 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:44.219431 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:44.220127 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:44.222708 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:44.225481 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:44.008219 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:44.228843 14220 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:44.230176 14229 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:44.233573 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 56119.1us
I20260709 13:20:44.239372 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:44.245079 14342 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:44.205379 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:44.002923 14372 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:44.343262 14893 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:44.259732 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:44.343997 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:44.344897 14373 raft_consensus.cc:2393] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:44.346140 21553 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:44.346463 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:44.346801 21553 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.987408 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:43.999421 14375 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:20:44.350374 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:44.351467 14375 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:44.351898 21568 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.352490 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:44.353958 21569 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:44.354202 21585 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:44.354331 14221 raft_consensus.cc:2376] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18. Re-sending same reply.
I20260709 13:20:44.354910 21468 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.262813 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:44.355873 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.356405 21522 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:44.356750 14221 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:44.265196 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:44.273012 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 354002us
I20260709 13:20:44.275730 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:44.216215 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:44.286105 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.226902 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.027673 21193 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.278350 14304 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:44.209151 14270 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:44.322894 21322 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.326188 21423 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:20:44.106777 21481 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:44.340330 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.341131 14226 raft_consensus.cc:2376] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19. Re-sending same reply.
I20260709 13:20:44.341718 14301 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.342777 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:43.978245 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:44.355787 21534 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:44.356947 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:44.359443 14298 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:44.345345 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 106415us
I20260709 13:20:44.362542 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:44.347620 14373 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
W20260709 13:20:44.347175 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 102480us
I20260709 13:20:44.365571 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.352767 21568 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.359524 21553 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:44.378153 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.356942 21522 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.385898 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.358212 21569 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.389878 14229 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:44.116571 21507 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:20:44.390836 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 185743us
I20260709 13:20:44.397450 21596 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:44.355790 21468 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:44.401233 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 126730us
I20260709 13:20:44.402168 21536 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:44.402803 21349 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:44.407227 21535 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:44.408589 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:44.068298 21327 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:44.410518 20902 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:44.411158 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.413053 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:44.414305 21472 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:44.415124 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:44.416440 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:44.417374 14193 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:44.420536 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 138384us
I20260709 13:20:44.429526 21456 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:44.449736 14227 raft_consensus.cc:2410] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:20:44.450568 21507 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:44.455391 14300 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:44.537756 14376 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:44.796830 14375 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:44.427065 21322 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:44.797585 14304 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:20:44.736552 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3323) took 1336 ms. Trace:
W20260709 13:20:44.496505 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:44.456108 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 89081.1us
W20260709 13:20:44.630192 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 92985.7us
I20260709 13:20:44.833489 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1665) took 1274 ms. Trace:
I20260709 13:20:44.405494 21534 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:44.476703 14374 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
W20260709 13:20:44.835906 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.840728 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3472) took 1285 ms. Trace:
I20260709 13:20:44.462476 14229 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:44.823685 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 614776us
I20260709 13:20:44.837864 14227 rpcz_store.cc:276] 0709 13:20:43.558540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.359057 (+800517us) service_pool.cc:224] Handling call
0709 13:20:44.833415 (+474358us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:44.839836 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 424901us
I20260709 13:20:44.621486 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1631) took 2781 ms. Trace:
I20260709 13:20:44.646752 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:44.843181 14300 rpcz_store.cc:276] 0709 13:20:43.542357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.433236 (+890879us) service_pool.cc:224] Handling call
0709 13:20:44.455067 (+ 21831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.827057 (+371990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.827323 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.844368 14899 rpcz_store.cc:276] 0709 13:20:41.608817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.986406 (+377589us) service_pool.cc:224] Handling call
0709 13:20:44.390235 (+2403829us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54008674d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:44.390519 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2497129728}
W20260709 13:20:44.727330 21607 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.147s	user 0.003s	sys 0.000s
I20260709 13:20:44.830178 21535 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.730155 21193 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:44.832456 21472 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:44.645767 21414 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.008s
W20260709 13:20:44.727660 21606 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:20:44.858552 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:44.863276 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:44.438763 21522 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:44.646023 21332 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:44.847756 21349 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:44.870122 20902 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:44.848274 21534 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:44.877315 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.477386 21552 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:44.872236 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 455078us
I20260709 13:20:44.881737 14376 raft_consensus.cc:2376] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17. Re-sending same reply.
I20260709 13:20:44.882221 14900 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:44.892168 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3471) took 1350 ms. Trace:
W20260709 13:20:44.873639 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 529775us
I20260709 13:20:44.888017 14373 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:44.876904 21472 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:44.898972 14229 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:44.868646 21569 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:44.857765 21423 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.868922 21535 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:44.907051 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:44.907603 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:44.878575 21596 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:44.875074 21156 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:44.917229 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:44.909243 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.909591 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:44.888011 21478 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.185s	user 0.010s	sys 0.005s
I20260709 13:20:44.910974 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:44.913468 14893 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:44.920135 14369 raft_consensus.cc:1240] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:44.921197 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:44.893364 20902 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:44.899571 21568 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:44.904759 14295 rpcz_store.cc:276] 0709 13:20:43.542105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.324924 (+782819us) service_pool.cc:224] Handling call
0709 13:20:44.325467 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.384763 (+ 59296us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:44.502016 (+117253us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.891421 (+389405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.891680 (+   259us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:44.891763 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.891900 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.892103 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14964,"prepare.queue_time_us":179491,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":23919,"thread_start_us":365031,"threads_started":1}
I20260709 13:20:44.933547 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1646) took 1011 ms. Trace:
W20260709 13:20:44.927488 14895 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.146s	user 0.050s	sys 0.059s
I20260709 13:20:44.942734 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:44.941099 14893 rpcz_store.cc:276] 0709 13:20:43.922132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.646308 (+724176us) service_pool.cc:224] Handling call
0709 13:20:44.933465 (+287157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.930411 21591 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:44.947539 14298 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
W20260709 13:20:44.952446 14895 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.207s	user 0.050s	sys 0.060s
I20260709 13:20:44.831878 14296 rpcz_store.cc:276] 0709 13:20:43.399891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.716232 (+316341us) service_pool.cc:224] Handling call
0709 13:20:43.716573 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.023883 (+307310us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:44.318471 (+294588us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.611369 (+292898us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.631362 (+ 19993us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.671754 (+ 40392us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:44.703567 (+ 31813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.735993 (+ 32426us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400154854. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:44.736063 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.736297 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76443,"prepare.queue_time_us":178640,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":111,"raft.queue_time_us":58531,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":25690,"spinlock_wait_cycles":706130816,"thread_start_us":349865,"threads_started":2,"wal-append.queue_time_us":133127}
W20260709 13:20:44.954912 21374 consensus_meta.cc:287] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.887s	user 0.012s	sys 0.003s
W20260709 13:20:44.959236 21433 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.198s	user 0.012s	sys 0.008s
I20260709 13:20:44.959022 21374 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.959781 21433 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.954972 14376 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:44.962971 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:44.963618 21473 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.964381 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:44.965051 14376 raft_consensus.cc:3060] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:44.956254 21327 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:44.950222 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:44.942366 20902 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:44.977404 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:44.979563 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 90974.1us
I20260709 13:20:44.980130 21301 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:44.980823 21301 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:44.980913 21433 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:44.979627 14373 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:44.982017 14224 raft_consensus.cc:2368] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19.
I20260709 13:20:44.982357 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:44.983037 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:44.984007 14900 raft_consensus.cc:2410] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:20:44.983855 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:44.967540 21552 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:44.984403 14373 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:44.985877 21414 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:44.986666 21414 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.972776 21528 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:20:44.988054 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1589) took 2038 ms. Trace:
I20260709 13:20:44.991310 21470 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:44.991779 14193 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:44.991946 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:44.992933 14899 raft_consensus.cc:2410] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:20:44.993420 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1644) took 1083 ms. Trace:
I20260709 13:20:44.984422 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1544) took 1169 ms. Trace:
I20260709 13:20:44.993762 14899 rpcz_store.cc:276] 0709 13:20:43.909821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.973248 (+1063427us) service_pool.cc:224] Handling call
0709 13:20:44.993338 (+ 20090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.994210 14900 rpcz_store.cc:276] 0709 13:20:43.815026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.917711 (+1102685us) service_pool.cc:224] Handling call
0709 13:20:44.984341 (+ 66630us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.995191 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:44.995568 21597 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:44.996243 21597 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:44.997450 21597 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:44.998090 21585 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:44.998600 21585 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:44.999725 21585 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.000665 14375 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:45.002274 21614 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.444s	user 0.001s	sys 0.001s
I20260709 13:20:44.995515 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:45.003840 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2840) took 1252 ms. Trace:
I20260709 13:20:45.003926 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1605) took 1074 ms. Trace:
I20260709 13:20:45.004392 14900 rpcz_store.cc:276] 0709 13:20:43.929300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.995115 (+1065815us) service_pool.cc:224] Handling call
0709 13:20:45.003849 (+  8734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.005892 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:45.004261 14371 rpcz_store.cc:276] 0709 13:20:43.752001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.752155 (+   154us) service_pool.cc:224] Handling call
0709 13:20:43.893418 (+141263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:43.901221 (+  7803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.901253 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:43.916832 (+ 15579us) log.cc:844] Serialized 26 byte log entry
0709 13:20:44.456233 (+539401us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:44.499847 (+ 43614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.499950 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:45.001418 (+501468us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:45.003379 (+  1961us) raft_consensus.cc:1685] finished
0709 13:20:45.003399 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.003631 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18109,"raft.queue_time_us":7734,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7852,"spinlock_wait_cycles":70141184,"thread_start_us":356881,"threads_started":1,"wal-append.queue_time_us":617483}
I20260709 13:20:45.007155 14900 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 22: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:45.007992 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:45.009544 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:45.010572 14371 raft_consensus.cc:2410] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:20:45.011468 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:45.012410 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1645) took 1092 ms. Trace:
I20260709 13:20:45.012790 14896 rpcz_store.cc:276] 0709 13:20:43.920056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.010947 (+1090891us) service_pool.cc:224] Handling call
0709 13:20:45.012330 (+  1383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.014864 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:45.015627 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1642) took 1139 ms. Trace:
I20260709 13:20:45.015911 14894 rpcz_store.cc:276] 0709 13:20:43.876756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.014454 (+1137698us) service_pool.cc:224] Handling call
0709 13:20:45.015575 (+  1121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.016955 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:45.017813 14223 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:45.019174 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1661) took 1461 ms. Trace:
I20260709 13:20:45.019609 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1638) took 3380 ms. Trace:
I20260709 13:20:45.019537 14223 rpcz_store.cc:276] 0709 13:20:43.557624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.988722 (+431098us) service_pool.cc:224] Handling call
0709 13:20:45.018965 (+1030243us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b540019afd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:45.019111 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920442624}
I20260709 13:20:45.021104 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:45.021883 21524 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:45.022348 21468 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.023113 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:45.023239 21423 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.024019 14300 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.016316 14373 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:44.920827 21456 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.026876 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:45.027175 21246 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:45.028091 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:45.028829 21456 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:45.029278 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:44.949126 21156 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.029983 14373 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:45.030622 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1597) took 1728 ms. Trace:
I20260709 13:20:45.031111 14892 rpcz_store.cc:276] 0709 13:20:43.301803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.317467 (+ 15664us) service_pool.cc:224] Handling call
0709 13:20:45.030162 (+1712695us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b54004c0254. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:45.030394 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126004096}
I20260709 13:20:45.032145 21156 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:45.032508 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:44.899525 21507 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.033623 14892 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 22: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:45.033746 21507 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:45.034320 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1541) took 1267 ms. Trace:
I20260709 13:20:45.034693 14892 rpcz_store.cc:276] 0709 13:20:43.766581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.032133 (+1265552us) service_pool.cc:224] Handling call
0709 13:20:45.034258 (+  2125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.036417 14892 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:45.037081 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1641) took 1213 ms. Trace:
I20260709 13:20:45.041429 21336 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:45.046739 14374 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:45.047415 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2853) took 1067 ms. Trace:
I20260709 13:20:45.047837 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:45.047806 14369 rpcz_store.cc:276] 0709 13:20:43.979763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.984196 (+  4433us) service_pool.cc:224] Handling call
0709 13:20:43.984499 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.956501 (+972002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.047096 (+ 90595us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b5400170cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:45.047361 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029603712}
I20260709 13:20:45.049391 21290 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:45.049844 21290 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:44.945559 21478 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.050220 14373 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:20:45.050905 21290 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.051520 14373 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:45.052074 21290 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.052289 21478 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:45.053341 21557 consensus_meta.cc:287] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.739s	user 0.013s	sys 0.003s
I20260709 13:20:45.053032 21478 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.054419 21478 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.982542 21500 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.053457 14221 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:45.020140 14895 rpcz_store.cc:276] 0709 13:20:41.638989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.765527 (+1126538us) service_pool.cc:224] Handling call
0709 13:20:42.765942 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.766186 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:42.804220 (+ 38034us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.744996 (+940776us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b1800359c20. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a 00007f8ded096a2a
0709 13:20:45.019070 (+1274074us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:45.019177 (+   107us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:45.019254 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.019377 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.019540 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37269,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"spinlock_wait_cycles":6192512,"thread_start_us":1207732,"threads_started":1}
W20260709 13:20:45.052081 14224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2898) took 1478 ms (client timeout 1788 ms). Trace:
I20260709 13:20:45.011530 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:45.037380 14892 rpcz_store.cc:276] 0709 13:20:43.823594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.035771 (+1212177us) service_pool.cc:224] Handling call
0709 13:20:45.036161 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.036814 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.037009 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.008215 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:44.986176 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:45.059373 14301 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.002s
I20260709 13:20:45.063836 14301 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:45.056540 14897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1604) took 1127 ms. Trace:
I20260709 13:20:45.000097 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:45.057085 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:45.061610 14224 rpcz_store.cc:269] 0709 13:20:43.573724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.615613 (+ 41889us) service_pool.cc:224] Handling call
0709 13:20:45.051813 (+1436200us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002bded4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:45.051988 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3071195904}
I20260709 13:20:45.073333 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:45.064549 14897 rpcz_store.cc:276] 0709 13:20:43.928822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.738069 (+809247us) service_pool.cc:224] Handling call
0709 13:20:45.056476 (+318407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.067955 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1540) took 1301 ms. Trace:
I20260709 13:20:45.085305 14899 rpcz_store.cc:276] 0709 13:20:43.766289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.994761 (+1228472us) service_pool.cc:224] Handling call
0709 13:20:45.067860 (+ 73099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.093405 14295 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:45.074494 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:44.988428 14901 rpcz_store.cc:276] 0709 13:20:42.949341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.416941 (+467600us) service_pool.cc:224] Handling call
0709 13:20:43.417333 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:43.417698 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.417738 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:43.418206 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:20:44.398646 (+980440us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b18004a9fe0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:20:44.861298 (+462652us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:44.873550 (+ 12252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.895097 (+ 21547us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:44.987587 (+ 92490us) raft_consensus.cc:1685] finished
0709 13:20:44.987607 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.987832 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1170,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":10492,"spinlock_wait_cycles":107265280,"thread_start_us":308748,"threads_started":1,"wal-append.queue_time_us":1535497}
I20260709 13:20:45.114503 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1660) took 1539 ms. Trace:
I20260709 13:20:45.117519 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3474) took 1557 ms. Trace:
I20260709 13:20:45.118026 14295 rpcz_store.cc:276] 0709 13:20:43.546032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.946007 (+1399975us) service_pool.cc:224] Handling call
0709 13:20:45.093178 (+147171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.103294 (+ 10116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.103650 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.118419 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:45.119206 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:45.120744 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.122298 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:45.122419 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:45.123780 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:45.124820 14229 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 19: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:45.126411 21327 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:45.126900 21327 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:45.127390 21327 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.129319 21433 raft_consensus.cc:2764] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 13:20:45.131807 21234 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.638s	user 0.010s	sys 0.012s
I20260709 13:20:45.132354 21234 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.133019 14377 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:20:45.093410 21502 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.014s	user 0.010s	sys 0.010s
I20260709 13:20:45.073380 21500 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:44.982061 21301 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.115075 14228 rpcz_store.cc:276] 0709 13:20:43.557384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.392492 (+835108us) service_pool.cc:224] Handling call
0709 13:20:44.418662 (+ 26170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.029510 (+610848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.029542 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:45.029583 (+    41us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:45.029611 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.096738 (+ 67127us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b5400135bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:45.096796 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.096940 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404295424}
I20260709 13:20:44.976811 21374 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:45.140189 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 161796us
I20260709 13:20:45.145069 14221 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:45.142168 14896 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:45.121502 14295 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:45.104156 21423 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:45.147773 14299 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 15: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:45.154800 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.147186 21596 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.148108 14378 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:45.148298 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.154757 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1606) took 1215 ms. Trace:
I20260709 13:20:45.156142 14896 rpcz_store.cc:276] 0709 13:20:43.930031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.013579 (+1083548us) service_pool.cc:224] Handling call
0709 13:20:45.145776 (+132197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:45.153874 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 144132us
I20260709 13:20:45.155267 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1421) took 1716 ms. Trace:
I20260709 13:20:45.157405 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1608) took 1220 ms. Trace:
W20260709 13:20:45.150653 14192 connection.cc:256] RPC call timeout handler was delayed by -1.2030033010000807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:20:45.160491 14893 rpcz_store.cc:276] 0709 13:20:43.930914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.958621 (+1027707us) service_pool.cc:224] Handling call
0709 13:20:45.151074 (+192453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.166139 14375 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
I20260709 13:20:45.167147 14296 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:45.167661 14301 raft_consensus.cc:2393] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:45.168475 21524 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:45.168716 21478 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:45.137326 21414 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:45.173314 14867 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:45.157922 14297 rpcz_store.cc:276] 0709 13:20:43.438444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.284052 (+845608us) service_pool.cc:224] Handling call
0709 13:20:44.284513 (+   461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:44.285421 (+   908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:44.285451 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:44.286239 (+   788us) log.cc:844] Serialized 52 byte log entry
0709 13:20:44.685173 (+398934us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:44.685232 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.685327 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:45.155041 (+469714us) raft_consensus.cc:1685] finished
0709 13:20:45.155064 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.155207 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71788,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":213,"thread_start_us":398448,"threads_started":1,"wal-append.queue_time_us":698466}
I20260709 13:20:45.169135 21524 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.174916 21504 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:45.182559 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:45.183646 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 183665us
I20260709 13:20:44.954293 21349 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.190330 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.191898 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3475) took 1645 ms. Trace:
I20260709 13:20:45.199082 14376 raft_consensus.cc:2468] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:45.193564 14298 rpcz_store.cc:276] 0709 13:20:43.546253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.958329 (+1412076us) service_pool.cc:224] Handling call
0709 13:20:45.144707 (+186378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.179907 (+ 35200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.179936 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:45.184387 (+  4451us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:45.191614 (+  7227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.191690 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.191832 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.176539 21234 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:45.201646 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55649.3us
I20260709 13:20:45.200639 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:45.179186 21568 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:45.214037 14896 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:20:45.219499 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1600) took 1288 ms. Trace:
I20260709 13:20:45.220037 14896 rpcz_store.cc:276] 0709 13:20:43.927209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.156921 (+1229712us) service_pool.cc:224] Handling call
0709 13:20:45.208775 (+ 51854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.214465 (+  5690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.215482 (+  1017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.222211 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:45.209221 21414 raft_consensus.cc:2804] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:45.212828 21500 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:45.223557 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.222630 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:45.186764 21504 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.233433 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:45.237417 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37700 (request call id 1661) took 1001 ms. Trace:
I20260709 13:20:45.237931 14378 rpcz_store.cc:276] 0709 13:20:44.235824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.264632 (+ 28808us) service_pool.cc:224] Handling call
0709 13:20:45.237213 (+972581us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400060ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:45.237354 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765116672}
I20260709 13:20:45.212144 21552 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.241004 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.243235 21156 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:45.246302 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:45.249595 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:45.250301 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:45.250767 14301 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:45.247112 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:45.244374 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:45.258445 21591 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:45.239172 21502 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:45.253928 14867 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:45.260691 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.241638 21468 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:45.243834 21433 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:45.262287 14295 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 20: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:45.240321 21414 raft_consensus.cc:697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:45.222224 21568 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.249289 21156 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:45.289345 14299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3478) took 1700 ms (client timeout 2181 ms). Trace:
I20260709 13:20:45.262133 21502 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:45.268013 21553 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.771s	user 0.005s	sys 0.008s
I20260709 13:20:45.298905 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:45.304823 14223 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:45.294716 14299 rpcz_store.cc:269] 0709 13:20:43.567580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.665298 (+ 97718us) service_pool.cc:224] Handling call
0709 13:20:45.261762 (+1596464us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540020b054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:45.267521 (+  5759us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3389867776}
I20260709 13:20:45.301093 14297 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 21 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:20:45.297575 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:45.308370 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:45.312729 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1607) took 1373 ms. Trace:
I20260709 13:20:45.313354 14892 rpcz_store.cc:276] 0709 13:20:43.930632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.235479 (+1304847us) service_pool.cc:224] Handling call
0709 13:20:45.264137 (+ 28658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.289672 (+ 25535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.289712 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:45.295504 (+  5792us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:45.304086 (+  8582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.304184 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.304376 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.292810 21156 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:45.308889 21569 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:20:45.302909 21502 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:45.322907 21104 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:45.323390 21104 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.323799 21104 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.324744 21327 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.326858 14898 raft_consensus.cc:2410] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:20:45.327188 21504 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:45.327999 21289 consensus_meta.cc:287] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 1.330s	user 0.022s	sys 0.015s
W20260709 13:20:45.328167 14898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1535) took 1564 ms (client timeout 1814 ms). Trace:
I20260709 13:20:45.328501 21289 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:45.328675 14898 rpcz_store.cc:269] 0709 13:20:43.764297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.764523 (+   226us) service_pool.cc:224] Handling call
0709 13:20:45.327929 (+1563406us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54001045d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:45.328105 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3219029760}
I20260709 13:20:45.330646 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1666) took 1768 ms. Trace:
I20260709 13:20:45.330866 21289 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:45.331573 14303 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:45.331892 14220 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:45.332986 14220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2907) took 1617 ms. Trace:
I20260709 13:20:45.333349 14220 rpcz_store.cc:276] 0709 13:20:43.715780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.342330 (+626550us) service_pool.cc:224] Handling call
0709 13:20:45.332780 (+990450us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b5400051754. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:45.332931 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164062080}
I20260709 13:20:45.333946 14226 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:45.334764 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:45.319525 21243 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:45.314138 21553 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.335475 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:45.335775 21610 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.328186 21246 consensus_queue.cc:1059] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:20:45.336421 21610 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.337105 21553 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.337271 14296 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:45.337965 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1426) took 1787 ms. Trace:
I20260709 13:20:45.337863 14227 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:45.338642 21610 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:45.339509 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:45.340307 14220 raft_consensus.cc:2393] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 22: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:45.340343 21512 raft_consensus.cc:3055] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:45.340875 21512 raft_consensus.cc:740] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:45.341253 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:45.333544 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:45.292189 21234 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:45.318534 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 109502us
I20260709 13:20:45.269660 21386 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:45.335233 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1667) took 1772 ms. Trace:
I20260709 13:20:45.338095 21246 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.291867 21591 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:45.345268 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:45.347743 14299 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:45.354908 14892 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 13:20:45.338425 14296 rpcz_store.cc:276] 0709 13:20:43.550375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.336492 (+1786117us) service_pool.cc:224] Handling call
0709 13:20:45.336882 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.337687 (+   805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.337911 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.360291 14223 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:45.384698 14371 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:45.353960 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:45.405589 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.406216 14220 raft_consensus.cc:2410] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:20:45.394332 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:45.344664 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3248) took 1170 ms. Trace:
I20260709 13:20:45.407804 14227 rpcz_store.cc:276] 0709 13:20:44.174130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.852718 (+678588us) service_pool.cc:224] Handling call
0709 13:20:44.880151 (+ 27433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.338736 (+458585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.344436 (+  5700us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b5400341554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:45.344598 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1052157824}
I20260709 13:20:45.346076 14344 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:45.389818 14377 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:45.389031 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:45.343990 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:45.414080 14300 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:45.462766 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3326) took 1455 ms. Trace:
I20260709 13:20:45.347023 14226 rpcz_store.cc:276] 0709 13:20:43.562433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.390344 (+827911us) service_pool.cc:224] Handling call
0709 13:20:45.333744 (+943400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.334410 (+   666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.335017 (+   607us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b5400051750. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:45.335175 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155768192}
I20260709 13:20:45.463228 14299 rpcz_store.cc:276] 0709 13:20:43.951499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.347211 (+1395712us) service_pool.cc:224] Handling call
0709 13:20:45.347550 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.406127 (+ 58577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.406322 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.331048 14222 rpcz_store.cc:276] 0709 13:20:43.562122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.390601 (+828479us) service_pool.cc:224] Handling call
0709 13:20:44.443584 (+ 52983us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:44.452184 (+  8600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:44.452216 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:44.477171 (+ 24955us) log.cc:844] Serialized 52 byte log entry
0709 13:20:44.556446 (+ 79275us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:44.556578 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.559331 (+  2753us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:45.130408 (+571077us) raft_consensus.cc:1685] finished
0709 13:20:45.130426 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.330399 (+199973us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b54002765d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:45.330586 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2788,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":306,"spinlock_wait_cycles":84025088,"thread_start_us":78488,"threads_started":1,"wal-append.queue_time_us":649043}
I20260709 13:20:45.463388 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:45.366554 21411 consensus_meta.cc:287] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.671s	user 0.021s	sys 0.000s
I20260709 13:20:45.473284 14378 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:45.474169 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3324) took 2062 ms. Trace:
I20260709 13:20:45.266219 21433 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:45.333312 21104 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.347539 21246 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.474727 14303 rpcz_store.cc:276] 0709 13:20:43.402849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.912383 (+509534us) service_pool.cc:224] Handling call
0709 13:20:45.291663 (+1379280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:45.331984 (+ 40321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.464650 (+132666us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540020b050. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:45.464794 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3048793344}
I20260709 13:20:45.489691 14369 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:45.477823 21500 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:45.477543 14223 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:45.479660 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:45.264577 21468 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:45.478632 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:45.341755 21452 consensus_meta.cc:287] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 1.770s	user 0.012s	sys 0.008s
I20260709 13:20:45.343727 21234 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:45.484639 14227 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:45.486383 14297 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:45.380571 21366 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:45.492149 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:45.427567 21568 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.357142 21156 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.500067 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3477) took 1950 ms. Trace:
W20260709 13:20:45.504722 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 158797us
I20260709 13:20:45.504801 14297 rpcz_store.cc:276] 0709 13:20:43.549735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.317178 (+1767443us) service_pool.cc:224] Handling call
0709 13:20:45.481681 (+164503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.499737 (+ 18056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.499997 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:45.504009 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 249461us
I20260709 13:20:45.488312 21433 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:45.500458 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:45.507789 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:45.508571 21246 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:45.498497 21366 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.508875 21104 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:45.377737 21535 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.526775 21440 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:45.527392 21617 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:20:45.491806 21411 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.509548 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.509967 21414 consensus_queue.cc:237] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.512070 14224 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:45.512516 14895 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:45.513556 21156 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:45.517028 21472 consensus_meta.cc:287] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
I20260709 13:20:45.373765 21591 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.519374 14301 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:45.521981 14296 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:45.341807 21512 consensus_queue.cc:260] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.536584 14303 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 23: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:45.346926 21386 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.524184 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:45.531188 14298 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:20:45.496781 21468 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.348253 21502 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.532336 14893 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:45.528687 21535 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.492122 21500 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:45.499821 21234 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:45.538440 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 49153.9us
I20260709 13:20:45.539687 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3476) took 1993 ms. Trace:
I20260709 13:20:45.544138 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:45.547246 14298 rpcz_store.cc:276] 0709 13:20:43.546475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.293923 (+1747448us) service_pool.cc:224] Handling call
0709 13:20:45.506036 (+212113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.539434 (+ 33398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.539633 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.544498 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:45.548208 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 204281us
I20260709 13:20:45.529536 21193 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:45.530066 21366 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.550812 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1601) took 1619 ms. Trace:
I20260709 13:20:45.552071 14893 rpcz_store.cc:276] 0709 13:20:43.927528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.161760 (+1234232us) service_pool.cc:224] Handling call
0709 13:20:45.217440 (+ 55680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.540225 (+322785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.546573 (+  6348us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400775e54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:45.546808 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716016896}
I20260709 13:20:45.539621 21332 raft_consensus.cc:2764] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:45.547008 21500 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:45.551159 21507 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
I20260709 13:20:45.541381 21246 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:45.543571 21374 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:45.506683 21452 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.558239 14300 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:45.551403 21440 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:45.562139 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 142815us
W20260709 13:20:45.568275 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60583.5us
I20260709 13:20:45.538723 21472 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.572250 14303 raft_consensus.cc:1240] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
W20260709 13:20:45.573698 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.560266 21411 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:45.575670 14304 raft_consensus.cc:1240] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:45.577235 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3329) took 1622 ms. Trace:
I20260709 13:20:45.578339 14297 raft_consensus.cc:2410] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 17 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:20:45.577868 14303 rpcz_store.cc:276] 0709 13:20:43.952423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.556464 (+1604041us) service_pool.cc:224] Handling call
0709 13:20:45.570360 (+ 13896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:45.574148 (+  3788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.574498 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.559844 21512 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:45.574942 20902 consensus_meta.cc:287] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:20:45.583619 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:45.583998 14894 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 21. Ops: []
I20260709 13:20:45.582304 14193 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:45.587283 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3473) took 2041 ms. Trace:
I20260709 13:20:45.572553 21374 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:45.575124 21327 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:45.592144 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:45.583032 21522 consensus_meta.cc:287] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.665s	user 0.000s	sys 0.012s
I20260709 13:20:45.593042 14304 rpcz_store.cc:276] 0709 13:20:43.545746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.876509 (+1330763us) service_pool.cc:224] Handling call
0709 13:20:44.915795 (+ 39286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.576133 (+660338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.586991 (+ 10858us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54000fdcd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:45.587212 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517094272}
I20260709 13:20:45.598271 14297 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:45.599149 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3488) took 1353 ms. Trace:
I20260709 13:20:45.599494 14297 rpcz_store.cc:276] 0709 13:20:44.245996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.584500 (+1338504us) service_pool.cc:224] Handling call
0709 13:20:45.597924 (+ 13424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.598800 (+   876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.599044 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:45.602139 14193 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:45.603884 21524 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.566965 21440 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.606026 21524 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.606803 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:45.607708 21440 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.608393 21423 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:45.609356 21423 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:45.610061 21423 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:45.610646 21610 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:45.611138 21610 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:45.611505 14369 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:45.611609 21610 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:45.611243 21423 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.612453 21553 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:45.612996 21553 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:45.613334 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.610100 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1643) took 1703 ms. Trace:
I20260709 13:20:45.560680 21193 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.608919 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:45.614500 14894 rpcz_store.cc:276] 0709 13:20:43.906564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.092771 (+1186207us) service_pool.cc:224] Handling call
0709 13:20:45.093203 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.609202 (+515999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.609848 (+   646us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54004c0254. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:45.610043 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126343040}
W20260709 13:20:45.614666 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 520258us
W20260709 13:20:45.621666 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 64794.8us
I20260709 13:20:45.662659 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:45.667069 14303 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:45.589591 21552 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:20:45.572798 21290 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
W20260709 13:20:45.684471 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 97947.3us
W20260709 13:20:45.665863 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 70461.8us
W20260709 13:20:45.679522 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54111.7us
I20260709 13:20:45.609434 21500 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:45.623973 21534 consensus_meta.cc:287] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.706s	user 0.009s	sys 0.001s
I20260709 13:20:45.694319 14300 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:45.698210 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.704929 14297 raft_consensus.cc:2410] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 21 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 16.
I20260709 13:20:45.705982 14298 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:45.656736 21289 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:45.622725 21473 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.659s	user 0.018s	sys 0.014s
I20260709 13:20:45.706475 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:45.700294 14341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.012s	sys 0.025s
I20260709 13:20:45.715373 14304 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:45.715723 14341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.012s	sys 0.025s
I20260709 13:20:45.615464 20902 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.727771 20902 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:45.716102 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 728834us
I20260709 13:20:45.722312 21478 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.722680 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:45.728806 21478 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.730600 21470 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:45.731019 21478 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:45.724825 21585 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:45.725646 21386 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.736188 14341 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:45.737165 21337 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:45.738548 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:45.739511 21337 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:45.739961 21337 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:45.740623 21337 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:45.741998 14370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.005s	sys 0.013s
W20260709 13:20:45.742420 14370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.006s	sys 0.013s
I20260709 13:20:45.725885 14304 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
W20260709 13:20:45.744115 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 65228us
I20260709 13:20:45.746297 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3487) took 1551 ms. Trace:
I20260709 13:20:45.746860 14298 rpcz_store.cc:276] 0709 13:20:44.195218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.558023 (+1362805us) service_pool.cc:224] Handling call
0709 13:20:45.705691 (+147668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.706467 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.746016 (+ 39549us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54003edd50. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:45.746218 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321396992}
I20260709 13:20:45.699692 21552 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:45.620103 21568 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 13:20:45.748732 14193 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:45.752658 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.013s	sys 0.036s
W20260709 13:20:45.788991 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.013s	sys 0.036s
I20260709 13:20:45.752763 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:45.786168 14192 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.016s
I20260709 13:20:45.787954 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:45.789387 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:45.790514 14300 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 19: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:45.618048 21522 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:45.791193 14192 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.000s	sys 0.017s
W20260709 13:20:45.796932 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 554263us
I20260709 13:20:45.799208 14299 raft_consensus.cc:2410] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:20:45.799409 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.716456 21327 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:45.806180 14270 leader_election.cc:400] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19.
I20260709 13:20:45.806636 14270 leader_election.cc:403] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:20:45.618160 21553 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:45.805073 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 61060.1us
I20260709 13:20:45.708745 21534 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.755746 21552 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:20:45.808141 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.753914 21332 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:45.804679 14221 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.006s	sys 0.014s
I20260709 13:20:45.829325 14900 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 21: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:20:45.854035 14221 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.006s	sys 0.015s
W20260709 13:20:45.836534 14228 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.008s	sys 0.010s
I20260709 13:20:45.830304 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:45.851758 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
W20260709 13:20:45.852026 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 243182us
I20260709 13:20:45.797245 21591 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:45.857653 14228 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.008s	sys 0.011s
W20260709 13:20:45.859441 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 120959us
W20260709 13:20:45.867769 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.824959 21502 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:45.868959 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.873849 14300 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:45.823446 21386 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:45.870653 14298 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:45.872468 14341 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:45.876317 14344 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:45.834586 21440 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19.
I20260709 13:20:45.877254 14296 raft_consensus.cc:1240] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:45.827785 21327 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:45.764731 21289 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:45.881553 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:45.882125 14295 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.002s	sys 0.013s
W20260709 13:20:45.875779 21301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.001s	sys 0.048s
W20260709 13:20:45.916611 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 57443.2us
I20260709 13:20:45.916836 14300 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:45.918578 14295 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.002s	sys 0.013s
W20260709 13:20:45.915638 21301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.001s	sys 0.048s
I20260709 13:20:45.920930 14373 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
W20260709 13:20:45.926263 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 100985us
I20260709 13:20:45.927870 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:45.880604 21475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.001s	sys 0.017s
W20260709 13:20:45.930132 21475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.002s	sys 0.017s
I20260709 13:20:45.931125 21327 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.935375 21246 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:45.939097 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:45.939994 21478 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:45.941592 21478 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:45.942180 21478 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:45.944702 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.945658 21478 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:45.946537 21500 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:45.947163 21386 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:45.948210 21386 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.949872 21336 consensus_queue.cc:1059] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:45.950529 21336 consensus_queue.cc:1243] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:45.951105 14303 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:45.951210 21534 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.952168 21336 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:45.952626 21336 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:45.953015 21336 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.954123 21502 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:45.956368 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80180.1us
I20260709 13:20:45.952064 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.957831 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:45.959389 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:45.959640 20902 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:45.949427 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:45.879774 21536 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.003s	sys 0.012s
W20260709 13:20:45.961035 21596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.009s	sys 0.008s
I20260709 13:20:45.876397 21507 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:45.961959 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 251556us
I20260709 13:20:45.964653 14193 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:45.964808 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3327) took 2013 ms. Trace:
I20260709 13:20:45.966090 21552 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:45.967749 21623 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:45.967574 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.970082 21472 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.968667 21193 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.978777 21522 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:45.980849 21468 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:45.929647 14267 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:45.982060 21504 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:45.983055 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 3026) took 1767 ms. Trace:
W20260709 13:20:46.036285 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 283640us
I20260709 13:20:45.885878 21452 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:46.041604 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 112086us
I20260709 13:20:45.984104 21433 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:45.984863 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 112535us
I20260709 13:20:45.985561 21621 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:45.986421 21622 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:45.987232 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 3027) took 1771 ms. Trace:
I20260709 13:20:45.997500 14296 rpcz_store.cc:276] 0709 13:20:43.951835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.534150 (+1582315us) service_pool.cc:224] Handling call
0709 13:20:45.534441 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.881262 (+346821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.964526 (+ 83264us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54000fc8d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:45.964741 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778874240}
W20260709 13:20:46.000900 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 51554.6us
I20260709 13:20:45.997463 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:45.997473 21596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.010s	sys 0.008s
I20260709 13:20:46.005947 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:46.006304 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:46.005774 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:46.007475 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:45.907294 21528 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.014s	sys 0.002s
I20260709 13:20:46.036118 14373 rpcz_store.cc:276] 0709 13:20:44.215690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.052466 (+836776us) service_pool.cc:224] Handling call
0709 13:20:45.052808 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.921300 (+868492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.982806 (+ 61506us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400334d54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:45.982995 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996024192}
I20260709 13:20:46.047324 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:45.996657 20902 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:45.997390 21536 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.004s	sys 0.013s
I20260709 13:20:46.000336 21507 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.006716 21568 raft_consensus.cc:3055] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:45.873442 21374 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:45.996948 21609 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.029s	sys 0.075s
I20260709 13:20:46.125097 14225 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:20:46.001885 21478 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.031524 21290 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:46.005743 21301 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:46.031715 21591 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:46.086561 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:46.084167 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:46.084158 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:46.142791 14227 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:46.085445 14296 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:46.084218 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3489) took 1837 ms. Trace:
I20260709 13:20:46.035748 21504 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:46.099817 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:46.005085 21470 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:46.123445 14297 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:46.153733 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2919) took 1150 ms. Trace:
I20260709 13:20:46.123490 21568 raft_consensus.cc:740] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:46.128757 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:46.093977 21528 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.015s	sys 0.003s
I20260709 13:20:46.074023 21473 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:46.130684 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88690.4us
W20260709 13:20:46.102059 21234 consensus_meta.cc:287] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.002s
I20260709 13:20:46.065306 14370 rpcz_store.cc:276] 0709 13:20:44.216032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.056958 (+840926us) service_pool.cc:224] Handling call
0709 13:20:45.136672 (+ 79714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:45.137200 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.137231 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:45.137707 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:20:45.742868 (+605161us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:45.742924 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.743006 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:45.960050 (+217044us) raft_consensus.cc:1685] finished
0709 13:20:45.960068 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.987172 (+ 27104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2980,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":22967,"thread_start_us":604757,"threads_started":1,"wal-append.queue_time_us":713324}
I20260709 13:20:46.144098 14302 rpcz_store.cc:276] 0709 13:20:44.246298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.281759 (+ 35461us) service_pool.cc:224] Handling call
0709 13:20:46.071768 (+1790009us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54000906d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:46.084147 (+ 12379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3798720768}
I20260709 13:20:46.146621 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1431) took 1118 ms. Trace:
I20260709 13:20:46.199889 14300 rpcz_store.cc:276] 0709 13:20:45.015233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.057611 (+1042378us) service_pool.cc:224] Handling call
0709 13:20:46.100920 (+ 43309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.123544 (+ 22624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:46.125564 (+  2020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:46.133190 (+  7626us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:46.133251 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.133316 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.133445 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:46.022125 21610 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.153642 21472 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.153456 21193 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.122776 21414 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.137399 21290 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.089524 21585 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:20:46.183531 14303 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:46.130221 21609 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.030s	sys 0.076s
I20260709 13:20:46.128289 21507 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.199520 21475 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:46.141747 21502 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:46.141881 21500 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:46.169812 21478 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.099123 20902 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:46.274573 21639 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:20:46.199230 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:46.168874 21243 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:46.275406 21243 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:46.276075 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 76961.7us
I20260709 13:20:46.276558 21243 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.205670 14223 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:46.277690 21246 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:46.278004 21349 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:46.278509 21246 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:46.168474 21332 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:46.214558 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:46.280872 21534 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:46.281087 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 87287us
I20260709 13:20:46.280966 21332 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.282433 14270 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:46.283638 14370 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:46.284806 21534 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:46.285458 21636 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:20:46.286329 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.286387 14304 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 22. Current term is 23. Ops: []
W20260709 13:20:46.202471 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 129660us
I20260709 13:20:46.228818 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1432) took 1213 ms. Trace:
I20260709 13:20:46.244241 14296 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:46.193321 21473 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.188264 14220 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.102970 21522 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 13:20:46.250916 14302 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:20:46.294334 14302 pending_rounds.cc:85] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 13
I20260709 13:20:46.198607 21621 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:46.208250 21591 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.208858 21301 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:46.254621 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 257234us
I20260709 13:20:46.265287 14297 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:46.254563 21502 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:46.169589 14221 rpcz_store.cc:276] 0709 13:20:45.003145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.165134 (+161989us) service_pool.cc:224] Handling call
0709 13:20:45.177765 (+ 12631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.199895 (+ 22130us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:45.854621 (+654726us) log.cc:844] Serialized 14 byte log entry
0709 13:20:46.149197 (+294576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:46.149277 (+    80us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:46.149343 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.149427 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.153637 (+  4210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6569,"prepare.queue_time_us":768231,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":48,"thread_start_us":863497,"threads_started":2}
I20260709 13:20:46.227712 21290 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.266893 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2904) took 2545 ms. Trace:
I20260709 13:20:46.174072 21452 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 13:20:46.325964 14225 rpcz_store.cc:276] 0709 13:20:43.715022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.431491 (+716469us) service_pool.cc:224] Handling call
0709 13:20:44.431892 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:46.133214 (+1701322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.257540 (+124326us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54002774d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:46.260162 (+  2622us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3892736896}
W20260709 13:20:46.269351 14111 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 37975f772fc648329a8acae36d33a345 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 181bbac22422408c87cd13b7fe3008f9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:46.298517 21473 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:46.290235 14303 rpcz_store.cc:276] 0709 13:20:45.015509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.063894 (+1048385us) service_pool.cc:224] Handling call
0709 13:20:46.103727 (+ 39833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.228433 (+124706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.228733 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:46.262512 21500 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:46.292660 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 204889us
I20260709 13:20:46.292593 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.318284 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.294586 14302 pending_rounds.cc:107] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 14.14
W20260709 13:20:46.335240 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45319us
I20260709 13:20:46.358144 14369 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:20:46.311280 14864 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.700s (SENT)
W20260709 13:20:46.364699 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 53487.1us
I20260709 13:20:46.368325 14369 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
W20260709 13:20:46.265595 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.219734 21337 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.373504 21337 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.231659 21472 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.356678 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:46.377524 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.358073 14370 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 23.
W20260709 13:20:46.319720 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 253766us
I20260709 13:20:46.321156 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:46.326613 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:46.381135 14894 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.329113 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.266937 21475 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:46.231392 21193 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.279908 21246 raft_consensus.cc:3055] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:46.194895 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 189056us
I20260709 13:20:46.325688 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:46.298301 21440 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:46.327428 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.306463 21243 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:46.207105 21234 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.358392 14302 raft_consensus.cc:2889] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:46.355703 14111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 299489us
I20260709 13:20:46.382998 14341 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:46.383083 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.384111 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.227248 21414 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.320670 21621 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:46.388362 14378 raft_consensus.cc:2410] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:46.389986 14376 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.401552 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2920) took 1398 ms. Trace:
I20260709 13:20:46.399246 14900 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:20:46.402987 14893 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 22: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:20:46.417922 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 84842.1us
I20260709 13:20:46.314385 21591 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:46.416404 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57255.1us
W20260709 13:20:46.402895 21366 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.840s	user 0.012s	sys 0.000s
I20260709 13:20:46.433974 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.441299 14296 raft_consensus.cc:1240] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:20:46.434237 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.442021 14901 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:46.390723 21289 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:46.454770 21349 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:46.455251 21610 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.387785 21336 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.456727 21502 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.457245 21193 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:46.458143 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.458917 14900 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:46.460654 21663 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:46.461228 21663 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:46.462590 21646 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:20:46.463387 21591 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:46.463616 21663 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:46.464665 21633 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
W20260709 13:20:46.464995 21641 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:20:46.400297 21246 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:46.466114 21440 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.467043 21552 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:46.467289 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 109574us
I20260709 13:20:46.466776 21246 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.468350 21246 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.468459 21414 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:46.469007 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:46.440138 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:46.444975 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.444156 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:46.448702 21337 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:46.449270 21536 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:46.451262 21644 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:46.452308 14898 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:20:46.322422 21470 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.399246 21468 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:46.399495 21535 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:46.453193 21621 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.519029 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3485) took 2602 ms. Trace:
I20260709 13:20:46.433713 21433 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:46.404088 14228 rpcz_store.cc:276] 0709 13:20:45.005496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.165223 (+159727us) service_pool.cc:224] Handling call
0709 13:20:45.179748 (+ 14525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.223921 (+ 44173us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:45.858330 (+634409us) log.cc:844] Serialized 14 byte log entry
0709 13:20:46.082754 (+224424us) log.cc:844] Serialized 14 byte log entry
0709 13:20:46.372183 (+289429us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b1800383f80. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:46.384160 (+ 11977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:46.384213 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:46.401216 (+ 17003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.401330 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.401484 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14979,"prepare.queue_time_us":758500,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":240898,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":26091,"spinlock_wait_cycles":18236800,"thread_start_us":1086160,"threads_started":3,"wal-append.queue_time_us":270727}
W20260709 13:20:46.438898 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 123546us
I20260709 13:20:46.486843 14220 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:46.517396 14376 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:20:46.512473 14898 pending_rounds.cc:85] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 13
I20260709 13:20:46.531163 14898 pending_rounds.cc:107] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:20:46.531450 14898 raft_consensus.cc:2889] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:46.458429 21500 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.335058 21327 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.151s
I20260709 13:20:46.524998 14295 rpcz_store.cc:276] 0709 13:20:43.916731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.342691 (+1425960us) service_pool.cc:224] Handling call
0709 13:20:45.343056 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.343312 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:20:45.919098 (+575786us) log.cc:844] Serialized 14 byte log entry
0709 13:20:46.518365 (+599267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:46.518448 (+    83us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:46.518525 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.518649 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.518896 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":809624,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":5598,"raft.queue_time_us":81908,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":40977,"thread_start_us":1084595,"threads_started":3}
I20260709 13:20:46.458132 21502 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:46.538775 14892 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
W20260709 13:20:46.538938 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 112598us
W20260709 13:20:46.545261 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 63964.1us
I20260709 13:20:46.356870 21504 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.377586 21568 consensus_queue.cc:260] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.548007 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.549777 21478 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.511896 21585 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:46.530898 21636 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:20:46.545351 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:46.419284 21332 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.110s
W20260709 13:20:46.557685 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 88785.3us
I20260709 13:20:46.560899 14901 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:46.563225 14894 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:46.529877 21622 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:46.516229 21644 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:46.564968 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:46.466683 21440 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.579957 14892 raft_consensus.cc:2410] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
W20260709 13:20:46.581703 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 146712us
I20260709 13:20:46.577688 14342 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:46.583206 21512 consensus_meta.cc:287] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.989s	user 0.006s	sys 0.005s
I20260709 13:20:46.470146 21366 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.586001 21665 consensus_queue.cc:1059] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:46.587500 21655 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.154s
I20260709 13:20:46.589200 21327 consensus_queue.cc:1059] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:46.589534 21500 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:46.423727 21656 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.153s
I20260709 13:20:46.466715 21475 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.600338 21246 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.549319 21535 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.624663 14301 raft_consensus.cc:1240] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 20. Current term is 21. Ops: [18.13-20.14]
I20260709 13:20:46.596765 21301 consensus_queue.cc:1059] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:20:46.594241 21663 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:20:46.626742 21663 consensus_queue.cc:1243] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:46.627306 21440 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.631153 21535 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.604346 21585 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:46.634025 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 88764.8us
I20260709 13:20:46.635079 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:46.636899 21337 raft_consensus.cc:3055] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:46.637321 21337 raft_consensus.cc:740] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:46.638777 21366 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.641357 21504 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.642688 21452 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:46.643116 21452 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:46.644101 21452 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:46.645213 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 44624.3us
I20260709 13:20:46.638290 21644 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.649287 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:46.661928 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:46.654922 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 77329.7us
I20260709 13:20:46.656010 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:46.663123 14228 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.658627 21234 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.659452 21301 consensus_queue.cc:1243] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:46.659586 21621 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:46.659873 21336 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:46.661360 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:46.676100 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.666303 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:46.672974 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:46.674556 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1547) took 1524 ms. Trace:
I20260709 13:20:46.601104 21552 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.067s
W20260709 13:20:46.680956 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 45942.6us
I20260709 13:20:46.683876 21366 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:46.684104 14372 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:46.669894 21156 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:46.667809 21663 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:20:46.695995 20902 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.718760 21663 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:46.719164 21663 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:46.719518 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2858) took 1337 ms. Trace:
I20260709 13:20:46.720484 20902 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.720026 21663 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.692180 21423 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:46.721174 21423 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:46.722455 21478 raft_consensus.cc:3055] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:46.722219 21423 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.722828 21478 raft_consensus.cc:740] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:46.723580 21423 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.723812 21478 consensus_queue.cc:260] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.724654 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3328) took 2772 ms. Trace:
I20260709 13:20:46.725430 21243 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.725548 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.726040 14376 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:46.726301 21452 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.728179 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.728906 14373 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:46.729964 21349 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:46.730821 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:46.697916 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 110838us
I20260709 13:20:46.731539 14226 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.733489 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:46.734273 14295 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 22: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:46.734134 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:46.735055 21234 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:46.735366 14304 pending_rounds.cc:85] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 8
I20260709 13:20:46.735715 14304 pending_rounds.cc:107] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:20:46.736159 14304 raft_consensus.cc:2889] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:46.726069 21243 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.702652 21366 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:46.740363 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:46.699223 21535 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.708043 21337 consensus_queue.cc:260] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.712399 21643 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:46.741196 21366 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.741588 21643 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.670362 21621 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:46.744549 21643 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.744261 21621 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.745098 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.745316 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.745481 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.745723 14895 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:46.746315 14892 raft_consensus.cc:2410] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:20:46.748346 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.749150 14897 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 21: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:46.749626 21656 raft_consensus.cc:3055] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:46.750043 21656 raft_consensus.cc:740] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:46.750921 21656 consensus_queue.cc:260] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.751602 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:46.751813 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.752250 14220 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:46.717658 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:46.695204 21246 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:46.753717 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.754420 14373 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:46.754452 14895 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:46.700670 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2918) took 1697 ms. Trace:
I20260709 13:20:46.654912 21290 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.757591 14224 raft_consensus.cc:2368] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21.
I20260709 13:20:46.745580 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.741118 21535 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.735668 21234 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.725039 14301 rpcz_store.cc:276] 0709 13:20:43.952140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.542599 (+1590459us) service_pool.cc:224] Handling call
0709 13:20:45.554861 (+ 12262us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:46.625333 (+1070472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.724396 (+ 99063us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000db6d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:46.724590 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2459439488}
I20260709 13:20:46.753577 14223 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:46.730942 14227 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:20:46.767328 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 211936us
I20260709 13:20:46.767869 14898 raft_consensus.cc:2368] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17.
I20260709 13:20:46.755525 14229 rpcz_store.cc:276] 0709 13:20:45.002889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.125452 (+122563us) service_pool.cc:224] Handling call
0709 13:20:45.339802 (+214350us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b5800002a98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:20:45.339982 (+   180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.564460 (+224478us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:45.907780 (+343320us) log.cc:844] Serialized 14 byte log entry
0709 13:20:46.599607 (+691827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:46.599811 (+   204us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:46.599927 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.700412 (+100485us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54002a1cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:46.700469 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.700606 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":404658,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":147491,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"spinlock_wait_cycles":533986944,"thread_start_us":933099,"threads_started":3,"wal-append.queue_time_us":356869}
I20260709 13:20:46.738489 21468 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:46.712956 21585 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:46.716746 21472 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:46.751953 21656 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:46.759558 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.759977 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:46.781993 14222 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:46.710091 21507 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.763677 14373 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:46.786525 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:46.766530 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 69199.7us
I20260709 13:20:46.731141 21644 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:46.789481 14302 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:20:46.772873 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.769742 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:46.721561 21663 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:46.770159 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:46.779354 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:46.725044 21478 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.730795 21349 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:46.760948 14226 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:20:46.784392 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:46.778995 21246 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.719892 14375 rpcz_store.cc:276] 0709 13:20:45.382611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.443862 (+ 61251us) service_pool.cc:224] Handling call
0709 13:20:45.444344 (+   482us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:45.471968 (+ 27624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.472016 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:45.494518 (+ 22502us) log.cc:844] Serialized 52 byte log entry
0709 13:20:45.874835 (+380317us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:46.322736 (+447901us) log.cc:844] Serialized 14 byte log entry
0709 13:20:46.719054 (+396318us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b54003cc420. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded007733 00007f8ded08cdbf 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c
0709 13:20:46.719108 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.719188 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:46.719225 (+    37us) raft_consensus.cc:1685] finished
0709 13:20:46.719312 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.719463 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69999,"prepare.queue_time_us":590822,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":69459,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":26766,"spinlock_wait_cycles":116007168,"thread_start_us":646037,"threads_started":2,"wal-append.queue_time_us":529040}
I20260709 13:20:46.800735 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:46.804224 14299 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 21: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:46.804868 21507 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.805344 21366 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:46.769559 21468 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:46.679276 14899 rpcz_store.cc:276] 0709 13:20:45.157287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.241631 (+ 84344us) service_pool.cc:224] Handling call
0709 13:20:45.255276 (+ 13645us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:45.470520 (+215244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.470569 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:45.522774 (+ 52205us) log.cc:844] Serialized 78 byte log entry
0709 13:20:45.987221 (+464447us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:46.666900 (+679679us) spinlock_profiling.cc:243] Waited 8.23 ms on lock 0x7b1800493c00. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf
0709 13:20:46.667068 (+   168us) log.cc:844] Serialized 14 byte log entry
0709 13:20:46.667284 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.667370 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:46.667408 (+    38us) raft_consensus.cc:1685] finished
0709 13:20:46.674241 (+  6833us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.674480 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22615,"prepare.queue_time_us":411438,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":158471,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":7829,"spinlock_wait_cycles":18922368,"thread_start_us":703193,"threads_started":2,"wal-append.queue_time_us":757553}
I20260709 13:20:46.827970 21468 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.830875 21290 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.774817 21502 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:20:46.798738 21349 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:46.829438 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.833490 14867 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:46.834748 21349 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.814018 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.818886 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.835918 21349 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:46.836019 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:46.836637 21568 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:46.836045 14373 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
W20260709 13:20:46.837244 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.813571 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.839733 14372 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 23: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:46.822551 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.840562 14370 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.805835 21366 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.842005 21366 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:46.815151 21234 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:46.823616 21535 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:46.851358 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:46.827005 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:46.853068 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.852999 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:46.835074 14297 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:46.838572 14220 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 23.
I20260709 13:20:46.800953 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.854504 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:46.820803 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:46.848886 14373 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:46.850684 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:46.843705 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:46.857755 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.858176 14376 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:46.859071 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.860121 14369 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:20:46.862316 14225 raft_consensus.cc:2410] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:46.866643 14223 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
W20260709 13:20:46.868835 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 48106.3us
I20260709 13:20:46.868992 14375 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:20:46.869686 14375 pending_rounds.cc:85] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 10
I20260709 13:20:46.869481 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:46.869956 14375 pending_rounds.cc:107] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:20:46.870519 14375 raft_consensus.cc:2889] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:46.870832 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:46.769904 21473 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.869882 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.873054 14374 raft_consensus.cc:2410] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:46.867040 14867 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:46.875555 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:46.875557 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:46.875712 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:46.876370 14229 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.876606 14220 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.805763 21243 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:46.876959 14267 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:46.878644 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.878912 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.879951 14372 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:46.883473 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:46.889410 21652 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:20:46.891880 14300 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:46.889599 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.894194 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:46.850355 21336 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:46.895105 21336 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:46.895509 21336 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:46.896823 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:46.819329 21246 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.899813 21246 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:46.859596 21504 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:46.901240 21504 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:46.903366 21504 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:46.903479 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:46.846431 21585 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:46.878042 21411 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:46.904816 21585 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:46.850497 21507 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:46.903626 14224 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 13:20:46.846346 21472 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:46.886250 21193 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:46.907691 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:46.918506 14900 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 21: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:46.910161 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:46.919070 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.914229 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.914136 14223 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:20:46.920748 14369 raft_consensus.cc:2368] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17.
I20260709 13:20:46.921968 14298 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 18. Ops: []
I20260709 13:20:46.924692 14223 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:46.926175 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.935465 14222 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:46.885372 21234 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:46.944096 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:46.945567 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:46.946990 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 69127.8us
I20260709 13:20:46.914996 21535 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:46.948555 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:46.947084 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:46.956589 14220 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:46.966830 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:46.980086 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:46.941740 21652 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:20:46.948071 21507 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:46.948213 21411 raft_consensus.cc:697] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:46.917961 21193 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.974709 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.996258 14374 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:20:46.979123 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 69053.1us
I20260709 13:20:46.961006 14224 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:46.982980 14378 raft_consensus.cc:2368] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18.
W20260709 13:20:46.981012 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.983042 14228 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:46.987598 14222 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:46.987941 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.991222 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:46.993527 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.997490 14867 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:46.943703 21524 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:46.988137 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:47.006840 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:47.003432 14867 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:47.013329 14223 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:47.020407 14867 leader_election.cc:400] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21.
I20260709 13:20:47.020401 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:47.021162 14867 leader_election.cc:403] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:47.021497 14220 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:47.025533 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:47.025864 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45948.9us
I20260709 13:20:47.026832 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:47.028625 14270 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:47.028388 14378 raft_consensus.cc:2376] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23. Re-sending same reply.
I20260709 13:20:47.031206 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:47.032173 14894 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:46.988509 21472 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:47.022816 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:47.044651 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.045359 14373 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 21: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:47.005908 21440 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:46.987737 21535 raft_consensus.cc:697] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:47.042543 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.041666 21243 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:20:47.046031 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.947897 21246 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:20:47.002501 21193 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:47.049312 14375 raft_consensus.cc:2410] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:47.050024 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:46.981511 21666 consensus_queue.cc:1059] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 13:20:47.009229 21534 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:47.041936 21452 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:47.060784 14270 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:47.063325 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:47.071880 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.080814 14373 raft_consensus.cc:2368] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:47.081023 14372 raft_consensus.cc:2393] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 22: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:47.010126 21156 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:20:47.069075 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.029883 21234 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:47.077862 21246 consensus_queue.cc:1243] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:47.091615 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.092511 14378 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:47.093109 21673 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:47.094070 21679 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.094633 21679 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.095144 21635 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:47.095872 21676 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:47.097193 21679 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:47.098374 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1445) took 1132 ms. Trace:
I20260709 13:20:47.098446 21585 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:47.098981 14299 rpcz_store.cc:276] 0709 13:20:45.965681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.996779 (+ 31098us) service_pool.cc:224] Handling call
0709 13:20:47.098158 (+1101379us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54001f7f54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:47.098308 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682738944}
I20260709 13:20:47.042312 21414 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:47.101958 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:47.077225 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.043586 21472 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.973721 21366 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.088729 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.119053 14373 raft_consensus.cc:2410] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:20:47.090349 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.060323 21675 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:47.062614 21569 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:47.077051 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 89010.8us
I20260709 13:20:47.102180 14270 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
W20260709 13:20:47.061998 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.120098 14344 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:47.120860 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.075398 21656 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.060159 21536 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 13:20:47.130774 14344 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:47.131904 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.132510 14373 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 23.
W20260709 13:20:47.138492 21686 log.cc:927] Time spent T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:20:47.125393 21534 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.093698 21673 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:47.141728 14378 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:20:47.101652 21414 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.148612 14374 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:47.104840 21246 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:47.123611 21472 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:47.154908 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.156313 14226 raft_consensus.cc:2468] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 13.
I20260709 13:20:47.104104 21635 raft_consensus.cc:697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 21 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:47.141667 21655 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:47.137161 21440 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:47.157636 21414 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:47.181600 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.191471 14373 raft_consensus.cc:2376] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17. Re-sending same reply.
I20260709 13:20:47.141296 21569 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:47.182255 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:47.193006 14370 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:20:47.154948 21478 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:20:47.238343 14229 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:20:47.193619 21700 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:47.180038 21694 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:47.198378 21689 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:20:47.199879 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:47.242875 14228 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:47.200507 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:47.200978 21678 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:20:47.202816 21534 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:47.206589 21688 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:20:47.187222 21535 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:47.210496 21687 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:20:47.154633 21656 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:47.212505 21366 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:47.131048 21507 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.214821 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:47.215548 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:47.216578 14375 raft_consensus.cc:1275] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:47.253674 14369 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:47.218169 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:47.219321 21440 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.219847 21635 consensus_queue.cc:237] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.220368 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.224543 21243 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21.
W20260709 13:20:47.225163 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.160636 21500 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:20:47.186307 21650 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.623s	user 0.004s	sys 0.001s
I20260709 13:20:47.195089 21655 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:47.183439 21433 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:47.133388 21411 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.230417 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:47.282194 14224 raft_consensus.cc:2410] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 24 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:20:47.230803 21569 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.231693 21673 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:47.239634 14378 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:47.244114 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.244577 14225 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
W20260709 13:20:47.246824 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46400.3us
I20260709 13:20:47.285403 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:47.255772 14374 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 21: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:47.259123 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:47.259671 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.264214 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:47.249995 21290 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:47.289899 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:47.239235 21336 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.280633 14369 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:20:47.282968 14228 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:47.242940 21700 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.291777 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:47.299077 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.287588 14373 raft_consensus.cc:2376] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17. Re-sending same reply.
I20260709 13:20:47.296146 14227 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:47.300309 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.297367 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.297808 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.300985 14378 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:47.301154 14375 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 23.
I20260709 13:20:47.282295 21500 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:47.299671 14374 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:47.302182 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.302526 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.305591 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.306330 14373 raft_consensus.cc:2376] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21. Re-sending same reply.
I20260709 13:20:47.307140 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:47.307508 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:47.307713 14369 raft_consensus.cc:2376] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18. Re-sending same reply.
I20260709 13:20:47.309273 14375 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:47.308049 14373 raft_consensus.cc:2376] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22. Re-sending same reply.
I20260709 13:20:47.295454 21366 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:47.295116 21475 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:47.312237 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.314383 14375 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:47.298676 21673 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:47.320457 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.321214 14378 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:20:47.281190 21193 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.315639 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:47.326653 14370 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:47.316305 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.302099 21700 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:47.322671 21500 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:47.337760 14370 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 24.
I20260709 13:20:47.324668 14369 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:47.310890 21290 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:47.329174 21512 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:20:47.333236 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:47.327489 14374 raft_consensus.cc:2376] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17. Re-sending same reply.
W20260709 13:20:47.342965 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.360800 14373 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:47.363093 14378 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:20:47.363565 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:47.338523 21644 consensus_meta.cc:287] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 13:20:47.373009 21243 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:47.324522 21366 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 21 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:47.358945 14341 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:47.375883 21366 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.357074 21290 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:47.344480 21568 consensus_meta.cc:287] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.004s
I20260709 13:20:47.311409 21675 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:20:47.364912 14369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:33940
I20260709 13:20:47.421412 14369 raft_consensus.cc:606] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:47.421970 14369 raft_consensus.cc:614] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:47.367357 21656 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:47.423046 14896 raft_consensus.cc:2410] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
W20260709 13:20:47.368733 21701 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:47.378300 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.381368 21694 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:47.341331 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:47.424520 21290 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:47.424600 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 83345.1us
I20260709 13:20:47.388289 21644 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:47.427139 21644 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:47.427738 21644 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:47.431038 21512 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:47.431354 21337 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:47.431931 21512 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 24 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:47.433887 21290 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.438678 14222 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:47.439322 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.411401 21663 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:47.411484 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 48025.6us
I20260709 13:20:47.365222 21655 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:47.413892 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 102057us
I20260709 13:20:47.377367 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:47.436347 21290 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:47.447645 21452 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.448236 21452 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:47.450505 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 73234.3us
I20260709 13:20:47.451584 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:47.452929 21656 raft_consensus.cc:2764] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:20:47.453102 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:47.445650 21534 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.454416 21534 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.455523 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:47.456812 21534 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:47.457144 21336 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:47.445453 21663 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:47.459210 21663 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:47.460769 21663 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:47.464836 21647 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:47.466223 21568 consensus_queue.cc:1048] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:47.466624 21647 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:47.467083 21647 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:47.467701 14344 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:47.468046 21647 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.433187 21512 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.464926 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:47.474009 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.474181 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:47.469460 21647 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:47.480237 14222 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:47.480497 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:47.476758 14341 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:47.478513 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:47.487810 14229 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:47.488592 14341 leader_election.cc:400] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 16. Current term is 17.
I20260709 13:20:47.490340 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.491006 14369 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:47.492244 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:47.493153 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:47.500413 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:47.478462 21336 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:47.482566 21522 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:47.507481 21568 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:47.523038 14229 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:47.525683 14302 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:47.510763 14297 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:47.460716 21472 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.527488 21585 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:47.502380 21673 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:47.533728 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 45267.9us
I20260709 13:20:47.494637 20902 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:47.492957 21502 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:47.558981 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.560011 14369 raft_consensus.cc:2393] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 23: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:47.549327 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.504246 21423 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:47.530148 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:47.528267 21246 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.575511 21246 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.520356 21473 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:47.508754 21702 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:47.578327 21702 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.578709 21702 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:47.551949 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:47.571403 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.572247 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:47.574515 14378 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:20:47.579636 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3336) took 2404 ms. Trace:
I20260709 13:20:47.590399 14298 rpcz_store.cc:276] 0709 13:20:45.175376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.135221 (+959845us) service_pool.cc:224] Handling call
0709 13:20:46.135736 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.922377 (+786641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.579389 (+657012us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54001a0ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:47.579577 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807680768}
I20260709 13:20:47.583029 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:47.583837 14373 raft_consensus.cc:2376] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18. Re-sending same reply.
I20260709 13:20:47.584645 14900 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:47.586817 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:47.589197 14378 pending_rounds.cc:85] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 10
I20260709 13:20:47.596315 14378 pending_rounds.cc:107] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:20:47.596594 14378 raft_consensus.cc:2889] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:47.581961 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:47.509903 21679 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.052s
W20260709 13:20:47.613929 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.639554 14373 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:20:47.649336 14373 pending_rounds.cc:85] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 10
I20260709 13:20:47.649590 14373 pending_rounds.cc:107] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:20:47.649852 14373 raft_consensus.cc:2889] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:47.650238 14373 pending_rounds.cc:107] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:20:47.556974 21475 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:20:47.650406 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:47.650501 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:47.651175 14225 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:47.651734 21475 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:47.593365 21246 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:47.554253 21522 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:47.556385 21478 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:20:47.582702 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:47.593710 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:47.627835 14899 pending_rounds.cc:85] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 14
I20260709 13:20:47.626533 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:47.640688 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 124823us
I20260709 13:20:47.656278 14378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:33940
I20260709 13:20:47.657305 14378 raft_consensus.cc:606] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:47.657691 14378 raft_consensus.cc:614] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:47.640908 21679 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:47.641626 21452 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:47.641918 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.641425 21336 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:47.643532 21472 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:47.556604 21673 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:47.582597 21591 raft_consensus.cc:2764] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:20:47.607184 20902 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:47.609036 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:47.615325 14892 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:47.605446 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:47.669396 14229 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:47.613725 21193 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:47.638667 21700 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.650473 14373 raft_consensus.cc:2889] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:47.512002 21414 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.657696 14864 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:47.658699 14899 pending_rounds.cc:107] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:20:47.675581 14225 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:47.675881 14899 raft_consensus.cc:2889] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:47.561966 21675 consensus_queue.cc:1059] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
W20260709 13:20:47.649762 21690 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.553s	user 0.005s	sys 0.000s
I20260709 13:20:47.678646 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:47.679343 14378 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 23.
I20260709 13:20:47.662128 21336 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.684430 14894 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:47.686928 14892 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:20:47.648859 21676 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.026s	sys 0.026s
I20260709 13:20:47.661288 21679 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:47.698171 14267 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:47.699118 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.700505 14229 raft_consensus.cc:2468] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
W20260709 13:20:47.700980 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 206602us
I20260709 13:20:47.703761 20902 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:47.706287 14895 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 24: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:47.682721 21336 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:47.727037 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 69399us
W20260709 13:20:47.719874 21676 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.027s	sys 0.026s
I20260709 13:20:47.706990 21656 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:47.727662 21528 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:47.726698 21675 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:47.694454 21193 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:47.833078 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:47.835959 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:47.857374 14892 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:47.836858 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 114541us
I20260709 13:20:47.727314 21337 consensus_queue.cc:1059] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:20:47.845151 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1450) took 1074 ms. Trace:
I20260709 13:20:47.869375 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2875) took 1145 ms. Trace:
I20260709 13:20:47.871377 14371 rpcz_store.cc:276] 0709 13:20:46.723504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.727252 (+  3748us) service_pool.cc:224] Handling call
0709 13:20:46.727616 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:46.782896 (+ 55280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:46.782929 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:46.800647 (+ 17718us) log.cc:844] Serialized 26 byte log entry
0709 13:20:46.986204 (+185557us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:46.986244 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.986310 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:47.576810 (+590500us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:47.868917 (+292107us) raft_consensus.cc:1685] finished
0709 13:20:47.868961 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.869293 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39297,"raft.queue_time_us":51737,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":15866,"spinlock_wait_cycles":12418816,"thread_start_us":146880,"threads_started":1,"wal-append.queue_time_us":256945}
I20260709 13:20:47.834457 21478 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:47.879724 14296 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:47.883585 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 331681us
I20260709 13:20:47.841743 21528 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.870206 21472 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:47.866317 21655 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:47.895107 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 59234us
I20260709 13:20:47.843686 21675 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:47.766242 21522 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:47.870383 21322 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.867151 21193 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:47.880959 21337 consensus_queue.cc:1243] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:47.867131 20902 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:47.888893 21528 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:47.892383 21468 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:47.956427 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 60316.9us
I20260709 13:20:47.906298 21478 raft_consensus.cc:3055] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:47.965116 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:47.910411 21193 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:47.925426 14898 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:47.884370 21694 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:20:47.957574 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:47.982336 14229 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:47.961161 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:47.968516 21663 consensus_meta.cc:287] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.507s	user 0.017s	sys 0.001s
I20260709 13:20:47.903244 21655 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:48.000185 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.995102 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:48.000607 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:48.001312 14222 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:20:48.002151 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:47.964498 21700 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:47.998888 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 86179.7us
I20260709 13:20:47.965667 21478 raft_consensus.cc:740] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:48.006541 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:47.906648 21714 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:20:47.910126 21322 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.010663 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:48.019501 14223 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
W20260709 13:20:48.005801 21666 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.014s	sys 0.028s
I20260709 13:20:48.011777 14225 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:48.016988 14229 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 24.
I20260709 13:20:47.989889 21673 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:48.003698 21414 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:48.006812 21500 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:20:47.976012 21621 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:48.024130 21655 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:48.030565 21712 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:20:48.031416 21710 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:20:48.032274 21709 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:20:48.032770 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 67792us
W20260709 13:20:48.065143 21644 consensus_meta.cc:287] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.007s
I20260709 13:20:48.036289 14270 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:48.064774 21647 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:48.074360 14893 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:48.004190 21568 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:48.003958 21569 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:20:48.013329 21512 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.041354 21290 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.041564 21322 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:48.004041 21702 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:48.014518 21708 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:20:48.080981 21512 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.093449 21512 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:48.055195 14377 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
I20260709 13:20:48.061657 14892 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:47.907240 21679 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.157402 21679 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.072616 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:48.004783 21675 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.038995 20902 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:48.063362 21666 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.015s	sys 0.028s
W20260709 13:20:48.076287 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.070870 21500 consensus_queue.cc:1243] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:48.064476 21478 consensus_queue.cc:260] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.184449 21478 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.018736 21452 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:48.187932 14376 raft_consensus.cc:2410] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:20:48.188155 21452 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.098508 21702 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:48.077267 21694 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.114490 21411 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:48.102345 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 2927) took 1246 ms. Trace:
I20260709 13:20:48.196681 14226 rpcz_store.cc:276] 0709 13:20:46.855883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.855970 (+    87us) service_pool.cc:224] Handling call
0709 13:20:48.102079 (+1246109us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54002a17d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:48.102233 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514914048}
I20260709 13:20:48.081192 21290 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:48.100565 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1682) took 1764 ms. Trace:
I20260709 13:20:48.110191 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:48.128244 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:48.076339 21673 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:48.140566 21535 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:48.102481 21647 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:48.073995 21644 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.101974 21322 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.123445 21528 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:48.133232 21193 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.145874 14375 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:48.147537 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:48.229102 14370 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:48.133065 21336 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.229964 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:48.163239 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 90710.6us
I20260709 13:20:48.231024 14298 raft_consensus.cc:2393] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 20: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:48.175503 21534 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:48.181319 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:48.182399 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:48.240629 14228 raft_consensus.cc:2393] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 13: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:48.202234 14225 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: [16.11-18.12]
I20260709 13:20:48.203034 14221 rpcz_store.cc:276] 0709 13:20:46.342954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.729878 (+386924us) service_pool.cc:224] Handling call
0709 13:20:46.730171 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.744163 (+ 13992us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:46.884396 (+140233us) log.cc:844] Serialized 14 byte log entry
0709 13:20:47.106137 (+221741us) log.cc:844] Serialized 14 byte log entry
0709 13:20:47.106346 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:47.106391 (+    45us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:47.106443 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.435523 (+329080us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b18000d9a80. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:47.726856 (+291333us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b18000d9a80. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f6d2a6 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419
0709 13:20:48.100302 (+373446us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54002765d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:48.100352 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:48.100501 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2120,"prepare.queue_time_us":232999,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":15197,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":11871,"spinlock_wait_cycles":119499648,"thread_start_us":358846,"threads_started":2,"wal-append.queue_time_us":333360}
I20260709 13:20:48.218842 14227 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:48.219676 14222 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:20:48.221065 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 226067us
I20260709 13:20:48.218350 21569 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:48.232308 14270 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:48.218545 21673 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:48.249439 14896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1555) took 1847 ms (client timeout 1535 ms). Trace:
W20260709 13:20:48.238682 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.008s	sys 0.036s
W20260709 13:20:48.261937 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.008s	sys 0.036s
W20260709 13:20:48.262739 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 669054us
I20260709 13:20:48.264154 14192 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:48.261678 14896 rpcz_store.cc:269] 0709 13:20:46.402097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.411863 (+  9766us) service_pool.cc:224] Handling call
0709 13:20:48.249165 (+1837302us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54007e7cd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:48.249349 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190106496}
I20260709 13:20:48.243398 14867 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:48.267831 14897 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:48.254352 14297 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:48.256453 14295 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:48.266908 14270 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:48.200109 20902 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:20:48.260625 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:48.274719 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:48.275734 14297 raft_consensus.cc:2410] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:20:48.277187 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 195173us
I20260709 13:20:48.277464 14295 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:20:48.278101 14295 pending_rounds.cc:85] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 13
I20260709 13:20:48.278371 14295 pending_rounds.cc:107] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:20:48.278621 14295 raft_consensus.cc:2889] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:48.278890 14192 leader_election.cc:400] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17.
I20260709 13:20:48.268263 14867 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:48.280073 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:48.280656 14302 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.281152 14901 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:20:48.280781 14297 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:48.282451 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:48.282622 14295 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:48.207020 21694 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:48.283516 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:48.286693 14304 raft_consensus.cc:2368] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 23. Current term is 24.
I20260709 13:20:48.286438 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:48.245908 21534 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.300218 14297 pending_rounds.cc:85] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 13
I20260709 13:20:48.300665 14297 pending_rounds.cc:107] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:20:48.300927 14297 raft_consensus.cc:2889] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:48.269678 21673 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.307459 14370 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
W20260709 13:20:48.304198 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 195901us
I20260709 13:20:48.309363 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:48.276891 21234 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:48.265569 21504 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:20:48.311206 14220 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:48.311692 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 158402us
I20260709 13:20:48.232314 21322 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.318929 21676 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:48.319680 21676 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:48.281482 21568 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:48.304234 21534 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:48.240670 21535 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:48.348726 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 76803.4us
I20260709 13:20:48.434211 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:48.345029 21663 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:48.359320 21730 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:20:48.364354 21644 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:48.365849 21290 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:48.371476 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 93239.1us
I20260709 13:20:48.310777 21731 raft_consensus.cc:2804] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:48.379276 21668 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:48.446746 21668 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.383265 21472 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:48.448098 21472 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:48.448923 21472 consensus_queue.cc:1243] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:48.385035 21694 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:48.386371 21528 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:48.332834 14270 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:48.447247 21668 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:48.435871 14302 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:48.432277 21522 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:48.303613 21720 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.160s
W20260709 13:20:48.461170 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 145587us
I20260709 13:20:48.463156 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:48.464639 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 131939us
W20260709 13:20:48.465807 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 156544us
I20260709 13:20:48.364251 21452 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:48.473753 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:48.455930 21656 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.482193 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:48.483767 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:48.484313 14375 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:48.485708 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:48.323566 21725 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.154s
I20260709 13:20:48.323074 21647 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.463246 21731 raft_consensus.cc:697] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:48.473062 21473 raft_consensus.cc:2804] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:48.478029 21740 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:48.519922 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 208375us
I20260709 13:20:48.478835 21522 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 24 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:48.462006 21290 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:20:48.526698 14193 leader_election.cc:400] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 23. Current term is 24.
I20260709 13:20:48.527119 14193 leader_election.cc:403] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:48.555521 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 69879.3us
W20260709 13:20:48.551824 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 60013.1us
I20260709 13:20:48.515363 21234 raft_consensus.cc:697] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:48.565315 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:48.568255 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:48.502213 21744 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:20:48.510149 21656 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.588092 14375 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 24.
I20260709 13:20:48.604074 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:48.604832 14375 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:48.595624 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.595652 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:48.606662 14892 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:48.553073 21246 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.544880 21694 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.598814 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:48.611802 14900 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:48.624953 14892 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 24.
I20260709 13:20:48.577334 21472 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:20:48.629159 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:48.632679 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:48.636904 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:48.565223 21739 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:48.640103 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:48.664772 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:48.637599 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:48.666791 14897 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 21: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:48.587769 21635 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:48.646535 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 119752us
I20260709 13:20:48.670892 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:48.671792 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:48.671844 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 151091us
I20260709 13:20:48.662930 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:48.673857 14899 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:48.646863 14375 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 24.
I20260709 13:20:48.627848 21702 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.517946 21676 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:48.694478 14894 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:20:48.673087 14193 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:48.700635 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:48.681231 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:48.682754 14900 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:48.702507 14375 raft_consensus.cc:2368] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 23. Current term is 24.
W20260709 13:20:48.651111 21742 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:20:48.545073 21568 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.703881 14375 raft_consensus.cc:1217] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 11.8->[13.9-17.11]   Dedup: 13.9->[15.10-17.11]
I20260709 13:20:48.528169 21740 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.710170 14267 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:48.701433 14227 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:48.729995 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:48.645612 21725 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:48.655354 21762 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:48.651221 21729 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:48.735754 21591 raft_consensus.cc:3060] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:20:48.637511 21246 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:48.713650 21752 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.655617 21731 consensus_queue.cc:237] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.723626 14375 pending_rounds.cc:85] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 9
I20260709 13:20:48.763935 14899 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:48.764052 14375 pending_rounds.cc:107] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:20:48.722291 21569 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.638600 21694 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:48.748088 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 313994us
W20260709 13:20:48.730505 21478 consensus_meta.cc:287] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.545s	user 0.013s	sys 0.001s
I20260709 13:20:48.764554 14375 raft_consensus.cc:2889] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:48.739024 21475 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:20:48.775559 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 65475.4us
I20260709 13:20:48.783820 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:48.740873 21322 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:48.747802 21290 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:48.790640 14900 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:48.747983 21535 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:48.636332 21473 raft_consensus.cc:697] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:48.694078 21702 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:48.795773 14192 leader_election.cc:400] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18.
I20260709 13:20:48.815790 14192 leader_election.cc:403] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:20:48.800125 21726 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.704s	user 0.005s	sys 0.000s
W20260709 13:20:48.808686 21746 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.291s	user 0.000s	sys 0.000s
W20260709 13:20:48.810293 21717 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.817s	user 0.002s	sys 0.000s
I20260709 13:20:48.668670 21522 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:48.842442 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 46845.8us
I20260709 13:20:48.843453 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:48.848342 21756 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18.
I20260709 13:20:48.851011 21668 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:48.851601 21740 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:48.852357 21740 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:48.852890 21740 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:48.853487 21765 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.790860 21475 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.855723 21780 raft_consensus.cc:2804] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:48.856218 21475 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:48.856377 21780 raft_consensus.cc:697] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 24 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:48.857074 21475 raft_consensus.cc:2764] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader election decision vote started in defunct term 23: won
I20260709 13:20:48.841977 21290 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:48.859742 21747 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.729921 21234 consensus_queue.cc:237] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.815213 21535 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.784987 21569 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:48.867576 21673 consensus_meta.cc:287] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.004s
I20260709 13:20:48.897317 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:48.758410 21751 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.173s
W20260709 13:20:48.917095 21746 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:20:48.769490 21752 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:48.915138 21673 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.925966 21475 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:48.854125 21765 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:48.758327 21729 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.976011 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:48.946471 21761 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:20:48.952800 21534 consensus_meta.cc:287] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.001s
I20260709 13:20:48.894753 21535 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:48.952018 21473 consensus_queue.cc:237] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:48.990216 14302 raft_consensus.cc:1240] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:20:48.994589 21569 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:48.994831 21673 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:48.991199 14303 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 21: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:48.983183 14341 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.132:33137 timed out after 1.659s (SENT) [suppressed 39 similar messages]
W20260709 13:20:48.991523 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 61405us
I20260709 13:20:48.880997 21747 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:49.000563 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:48.948256 21733 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:48.857523 21780 consensus_queue.cc:237] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:48.999158 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:48.953112 21656 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.005153 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:49.020015 21478 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:49.021695 21752 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:48.949151 21740 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.022323 21765 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.024124 21762 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:49.024714 21762 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.018885 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:48.984265 21475 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:49.055604 14893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50016 (request call id 1661) took 1475 ms (client timeout 1659 ms). Trace:
W20260709 13:20:49.056398 14893 rpcz_store.cc:269] 0709 13:20:47.579752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:47.582773 (+  3021us) service_pool.cc:224] Handling call
0709 13:20:49.055322 (+1472549us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400624b54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:49.055503 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108061440}
I20260709 13:20:48.999420 21534 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:49.031229 21569 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.025851 21773 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:49.091459 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 72631.1us
I20260709 13:20:49.039341 21673 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.998921 21290 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.114032 14296 raft_consensus.cc:1240] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:49.120949 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 145035us
I20260709 13:20:49.092195 21522 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.097132 21694 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:49.124610 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 141460us
I20260709 13:20:49.123391 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:49.133024 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.109512 21535 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.036855 21788 consensus_queue.cc:1059] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.088s
W20260709 13:20:49.130111 14192 connection.cc:256] RPC call timeout handler was delayed by -1.3567398800000774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:20:49.144259 21478 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:49.115717 21702 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.147891 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.133288 21773 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:49.150437 14371 raft_consensus.cc:2393] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:49.108883 21569 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:49.152441 21775 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:20:49.152576 21729 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.152922 21475 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:49.153220 21754 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:20:49.154376 21774 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:20:49.113009 21673 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:49.165827 14227 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:20:49.167387 21789 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:49.180825 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.168491 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.169032 21771 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:49.169520 21743 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:49.169914 21734 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:49.162648 21788 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:49.171686 21767 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:20:49.178187 21475 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.172305 14893 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:49.194655 21475 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:49.184667 21535 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:49.195575 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.173130 21502 raft_consensus.cc:3055] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:49.173458 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:49.197322 21502 raft_consensus.cc:740] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:49.205621 21731 consensus_queue.cc:1059] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:49.207046 21731 raft_consensus.cc:3055] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:49.178429 14372 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:49.182149 14369 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:49.207495 21731 raft_consensus.cc:740] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:49.208000 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:49.174803 14892 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:20:49.208376 21731 consensus_queue.cc:260] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.186009 14295 raft_consensus.cc:1240] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:49.208298 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:49.190490 14377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 3038) took 2360 ms (client timeout 1891 ms). Trace:
W20260709 13:20:49.170822 21745 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:20:49.209650 14377 rpcz_store.cc:269] 0709 13:20:46.813615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.813722 (+   107us) service_pool.cc:224] Handling call
0709 13:20:49.174125 (+2360403us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b540039b7d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:49.174239 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918647552}
I20260709 13:20:49.210790 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3275) took 1019 ms. Trace:
I20260709 13:20:49.211040 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.211159 14223 rpcz_store.cc:276] 0709 13:20:48.191117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.202725 (+ 11608us) service_pool.cc:224] Handling call
0709 13:20:48.219857 (+ 17132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:48.232616 (+ 12759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:48.232666 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:48.233313 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:20:48.448616 (+215303us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:48.448834 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:48.856886 (+408052us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b54002bcfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:48.856945 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:49.210509 (+353564us) raft_consensus.cc:1685] finished
0709 13:20:49.210529 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:49.210732 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6579,"raft.queue_time_us":1972,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":26275,"spinlock_wait_cycles":9516800,"thread_start_us":150335,"threads_started":1,"wal-append.queue_time_us":707427}
I20260709 13:20:49.212303 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:49.190784 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:47.867622 14301 rpcz_store.cc:276] 0709 13:20:46.771127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:47.477875 (+706748us) service_pool.cc:224] Handling call
0709 13:20:47.509190 (+ 31315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:47.509395 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:47.535082 (+ 25687us) log.cc:844] Serialized 14 byte log entry
0709 13:20:47.844567 (+309485us) log.cc:844] Serialized 14 byte log entry
0709 13:20:47.844756 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:47.844810 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:47.844871 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.844944 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.845083 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36998,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":130,"raft.queue_time_us":14801,"thread_start_us":308701,"threads_started":1}
I20260709 13:20:49.213382 14229 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:49.209647 14369 raft_consensus.cc:2376] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23. Re-sending same reply.
I20260709 13:20:49.214880 21591 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 23. Current term is 24.
I20260709 13:20:49.214702 21795 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:20:49.197089 21475 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.199340 21778 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:49.199550 21569 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:49.174610 14898 raft_consensus.cc:1240] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:20:49.203461 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.173498 21781 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.223326 14304 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:49.204216 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.206619 21502 consensus_queue.cc:260] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:49.183378 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 60071.5us
I20260709 13:20:49.209105 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 3061) took 2165 ms. Trace:
I20260709 13:20:49.198750 14864 leader_election.cc:400] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 23. Current term is 24.
I20260709 13:20:49.224527 14864 leader_election.cc:403] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:20:49.197708 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.185695 14371 raft_consensus.cc:2393] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 21: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:49.225981 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:49.134155 21522 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.221053 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:49.212996 14227 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:49.228315 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:49.232474 14864 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:49.233774 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.229969 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:49.224423 14372 rpcz_store.cc:276] 0709 13:20:47.043971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:47.100487 (+ 56516us) service_pool.cc:224] Handling call
0709 13:20:49.174318 (+2073831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:49.207619 (+ 33301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:49.208877 (+  1258us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b540039b7d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:49.209004 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4713255296}
I20260709 13:20:49.180503 21193 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.215888 21591 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:49.246165 21698 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:49.222136 21635 raft_consensus.cc:3055] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:49.246272 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984"
dest_uuid: "cebb34ac155340899a38c728707ddc0d"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:58440
I20260709 13:20:49.254801 14893 raft_consensus.cc:606] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:49.255177 14892 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:49.255307 14893 raft_consensus.cc:614] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:49.256491 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.256810 14896 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:49.257619 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.253746 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.258410 14897 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:49.258793 14300 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:49.231792 21789 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:49.260455 14192 connection.cc:256] RPC call timeout handler was delayed by -1.2343398800001069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 13:20:49.262594 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:49.264242 14220 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:49.233532 21647 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.266203 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.271090 14300 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:49.267280 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.247072 21472 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:49.238091 21569 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 23. Current term is 24.
I20260709 13:20:49.247102 21502 raft_consensus.cc:3060] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:49.268216 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:49.249454 21731 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:49.246783 21698 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:49.192750 21771 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.246379 21591 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.286123 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:49.286237 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:49.316156 14897 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:49.287722 14226 raft_consensus.cc:1240] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:49.254405 21635 raft_consensus.cc:740] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:49.272063 21478 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.297014 21468 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:49.299245 14295 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:20:49.305446 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:49.306218 21782 log.cc:927] Time spent T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 13:20:49.307114 21776 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:49.223966 21788 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:49.309820 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:49.331133 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.310209 21729 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.310827 21698 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:49.310982 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.312148 21673 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.216806 21734 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:49.320495 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 51313.9us
I20260709 13:20:49.271773 21747 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.216202 21743 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.280512 21472 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.293766 21762 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.339926 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:49.231478 21781 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:49.322552 21468 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:49.331408 21694 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.380057 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.249153 21440 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:20:49.333906 21656 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.280781 21647 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.335682 21679 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.360811 21673 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:49.331017 21478 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:49.420007 21673 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.421401 21478 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.348297 21502 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.422152 21673 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.422593 21502 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.351799 21773 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:49.424918 21502 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.424732 21773 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.426455 21781 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.388393 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:49.428160 14227 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:49.349984 21732 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.349074 21534 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.395496 21468 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.400992 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:49.407138 21734 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:49.385983 21694 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:49.342344 21729 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.363583 21472 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:49.414179 21741 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.414779 21655 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:49.414955 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.415459 21336 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.415889 21656 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.416960 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:49.418005 21647 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.418396 21679 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:49.419407 21733 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.384042 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.485889 14893 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:49.431020 14296 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:49.439175 21440 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:49.441488 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 155426us
I20260709 13:20:49.447199 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:49.409458 21743 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.470410 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.422252 21478 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:49.480309 14378 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 21: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:49.435168 14224 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:20:49.494218 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:49.497336 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.504463 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.506934 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:49.479895 21655 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:49.510417 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 168483us
W20260709 13:20:49.497365 21786 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:20:49.511341 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:49.516229 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.521458 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.523988 14342 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:49.512698 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:49.526881 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.529264 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.449322 21732 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:49.544740 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.541327 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:49.545473 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.545758 14378 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:49.547555 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:49.519652 21468 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:49.548827 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:49.559608 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:49.560263 14225 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 23.
I20260709 13:20:49.561084 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:49.551051 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.562443 14302 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 23: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:49.561185 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.563354 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.563979 14302 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
I20260709 13:20:49.553197 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.566123 14298 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:49.554138 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:49.501842 21733 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.567037 14227 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:49.526441 14372 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:49.564963 14378 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:49.568547 14225 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:49.486603 21741 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.572117 14893 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:49.497814 21440 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.574536 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.580943 14301 raft_consensus.cc:2393] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:49.582480 14378 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 13:20:49.573637 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 81958.6us
I20260709 13:20:49.577072 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:49.586301 14225 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:20:49.586423 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:49.587196 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:49.587775 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 63859.7us
I20260709 13:20:49.576092 14893 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:49.579404 14372 raft_consensus.cc:1275] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:49.589948 14893 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.613157 14298 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
W20260709 13:20:49.611223 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 134303us
I20260709 13:20:49.616122 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:49.574980 21800 log.cc:927] Time spent T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.001s
I20260709 13:20:49.613904 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:49.489356 21635 consensus_queue.cc:260] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.572372 21722 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.630782 14225 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:49.628350 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:49.633817 21784 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:49.636941 14192 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:49.631227 14378 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:20:49.616653 21475 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.650054 21679 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:49.650720 21771 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.637630 21773 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:49.650349 21475 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:49.629550 21591 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.644321 14867 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:49.650202 21826 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:49.690457 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46237.6us
W20260709 13:20:49.647061 21814 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:20:49.648008 21805 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:20:49.699628 21826 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:49.700430 21819 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:20:49.701929 21792 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
W20260709 13:20:49.703708 21808 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:49.704931 21733 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.705087 21502 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:49.707850 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 70998.5us
I20260709 13:20:49.705502 21502 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.710033 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.648873 21656 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.707531 21591 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:49.654459 21788 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:49.646296 21810 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:49.654384 21647 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:49.720453 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.639106 21778 consensus_queue.cc:1048] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:20:49.718806 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1708) took 1146 ms. Trace:
W20260709 13:20:49.711791 21764 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:20:49.651227 21679 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:20:49.722035 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.797336 21741 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.797475 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:49.792667 21814 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:49.798233 14378 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:49.797272 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:49.799322 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.799898 14378 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 15.
W20260709 13:20:49.799970 21789 consensus_meta.cc:287] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.000s
I20260709 13:20:49.800467 21789 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:49.691642 21522 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.725396 14375 rpcz_store.cc:276] 0709 13:20:48.572851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.703199 (+130348us) service_pool.cc:224] Handling call
0709 13:20:48.703634 (+   435us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:49.306443 (+602809us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:49.306790 (+   347us) log.cc:844] Serialized 14 byte log entry
0709 13:20:49.447144 (+140354us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:49.447725 (+   581us) log.cc:844] Serialized 52 byte log entry
0709 13:20:49.447864 (+   139us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:49.448091 (+   227us) log.cc:844] Serialized 14 byte log entry
0709 13:20:49.476834 (+ 28743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:49.476906 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:49.704833 (+227927us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b180003b920. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f522 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:49.718546 (+ 13713us) raft_consensus.cc:1685] finished
0709 13:20:49.718586 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:49.718746 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":491628,"prepare.queue_time_us":2326,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":3488,"raft.queue_time_us":498339,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":15433,"spinlock_wait_cycles":11514752,"thread_start_us":139955,"threads_started":1,"wal-append.queue_time_us":240353}
I20260709 13:20:49.716920 21502 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:49.643559 21722 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.793725 14222 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:49.620482 21655 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:49.727963 21591 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:49.800745 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:49.719236 21826 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:20:49.808789 14193 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:49.915346 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.915732 14304 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:49.923256 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:49.925565 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 116851us
I20260709 13:20:49.926597 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:49.792200 21512 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:49.804654 21694 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:49.935827 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.940037 21729 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:49.946472 21815 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:49.931324 21810 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:49.917457 21647 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.952085 14221 raft_consensus.cc:2468] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 24.
I20260709 13:20:49.935103 21655 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:49.956686 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3366) took 1700 ms. Trace:
W20260709 13:20:49.962759 21807 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
I20260709 13:20:49.963537 21668 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:49.996822 14303 rpcz_store.cc:276] 0709 13:20:48.255822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.259257 (+  3435us) service_pool.cc:224] Handling call
0709 13:20:49.956410 (+1697153us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b540022ddd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:49.956606 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610566912}
W20260709 13:20:49.964390 14376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 3047) took 3098 ms (client timeout 1671 ms). Trace:
I20260709 13:20:49.964622 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1573) took 2279 ms. Trace:
I20260709 13:20:49.940673 21750 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:49.998963 14901 rpcz_store.cc:276] 0709 13:20:47.685011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:47.685146 (+   135us) service_pool.cc:224] Handling call
0709 13:20:47.707750 (+ 22604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:48.281830 (+574080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:49.964382 (+1682552us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b5400268ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:49.964572 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307336448}
I20260709 13:20:49.965764 14369 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 13:20:50.000680 14369 pending_rounds.cc:85] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 8
I20260709 13:20:50.001009 14369 pending_rounds.cc:107] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:20:50.001296 14369 raft_consensus.cc:2889] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:50.002494 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 388621us
I20260709 13:20:49.983072 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:49.982668 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 268093us
I20260709 13:20:49.986112 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.915575 21780 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:49.786988 21788 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.136s
W20260709 13:20:49.998202 14376 rpcz_store.cc:269] 0709 13:20:46.866311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.905756 (+ 39445us) service_pool.cc:224] Handling call
0709 13:20:49.964170 (+3058414us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54000609d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:49.964320 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2899574016}
W20260709 13:20:49.983170 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 286095us
I20260709 13:20:49.986066 21815 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:50.038964 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
W20260709 13:20:50.036957 14192 leader_election.cc:336] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Timed out: RequestConsensusVote RPC to 127.12.208.131:41203 timed out after 1.841s (SENT)
I20260709 13:20:50.049350 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:50.044411 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:50.052801 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:49.989145 21810 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.061853 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.066502 14221 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:20:49.987509 21732 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:50.064558 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:50.034716 21818 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 13:20:50.067749 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:50.068740 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.070243 21722 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.070212 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:50.070586 21827 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:20:50.052081 21731 consensus_queue.cc:1059] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:20:50.072606 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.072892 21829 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:50.053462 21815 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:49.981652 21773 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:20:49.984050 21512 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:50.077257 14303 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:50.078282 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.056489 21694 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:50.086356 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49448.1us
I20260709 13:20:50.088011 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:50.085355 14193 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:50.003340 21647 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.090313 14344 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:50.074271 21810 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:50.080494 21698 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.000s
I20260709 13:20:50.077036 21440 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.078066 21478 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:50.078130 21722 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.099656 21811 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.077185 21591 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.16, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.098999 21784 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:20:50.052244 21780 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:50.100279 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.079164 21829 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:50.122328 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:50.133852 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.113554 21246 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:50.105522 21663 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:50.128176 21656 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:50.087404 21694 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.140105 14896 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:20:50.127128 21825 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:50.144279 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 3072) took 1008 ms. Trace:
I20260709 13:20:50.145313 14229 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
W20260709 13:20:50.149413 14297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.011s	sys 0.032s
I20260709 13:20:50.131561 21644 raft_consensus.cc:3055] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:50.100493 21733 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:50.149209 14377 rpcz_store.cc:276] 0709 13:20:49.135755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.212752 (+ 76997us) service_pool.cc:224] Handling call
0709 13:20:49.213070 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:49.213272 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:49.213296 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:49.213758 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:20:49.471898 (+258140us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:49.471974 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:49.472114 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:50.144039 (+671925us) raft_consensus.cc:1685] finished
0709 13:20:50.144062 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:50.144213 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":255742,"threads_started":1,"wal-append.queue_time_us":491984}
W20260709 13:20:50.151374 14297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.011s	sys 0.032s
W20260709 13:20:50.152122 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.009s	sys 0.034s
W20260709 13:20:50.162369 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.009s	sys 0.034s
W20260709 13:20:50.162932 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 533794us
I20260709 13:20:50.094848 21729 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:50.164727 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:50.169816 14342 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:50.146857 21663 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.151602 21694 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:50.148808 21656 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.147138 21829 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:50.134264 21698 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.152572 21644 raft_consensus.cc:740] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:50.138680 21722 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:50.174652 21663 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:50.182955 21780 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:50.182960 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.216117 14298 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:50.224794 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.226405 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.227064 14302 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:50.228099 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.228766 14302 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:20:50.142028 21811 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.237123 21811 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.160984 21825 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.242969 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1638) took 1535 ms. Trace:
I20260709 13:20:50.243402 14899 rpcz_store.cc:276] 0709 13:20:48.708011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.708175 (+   164us) service_pool.cc:224] Handling call
0709 13:20:48.708501 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:48.769749 (+ 61248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.242717 (+1472968us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b5400602054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:50.242903 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127008512}
I20260709 13:20:50.244861 21825 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.250198 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:50.251767 21731 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:50.252183 21731 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:50.252570 21731 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:50.253855 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3510) took 1051 ms. Trace:
I20260709 13:20:50.254328 14304 rpcz_store.cc:276] 0709 13:20:49.201984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.290911 (+ 88927us) service_pool.cc:224] Handling call
0709 13:20:49.332782 (+ 41871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:49.918751 (+585969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.253581 (+334830us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54001559d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:50.253768 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340231040}
I20260709 13:20:50.174018 21656 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:50.257067 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 3073) took 1121 ms. Trace:
I20260709 13:20:50.257525 14369 rpcz_store.cc:276] 0709 13:20:49.136051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.214336 (+ 78285us) service_pool.cc:224] Handling call
0709 13:20:49.965416 (+751080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:50.001950 (+ 36534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.256821 (+254871us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54000609d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:50.256982 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726577920}
I20260709 13:20:50.263823 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.245555 21825 raft_consensus.cc:3060] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:50.169452 21679 consensus_queue.cc:1059] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:20:50.169418 21423 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
W20260709 13:20:50.282748 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.286105 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.290658 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.172344 21729 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.288722 21679 consensus_queue.cc:1243] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:50.308598 14867 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:50.283520 21663 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.284446 21502 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:50.314826 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 224603us
I20260709 13:20:50.326854 14229 raft_consensus.cc:2368] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 21. Current term is 22.
I20260709 13:20:50.328105 21663 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.316018 21679 raft_consensus.cc:3055] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:50.339000 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:50.314576 21778 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:50.343829 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1644) took 1092 ms. Trace:
I20260709 13:20:50.344285 14892 rpcz_store.cc:276] 0709 13:20:49.251927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.252672 (+   745us) service_pool.cc:224] Handling call
0709 13:20:49.252963 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:49.255723 (+  2760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.343546 (+1087823us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5400868154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:50.343766 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4091136}
I20260709 13:20:50.345885 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1635) took 1705 ms. Trace:
I20260709 13:20:50.346342 14894 rpcz_store.cc:276] 0709 13:20:48.640318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.665822 (+ 25504us) service_pool.cc:224] Handling call
0709 13:20:48.675178 (+  9356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:48.694987 (+ 19809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.345643 (+1650656us) spinlock_profiling.cc:243] Waited 8.94 ms on lock 0x7b54007dc3d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08b8ad 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:50.345819 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20558208}
W20260709 13:20:50.347574 14403 heartbeater.cc:646] Failed to heartbeat to 127.12.208.190:37027 (4 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.208.190:37027 timed out after 15.000s (SENT)
I20260709 13:20:50.354749 21674 raft_consensus.cc:3055] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:50.355226 21674 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:50.316989 21512 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:50.357532 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 269570us
W20260709 13:20:50.334050 21812 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:20:50.360952 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:50.297190 21644 consensus_queue.cc:260] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.341921 21679 raft_consensus.cc:740] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:50.312655 21833 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:20:50.360507 21647 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:50.367074 21423 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.417749 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:50.419153 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:50.396757 21732 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.400923 21644 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:50.428100 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 89167.8us
I20260709 13:20:50.409312 21823 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:50.430896 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:50.409417 21756 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:50.436506 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:50.438625 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 3076) took 1264 ms. Trace:
I20260709 13:20:50.441628 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:50.441596 14373 rpcz_store.cc:276] 0709 13:20:49.136870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.230135 (+ 93265us) service_pool.cc:224] Handling call
0709 13:20:49.230494 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:49.312566 (+ 82072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:49.312599 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:49.313092 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:20:49.511963 (+198871us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:49.541429 (+ 29466us) log.cc:844] Serialized 14 byte log entry
0709 13:20:49.960947 (+419518us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b18002bdd40. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:50.189900 (+228953us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b18002bdd40. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:20:50.399552 (+209652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.400432 (+   880us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:50.400490 (+    58us) raft_consensus.cc:1685] finished
0709 13:20:50.400507 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:50.400784 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81668,"prepare.queue_time_us":30742,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":209024,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":7966,"spinlock_wait_cycles":15466240,"thread_start_us":396552,"threads_started":2,"wal-append.queue_time_us":227302}
I20260709 13:20:50.444734 14374 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:50.427666 21663 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:50.412241 21821 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:50.419984 21843 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.447985 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:50.451208 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:50.479748 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:50.493232 14369 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:20:50.494994 14369 raft_consensus.cc:1240] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:50.433810 21478 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:50.450497 14375 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:50.435237 21698 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.382972 21674 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:50.496990 21674 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:50.424903 21423 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:50.505821 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 57906.7us
I20260709 13:20:50.449542 21504 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:50.484493 21842 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:20:50.516803 21839 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:50.427496 21810 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:50.514781 14369 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:20:50.432725 21732 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.502058 21811 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:50.506695 21833 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.529611 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:50.542105 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.541630 21773 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:20:50.545169 21773 consensus_queue.cc:1243] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:50.546648 21795 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:50.547992 21795 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:50.548403 21795 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:50.543912 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:50.545557 21844 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:20:50.552740 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:50.492781 21821 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.549041 21423 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:50.556057 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.521813 21839 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.549430 21795 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:50.546680 21836 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:20:50.561488 21773 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:50.445892 21679 consensus_queue.cc:260] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:50.529424 21663 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.550493 21842 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:50.446362 21722 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:50.561949 21840 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:20:50.522310 21504 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:50.611702 21504 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:50.450352 21475 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:50.578069 21839 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:50.502367 21843 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.578563 21784 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:50.615118 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.616982 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3373) took 1066 ms. Trace:
I20260709 13:20:50.577327 21821 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:50.618706 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:50.643105 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:50.645263 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.557521 21833 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.653100 14377 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:20:50.660527 21835 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.328s	user 0.000s	sys 0.002s
I20260709 13:20:50.661834 21591 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:50.606073 21663 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.662668 21591 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:50.664804 21591 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:50.661875 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2908) took 1393 ms. Trace:
I20260709 13:20:50.665491 14372 rpcz_store.cc:276] 0709 13:20:49.268172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.590825 (+322653us) service_pool.cc:224] Handling call
0709 13:20:49.591129 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:49.693677 (+102548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:49.693710 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:49.694265 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:20:50.142232 (+447967us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:50.142276 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.142352 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:50.659818 (+517466us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:50.661550 (+  1732us) raft_consensus.cc:1685] finished
0709 13:20:50.661572 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:50.661812 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84513,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"spinlock_wait_cycles":11004800,"thread_start_us":492954,"threads_started":2,"wal-append.queue_time_us":584472}
W20260709 13:20:50.668735 21851 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:20:50.676595 21852 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:20:50.682545 21732 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.692548 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3507) took 1491 ms. Trace:
I20260709 13:20:50.693041 14296 rpcz_store.cc:276] 0709 13:20:49.201063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.210674 (+  9611us) service_pool.cc:224] Handling call
0709 13:20:49.211034 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:49.486854 (+275820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.692290 (+1205436us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54001a1154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:50.692475 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505151872}
I20260709 13:20:50.694926 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.695674 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.696354 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.696780 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.697930 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.698129 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.698714 14223 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:50.642926 14297 rpcz_store.cc:276] 0709 13:20:49.550369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.551486 (+  1117us) service_pool.cc:224] Handling call
0709 13:20:49.571991 (+ 20505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:49.578669 (+  6678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:49.578700 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:49.579128 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:20:50.130115 (+550987us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b4800241ed8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
0709 13:20:50.161770 (+ 31655us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:50.161850 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.161946 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:50.613897 (+451951us) raft_consensus.cc:1685] finished
0709 13:20:50.613920 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:50.616901 (+  2981us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8739,"raft.queue_time_us":18744,"raft.run_cpu_time_us":7419,"raft.run_wall_time_us":518717,"spinlock_wait_cycles":16200064,"thread_start_us":541847,"threads_started":1,"wal-append.queue_time_us":712530}
I20260709 13:20:50.708552 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:50.710798 14228 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:50.711697 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:50.709146 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.715075 14270 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:50.647629 21795 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:50.720000 21512 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:50.720728 21512 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.722007 21246 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:50.722215 14228 raft_consensus.cc:2410] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:20:50.722462 21246 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.722939 21246 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:50.723474 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.725533 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1704) took 2158 ms. Trace:
I20260709 13:20:50.725937 14370 rpcz_store.cc:276] 0709 13:20:48.567635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.680671 (+113036us) service_pool.cc:224] Handling call
0709 13:20:48.722124 (+ 41453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:49.004594 (+282470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:49.004628 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:49.004671 (+    43us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:49.004703 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.725313 (+1720610us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002594d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:50.725364 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:50.725476 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649086720}
I20260709 13:20:50.728508 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:50.731887 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:50.732695 21727 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:50.720651 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.698488 21679 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:50.675876 21843 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.737099 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:50.746738 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:50.752650 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:50.692752 21842 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:50.746098 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:50.757771 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:50.755789 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:50.757486 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:50.758919 14376 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:20:50.757395 14371 raft_consensus.cc:2368] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 23. Current term is 24.
I20260709 13:20:50.760720 21863 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:50.739758 21452 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:50.761294 21452 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.761178 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:50.761821 21452 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:50.768181 14371 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:20:50.756495 21733 consensus_meta.cc:287] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.004s
I20260709 13:20:50.798077 14371 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:50.756839 21756 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:50.757426 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:50.782106 21846 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.757746 21535 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:50.782644 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3380) took 1152 ms. Trace:
W20260709 13:20:50.810581 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 53553.8us
I20260709 13:20:50.810631 14298 rpcz_store.cc:276] 0709 13:20:49.630484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.641512 (+ 11028us) service_pool.cc:224] Handling call
0709 13:20:49.641850 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:50.242001 (+600151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.782360 (+540359us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54001a09d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:50.782561 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320046848}
I20260709 13:20:50.754633 21732 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.755949 21784 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:20:50.758999 21656 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:50.794538 21472 consensus_meta.cc:287] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.280s	user 0.007s	sys 0.007s
I20260709 13:20:50.812136 14370 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:50.750154 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:50.819707 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.818936 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.804100 21733 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:50.792186 21833 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.816365 21727 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:50.761305 21863 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.848632 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.849236 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:50.842235 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 92233.2us
I20260709 13:20:50.814090 21846 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.844314 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.853399 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:50.814967 21535 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.851513 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:50.857987 14228 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:50.858213 14300 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:20:50.856281 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:50.856633 14303 raft_consensus.cc:2393] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 21: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:50.823761 21663 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.863435 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:50.848944 21849 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:50.841056 21512 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.867014 14228 raft_consensus.cc:1275] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:20:50.875113 14192 leader_election.cc:400] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 23. Current term is 24.
I20260709 13:20:50.819118 21732 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.860580 21535 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:50.842828 21472 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.864845 21834 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:50.868518 21863 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.873672 21663 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:50.888515 21815 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.797s	user 0.008s	sys 0.005s
I20260709 13:20:50.884424 21834 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:50.906107 14299 raft_consensus.cc:1240] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:50.904703 21815 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.909008 21815 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:50.901801 21825 consensus_meta.cc:287] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
I20260709 13:20:50.916524 21825 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:50.916889 21815 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:50.917651 21815 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:50.918471 21868 log.cc:927] Time spent T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:50.919076 21472 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:50.920568 21815 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:50.920724 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3374) took 1370 ms. Trace:
I20260709 13:20:50.921216 14295 rpcz_store.cc:276] 0709 13:20:49.550679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.551567 (+   888us) service_pool.cc:224] Handling call
0709 13:20:49.551845 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:49.567632 (+ 15787us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:50.403661 (+836029us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b180031b880. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:20:50.492733 (+ 89072us) log.cc:844] Serialized 14 byte log entry
0709 13:20:50.742761 (+250028us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:50.755173 (+ 12412us) log.cc:844] Serialized 26 byte log entry
0709 13:20:50.756111 (+   938us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:50.756157 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.756245 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:50.920437 (+164192us) raft_consensus.cc:1685] finished
0709 13:20:50.920531 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:50.920661 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12194,"prepare.queue_time_us":837357,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":9183,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":48467,"spinlock_wait_cycles":6280064,"thread_start_us":287847,"threads_started":2,"wal-append.queue_time_us":326508}
I20260709 13:20:50.924892 21656 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.882398 21475 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
W20260709 13:20:50.930063 21829 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.743s	user 0.005s	sys 0.007s
I20260709 13:20:50.930526 21829 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:50.933456 21829 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:50.935304 21644 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 13:20:50.939002 21821 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:50.940963 21839 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:50.889160 21846 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:50.990797 14220 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:50.943908 21834 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:50.987953 21804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.045s	sys 0.113s
W20260709 13:20:50.995404 21804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.045s	sys 0.113s
W20260709 13:20:50.994163 21731 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.739s	user 0.011s	sys 0.002s
I20260709 13:20:50.991845 21246 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.076287 21810 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.079032 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:51.081221 21675 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:51.090879 21839 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.014035 21732 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.160989 14297 raft_consensus.cc:1240] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:51.159847 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.163215 14374 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 24.
I20260709 13:20:51.062624 21452 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.015050 21731 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.001055 21535 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.190318 14376 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
W20260709 13:20:51.196060 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.196492 14342 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:51.189610 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:51.168130 21765 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:51.196863 21864 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:51.207978 21246 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.208832 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:51.200821 14295 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:20:51.202675 21804 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:51.217526 21804 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.217905 21804 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:51.166111 21821 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:51.221472 21502 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:51.222123 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.206424 21765 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.194031 21846 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.223560 21846 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.200793 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:51.225838 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.226936 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:51.228648 14378 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:51.229537 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:51.229838 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:51.234081 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:51.235482 21246 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:51.236645 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:51.239315 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.234628 14374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:33940
I20260709 13:20:51.240383 14374 raft_consensus.cc:606] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:51.240967 14374 raft_consensus.cc:614] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:51.250383 14223 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:51.251235 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:51.224092 21765 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.252044 14301 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.252868 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:51.254585 14296 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:51.255937 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:51.235750 21826 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:51.258219 14295 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:51.235826 21512 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:51.261986 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:51.229485 21846 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.265549 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:51.235910 21246 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.267181 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:51.267787 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:51.266997 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 445557us
I20260709 13:20:51.311861 14374 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:51.271481 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:51.242856 21795 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.246958 21732 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:51.309437 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 53596.3us
I20260709 13:20:51.236326 21470 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:51.310004 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:51.315454 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48326.3us
I20260709 13:20:51.293573 14295 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:51.321102 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:51.312860 21727 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.009s
I20260709 13:20:51.322207 21502 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:51.308722 21674 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:20:51.261870 21734 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.323275 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.354316 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:51.272140 21765 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.076s
I20260709 13:20:51.344376 21502 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.355801 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.356504 14369 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:51.326011 21512 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:51.357569 14369 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:51.359288 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:51.360491 14193 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:51.362303 21725 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:51.362968 21725 consensus_queue.cc:1243] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:51.363095 21452 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.364301 21725 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:51.364717 21725 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:51.365100 21725 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.368419 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:51.329382 21694 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.150s	user 0.017s	sys 0.000s
I20260709 13:20:51.323848 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:51.337986 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.372887 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:51.356149 21502 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:51.261166 21411 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:51.338846 14865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.342583 14223 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:51.342665 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:51.365976 21475 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:51.358124 21414 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.346254 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.342917 14267 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:51.407086 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 64257.7us
I20260709 13:20:51.236505 21507 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 13:20:51.240531 21234 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.088s
I20260709 13:20:51.315196 21246 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:51.325830 21874 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.175s	user 0.003s	sys 0.000s
I20260709 13:20:51.250500 21839 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:20:51.323350 21535 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.330853 14301 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:20:51.374446 14302 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 21: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:51.356215 21765 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:51.338517 14296 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:51.383432 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:51.384146 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.335968 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:51.431277 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:51.431625 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 95755.6us
I20260709 13:20:51.393344 14374 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:51.395738 14295 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 17. (term mismatch)
I20260709 13:20:51.402711 14896 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:51.337195 21795 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.408819 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:51.348590 21821 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:20:51.366225 21512 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.413757 14369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "bee4f7fc1b4740dc875537c79309664f"
 from {username='slave'} at 127.0.0.1:33940
I20260709 13:20:51.344691 21732 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.424763 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:51.423918 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.430120 14193 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:51.358006 21734 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:51.433490 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50143.2us
I20260709 13:20:51.344884 21470 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.444619 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:51.441826 20902 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:51.448158 20902 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.448563 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:51.451402 21470 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.452745 14224 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:51.453135 21795 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.379138 21694 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.431877 21765 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:51.458891 21765 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.459504 21694 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:51.460153 21765 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:51.425421 21414 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.440416 21535 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:51.462246 21535 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.464010 14296 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:20:51.464332 21535 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.441970 21512 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:51.410317 21411 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.466634 21411 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.414528 21336 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:51.467350 21336 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.467653 21731 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:51.469154 14226 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
W20260709 13:20:51.469444 21880 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:20:51.470058 21844 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:51.470608 14895 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 15.
I20260709 13:20:51.472792 21829 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:51.473862 21793 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.442982 14301 pending_rounds.cc:85] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 13
I20260709 13:20:51.474857 14301 pending_rounds.cc:107] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:20:51.475117 14301 raft_consensus.cc:2889] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:51.475605 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 66911.6us
I20260709 13:20:51.476094 14193 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:51.476526 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:51.449723 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:51.375437 21647 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:51.440143 14900 raft_consensus.cc:2410] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260709 13:20:51.440661 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.441664 14295 pending_rounds.cc:85] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 16
I20260709 13:20:51.487736 14295 pending_rounds.cc:107] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 19.17
I20260709 13:20:51.488034 14295 raft_consensus.cc:2889] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:51.404793 21475 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:51.472595 21799 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:20:51.438081 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.429627 21472 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.474225 21829 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.489341 14223 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
I20260709 13:20:51.448571 20902 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:51.499330 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:51.484637 14224 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:51.495592 14344 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:51.495620 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:51.500784 21472 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.503139 21472 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.492414 21475 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.504601 21246 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.489063 21675 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:51.506176 21675 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:51.507017 21675 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.507537 21246 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.510601 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1717) took 1247 ms. Trace:
I20260709 13:20:51.511279 21732 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:51.511878 21732 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:51.512336 21732 raft_consensus.cc:697] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:51.513142 21834 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.002s
I20260709 13:20:51.490775 21731 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:51.490600 21193 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:51.474423 21734 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:51.513829 21193 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.515913 21193 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.519429 21336 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.513163 21732 consensus_queue.cc:237] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.520833 21829 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.474359 21793 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.522209 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2921) took 1090 ms. Trace:
I20260709 13:20:51.522745 14377 rpcz_store.cc:276] 0709 13:20:50.431558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.491035 (+ 59477us) service_pool.cc:224] Handling call
0709 13:20:50.498342 (+  7307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:50.653545 (+155203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.521870 (+868325us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54001b85d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:51.522133 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355101568}
I20260709 13:20:51.524219 21770 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:51.524622 14370 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:51.525254 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:51.501636 21799 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:51.526700 21799 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.527777 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:51.528651 21872 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 13:20:51.528915 14267 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:51.529362 21234 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:51.530177 21234 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:51.530447 21878 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:20:51.526911 21781 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:20:51.530594 21823 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:51.531162 21823 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.533989 21834 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.536048 21834 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.537092 21502 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.539659 21502 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:51.540410 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:51.540980 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1715) took 1912 ms. Trace:
I20260709 13:20:51.541289 14223 raft_consensus.cc:2410] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:20:51.490038 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:51.541407 14375 rpcz_store.cc:276] 0709 13:20:49.628234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.905226 (+276992us) service_pool.cc:224] Handling call
0709 13:20:49.905536 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:50.498386 (+592850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.509598 (+1011212us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54002ec054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:51.509774 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252334464}
I20260709 13:20:51.498054 21830 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:51.542994 21871 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:20:51.524652 21770 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:51.491271 21647 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.543962 21770 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:51.544600 21811 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:51.545043 21811 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:51.545425 21647 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.511016 14229 rpcz_store.cc:276] 0709 13:20:50.263089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.263220 (+   131us) service_pool.cc:224] Handling call
0709 13:20:51.510375 (+1247155us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b5400052154. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:51.510539 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80872192}
I20260709 13:20:51.487835 21771 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:51.528666 21507 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:20:51.550486 14296 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:51.551481 21760 log.cc:927] Time spent T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.382s	user 0.000s	sys 0.002s
W20260709 13:20:51.551864 14226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1712) took 2212 ms (client timeout 1987 ms). Trace:
W20260709 13:20:51.552237 14226 rpcz_store.cc:269] 0709 13:20:49.339284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.339602 (+   318us) service_pool.cc:224] Handling call
0709 13:20:51.551673 (+2212071us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b5400276fd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:51.551775 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4846804352}
I20260709 13:20:51.553149 21829 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:51.558625 21729 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.562284 21414 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.565857 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:51.497042 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:51.575103 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.577813 14377 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:51.580436 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.581323 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:51.581990 14377 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:51.569208 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:51.584141 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.585671 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1578) took 1783 ms. Trace:
I20260709 13:20:51.586181 14898 rpcz_store.cc:276] 0709 13:20:49.802835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.065035 (+262200us) service_pool.cc:224] Handling call
0709 13:20:50.065494 (+   459us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:50.075478 (+  9984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:50.075506 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:50.082634 (+  7128us) log.cc:844] Serialized 78 byte log entry
0709 13:20:50.333669 (+251035us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:50.403519 (+ 69850us) log.cc:844] Serialized 14 byte log entry
0709 13:20:50.414198 (+ 10679us) log.cc:844] Serialized 14 byte log entry
0709 13:20:51.224532 (+810334us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18001bfe20. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:20:51.375000 (+150468us) log.cc:844] Serialized 14 byte log entry
0709 13:20:51.461810 (+ 86810us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b18001bfe20. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f522 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:51.585295 (+123485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.585364 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:51.585408 (+    44us) raft_consensus.cc:1685] finished
0709 13:20:51.585425 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:51.585594 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49642,"prepare.queue_time_us":24271,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":11900,"raft.queue_time_us":932358,"raft.run_cpu_time_us":575,"raft.run_wall_time_us":23598,"spinlock_wait_cycles":14846720,"thread_start_us":532041,"threads_started":3,"wal-append.queue_time_us":245962}
W20260709 13:20:51.574910 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 46057.8us
I20260709 13:20:51.593658 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.595430 14377 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:51.594300 14374 raft_consensus.cc:1240] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:20:51.597290 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:51.598316 14374 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:51.533188 21823 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:51.592638 14370 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 16: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:51.525563 21793 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.595593 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:51.604151 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:51.601279 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2954) took 2198 ms. Trace:
I20260709 13:20:51.610981 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:51.593958 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:51.615811 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 118826us
I20260709 13:20:51.615660 14225 rpcz_store.cc:276] 0709 13:20:49.403240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.588968 (+185728us) service_pool.cc:224] Handling call
0709 13:20:49.589247 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:49.640127 (+ 50880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.601038 (+1960911us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b54003e0654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:51.601222 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83210624}
I20260709 13:20:51.616729 14220 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:20:51.625185 14378 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: [16.13-18.14]
I20260709 13:20:51.626657 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:51.626965 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.627557 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.627827 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.628461 14896 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 24.
I20260709 13:20:51.629380 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.630218 14896 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:51.631089 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.631618 14896 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:51.632540 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:51.638556 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.557212 21804 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.657837 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:51.591673 21795 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.592427 21452 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:51.660166 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.600570 21470 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:51.669474 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.670344 14900 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
W20260709 13:20:51.660737 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44670.5us
I20260709 13:20:51.591116 21729 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:51.661937 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.608510 21765 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:51.671772 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:51.675123 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 58386.3us
I20260709 13:20:51.671690 14895 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:51.675002 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.677498 14267 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:51.690800 21811 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.693274 21804 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.660701 21771 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:51.662878 21507 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:51.656189 21647 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.679404 14864 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:51.701721 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.660859 21793 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:51.660516 21414 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:51.664417 21815 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:51.669767 21470 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:51.621261 21810 consensus_queue.cc:1059] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:20:51.722829 20902 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.703130 21475 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.725342 21569 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:51.796355 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.796574 21569 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:51.797112 14377 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:51.797868 14369 raft_consensus.cc:606] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Received request to transfer leadership to TS bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:51.798408 14369 raft_consensus.cc:614] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:51.798610 14370 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:51.799217 14229 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:51.677143 21795 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.799786 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.801412 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.801827 21795 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.730894 21765 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:51.803224 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:51.735813 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.18484e+06us
I20260709 13:20:51.803915 14377 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 24.
I20260709 13:20:51.794018 20902 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.693907 21729 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.807703 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.807835 21729 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.718585 14900 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:51.808375 14374 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:51.809446 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:51.810276 21884 log.cc:927] Time spent T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:20:51.810393 21734 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:51.810851 21734 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:51.811218 21734 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:51.811822 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:51.812122 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:51.695956 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:51.812917 14297 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:51.813862 14895 raft_consensus.cc:1217] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Deduplicated request from leader. Original: 14.11->[16.12-20.14]   Dedup: 16.12->[18.13-20.14]
I20260709 13:20:51.814373 14895 pending_rounds.cc:85] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 12
I20260709 13:20:51.814595 14895 pending_rounds.cc:107] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:20:51.814852 14895 raft_consensus.cc:2889] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:51.814684 21731 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:51.815479 21731 consensus_queue.cc:1243] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:51.816195 14867 leader_election.cc:400] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 21. Current term is 22.
I20260709 13:20:51.816517 14867 leader_election.cc:403] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:51.714231 21823 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.780180 21815 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.816834 21472 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.817222 14867 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:51.817510 21823 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.818624 21739 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:51.818994 21739 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:51.819362 21739 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:51.820042 21823 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:51.740180 14896 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:51.743822 21414 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.743577 21647 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.706769 21512 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.822184 21414 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:51.793964 21830 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:51.794691 21788 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.795816 21475 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.824244 21193 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:51.838048 21193 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.805508 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.839105 21811 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:51.839406 14370 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:20:51.812445 14296 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.813539 21569 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.712476 21882 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:20:51.728212 21725 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.816831 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:51.675439 21781 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 13:20:51.743992 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:51.788080 14371 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:51.789798 21876 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.433s	user 0.001s	sys 0.002s
I20260709 13:20:51.788807 21470 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:51.789443 21234 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:51.817262 21762 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.869762 21234 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:51.865553 21788 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.870409 21234 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:51.872165 21788 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.874138 21512 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:51.874607 14373 raft_consensus.cc:1275] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:51.878156 21770 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:51.817462 21472 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:51.880777 21770 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.881244 21472 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:51.881516 14899 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:51.881300 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 3090) took 1133 ms. Trace:
I20260709 13:20:51.882702 14376 rpcz_store.cc:276] 0709 13:20:50.748241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.759572 (+ 11331us) service_pool.cc:224] Handling call
0709 13:20:51.881089 (+1121517us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540039bcd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:51.881204 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984524160}
W20260709 13:20:51.887475 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 69973.6us
I20260709 13:20:51.902750 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:51.907671 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:51.817266 21815 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:51.867306 14296 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:20:51.849715 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.836761 21830 consensus_queue.cc:1243] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:51.936932 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:51.947101 21647 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:51.947894 21762 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 21. Current term is 22.
I20260709 13:20:51.949043 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57812 (request call id 1713) took 2516 ms. Trace:
I20260709 13:20:51.949280 14896 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:51.949568 14222 rpcz_store.cc:276] 0709 13:20:49.432151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.621675 (+189524us) service_pool.cc:224] Handling call
0709 13:20:49.621991 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:49.913513 (+291522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.948707 (+2035194us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400135bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:51.948941 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380036992}
I20260709 13:20:51.950433 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.951530 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:51.954070 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:51.955294 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:51.956332 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:51.959810 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2923) took 1527 ms. Trace:
I20260709 13:20:51.960244 14373 rpcz_store.cc:276] 0709 13:20:50.432145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.498359 (+ 66214us) service_pool.cc:224] Handling call
0709 13:20:50.498705 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:51.875027 (+1376322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.959537 (+ 84510us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000b9354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:51.959745 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3163448064}
W20260709 13:20:51.962292 21856 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.448s	user 0.003s	sys 0.001s
I20260709 13:20:51.969208 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:51.973600 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3287) took 1911 ms. Trace:
I20260709 13:20:51.935727 21694 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
W20260709 13:20:51.928982 21784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.008s	sys 0.010s
I20260709 13:20:51.981211 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:51.983701 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 76112us
I20260709 13:20:52.014286 14378 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:51.974395 14227 rpcz_store.cc:276] 0709 13:20:50.062328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.089652 (+ 27324us) service_pool.cc:224] Handling call
0709 13:20:50.132900 (+ 43248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:50.281416 (+148516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:50.281451 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:50.281999 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:20:50.385140 (+103141us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:50.385210 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.791768 (+406558us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b48000030d8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
0709 13:20:51.973163 (+1181395us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400082354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:51.973247 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:51.973307 (+    60us) raft_consensus.cc:1685] finished
0709 13:20:51.973325 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:51.973524 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":2264,"raft.run_wall_time_us":507534,"spinlock_wait_cycles":348611712,"thread_start_us":75045,"threads_started":1,"wal-append.queue_time_us":121728,"wal-append.run_cpu_time_us":1737,"wal-append.run_wall_time_us":1006329}
I20260709 13:20:52.013095 14341 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:51.904222 21452 consensus_queue.cc:1048] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:20:51.931039 21885 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:20:51.983242 21784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.009s	sys 0.010s
W20260709 13:20:52.013459 21878 log.cc:927] Time spent T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:20:52.025247 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 327264us
I20260709 13:20:52.021239 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:52.022650 14304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.005s	sys 0.018s
W20260709 13:20:52.027951 14304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.005s	sys 0.018s
I20260709 13:20:51.982645 21811 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:52.030061 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1470) took 1190 ms. Trace:
I20260709 13:20:52.012979 20902 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:52.012696 21725 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:52.032601 14304 rpcz_store.cc:276] 0709 13:20:50.839350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.839508 (+   158us) service_pool.cc:224] Handling call
0709 13:20:51.473522 (+634014us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df2065fc0 00007f8df2050929 00007f8df20503d2 00007f8deb5c7bd4
0709 13:20:51.473734 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:51.473958 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:51.474206 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 13:20:52.029580 (+555374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:52.029657 (+    77us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:52.029722 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.029836 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.029988 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3085,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":1622,"raft.queue_time_us":1006,"spinlock_wait_cycles":6472576,"thread_start_us":553965,"threads_started":1}
I20260709 13:20:51.982875 21729 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:52.016875 21826 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:52.018725 21821 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:52.053530 21821 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.054044 21821 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.015024 21647 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:52.058265 21647 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:52.058851 21647 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:52.039052 21734 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.064543 21734 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:52.034732 20902 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:52.065704 20902 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:52.043781 14894 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
W20260709 13:20:52.031507 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 354074us
I20260709 13:20:51.984721 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:52.070708 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 86089.9us
I20260709 13:20:52.025064 21885 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.071523 21734 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:52.072414 21888 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:52.075073 21722 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:52.075158 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:52.025627 21732 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:52.084860 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:52.086419 14374 pending_rounds.cc:85] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 11
I20260709 13:20:52.091876 14374 pending_rounds.cc:107] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:20:52.092299 14374 raft_consensus.cc:2889] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:52.086949 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:52.094300 14376 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:52.087009 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57717.9us
I20260709 13:20:52.100028 14377 pending_rounds.cc:85] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 13
I20260709 13:20:52.102792 14377 pending_rounds.cc:107] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:20:52.103173 14377 raft_consensus.cc:2889] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:52.105883 21739 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.107187 14896 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:52.115839 21739 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:52.083158 21885 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:52.047228 21675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.028s	sys 0.058s
I20260709 13:20:52.032260 21811 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.035564 21846 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:52.125181 21846 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:52.126379 21846 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.031399 21674 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:52.117813 14301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.001s	sys 0.027s
I20260709 13:20:52.080950 21729 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.132040 21729 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.042474 21825 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:52.138588 21825 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:52.119051 21675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.028s	sys 0.059s
I20260709 13:20:52.124434 21811 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:52.082778 21734 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:52.154078 14375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.018s	sys 0.007s
W20260709 13:20:52.154515 14375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.018s	sys 0.007s
W20260709 13:20:52.154659 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 79610.2us
W20260709 13:20:52.150123 14301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.001s	sys 0.027s
I20260709 13:20:52.152675 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:52.158118 14342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.009s	sys 0.026s
W20260709 13:20:52.158536 14342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.009s	sys 0.026s
W20260709 13:20:52.158921 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 720164us
W20260709 13:20:52.164182 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:52.164979 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:52.165436 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.100453 21722 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:52.146011 21825 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:52.160629 14342 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:52.158699 21734 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.193046 14296 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:20:52.190903 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.194998 14304 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:52.193186 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.158267 21789 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:52.197335 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.157912 21778 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:52.207846 14295 raft_consensus.cc:1240] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:20:52.148617 21234 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:52.217089 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.205457 14376 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:52.218758 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.220005 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.145726 21470 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:52.239779 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.241219 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.179235 21512 consensus_queue.cc:1048] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:20:52.180015 21770 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:20:52.244325 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.245112 14303 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:52.249220 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:52.239454 21864 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.253405 21864 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:52.220458 21528 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:20:52.243628 21722 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.257390 21722 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:52.243218 21825 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:20:52.260330 21825 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:52.260727 21825 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:52.188403 20902 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.265110 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:52.253368 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.210301 21829 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:52.271369 14303 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 16: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:52.266942 14295 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260709 13:20:52.267515 14192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.012s	sys 0.029s
W20260709 13:20:52.273490 14892 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.019s	sys 0.038s
W20260709 13:20:52.273754 14192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.013s	sys 0.030s
W20260709 13:20:52.274037 14892 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.019s	sys 0.038s
W20260709 13:20:52.274206 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 616122us
I20260709 13:20:52.255772 21864 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:52.278195 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:52.281548 14894 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 21: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:52.279999 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.282295 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.262789 21470 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:52.297430 14901 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.020s	sys 0.031s
W20260709 13:20:52.298346 14901 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.020s	sys 0.031s
I20260709 13:20:52.233722 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:52.288134 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:52.271210 21799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.008s	sys 0.048s
I20260709 13:20:52.302934 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.220922 21778 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.302212 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:52.303872 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 70278.7us
I20260709 13:20:52.315346 14894 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:52.311455 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:52.313566 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:52.316812 14295 raft_consensus.cc:2368] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21.
I20260709 13:20:52.318220 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:52.318610 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:20:52.324982 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.340334 14376 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 23: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:52.340581 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:52.345667 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.346524 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:52.261674 21825 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:52.303049 21799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.008s	sys 0.049s
I20260709 13:20:52.349206 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:52.276281 21821 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.351847 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:52.357132 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:52.334575 21470 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:52.340049 21795 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:52.294571 21647 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.335827 21829 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:52.362898 14894 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:52.350270 21512 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.378053 14894 raft_consensus.cc:3055] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:52.378574 14894 raft_consensus.cc:740] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:52.363732 14376 raft_consensus.cc:2393] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:52.364745 14865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.008s	sys 0.030s
W20260709 13:20:52.380306 14865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.008s	sys 0.030s
W20260709 13:20:52.381045 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 936466us
I20260709 13:20:52.373994 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.374773 14900 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:52.379819 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:52.339927 21864 consensus_queue.cc:1059] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:20:52.339742 21733 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:20:52.372790 21725 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:52.361749 21675 raft_consensus.cc:2764] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:20:52.398010 14373 raft_consensus.cc:2368] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 21. Current term is 22.
I20260709 13:20:52.350481 21839 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 13:20:52.393167 21896 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:20:52.384661 21679 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:52.386031 21825 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:52.399760 14894 consensus_queue.cc:260] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.417341 14894 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:52.402375 21414 consensus_meta.cc:287] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.004s
I20260709 13:20:52.396113 21246 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:52.404433 21470 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:52.429775 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.428455 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.393131 21512 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.432790 14295 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:52.434532 14299 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 23: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:52.409502 21725 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.411000 21815 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.446529 21193 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:52.447597 21879 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.212s	user 0.008s	sys 0.003s
I20260709 13:20:52.450963 21647 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:52.452395 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 3083) took 1706 ms. Trace:
I20260709 13:20:52.452692 21821 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:52.452821 14372 rpcz_store.cc:276] 0709 13:20:50.746017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.746137 (+   120us) service_pool.cc:224] Handling call
0709 13:20:50.746442 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:50.751271 (+  4829us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:50.761605 (+ 10334us) log.cc:844] Serialized 14 byte log entry
0709 13:20:51.875348 (+1113743us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b180010c120. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a 00007f8ded096a2a
0709 13:20:52.071947 (+196599us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b180010c120. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:52.377094 (+305147us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:52.377749 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 13:20:52.377905 (+   156us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:52.377941 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.378029 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:52.452179 (+ 74150us) raft_consensus.cc:1685] finished
0709 13:20:52.452201 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.452337 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27513,"prepare.queue_time_us":10696,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":9963,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":7605,"spinlock_wait_cycles":22275072,"thread_start_us":484434,"threads_started":1,"wal-append.queue_time_us":1688764}
I20260709 13:20:52.457752 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.432489 21470 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:52.458029 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.436480 21234 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:52.487031 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.427587 21414 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.467834 21811 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.446570 21725 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:52.475580 21778 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:52.475883 21885 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.477129 20902 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:52.477336 21663 raft_consensus.cc:3055] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:52.477196 21734 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.507946 21815 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:52.508162 21414 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:52.508623 21734 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:52.508915 21895 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 13:20:52.483707 21900 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:20:52.483537 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:52.511314 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 215743us
W20260709 13:20:52.487181 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 103585us
I20260709 13:20:52.490674 14895 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:20:52.514305 14894 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:20:52.514847 14894 pending_rounds.cc:85] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 14
I20260709 13:20:52.514703 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:52.492116 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:52.488668 21470 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.499899 14898 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 23: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:52.499290 14376 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 13:20:52.482684 21512 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:52.460554 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2974) took 1614 ms. Trace:
I20260709 13:20:52.528075 14228 rpcz_store.cc:276] 0709 13:20:50.846087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.874929 (+ 28842us) service_pool.cc:224] Handling call
0709 13:20:50.882351 (+  7422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:50.885660 (+  3309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:50.885740 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:50.886381 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 13:20:51.153347 (+266966us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:51.153559 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.154071 (+   512us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:52.443126 (+1289055us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:52.457192 (+ 14066us) raft_consensus.cc:1685] finished
0709 13:20:52.457216 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.460478 (+  3262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2457,"raft.queue_time_us":2602,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3910,"spinlock_wait_cycles":7356672,"thread_start_us":224558,"threads_started":1,"wal-append.queue_time_us":308615}
I20260709 13:20:52.515218 14894 pending_rounds.cc:107] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:20:52.517596 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:52.523336 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.526487 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:52.528678 14267 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:52.534937 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 51528.8us
I20260709 13:20:52.503304 21725 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:52.535574 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:52.505980 21663 raft_consensus.cc:740] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:52.534328 14894 raft_consensus.cc:2889] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:52.539547 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:52.540604 14895 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:52.527487 20902 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:52.544304 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.516774 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:52.548842 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.549664 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.550922 14892 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:52.543659 21193 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:52.541651 21737 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:52.531925 21815 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:20:52.552676 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:52.561474 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.562847 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:52.563031 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.559736 14299 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:52.559957 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.564970 14296 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:52.565302 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.561125 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.560845 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.569450 14300 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:20:52.567047 21815 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:52.570851 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.549752 21635 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:52.573698 21733 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:52.574442 21733 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.577095 21733 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:52.542230 21727 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:52.586064 14897 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:52.586660 21414 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.587067 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.587167 21414 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.590251 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:52.591631 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:52.592732 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:52.581696 21663 consensus_queue.cc:260] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:52.594588 21663 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:52.595917 21911 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:20:52.595960 14377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fde6831a789b45549658b2c2146dd650"
dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
mode: GRACEFUL
new_leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
 from {username='slave'} at 127.0.0.1:33940
I20260709 13:20:52.596671 14377 raft_consensus.cc:606] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Received request to transfer leadership to TS a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:52.596990 14377 raft_consensus.cc:614] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:52.598977 21892 raft_consensus.cc:3055] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:52.599517 21892 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:52.600562 21892 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:52.603991 21902 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.604565 21902 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.606957 21902 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:52.607506 21902 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:52.608019 21902 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.608366 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:52.609622 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:52.610200 21899 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 13:20:52.610833 14897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50036 (request call id 1647) took 3189 ms (client timeout 1669 ms). Trace:
W20260709 13:20:52.611244 14897 rpcz_store.cc:269] 0709 13:20:49.420977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.429514 (+  8537us) service_pool.cc:224] Handling call
0709 13:20:52.610675 (+3181161us) spinlock_profiling.cc:243] Waited 3.09 s on lock 0x7b540041d7d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:52.610772 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7117622144}
I20260709 13:20:52.612735 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:52.613413 14897 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:52.614269 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3401) took 1244 ms. Trace:
I20260709 13:20:52.614773 14301 rpcz_store.cc:276] 0709 13:20:51.369981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.428719 (+ 58738us) service_pool.cc:224] Handling call
0709 13:20:51.442705 (+ 13986us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:51.476031 (+ 33326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:51.476060 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:51.476586 (+   526us) log.cc:844] Serialized 52 byte log entry
0709 13:20:51.565316 (+ 88730us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b18001cf600. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c0d1 00007f8ded047a0f
0709 13:20:52.157271 (+591955us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:52.157333 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.157433 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:52.613863 (+456430us) raft_consensus.cc:1685] finished
0709 13:20:52.613893 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.614192 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11330,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3381,"spinlock_wait_cycles":2518400,"thread_start_us":591698,"threads_started":1,"wal-append.queue_time_us":858527}
I20260709 13:20:52.618865 21904 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:52.567873 21823 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:20:52.542831 21725 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:52.643569 14295 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:20:52.568995 21729 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.582240 21734 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.553994 21898 consensus_queue.cc:1059] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:20:52.650209 14226 raft_consensus.cc:1275] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:52.583940 14369 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:20:52.585278 14865 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:52.554109 20902 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:52.622022 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.658401 14864 leader_election.cc:400] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 21. Current term is 22.
I20260709 13:20:52.658820 14864 leader_election.cc:403] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:20:52.609526 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:52.624538 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:52.580941 14895 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:52.627936 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:52.629365 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.668663 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:52.633740 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:52.580907 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:52.643654 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:52.646559 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:52.648033 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 85293.9us
I20260709 13:20:52.648173 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:52.651553 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:52.653079 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:52.654819 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.667945 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:52.670881 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:52.673336 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:52.674194 14297 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:52.654439 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.670750 14372 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:52.678705 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:52.679343 14299 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 23: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:20:52.681152 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 53353.8us
W20260709 13:20:52.682051 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 96838.2us
I20260709 13:20:52.681192 14226 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:52.686400 14222 raft_consensus.cc:1240] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:52.683656 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:52.694459 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:52.695935 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:52.677281 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:52.567859 21737 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:52.699342 14895 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 23: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:52.700639 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:52.648264 21892 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.705245 14226 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:52.706660 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:52.707760 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:52.708468 14301 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.712055 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:52.705986 21534 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:52.713871 21902 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:52.714021 21534 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:52.714570 21534 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:52.714999 21737 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.716312 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:52.717249 14895 raft_consensus.cc:2410] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:20:52.703579 21903 consensus_queue.cc:1059] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.17, Next index: 18, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:20:52.704018 21778 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.678452 20902 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.721925 14222 raft_consensus.cc:1240] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:52.654438 21733 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.655234 21452 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:52.727308 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:52.720448 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:52.730336 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 3093) took 1164 ms. Trace:
I20260709 13:20:52.707295 14898 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:52.727784 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:52.730842 14371 rpcz_store.cc:276] 0709 13:20:51.566392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.591877 (+ 25485us) service_pool.cc:224] Handling call
0709 13:20:51.592182 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:51.867838 (+275656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.730086 (+862248us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540004bfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:52.730273 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444062464}
I20260709 13:20:52.734570 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:52.699126 21644 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.699280 21722 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:20:52.735440 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 66871.8us
I20260709 13:20:52.736984 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:52.737573 14896 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 13:20:52.746399 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:52.698988 21727 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:52.748729 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:52.751688 14896 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 22: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:52.752920 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:52.723733 21750 raft_consensus.cc:3055] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:52.760597 14301 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:20:52.765153 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:52.770555 14896 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 25: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:52.730918 21647 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:52.725692 21234 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:52.677670 21734 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.770525 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:52.778136 14295 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 20: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:52.737761 21898 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:52.735889 21731 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:52.792163 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.752101 21826 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:52.822592 14896 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:20:52.822889 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:52.771206 21904 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:52.752223 21821 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.768972 21750 raft_consensus.cc:740] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:52.832060 21750 consensus_queue.cc:260] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.833451 21750 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:52.827112 14222 raft_consensus.cc:2368] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 21. Current term is 22.
I20260709 13:20:52.776715 21647 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.771535 21888 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:52.739864 21733 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.841594 14897 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:20:52.834693 21826 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:52.873730 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:52.881767 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:52.882846 14222 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
W20260709 13:20:52.887039 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.847259 21898 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:52.855773 21647 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:52.898893 14220 raft_consensus.cc:2410] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:20:52.821828 21731 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.860128 21885 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:52.899376 14223 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:52.911515 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1586) took 1085 ms. Trace:
I20260709 13:20:52.916887 14899 rpcz_store.cc:276] 0709 13:20:51.825861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.828345 (+  2484us) service_pool.cc:224] Handling call
0709 13:20:51.828871 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:51.881945 (+ 53074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.911190 (+1029245us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b5400883bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:52.911438 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120573824}
I20260709 13:20:52.918855 14899 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:52.921523 14223 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:52.853511 21821 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:52.899334 21898 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.910732 14895 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:52.922530 14223 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:52.973294 14223 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:52.915866 21778 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:52.989858 14893 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:52.990648 14223 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:52.934774 21898 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:52.996804 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 240870us
W20260709 13:20:52.981670 21879 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:52.978251 21888 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:52.971799 21799 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.008617 21246 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:53.010581 21921 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 13:20:53.011615 21919 log.cc:927] Time spent T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:20:53.049376 14377 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:52.999750 21826 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.027923 21811 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:52.923393 21193 consensus_queue.cc:1048] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:20:53.032272 21888 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.032406 21534 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.025354 21535 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:52.930727 21823 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:20:52.986557 21725 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:53.015313 21729 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:53.066718 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1583) took 1390 ms. Trace:
W20260709 13:20:53.072173 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 374759us
I20260709 13:20:53.044034 21246 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:53.089730 14900 rpcz_store.cc:276] 0709 13:20:51.676477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.809150 (+132673us) service_pool.cc:224] Handling call
0709 13:20:51.809524 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.382236 (+572712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.066420 (+684184us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54004bfad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:53.066641 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299359488}
I20260709 13:20:53.085542 14229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3291) took 1835 ms. Trace:
I20260709 13:20:53.092695 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:53.095032 14229 rpcz_store.cc:276] 0709 13:20:51.249989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.547122 (+297133us) service_pool.cc:224] Handling call
0709 13:20:51.547513 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:51.799689 (+252176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.074006 (+1274317us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540033d454. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:53.085468 (+ 11462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578271616}
I20260709 13:20:53.059686 21656 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:20:53.098748 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 97436us
W20260709 13:20:53.107698 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 373197us
I20260709 13:20:53.071108 21679 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.109053 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:53.070946 21535 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:53.119369 21644 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 21. Current term is 22.
I20260709 13:20:53.120836 21535 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:53.124029 21923 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:20:53.124226 21535 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:53.126359 21920 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:20:53.042984 21799 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.122109 21679 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.105959 21725 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.130550 21725 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.132797 21725 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:53.135114 21679 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:53.137241 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:53.138440 21675 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:20:53.140940 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:53.141812 14370 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 24.
I20260709 13:20:53.143033 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:53.143980 14370 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:53.144764 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:53.146106 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1581) took 1490 ms. Trace:
I20260709 13:20:53.146615 14901 rpcz_store.cc:276] 0709 13:20:51.655370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.712112 (+ 56742us) service_pool.cc:224] Handling call
0709 13:20:51.712508 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:51.713008 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:52.298809 (+585801us) log.cc:844] Serialized 14 byte log entry
0709 13:20:52.574035 (+275226us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:52.574537 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:20:52.574676 (+   139us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:52.574887 (+   211us) log.cc:844] Serialized 14 byte log entry
0709 13:20:52.582384 (+  7497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.582452 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:53.145869 (+563417us) raft_consensus.cc:1685] finished
0709 13:20:53.145894 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:53.146041 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77498,"prepare.queue_time_us":60192,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":32969,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":230,"spinlock_wait_cycles":41344,"thread_start_us":703968,"threads_started":2,"wal-append.queue_time_us":493357}
I20260709 13:20:53.152133 21644 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:53.152998 21644 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:53.154090 21644 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.155630 21534 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:53.163628 14375 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 19. Current term is 20. Ops: [19.11-19.11]
W20260709 13:20:53.171375 21663 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.004s
W20260709 13:20:53.178781 14192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.088927 21894 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:53.106252 21811 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:20:53.205767 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 96813.4us
I20260709 13:20:53.105878 21656 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:53.201944 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:53.190434 21679 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:53.186002 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:53.206293 14193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.230979 21663 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:53.234855 14901 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:53.113102 21734 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:53.255224 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 69329.2us
I20260709 13:20:53.256984 14193 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:53.235919 21733 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:53.233300 21925 log.cc:927] Time spent T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:20:53.245491 14270 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:53.213845 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:53.201174 14893 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:20:53.249048 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:53.236867 21811 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:53.260371 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:53.199512 20902 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.205617 21676 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:53.251281 21781 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:53.268778 14893 pending_rounds.cc:85] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 13
I20260709 13:20:53.270121 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:53.314131 14893 pending_rounds.cc:107] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:20:53.261027 21725 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:53.292622 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 49379.7us
W20260709 13:20:53.278779 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.232993 21894 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.321099 14377 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 22: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:53.308463 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:53.261448 21904 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:53.316634 21674 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:53.327211 14372 raft_consensus.cc:1240] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:53.331400 21901 log.cc:927] Time spent T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.919s	user 0.004s	sys 0.000s
I20260709 13:20:53.311640 21656 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.333143 21656 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:53.247735 21366 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
W20260709 13:20:53.310425 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50115.2us
I20260709 13:20:53.314474 14893 raft_consensus.cc:2889] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:53.302706 21733 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:53.321094 14892 pending_rounds.cc:85] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 13
I20260709 13:20:53.368163 14892 pending_rounds.cc:107] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:20:53.306677 21821 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:53.319183 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51136us
W20260709 13:20:53.325994 21942 log.cc:927] Time spent T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:20:53.326104 14377 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:53.312232 21815 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:53.338640 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1650) took 3767 ms. Trace:
I20260709 13:20:53.382445 14893 rpcz_store.cc:276] 0709 13:20:49.571626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.571762 (+   136us) service_pool.cc:224] Handling call
0709 13:20:49.572013 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:49.960088 (+388075us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b18001ce540. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0c7646 00007f8ded00158e 00007f8ded082f9e 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4
0709 13:20:50.676044 (+715956us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b5800a103d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8decfe80aa 00007f8ded06a447 00007f8ded082fe7 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4
0709 13:20:52.989325 (+2313281us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b5800a106d0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8decfe80aa 00007f8ded06a447 00007f8ded082fe7 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4
0709 13:20:53.338363 (+349038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.338582 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3907794944}
W20260709 13:20:53.315932 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.343721 14376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2937) took 1171 ms. Trace:
I20260709 13:20:53.384594 14376 rpcz_store.cc:276] 0709 13:20:52.172140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.387239 (+215099us) service_pool.cc:224] Handling call
0709 13:20:52.387639 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:52.522930 (+135291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.343379 (+820449us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54001ba3d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:53.343626 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256119680}
I20260709 13:20:53.346652 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:53.346890 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.388799 14304 raft_consensus.cc:2410] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:53.371050 21246 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.392278 21246 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:53.392750 21414 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:53.374429 21823 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:53.367265 21336 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.394737 21894 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:53.394830 21336 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.317823 21725 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.368530 14892 raft_consensus.cc:2889] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:53.302641 21799 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:53.324681 14374 raft_consensus.cc:2393] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 23: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:53.259919 21663 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.369120 14370 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:53.263335 21675 consensus_queue.cc:1059] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:20:53.266831 21722 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.051s
W20260709 13:20:53.368727 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 111818us
I20260709 13:20:53.256471 21679 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.378491 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:53.379267 14296 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:53.380349 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.390240 14304 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:53.349776 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:53.393918 21931 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:20:53.410490 21725 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.387375 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.426890 14295 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 24: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:53.356698 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:53.424082 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.397332 14302 raft_consensus.cc:1240] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:53.411892 20902 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:53.375069 21470 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.840s	user 0.010s	sys 0.002s
I20260709 13:20:53.305051 21928 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.115s
I20260709 13:20:53.414044 14342 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:53.414069 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.378603 21821 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:53.419384 14297 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:53.367941 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.423787 14369 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:53.424155 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.439488 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:53.427752 14299 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:53.442081 14298 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
W20260709 13:20:53.424798 21924 log.cc:927] Time spent T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:20:53.418331 21246 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.447467 20902 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:53.394364 21823 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:53.445734 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 106346us
I20260709 13:20:53.443033 14193 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:53.448418 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:53.474186 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:53.415737 21815 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:20:53.474526 20902 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:53.449708 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:53.374706 21811 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.478847 14342 leader_election.cc:400] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 20. Current term is 21.
I20260709 13:20:53.421005 21888 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:53.480229 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:53.473542 21939 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:20:53.449546 21246 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.482362 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:53.483335 20902 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:53.481835 21750 consensus_meta.cc:287] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.002s
I20260709 13:20:53.439595 21470 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.495460 20902 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.498550 20902 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:53.501294 21961 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:53.501726 21961 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:53.502118 21246 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:53.502609 21961 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.503216 21656 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:53.503841 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.504426 21928 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:53.504729 14222 raft_consensus.cc:2410] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
W20260709 13:20:53.488200 21647 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.003s
I20260709 13:20:53.504869 21928 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:53.505336 21928 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:53.446997 21821 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.507755 21821 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:53.508908 21663 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:53.509550 21823 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:53.481586 21675 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:53.511188 21675 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:53.512118 21675 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.491430 21770 raft_consensus.cc:3055] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:53.514174 21770 raft_consensus.cc:740] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:53.505298 21647 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.516222 21898 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.516667 21647 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:53.517236 21892 consensus_meta.cc:287] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.791s	user 0.009s	sys 0.000s
I20260709 13:20:53.518685 21470 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:53.519176 21336 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:53.519630 14226 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 22: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:53.518735 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:53.520390 14302 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.521688 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:53.529397 14378 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:20:53.530571 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.494674 21964 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:53.531611 21733 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:53.536814 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:53.537935 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.538688 14223 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:53.540874 14302 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:20:53.533365 21679 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:53.548113 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:53.550684 20902 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.553362 14222 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:53.559083 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:53.503865 21961 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:53.541518 21722 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:53.590224 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.591252 14229 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 20: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:53.561380 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.602841 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.598676 20902 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:53.559306 21939 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:20:53.601681 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 104340us
I20260709 13:20:53.560341 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:53.602626 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 128514us
I20260709 13:20:53.603652 14228 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:53.551198 21964 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:53.605296 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 82486.2us
I20260709 13:20:53.609292 14227 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 22: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:53.602190 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:53.611284 14222 raft_consensus.cc:2410] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 20 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:20:53.612859 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:53.552903 21733 consensus_queue.cc:1059] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:20:53.613498 14893 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:53.615861 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.620469 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:53.609972 21799 raft_consensus.cc:3055] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:53.621260 14897 raft_consensus.cc:2368] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20.
I20260709 13:20:53.621711 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.624347 14222 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:53.622498 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:53.630378 14900 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 22: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:53.632685 21928 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.599066 21676 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:20:53.649916 21733 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.650540 21733 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.652698 21733 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:53.653630 21663 raft_consensus.cc:3055] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:53.654076 21663 raft_consensus.cc:740] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:53.654886 21663 consensus_queue.cc:260] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.655998 21663 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:53.656654 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:53.657441 21970 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.657960 21970 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.658564 21898 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:53.660022 21970 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:53.657986 14220 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:53.665699 14896 raft_consensus.cc:1240] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:53.667521 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:53.667620 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:53.636771 21928 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:53.762890 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:53.766064 14301 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:53.766333 14220 raft_consensus.cc:1275] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:20:53.763850 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:53.764631 14864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:53.776886 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 109443us
I20260709 13:20:53.623567 21799 raft_consensus.cc:740] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:53.791576 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.779742 21733 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:53.778837 21512 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:53.821727 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:53.832391 14220 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 22: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:53.848603 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2946) took 1324 ms. Trace:
W20260709 13:20:53.850859 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.853124 14228 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:53.862267 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.863708 14220 raft_consensus.cc:2410] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:53.804687 21725 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.849236 14371 rpcz_store.cc:276] 0709 13:20:52.524636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.732301 (+207665us) service_pool.cc:224] Handling call
0709 13:20:52.732686 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:52.752834 (+ 20148us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:52.780660 (+ 27826us) log.cc:844] Serialized 14 byte log entry
0709 13:20:53.138985 (+358325us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b180033f5e0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f9f3f3 00007f8de9fa17c1 00007f8de9fa1779 00007f8de9fa1709 00007f8de9fa16d1 00007f8de9fa09cd 000000000038f354 000000000038f199 00007f8de9f8283a
0709 13:20:53.207074 (+ 68089us) log.cc:844] Serialized 14 byte log entry
0709 13:20:53.207248 (+   174us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:53.207724 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:20:53.207851 (+   127us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:53.207884 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.207956 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:53.847465 (+639509us) raft_consensus.cc:1685] finished
0709 13:20:53.848326 (+   861us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:53.848514 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19697,"prepare.queue_time_us":33839,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":83,"raft.queue_time_us":31028,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":9673,"spinlock_wait_cycles":9204608,"thread_start_us":364263,"threads_started":1,"wal-append.queue_time_us":444543}
I20260709 13:20:53.873067 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:53.867115 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 88705.6us
I20260709 13:20:53.873435 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:53.874850 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.875486 14228 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:53.876907 14301 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:53.878487 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:53.878801 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.879248 14302 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 22: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:53.879415 14298 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:53.880249 14303 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:53.880306 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:53.880014 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:53.882050 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.884760 14228 raft_consensus.cc:1240] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:53.884968 14295 raft_consensus.cc:2393] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 20: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:53.885777 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.880282 21739 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:53.887192 21739 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:53.888123 21739 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.882474 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:53.828696 21512 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.895985 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:53.894745 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.896683 14228 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:53.897450 14229 raft_consensus.cc:2368] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22.
I20260709 13:20:53.895153 21898 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:53.831251 21799 consensus_queue.cc:260] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.905740 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:53.911566 14342 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:53.912892 14342 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:53.904529 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:53.914113 14295 raft_consensus.cc:3060] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:53.912212 14192 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:53.805683 21964 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.916253 21970 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:53.916936 20902 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:53.917094 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.919350 20902 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.920356 20902 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:53.919597 14192 leader_election.cc:400] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20.
I20260709 13:20:53.923300 14192 leader_election.cc:403] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:53.927548 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.928757 14228 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:53.932159 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.932838 14228 raft_consensus.cc:2376] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18. Re-sending same reply.
I20260709 13:20:53.929175 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.933701 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:53.929593 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.929911 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:53.934945 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:53.935634 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:53.928540 14344 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:53.938815 14301 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:20:53.939098 21972 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:20:53.940158 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:53.941104 14301 raft_consensus.cc:2393] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 24: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:53.941962 21955 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:20:53.943807 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:53.944957 14301 raft_consensus.cc:2410] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:20:53.947055 14304 raft_consensus.cc:2368] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20.
I20260709 13:20:53.947531 14298 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 22: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:53.933987 14296 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
I20260709 13:20:53.947638 14227 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:53.918726 21898 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:53.955677 14193 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:53.919178 21970 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.919642 21892 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:53.967690 20902 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:53.922822 21799 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:53.970309 14193 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:53.918524 21969 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:53.968329 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:53.919397 21826 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:20:53.977029 21823 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:53.988116 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2951) took 1232 ms. Trace:
I20260709 13:20:53.991215 21823 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:53.991714 21823 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:53.991410 14370 rpcz_store.cc:276] 0709 13:20:52.755486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.145728 (+390242us) service_pool.cc:224] Handling call
0709 13:20:53.202108 (+ 56380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:53.415027 (+212919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.987858 (+572831us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003985d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:53.988051 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383494016}
I20260709 13:20:53.990198 14220 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:53.974845 21933 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:53.971007 21966 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:53.996614 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:53.998790 21963 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:54.002226 21898 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:53.977770 21970 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:54.006218 14295 raft_consensus.cc:2468] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
W20260709 13:20:53.989068 21971 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:20:53.975102 21839 raft_consensus.cc:2764] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:54.020771 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:54.029976 14220 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:54.032248 14270 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:54.022749 14344 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.023649 21955 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20.
I20260709 13:20:54.025509 14226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1731) took 1255 ms. Trace:
I20260709 13:20:54.034265 14226 rpcz_store.cc:276] 0709 13:20:52.770059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.770206 (+   147us) service_pool.cc:224] Handling call
0709 13:20:54.025262 (+1255056us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400135bd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:54.025439 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1700023040}
I20260709 13:20:54.018349 14342 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:54.039412 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.042618 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.045096 14344 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:54.027710 21969 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:54.052104 21839 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:54.038224 21826 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:54.044365 21963 raft_consensus.cc:2804] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:54.049629 21821 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:54.082075 21969 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:54.051721 21954 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:54.050202 21892 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:54.066344 21635 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:54.038244 21452 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 13:20:54.077608 21976 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:20:54.072407 21725 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.094844 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.106189 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:20:54.106578 14341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.111841 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:54.115016 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:54.115816 14372 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:54.113458 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:54.117323 14375 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
W20260709 13:20:54.106926 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 120160us
I20260709 13:20:54.107199 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:54.122152 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:54.122898 14372 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:20:54.128381 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:54.084787 21512 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:54.120479 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:54.114204 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:54.139228 14376 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:54.131994 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:54.136950 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.132061 14897 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:54.141199 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:54.142899 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:54.060906 21964 consensus_queue.cc:1048] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:20:54.085953 21954 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:54.140698 21892 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:54.150321 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:54.150578 21778 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:54.151049 21750 consensus_queue.cc:1059] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:54.155426 21731 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:54.157401 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.186975 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:54.166227 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:54.087738 21963 raft_consensus.cc:697] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:54.172124 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 53521.9us
I20260709 13:20:54.188205 14900 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:54.188860 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:54.179618 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 134691us
W20260709 13:20:54.177459 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 44188.1us
I20260709 13:20:54.190881 14341 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:54.191308 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:54.177942 21954 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:54.173651 21885 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:54.102491 21635 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.205700 21928 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:54.205113 14193 leader_election.cc:400] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 19. Current term is 20.
I20260709 13:20:54.214291 14371 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:20:54.231812 14193 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:54.198856 21821 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:54.181351 21725 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.042s
W20260709 13:20:54.243726 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 93919.6us
I20260709 13:20:54.219090 21928 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:54.251554 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 60308.3us
I20260709 13:20:54.279762 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.238780 21795 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:54.290761 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 83983.5us
I20260709 13:20:54.278419 21928 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:54.301437 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 110636us
I20260709 13:20:54.274405 21452 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:54.296329 21972 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:20:54.296595 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:54.300763 14373 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 24.
I20260709 13:20:54.237349 21984 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:20:54.292064 21983 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:20:54.310693 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 76717.4us
I20260709 13:20:54.247107 21821 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.324072 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:54.296770 21795 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.345747 21795 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.350113 21991 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:54.351663 21991 consensus_queue.cc:1059] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:54.336972 21969 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:54.354743 21969 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.355069 21825 raft_consensus.cc:3055] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:54.355562 21825 raft_consensus.cc:740] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:54.355263 21969 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.330463 21983 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:54.358240 21983 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.358685 21983 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:54.290807 21963 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:54.362190 21965 log.cc:927] Time spent T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.745s	user 0.005s	sys 0.002s
W20260709 13:20:54.340353 21985 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:20:54.372128 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 3105) took 1855 ms. Trace:
I20260709 13:20:54.372602 14378 rpcz_store.cc:276] 0709 13:20:52.516562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.593665 (+ 77103us) service_pool.cc:224] Handling call
0709 13:20:54.371934 (+1778269us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54003340d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:54.372060 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955694848}
I20260709 13:20:54.374647 21635 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:54.375967 20902 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:54.316365 21452 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:54.378746 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1750) took 1196 ms. Trace:
I20260709 13:20:54.379685 21452 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:54.380906 21733 consensus_meta.cc:287] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.003s
I20260709 13:20:54.381348 21733 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:54.382786 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:54.384240 21663 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.001s
I20260709 13:20:54.384857 14223 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:54.386929 21885 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:54.387351 21826 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:54.388816 14369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2947) took 1863 ms. Trace:
I20260709 13:20:54.379136 14377 rpcz_store.cc:276] 0709 13:20:53.182786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.376026 (+193240us) service_pool.cc:224] Handling call
0709 13:20:53.376416 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:53.482338 (+105922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:53.482367 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:53.482407 (+    40us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:53.482440 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:54.378515 (+896075us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400349ed4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:54.378564 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:54.378692 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243136256}
I20260709 13:20:54.390547 14376 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:54.391300 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.392249 14229 raft_consensus.cc:1240] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:54.392594 14867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.539s	user 0.016s	sys 0.055s
I20260709 13:20:54.396874 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:54.397949 14119 catalog_manager.cc:5697] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:54.400120 14119 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 12 to 15, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 15 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:54.402324 21679 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:54.402470 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:54.402860 21679 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:54.403795 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:54.404294 21821 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.404925 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:54.389214 14369 rpcz_store.cc:276] 0709 13:20:52.524906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.024180 (+499274us) service_pool.cc:224] Handling call
0709 13:20:53.024634 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:53.443032 (+418398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:54.388597 (+945565us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54003c37d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:54.388763 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917486848}
I20260709 13:20:54.383880 21988 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:54.409169 21967 log.cc:927] Time spent T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.791s	user 0.006s	sys 0.000s
I20260709 13:20:54.411130 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1672) took 1090 ms. Trace:
I20260709 13:20:54.411643 14892 rpcz_store.cc:276] 0709 13:20:53.320358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.320542 (+   184us) service_pool.cc:224] Handling call
0709 13:20:53.320915 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:53.409058 (+ 88143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:53.409095 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:53.409551 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:20:53.610871 (+201320us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:53.619312 (+  8441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:53.619388 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:54.408432 (+789044us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:20:54.410727 (+  2295us) raft_consensus.cc:1685] finished
0709 13:20:54.410759 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:54.411035 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16162048,"thread_start_us":201001,"threads_started":1,"wal-append.queue_time_us":207793}
W20260709 13:20:54.383118 21960 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.887s	user 0.004s	sys 0.008s
I20260709 13:20:54.415578 21770 consensus_queue.cc:260] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.413872 21969 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.356389 21825 consensus_queue.cc:260] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:54.403905 21679 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.418236 21770 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:54.430558 21992 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:54.418027 21676 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:54.418645 21935 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:54.424611 21903 raft_consensus.cc:3055] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:54.366566 14372 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:20:54.426913 14900 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:20:54.377211 21823 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.431559 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:54.430722 21904 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:54.438387 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:54.389989 21839 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:54.432648 21733 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:54.490304 21733 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:54.491318 21733 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:54.493161 21823 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.494225 21679 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:54.495103 21954 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:54.476248 21795 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.498394 21795 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.498781 21966 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:54.499763 14224 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:54.500708 21795 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.500855 21935 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:54.436175 21675 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.501641 21935 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 21 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:54.502184 21675 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.502944 21935 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.504597 21675 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.484239 21799 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.505678 21799 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:54.489634 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 58170.3us
I20260709 13:20:54.483011 21452 consensus_queue.cc:1059] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:54.481693 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:54.512507 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:54.513397 14372 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:54.516710 14377 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:54.518410 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:54.437317 21534 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.077s
I20260709 13:20:54.484098 21903 raft_consensus.cc:740] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:54.530997 14867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.678s	user 0.017s	sys 0.056s
W20260709 13:20:54.531509 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.69708e+06us
I20260709 13:20:54.539173 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.539880 21994 consensus_queue.cc:1059] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:54.541088 21778 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:54.541652 21994 raft_consensus.cc:3055] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:54.526710 21795 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:20:54.542057 21994 raft_consensus.cc:740] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:54.542905 21994 consensus_queue.cc:260] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.540637 21999 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:20:54.515740 21966 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.515149 21675 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:54.524492 21725 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:54.552690 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:54.556038 14867 leader_election.cc:400] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 21. Current term is 22.
I20260709 13:20:54.556869 21675 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:54.493680 21983 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:54.485188 21992 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.556784 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.508854 21970 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.557041 21635 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:54.529417 21781 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:20:54.556207 21534 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:54.553889 21725 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.557081 21890 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:54.560163 21994 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:54.563285 21999 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:54.554873 21966 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.577888 21954 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:54.597980 21992 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.599758 21983 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:54.602779 21966 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.611055 21970 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:54.643661 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 367581us
I20260709 13:20:54.646171 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:54.653282 14342 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.563972 14867 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.576400 21725 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:54.659248 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 95246.2us
W20260709 13:20:54.660279 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.663847 21635 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:20:54.666952 21635 consensus_queue.cc:1243] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:20:54.668521 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.668998 21750 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:54.670187 21823 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:54.670630 21750 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.674300 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:54.666983 21799 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.660615 21647 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:54.653082 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 421125us
I20260709 13:20:54.677376 21647 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:54.691311 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.684084 21647 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:54.706554 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:54.672224 21823 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:54.710075 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45570.4us
I20260709 13:20:54.717849 14300 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:54.726092 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.756568 21954 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.757869 21954 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:54.759842 21750 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:54.760995 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.761158 21954 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:54.573163 21534 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:54.765511 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 257542us
I20260709 13:20:54.765537 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:54.766893 14296 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:54.767455 14296 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:54.767875 21534 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.768913 14296 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.752899 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:54.767263 21997 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:54.772315 14300 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:54.774281 14300 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:54.774374 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:54.776485 14300 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.792124 21823 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.795419 21675 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.797402 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:54.798583 14226 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:54.804697 14299 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:54.805866 21336 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:54.806811 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:54.806918 21336 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.813020 14867 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.795521 21928 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:54.839866 21823 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.840986 21825 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:54.841884 21725 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.843070 14296 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:54.774384 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 323060us
I20260709 13:20:54.813936 21635 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:54.826464 21778 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.854748 21997 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:54.856702 14302 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:54.858345 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:54.859658 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:54.860211 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:54.860978 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:54.574193 21903 consensus_queue.cc:260] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:54.864785 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 69767.8us
W20260709 13:20:54.846045 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 520598us
I20260709 13:20:54.827899 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:54.850577 21535 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:54.879860 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:54.899308 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 83769.7us
I20260709 13:20:54.861758 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:54.880615 21823 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:54.915175 21823 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.862990 21336 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:54.918159 21635 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.918999 21534 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:54.919545 21535 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.920892 21635 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:54.813643 21811 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:54.921888 14226 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 22: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:54.920514 21535 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.924276 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 2999) took 1394 ms. Trace:
I20260709 13:20:54.926137 21778 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.927416 21935 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.927983 21935 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:54.928743 21778 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:54.826382 22000 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:54.930744 22000 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:54.933687 21725 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.935245 14378 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:54.938117 14373 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
W20260709 13:20:54.933947 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:54.917659 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.936192 21535 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:54.958003 14221 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: [17.14-19.15]
I20260709 13:20:54.960008 21935 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:54.963928 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:54.966133 21954 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.966569 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:54.968981 21991 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:54.968812 21892 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:54.970142 21969 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:54.972697 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:54.973536 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.010296 21725 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.013761 22000 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:54.924772 14225 rpcz_store.cc:276] 0709 13:20:53.529827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.530201 (+   374us) service_pool.cc:224] Handling call
0709 13:20:53.533214 (+  3013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:53.533433 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:53.533733 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:20:54.167596 (+633863us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b18004d1b80. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:20:54.167816 (+   220us) log.cc:844] Serialized 14 byte log entry
0709 13:20:54.922961 (+755145us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b18004d1b80. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf
0709 13:20:54.923229 (+   268us) log.cc:844] Serialized 14 byte log entry
0709 13:20:54.923583 (+   354us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:54.923668 (+    85us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:54.923789 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:54.923892 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:54.924078 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73522,"prepare.queue_time_us":1387266,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":2573,"raft.queue_time_us":33833,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":15704,"spinlock_wait_cycles":23273088,"thread_start_us":78376,"threads_started":1}
I20260709 13:20:55.068512 14223 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
W20260709 13:20:55.072129 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 259439us
I20260709 13:20:55.072676 21970 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:55.073417 21970 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.074605 14867 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:55.077430 21970 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.078462 21954 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:55.081293 21954 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:55.081506 21935 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:55.082204 22013 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:55.083077 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 116699us
I20260709 13:20:55.051692 21778 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:55.085908 21470 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.088223 14900 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:55.088315 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.089569 14893 raft_consensus.cc:1240] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:55.089748 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86819.6us
I20260709 13:20:55.090274 21725 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.092204 21997 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:55.113278 14378 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:55.122766 14296 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:55.128703 14302 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:20:55.109606 14229 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:55.134022 21935 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:55.136199 21994 consensus_meta.cc:287] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.012s
I20260709 13:20:55.136924 21935 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.137732 21528 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.138497 21528 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.141069 21528 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.141371 21470 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.142015 21823 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.013224 21892 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.158139 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.159279 14378 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:55.159581 14222 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:55.054864 21957 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.289s
I20260709 13:20:55.044091 21991 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.111502 22013 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.121403 22000 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:55.172312 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.178547 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.185052 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.187269 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.144114 21470 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:55.177767 21962 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:20:55.208195 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.198189 14342 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:55.230479 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.231463 14229 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:55.234411 14371 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:55.238071 22023 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:20:55.240411 21679 consensus_meta.cc:287] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.746s	user 0.014s	sys 0.005s
W20260709 13:20:55.242614 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 63711.6us
I20260709 13:20:55.243702 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:55.246007 21997 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:55.248039 21892 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.198109 21928 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:55.251302 21725 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.253468 21991 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.254132 14225 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:55.254796 22024 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:55.256922 14370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 3119) took 1145 ms. Trace:
W20260709 13:20:55.258400 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 60370.9us
W20260709 13:20:55.259248 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 110577us
W20260709 13:20:55.260622 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:55.261125 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.261972 21234 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.262624 21234 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:55.265838 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.257330 14370 rpcz_store.cc:276] 0709 13:20:54.111473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.111616 (+   143us) service_pool.cc:224] Handling call
0709 13:20:55.256526 (+1144910us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54000b9854. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:55.256739 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312995584}
I20260709 13:20:55.266489 14369 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:55.210810 21823 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 13:20:55.272197 14270 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:55.272972 21935 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.253304 14119 catalog_manager.cc:5697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:55.267879 21234 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:55.276440 14192 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:55.178225 22013 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:55.287014 14121 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37072 (request call id 326) took 47639 ms (client timeout 15000 ms). Trace:
I20260709 13:20:55.220760 21957 consensus_queue.cc:1243] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 19.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
W20260709 13:20:55.315291 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 55149.9us
I20260709 13:20:55.294374 21731 raft_consensus.cc:3055] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:55.298449 14376 raft_consensus.cc:2393] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 22: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:55.307699 21961 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:55.308734 21770 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.824s	user 0.013s	sys 0.005s
I20260709 13:20:55.311100 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.332814 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:55.336647 14378 raft_consensus.cc:2393] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:55.345055 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:55.348889 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 72719.3us
I20260709 13:20:55.350698 14344 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:55.356266 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 172344us
I20260709 13:20:55.357174 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.327183 21731 raft_consensus.cc:740] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:20:55.358425 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 86399.9us
I20260709 13:20:55.344992 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.359606 14299 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:55.360303 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:55.367798 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.354820 21470 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:55.374694 14229 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:55.357234 21675 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.353199 21535 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.359864 21935 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:55.402580 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.403360 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.403517 14295 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:55.404302 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:55.406870 21528 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:20:55.407721 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68945.7us
I20260709 13:20:55.408497 21528 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:55.408610 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:55.410009 22026 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:55.410444 22026 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:55.389102 21961 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.411536 22026 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.412799 21961 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.413133 22026 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:55.410456 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:55.407047 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:55.416776 14222 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:20:55.419005 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:55.418035 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.413683 22004 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:55.391167 21991 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:55.421859 22003 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
W20260709 13:20:55.428520 22016 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:20:55.434180 21731 consensus_queue.cc:260] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.436604 21731 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:55.438390 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 43639.3us
I20260709 13:20:55.440372 14302 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:55.425598 21675 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.441767 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.447956 21528 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:55.448824 21528 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:55.442454 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:55.450949 21811 consensus_meta.cc:287] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.005s
I20260709 13:20:55.451704 21811 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:55.452626 22003 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:55.443199 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:55.454046 14376 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:55.454581 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.455523 14220 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:55.455963 21903 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:55.434765 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 119978us
I20260709 13:20:55.385360 21954 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:55.460023 14344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.390707 21470 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:55.460013 14867 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:55.421056 14223 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:55.457690 14220 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:55.453240 22003 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.465289 14221 raft_consensus.cc:3060] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:55.486203 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.443640 21770 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:55.497215 14119 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:55.499301 21528 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:55.501169 14302 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:55.480263 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.506328 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:55.507265 14228 raft_consensus.cc:2410] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:20:55.507292 14295 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:55.508643 22004 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:55.512404 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:55.513360 14299 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:55.514500 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.444571 21963 raft_consensus.cc:2804] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:55.522545 21963 raft_consensus.cc:697] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:55.524084 21963 consensus_queue.cc:237] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:55.526016 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.527765 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:55.528456 14224 raft_consensus.cc:2376] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21. Re-sending same reply.
I20260709 13:20:55.531116 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:55.534955 14376 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:55.529748 14371 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:20:55.531728 14378 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:55.443728 21991 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:55.392982 21535 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.540761 22004 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.551033 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.554579 22004 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.557498 22004 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.550928 21811 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:55.558459 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 151522us
I20260709 13:20:55.559578 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:55.561120 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:55.562005 14378 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 24.
I20260709 13:20:55.570716 21675 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.538890 22000 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:55.500427 14119 catalog_manager.cc:5697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 6 to 16, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 16 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.539161 21954 raft_consensus.cc:697] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:55.606307 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.443517 21892 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:55.608930 14302 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:55.609668 14295 raft_consensus.cc:2410] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:20:55.612205 14228 raft_consensus.cc:2393] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 25: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:55.616688 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.619936 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.582382 22000 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.631912 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.632925 14295 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:20:55.582273 21994 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.645057 14225 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:55.614022 21528 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:55.659209 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.661204 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.664148 14376 raft_consensus.cc:2410] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:55.619769 21770 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:55.626307 22000 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:55.558506 21811 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.605854 21991 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.638608 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:55.712538 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.709878 14344 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:55.710157 14193 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:55.717264 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:55.720636 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 159648us
I20260709 13:20:55.611826 21892 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:55.743309 21892 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:55.726998 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 87532.1us
I20260709 13:20:55.746917 14299 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:55.728223 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:55.660179 21994 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.748315 21928 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:55.758852 22025 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:20:55.760248 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.691829 21961 consensus_queue.cc:1059] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:20:55.627476 21470 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:55.765767 21995 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:55.777957 21647 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 1.044s	user 0.003s	sys 0.017s
I20260709 13:20:55.668556 22004 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:20:55.765246 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 43828.4us
I20260709 13:20:55.780846 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:55.782173 14228 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:55.761318 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.789188 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.790462 14376 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:55.792946 21935 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:55.794447 21991 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.795760 22003 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:55.773207 22008 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.247s
I20260709 13:20:55.796448 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:55.797367 21995 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.803753 21954 consensus_queue.cc:237] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:55.795783 21811 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.810581 22012 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.819741 21823 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:20:55.810974 14268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.803862 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.811805 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:55.847150 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.844530 14371 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:55.812913 21731 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:55.829130 21988 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:55.821983 14896 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:55.786883 21928 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.821643 14898 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 25.
I20260709 13:20:55.832901 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.810482 21675 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:55.838979 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.840238 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:55.813998 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 149525us
I20260709 13:20:55.850679 14369 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: [16.13-19.15]
I20260709 13:20:55.809566 22013 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.841944 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.851986 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:55.861738 14378 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 22: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:55.856671 14299 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:55.845674 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.841670 21935 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.864543 14375 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:55.819437 21647 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.858999 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.860162 14892 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:55.866568 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:55.826349 22004 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.873714 14895 raft_consensus.cc:2393] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 18: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:55.872030 14371 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:55.857828 21731 consensus_queue.cc:1243] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer a9b2cf49ceed478480fb0f27ccf55d81 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:55.858865 21928 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:55.877978 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.878142 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.878762 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.854526 21988 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:55.883275 21647 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:55.862435 21823 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:20:55.884390 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 67069.8us
I20260709 13:20:55.886332 14373 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:20:55.886411 14899 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:55.897778 14295 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:55.901850 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:55.902050 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.902832 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.901850 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.905508 14892 raft_consensus.cc:2393] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 20: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:55.903528 14895 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:20:55.866732 22012 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.913765 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.915006 14897 raft_consensus.cc:2410] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:20:55.915351 22012 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.915863 22008 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.916347 22008 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.842892 14119 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 12 to 15, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 15 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.919085 22026 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:55.919885 21991 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.919942 22004 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:55.919497 14119 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 12 to 15, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 15 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.912560 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.913383 22013 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:55.918355 22008 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:55.923277 21991 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:55.913118 14341 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:55.926724 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 81012.3us
I20260709 13:20:55.928697 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:55.936776 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:55.942574 22004 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:55.925519 21991 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:55.947295 22008 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.947862 22008 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.949469 22013 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:55.866367 21811 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:20:55.950105 22013 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.962007 14221 raft_consensus.cc:2468] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:20:55.878057 21935 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:55.957659 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.967199 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.976307 14302 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
W20260709 13:20:55.979120 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 430410us
I20260709 13:20:55.981724 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:55.983521 14898 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:56.016438 14341 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:56.020095 14374 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:20:56.015674 14896 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
W20260709 13:20:56.022764 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 115966us
I20260709 13:20:55.983203 14894 raft_consensus.cc:2468] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:56.023595 14267 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:56.026809 14296 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:56.030675 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:56.035290 21778 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.921420 14119 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 16 to 18, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 18 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.039767 14341 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:56.030339 21647 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:56.043506 21903 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:56.043710 21647 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:56.045099 22008 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:56.046842 22013 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:56.047049 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 52912.1us
I20260709 13:20:56.024809 21988 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:56.052305 21647 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:56.053118 21988 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:56.057847 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:56.059324 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:56.060036 14898 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:56.061931 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:56.060947 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:56.043553 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:56.049321 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:56.029776 22004 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:56.037755 21994 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:56.093809 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:56.100678 14299 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 24.
I20260709 13:20:56.103250 21512 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.103847 21512 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:56.093493 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:56.107975 14301 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 20: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:56.084717 22013 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:56.105898 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:56.088963 21811 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:56.036000 21778 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:56.098343 21725 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:56.137108 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 113595us
I20260709 13:20:56.147341 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:56.152842 14898 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:56.139885 21725 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.088094 21823 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:56.157812 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:56.140149 21995 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:56.167742 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 79093.9us
W20260709 13:20:56.171350 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 420192us
I20260709 13:20:56.172537 14193 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:56.175040 14301 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:56.186513 14193 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:56.161024 21725 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:56.178261 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:56.192181 14228 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:56.187291 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:56.197046 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:56.197950 14229 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:56.206146 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 354228us
I20260709 13:20:56.139707 22000 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:56.207249 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:56.252731 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:56.253665 14373 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:56.255393 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:56.257663 14371 raft_consensus.cc:2410] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:56.271811 14298 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:20:56.272630 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:56.158456 21512 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:56.274621 14226 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:20:56.275646 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 102265us
W20260709 13:20:56.284113 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 76971.9us
I20260709 13:20:56.286410 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:56.258746 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:56.288825 14369 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:20:56.251258 21955 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:56.346942 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 70367.2us
I20260709 13:20:56.354660 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:56.366961 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:56.343536 22038 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:20:56.364238 14193 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:56.377746 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 199584us
I20260709 13:20:56.378984 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:56.336592 21470 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.371155 22013 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:56.353737 21935 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:56.390821 14371 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 16.
I20260709 13:20:56.411883 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
W20260709 13:20:56.419919 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 62969.2us
I20260709 13:20:56.420949 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:56.426456 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:56.479863 22013 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:56.481441 22035 log.cc:927] Time spent T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 13:20:56.482226 21733 raft_consensus.cc:3055] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:56.482730 21733 raft_consensus.cc:740] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:56.490819 21778 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:56.491808 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2965) took 1273 ms. Trace:
W20260709 13:20:56.494609 22039 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:20:56.495236 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3571) took 1188 ms. Trace:
W20260709 13:20:56.498198 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 160491us
I20260709 13:20:56.377252 22045 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:56.397017 21961 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:56.495821 14297 rpcz_store.cc:276] 0709 13:20:55.307310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.307540 (+   230us) service_pool.cc:224] Handling call
0709 13:20:55.307957 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:55.308413 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:55.308442 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:55.348095 (+ 39653us) log.cc:844] Serialized 26 byte log entry
0709 13:20:55.784774 (+436679us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:55.784813 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:55.784877 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:56.494819 (+709942us) raft_consensus.cc:1685] finished
0709 13:20:56.494852 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:56.495110 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3204,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":30955,"thread_start_us":407273,"threads_started":1,"wal-append.queue_time_us":672185}
W20260709 13:20:56.530685 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 151819us
I20260709 13:20:56.423974 21811 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:56.492283 14377 rpcz_store.cc:276] 0709 13:20:55.139797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.228557 (+ 88760us) service_pool.cc:224] Handling call
0709 13:20:55.335080 (+106523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:55.352074 (+ 16994us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:55.382340 (+ 30266us) log.cc:844] Serialized 14 byte log entry
0709 13:20:55.863777 (+481437us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.305647 (+441870us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.411799 (+106152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:56.411858 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:56.411914 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.413045 (+  1131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:56.413195 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46909,"prepare.queue_time_us":24413,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":148,"raft.queue_time_us":57306,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":2648,"thread_start_us":906230,"threads_started":3,"wal-append.queue_time_us":620154}
W20260709 13:20:56.536659 22038 log.cc:927] Time spent T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:20:56.543483 21961 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:56.532596 22057 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:56.554905 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 134031us
I20260709 13:20:56.423205 21470 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:56.548766 22056 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:56.559490 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:56.621187 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 64988.9us
I20260709 13:20:56.625258 14229 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:56.552644 21991 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:56.551388 21955 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:56.630357 22041 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.087s
W20260709 13:20:56.631909 22046 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
I20260709 13:20:56.627355 22053 raft_consensus.cc:2764] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:20:56.651537 22047 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.092s
I20260709 13:20:56.634900 22069 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.652688 22069 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:56.655108 22069 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:56.614404 22062 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.655967 14304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3439) took 1139 ms. Trace:
I20260709 13:20:56.655870 22062 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:56.658452 22062 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:56.659122 22062 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.659502 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:56.659615 22062 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:56.660185 14901 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
W20260709 13:20:56.661124 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 519060us
I20260709 13:20:56.662065 21512 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:56.662158 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:56.662614 21512 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.663034 21512 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:56.664443 21991 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:56.663193 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 516194us
I20260709 13:20:56.666101 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:56.666997 14270 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:56.667532 22012 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:56.668008 22012 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:56.668440 22012 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:56.668859 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:55.323374 14121 rpcz_store.cc:269] 0709 13:20:07.646747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.647368 (+   621us) service_pool.cc:224] Handling call
0709 13:20:09.537365 (+1889997us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54002c0010. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f68640 00007f8df2e3fb76 00007f8df2f49c3e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc 00007f8df1409392 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:55.285627 (+45748262us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:43.664965 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:43.710828 (+ 45863us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:43.710880 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:20:43.710897 (+    17us) tablet.cc:662] Decoding operations
0709 13:20:43.712042 (+  1145us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:43.712155 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:43.712187 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:20:43.713336 (+  1149us) tablet.cc:701] Row locks acquired
0709 13:20:43.713386 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:20:43.849051 (+135665us) write_op.cc:270] Start()
0709 13:20:43.921690 (+ 72639us) write_op.cc:276] Timestamp: P: 1783603243810527 usec, L: 0
0709 13:20:43.942585 (+ 20895us) op_driver.cc:348] REPLICATION: starting
0709 13:20:44.039313 (+ 96728us) log.cc:844] Serialized 4475 byte log entry
0709 13:20:44.142285 (+102972us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5400152054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded087e28 00007f8df0ac2581 00007f8df0ac1d58 00007f8df0ac69f1 00007f8df0ac69a9 00007f8df0ac6939 00007f8df0ac6901 00007f8df0ac5b2d 000000000038f354 000000000038f199
0709 13:20:45.146759 (+1004474us) op_driver.cc:464] REPLICATION: finished
0709 13:20:46.270606 (+1123847us) write_op.cc:301] APPLY: starting
0709 13:20:46.270730 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:46.335334 (+ 64604us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:46.384662 (+ 49328us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:46.634720 (+250058us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b5400152054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08932a 00007f8ded00ef14 00007f8ded00eec3 00007f8ded00ee38 00007f8ded00edf3 00007f8ded00e0dc 00007f8ded037e16 00007f8ded01fcbb 00007f8ded00a39d 00007f8ded00dd75
0709 13:20:46.811659 (+176939us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:46.814067 (+  2408us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:20:46.814130 (+    63us) write_op.cc:312] APPLY: finished
0709 13:20:46.814573 (+   443us) log.cc:844] Serialized 105 byte log entry
0709 13:20:46.959626 (+145053us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:46.964843 (+  5217us) write_op.cc:454] Released schema lock
0709 13:20:46.964923 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:46.965575 (+   652us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:46.965613 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6979234,"reported_tablets":46,"spinlock_wait_cycles":67487104,"child_traces":[["op",{"apply.queue_time_us":1123458,"apply.run_cpu_time_us":30742,"apply.run_wall_time_us":694931,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":247410,"prepare.run_cpu_time_us":15788,"prepare.run_wall_time_us":508340,"raft.queue_time_us":845716,"raft.run_cpu_time_us":112073,"raft.run_wall_time_us":1653380,"replication_time_us":1170681,"spinlock_wait_cycles":216729088,"thread_start_us":1627196,"threads_started":5,"wal-append.queue_time_us":287605,"wal-append.run_cpu_time_us":22154,"wal-append.run_wall_time_us":2548803}]]}
I20260709 13:20:56.670315 21954 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:56.670802 21954 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.671192 21954 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:56.671367 21961 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:56.672140 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:56.673066 14371 raft_consensus.cc:2410] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:20:56.674521 14375 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:20:56.674973 14375 pending_rounds.cc:85] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 14
I20260709 13:20:56.675272 14375 pending_rounds.cc:107] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:20:56.675647 14375 raft_consensus.cc:2889] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:56.639454 21470 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:56.568610 22000 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:56.640753 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:56.359674 14119 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 13 to 15, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 15 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:56.558548 22057 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:56.694051 14898 consensus_meta.cc:287] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.001s
I20260709 13:20:56.694591 14898 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:20:56.680372 14373 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:56.656368 14304 rpcz_store.cc:276] 0709 13:20:55.516400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.540890 (+ 24490us) service_pool.cc:224] Handling call
0709 13:20:55.586537 (+ 45647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:55.608821 (+ 22284us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:55.705122 (+ 96301us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.132195 (+427073us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.655460 (+523265us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b18003739c0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:20:56.655624 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:56.655674 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:56.655726 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.655792 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:56.655911 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9952,"prepare.queue_time_us":78876,"prepare.run_wall_time_us":45,"raft.queue_time_us":801,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":7908,"spinlock_wait_cycles":52849024,"thread_start_us":332816,"threads_started":1,"wal-append.queue_time_us":586811}
I20260709 13:20:56.622473 22056 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:56.692771 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:56.694368 14893 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
I20260709 13:20:56.701341 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:56.703289 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:56.705336 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:56.704852 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 193747us
I20260709 13:20:56.705209 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:56.707197 14371 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:56.708619 14303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3431) took 1337 ms. Trace:
I20260709 13:20:56.708976 21955 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:56.709087 14303 rpcz_store.cc:276] 0709 13:20:55.354540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.359371 (+  4831us) service_pool.cc:224] Handling call
0709 13:20:55.396817 (+ 37446us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:55.492788 (+ 95971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:55.492837 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:55.493872 (+  1035us) log.cc:844] Serialized 78 byte log entry
0709 13:20:55.976328 (+482456us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:56.160086 (+183758us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.662651 (+502565us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.676318 (+ 13667us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.691838 (+ 15520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.691920 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:56.691977 (+    57us) raft_consensus.cc:1685] finished
0709 13:20:56.691989 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:56.692132 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":524377,"raft.queue_time_us":520772,"raft.run_cpu_time_us":567,"raft.run_wall_time_us":23161,"thread_start_us":615106,"threads_started":2,"wal-append.queue_time_us":674073}
I20260709 13:20:56.714454 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:56.717170 14119 catalog_manager.cc:5697] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 11 to 18, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 18 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:56.720712 21904 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:56.725430 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3574) took 1186 ms. Trace:
I20260709 13:20:56.715734 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:20:56.727777 14299 rpcz_store.cc:276] 0709 13:20:55.538790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.107126 (+568336us) service_pool.cc:224] Handling call
0709 13:20:56.107516 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:56.148382 (+ 40866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.148417 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:56.153348 (+  4931us) log.cc:844] Serialized 26 byte log entry
0709 13:20:56.697903 (+544555us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:56.697974 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.698085 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:56.725116 (+ 27031us) raft_consensus.cc:1685] finished
0709 13:20:56.725146 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:56.725345 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":536674,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":355314,"threads_started":1,"wal-append.queue_time_us":529193}
I20260709 13:20:56.737978 14371 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 25.
I20260709 13:20:56.740411 21904 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:56.742645 21928 consensus_meta.cc:287] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.837s	user 0.007s	sys 0.004s
I20260709 13:20:56.746289 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:56.694000 22057 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:56.722523 14119 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:56.743212 21928 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:56.753199 22051 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:56.764458 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 58593.7us
I20260709 13:20:56.753309 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:56.708664 21998 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:56.753609 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:56.757514 21984 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.754550 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:56.756143 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:56.759289 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:56.725364 22022 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.701704 22056 raft_consensus.cc:3060] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:56.753368 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:56.775998 14304 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 16: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:56.766980 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:56.774232 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:56.777012 14301 raft_consensus.cc:2393] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 18: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:56.777218 14220 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:56.780162 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:56.783257 14227 raft_consensus.cc:2368] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21.
I20260709 13:20:56.783834 14301 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:56.786315 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 71044.3us
I20260709 13:20:56.795475 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:56.803730 14893 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:56.777513 21954 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:56.801132 22079 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:56.822161 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:56.828868 14893 raft_consensus.cc:2393] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:56.833570 14297 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:56.838572 21935 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:56.839797 22072 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.840865 22072 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:56.844265 22072 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:56.846151 22079 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:56.848728 22079 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:56.859110 22012 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:56.862833 21928 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:56.779138 21984 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:56.864850 21988 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.811s	user 0.012s	sys 0.001s
I20260709 13:20:56.865692 14896 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:56.770846 22051 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:56.868363 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:56.869122 14303 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:56.869354 22051 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:56.820678 21998 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:56.794850 22022 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:56.870426 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:56.865635 22044 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:56.874405 21904 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:56.875262 21892 consensus_meta.cc:287] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.131s	user 0.022s	sys 0.020s
I20260709 13:20:56.820710 21962 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.760022 14119 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 15 to 16, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 16 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.876012 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:56.879416 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53824 (request call id 3329) took 1536 ms. Trace:
I20260709 13:20:56.884859 14270 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:56.865872 22067 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.875151 21954 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:56.865593 21984 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:56.876219 22062 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:56.897246 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:56.941442 14299 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 24.
I20260709 13:20:56.839928 21935 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:56.918445 14222 rpcz_store.cc:276] 0709 13:20:55.343535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.424163 (+ 80628us) service_pool.cc:224] Handling call
0709 13:20:55.543393 (+119230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:55.630307 (+ 86914us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:55.706521 (+ 76214us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.132378 (+425857us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:56.176070 (+ 43692us) log.cc:844] Serialized 26 byte log entry
0709 13:20:56.176208 (+   138us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:56.650328 (+474120us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b18001b4600. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f81e07 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:20:56.777956 (+127628us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.830251 (+ 52295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.830359 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:56.879245 (+ 48886us) raft_consensus.cc:1685] finished
0709 13:20:56.879261 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:56.879371 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51907,"prepare.queue_time_us":169553,"prepare.run_cpu_time_us":170,"prepare.run_wall_time_us":3757,"raft.queue_time_us":156105,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":21856,"spinlock_wait_cycles":21901568,"thread_start_us":449990,"threads_started":2,"wal-append.queue_time_us":789346}
I20260709 13:20:56.814402 21512 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:56.861682 22012 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:56.939915 14893 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:20:56.918597 14297 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
W20260709 13:20:56.945923 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61182.9us
I20260709 13:20:56.886170 22044 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:56.942857 21725 consensus_meta.cc:287] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.001s
I20260709 13:20:56.950454 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1631) took 1063 ms. Trace:
I20260709 13:20:56.953987 14893 rpcz_store.cc:276] 0709 13:20:55.881560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.832702 (+951142us) service_pool.cc:224] Handling call
0709 13:20:56.886737 (+ 54035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:56.944437 (+ 57700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.945393 (+   956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:56.987538 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:56.988030 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:56.988898 14226 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:56.990166 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:56.991046 14229 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:56.993352 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:56.994596 14222 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:56.956207 22062 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:56.943538 21935 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:56.953914 21955 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.948487 21904 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:56.937462 21892 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.002055 22083 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:57.001853 21998 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.024262 14301 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
W20260709 13:20:57.006043 14344 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.208.129:38445 timed out after 2.177s (SENT) [suppressed 9 similar messages]
I20260709 13:20:56.953053 22044 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:57.003981 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 105662us
I20260709 13:20:56.959406 21535 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.002933 21984 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:56.954360 21928 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:57.090113 22022 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:57.083333 22082 log.cc:927] Time spent T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:57.083755 22060 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.007179 21955 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:57.063637 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 193278us
I20260709 13:20:56.960839 21725 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.007302 21823 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:57.102871 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:57.007395 22083 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.960074 22067 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.085632 22086 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:57.007750 22062 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.118137 21935 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.149246 22086 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.162735 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:57.164312 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:57.164633 22086 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:57.104827 22057 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.149112 22083 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:57.122054 14377 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:57.134654 14119 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:57.124369 21892 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:56.940897 21962 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.167613 14119 catalog_manager.cc:5697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 11 to 17, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 17 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:57.169668 21962 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:57.063863 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:57.078137 22045 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:57.076917 21512 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.088565 14229 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:57.174139 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:57.105405 14226 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:20:57.174438 14270 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.175429 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:57.175446 21512 raft_consensus.cc:2804] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:57.176411 21512 raft_consensus.cc:697] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:57.153491 21823 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.177598 21512 consensus_queue.cc:237] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.179127 21823 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:57.180508 14300 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:57.181061 14270 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.182092 21957 raft_consensus.cc:2804] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:57.182585 21957 raft_consensus.cc:697] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 21 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:57.183459 21957 consensus_queue.cc:237] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.186193 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.186851 14303 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:20:57.187247 14303 pending_rounds.cc:85] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 10
I20260709 13:20:57.187413 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:57.127444 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:57.188215 14299 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 21: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:57.188712 22057 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.187417 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.189849 14298 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:57.128330 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.187460 14303 pending_rounds.cc:107] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 19.11
W20260709 13:20:57.190528 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 62288.5us
I20260709 13:20:57.190817 14303 raft_consensus.cc:2889] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:57.192643 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.193558 21892 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:57.194036 21892 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.194175 22003 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:57.124924 21675 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.194604 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:57.138931 21928 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.176337 14226 raft_consensus.cc:2410] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:20:57.196364 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1621) took 1317 ms. Trace:
I20260709 13:20:57.197026 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:57.197178 21928 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:57.194409 21892 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:57.141454 21955 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.142865 22060 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.198197 22045 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.199913 22060 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.195149 21675 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.145560 21725 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.146725 14224 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 23: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:57.148757 22089 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:57.144292 22034 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 1.004s	user 0.000s	sys 0.012s
I20260709 13:20:57.170493 14222 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:57.154997 21935 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:57.150957 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 2957) took 2312 ms. Trace:
I20260709 13:20:57.152561 14220 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 22: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:57.171759 14375 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:57.120805 22056 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:57.153981 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 51225.2us
I20260709 13:20:57.152240 21811 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:57.212983 14304 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:20:57.129496 21984 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.183887 21528 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:57.192790 21991 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.195341 14228 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:20:57.196729 14898 rpcz_store.cc:276] 0709 13:20:55.878744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.060686 (+181942us) service_pool.cc:224] Handling call
0709 13:20:57.196178 (+1135492us) spinlock_profiling.cc:243] Waited 89.5 ms on lock 0x7b5400882f54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:57.196281 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205788544}
I20260709 13:20:57.223775 22044 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.224366 14898 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:57.200376 22045 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.153276 22067 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:57.201779 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:57.201988 14229 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:57.140185 14267 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:57.226472 14302 raft_consensus.cc:3060] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:57.227058 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 86951.5us
I20260709 13:20:57.070618 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1633) took 1163 ms. Trace:
I20260709 13:20:57.228549 14893 rpcz_store.cc:276] 0709 13:20:55.906832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.004919 (+1098087us) service_pool.cc:224] Handling call
0709 13:20:57.062838 (+ 57919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:57.063030 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:57.063058 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:57.063103 (+    45us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:57.063136 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.063336 (+   200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.070545 (+  7209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:57.150842 22062 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:57.230625 21904 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:57.232386 22015 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:20:57.203675 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 197663us
I20260709 13:20:57.193567 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:57.153558 14295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1509) took 1633 ms (client timeout 1882 ms). Trace:
I20260709 13:20:57.196975 22052 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.233824 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.234274 22062 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:57.234174 22052 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.234732 22062 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.235150 22062 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:57.236382 22052 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:57.226336 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:57.141399 22049 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.742s	user 0.001s	sys 0.001s
I20260709 13:20:57.237095 22044 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.238013 21823 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:57.238198 14299 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:57.238479 21823 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.233490 14302 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:20:57.238902 21823 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.239202 14302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45306 (request call id 1514) took 1294 ms. Trace:
I20260709 13:20:57.239566 14302 rpcz_store.cc:276] 0709 13:20:55.944580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.032133 (+ 87553us) service_pool.cc:224] Handling call
0709 13:20:57.201623 (+1169490us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b5800195f98. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f67a22 00007f8df2e80c09 00007f8df1fdaee0 00007f8df20a40ab 00007f8df20a4131 00007f8df20520a0 00007f8df2051984 00007f8deb5cc6d4 00007f8deb5cc662
0709 13:20:57.239150 (+ 37527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8798592}
I20260709 13:20:57.233564 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.240988 14300 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:20:57.222632 14270 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.241689 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.242530 14302 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:57.232146 21892 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.245409 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:57.246081 14267 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:57.194689 22003 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:57.203702 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:57.247185 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:57.248847 14300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1503) took 2542 ms. Trace:
I20260709 13:20:57.249212 14222 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:20:57.250838 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.252130 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:57.219403 21811 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:57.219659 21962 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:57.233958 14295 rpcz_store.cc:269] 0709 13:20:55.520268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.663906 (+143638us) service_pool.cc:224] Handling call
0709 13:20:57.153346 (+1489440us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000dbbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:57.153467 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423352192}
I20260709 13:20:57.251600 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.209257 22072 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:57.209924 14372 rpcz_store.cc:276] 0709 13:20:54.825860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.839205 (+ 13345us) service_pool.cc:224] Handling call
0709 13:20:54.839596 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:55.062254 (+222658us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:55.322843 (+260589us) log.cc:844] Serialized 14 byte log entry
0709 13:20:55.759491 (+436648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:55.759543 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:55.759588 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.137941 (+1378353us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54000b9354. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:57.137990 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.138149 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18302,"prepare.queue_time_us":163153,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":42,"raft.queue_time_us":1032,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2549,"spinlock_wait_cycles":397745408,"thread_start_us":617872,"threads_started":2,"wal-append.queue_time_us":685724,"wal-append.run_cpu_time_us":12566,"wal-append.run_wall_time_us":1021578}
I20260709 13:20:57.251569 14119 catalog_manager.cc:5697] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 13 to 16, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 16 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:57.291740 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.246625 21991 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:57.288153 21674 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:20:57.219278 21679 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:20:57.280908 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:57.284482 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 72549.2us
I20260709 13:20:57.301018 14304 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:20:57.284065 14298 raft_consensus.cc:1240] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:57.283243 14228 raft_consensus.cc:1275] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:57.259107 14267 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:57.277822 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.276738 14299 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:57.276149 14226 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:20:57.287025 14344 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:57.288473 22004 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:57.249604 14300 rpcz_store.cc:276] 0709 13:20:54.722296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.727298 (+  5002us) service_pool.cc:224] Handling call
0709 13:20:54.745765 (+ 18467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:57.179912 (+2434147us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54001a6420. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded001a1d 00007f8decfe81a4 00007f8ded06a447 00007f8ded082fe7 00007f8ded0847de 00007f8ded08eb49 00007f8ded08f416 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419
0709 13:20:57.241320 (+ 61408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.241555 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053290752}
I20260709 13:20:57.289974 22079 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:57.306203 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.280406 21984 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.282768 21675 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:57.310575 14300 raft_consensus.cc:2368] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19.
I20260709 13:20:57.310514 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.258303 21904 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:57.305683 21512 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:57.246479 21528 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.316888 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.317278 14298 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:57.304698 21679 consensus_queue.cc:1243] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:57.257767 22086 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:20:57.343338 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.342250 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.344007 14300 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
W20260709 13:20:57.320413 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 61387.6us
I20260709 13:20:57.303731 21903 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.344602 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.309269 22079 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:57.346812 14298 pending_rounds.cc:85] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 10
I20260709 13:20:57.347288 14298 pending_rounds.cc:107] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:20:57.347625 14298 raft_consensus.cc:2889] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:57.326711 21528 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.326920 22061 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:57.344897 21903 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.350303 22061 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.350746 22061 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:57.354252 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 661514us
I20260709 13:20:57.354449 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:57.355125 14893 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
I20260709 13:20:57.356753 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.363740 14119 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 14 to 16, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 16 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:20:57.366149 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 56426.2us
I20260709 13:20:57.366333 22041 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:57.366626 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53830 (request call id 3019) took 1007 ms. Trace:
I20260709 13:20:57.361371 21988 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.006s
I20260709 13:20:57.367043 14221 rpcz_store.cc:276] 0709 13:20:56.363915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.372064 (+  8149us) service_pool.cc:224] Handling call
0709 13:20:56.372462 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:56.535228 (+162766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.535261 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:56.535301 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:56.535333 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.366382 (+831049us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54003e0654. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:57.366427 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.366566 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373818624}
I20260709 13:20:57.367651 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:57.348404 21535 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:57.370007 22026 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:57.370220 21535 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.370472 22026 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.370630 21535 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.370884 22026 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:57.328583 21892 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.330168 21733 consensus_queue.cc:260] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.332551 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1708) took 1760 ms. Trace:
I20260709 13:20:57.384089 14193 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.296027 21962 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.339829 21963 consensus_queue.cc:1059] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:57.395574 21725 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:57.396157 21963 consensus_queue.cc:1243] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:20:57.341339 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 804236us
I20260709 13:20:57.342259 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:57.397563 14303 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:57.397979 21981 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:20:57.341421 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 804300us
I20260709 13:20:57.402223 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:57.402905 14892 raft_consensus.cc:3060] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:57.405462 14303 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 24.
I20260709 13:20:57.406615 14342 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.407447 21997 raft_consensus.cc:3055] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:57.407583 21679 raft_consensus.cc:2804] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:57.407953 21997 raft_consensus.cc:740] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:57.408270 21679 raft_consensus.cc:697] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 24 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:57.408913 21997 consensus_queue.cc:260] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.409281 21679 consensus_queue.cc:237] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.410130 21997 raft_consensus.cc:3060] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:57.410331 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:57.386377 22053 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:57.316511 21991 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:57.411897 22056 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.321772 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.414191 14299 raft_consensus.cc:1217] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Deduplicated request from leader. Original: 16.9->[18.10-18.10]   Dedup: 18.10->[]
I20260709 13:20:57.281250 22062 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.414737 14299 raft_consensus.cc:1240] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:20:57.416484 22062 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:57.359717 22061 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.328516 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1505) took 1809 ms. Trace:
I20260709 13:20:57.322400 21984 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:57.376573 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:57.369565 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.417841 14296 rpcz_store.cc:276] 0709 13:20:55.518986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.942503 (+423517us) service_pool.cc:224] Handling call
0709 13:20:55.942777 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:56.027436 (+ 84659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.328293 (+1300857us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54001f8454. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:20:57.328462 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188375936}
I20260709 13:20:57.321074 21904 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.306010 22072 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.391029 21733 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:57.392143 22073 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.391901 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.415225 21811 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.392773 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:57.394487 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.395099 22044 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:57.395215 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:57.424762 21904 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:57.411070 14898 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:57.369105 14865 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:57.445765 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:57.446434 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 77401.6us
I20260709 13:20:57.419696 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:57.348933 22079 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:57.322026 22003 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.386842 14900 rpcz_store.cc:276] 0709 13:20:55.572610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.572754 (+   144us) service_pool.cc:224] Handling call
0709 13:20:55.573133 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:56.017869 (+444736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.017899 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:56.083298 (+ 65399us) log.cc:844] Serialized 52 byte log entry
0709 13:20:56.363097 (+279799us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:56.535960 (+172863us) log.cc:844] Serialized 14 byte log entry
0709 13:20:57.331939 (+795979us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b18000b4d00. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8ded084060 00007f8ded096716 00007f8ded0a7287 00007f8ded0a7208
0709 13:20:57.332127 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.332194 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:57.332232 (+    38us) raft_consensus.cc:1685] finished
0709 13:20:57.332319 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.332469 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1138,"prepare.queue_time_us":42802,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":1043952,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":224,"spinlock_wait_cycles":15848832,"thread_start_us":792019,"threads_started":3,"wal-append.queue_time_us":433200}
I20260709 13:20:57.423705 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.429402 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:57.454123 14299 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:57.454316 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1753) took 1297 ms. Trace:
I20260709 13:20:57.317334 21823 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.419186 21991 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:57.423635 22089 raft_consensus.cc:2804] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:57.423184 21988 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:20:57.342571 21647 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:20:57.446979 14896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1622) took 1568 ms. Trace:
I20260709 13:20:57.486166 14896 rpcz_store.cc:276] 0709 13:20:55.879026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.057465 (+178439us) service_pool.cc:224] Handling call
0709 13:20:57.446831 (+1389366us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54007468d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:57.446927 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1855806208}
I20260709 13:20:57.487366 21647 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:57.487440 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:57.487936 21647 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:57.419239 21984 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:57.449146 14864 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.431314 22073 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:57.421525 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50983.8us
I20260709 13:20:57.451344 14897 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:20:57.493202 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 44123.7us
I20260709 13:20:57.453295 21731 raft_consensus.cc:2804] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:57.437232 22060 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:57.471390 21991 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:57.474092 22062 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:57.471820 22089 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:57.476022 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:57.476464 22072 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.459005 21778 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:20:57.477136 14220 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: [17.14-19.15]
I20260709 13:20:57.480324 14892 raft_consensus.cc:2468] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 24.
I20260709 13:20:57.526067 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.482775 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" is_pre_election: true
I20260709 13:20:57.483704 21962 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.484181 22041 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:57.489019 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:57.490363 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:57.365653 14119 catalog_manager.cc:5697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 11 to 12, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 12 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:57.457096 14341 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.453475 21995 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:57.493870 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:57.495090 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:57.492588 21984 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:57.495810 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.508232 22062 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:57.499006 22026 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.485548 21903 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.454919 14227 rpcz_store.cc:276] 0709 13:20:56.151014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.151133 (+   119us) service_pool.cc:224] Handling call
0709 13:20:57.443620 (+1292487us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54002774d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:57.447960 (+  4340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809114880}
W20260709 13:20:57.444427 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50022.8us
W20260709 13:20:57.506070 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 219148us
I20260709 13:20:57.474547 22086 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:57.511168 14895 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 25.
I20260709 13:20:57.503201 22060 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.447932 22053 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:57.527406 14300 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
W20260709 13:20:57.527549 14224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57812 (request call id 1756) took 1342 ms (client timeout 1511 ms). Trace:
I20260709 13:20:57.502578 22061 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:57.541864 14225 raft_consensus.cc:3060] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:57.449738 22044 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.491520 22013 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
W20260709 13:20:57.544570 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 87588.4us
I20260709 13:20:57.548707 14302 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:57.525153 22100 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:57.523885 22089 raft_consensus.cc:3060] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:57.551019 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 57286.2us
I20260709 13:20:57.570182 22062 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:57.558025 14299 raft_consensus.cc:2468] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 25.
I20260709 13:20:57.572618 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:57.567628 14193 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.569830 14344 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:57.574123 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 77909us
I20260709 13:20:57.623822 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:57.488850 21647 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:57.577891 14224 rpcz_store.cc:269] 0709 13:20:56.185118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.185270 (+   152us) service_pool.cc:224] Handling call
0709 13:20:57.527358 (+1342088us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400276fd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:57.527493 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047359360}
I20260709 13:20:57.559263 21997 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:57.629614 21997 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.630121 21997 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:57.631570 22108 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:20:57.632138 14343 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.632934 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:57.633548 14378 raft_consensus.cc:3060] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:57.634169 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:57.634639 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:57.635726 22061 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:57.634208 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 64508.4us
I20260709 13:20:57.636927 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:57.637217 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.637809 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:57.638392 14369 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:57.640774 22071 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:57.612623 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:57.641577 22071 consensus_queue.cc:1048] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:57.643301 14341 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:57.643391 22103 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:57.644586 22056 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:57.558923 21675 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:57.644955 22056 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.645359 22056 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:57.650481 14119 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 16 to 17, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 17 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:20:57.652225 14119 catalog_manager.cc:5697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 16 to 20, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 20 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:57.654364 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:57.655048 14895 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:20:57.622318 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:57.655877 22071 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:57.627244 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 54746us
I20260709 13:20:57.627151 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.657263 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:57.657469 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:57.658399 14864 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.658960 21512 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:57.659524 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.660362 22041 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:57.661106 22041 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:57.660298 21528 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:57.660931 21674 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:57.629173 21903 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:57.608752 22057 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:57.654476 21823 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:57.656024 14375 raft_consensus.cc:2368] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 22. Current term is 23.
I20260709 13:20:57.661770 21674 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.663239 21674 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:57.663522 22109 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:57.661530 22041 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.666091 22041 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.667960 14295 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
W20260709 13:20:57.668252 22099 log.cc:927] Time spent T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:20:57.668964 21935 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:57.610124 22053 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.670061 22053 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:57.670797 21954 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:57.671217 21954 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:57.672174 21954 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.652851 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:57.605808 22060 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:57.673506 22071 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:57.674883 22083 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 13:20:57.675307 22083 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.676544 22071 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:57.677398 22083 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.679368 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:57.621182 22100 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.683187 21674 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.684381 22100 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:57.685484 21674 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.686013 21823 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:57.687881 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:57.688482 22072 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:57.690177 14192 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.690980 22041 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:57.691332 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 123823us
I20260709 13:20:57.497568 22073 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.692097 22069 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:57.693297 22084 log.cc:927] Time spent T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:20:57.695998 22056 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.699996 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:57.703476 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.706589 14227 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:57.707866 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:57.709154 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.708840 22060 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.710135 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:57.710878 14373 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:57.711971 14342 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.714291 21954 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:57.714919 14301 raft_consensus.cc:1240] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:57.718029 14220 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:20:57.720273 22003 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:57.725143 22079 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.727810 21811 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.727855 14893 raft_consensus.cc:2468] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 25.
I20260709 13:20:57.729460 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:57.725112 14372 raft_consensus.cc:2468] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:57.730489 21647 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:57.603250 22086 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 2
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
W20260709 13:20:57.732496 22075 log.cc:927] Time spent T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:20:57.608596 21995 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 13:20:57.611210 22044 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:57.732106 22062 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.732976 14378 raft_consensus.cc:2468] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:20:57.868037 14297 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:57.662160 22057 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.721596 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
I20260709 13:20:57.632704 21885 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:57.761256 14302 raft_consensus.cc:2468] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:20:57.762104 14225 raft_consensus.cc:2468] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:20:57.872830 14370 raft_consensus.cc:1275] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:20:57.775542 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a9b2cf49ceed478480fb0f27ccf55d81"
W20260709 13:20:57.778036 14267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.874948 14267 leader_election.cc:400] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 22. Current term is 23.
I20260709 13:20:57.875321 14267 leader_election.cc:403] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:57.841631 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58078.8us
I20260709 13:20:57.879535 22062 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.842669 14298 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.883270 22041 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:57.842859 14300 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:20:57.877210 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.891750 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1624) took 2012 ms. Trace:
I20260709 13:20:57.893175 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:57.894815 21903 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:57.895313 21903 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.895779 21903 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:57.901741 22057 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.776641 21997 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.905314 21997 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:57.906128 14376 raft_consensus.cc:2393] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 17: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:57.857695 21679 raft_consensus.cc:2804] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:20:57.845460 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 63180.4us
I20260709 13:20:57.912508 14371 raft_consensus.cc:1275] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:57.846119 14377 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:57.848235 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 144868us
I20260709 13:20:57.915719 14867 leader_election.cc:400] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21.
I20260709 13:20:57.916149 14867 leader_election.cc:403] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:20:57.755016 22052 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.853304 13122 tablet_server.cc:179] TabletServer@127.12.208.129:0 shutting down...
I20260709 13:20:57.755537 21823 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.848691 14341 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:57.856722 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 166620us
I20260709 13:20:57.841845 21998 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:57.863950 14372 raft_consensus.cc:1275] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:20:57.865087 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.866417 14374 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:57.841708 21528 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.885455 22086 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:20:57.845402 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 133527us
I20260709 13:20:57.892213 14901 rpcz_store.cc:276] 0709 13:20:55.879592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.664274 (+784682us) service_pool.cc:224] Handling call
0709 13:20:56.664577 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:56.664778 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:20:56.694111 (+ 29333us) log.cc:844] Serialized 14 byte log entry
0709 13:20:57.773627 (+1079516us) log.cc:844] Serialized 14 byte log entry
0709 13:20:57.774148 (+   521us) log.cc:844] Serialized 14 byte log entry
0709 13:20:57.891063 (+116915us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b180031a500. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8decc42d70 00007f8decc36293 00007f8decc2bcea 00007f8decc2c23a 00007f8ded096a2a 00007f8ded0a60bf 00007f8ded0a6038
0709 13:20:57.891299 (+   236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:57.891352 (+    53us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:20:57.891404 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.891472 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.891685 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":444063,"prepare.queue_time_us":134004,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":14420,"raft.queue_time_us":424361,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":61986,"spinlock_wait_cycles":3245440,"thread_start_us":585153,"threads_started":3,"wal-append.queue_time_us":269232}
I20260709 13:20:57.858294 21778 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:57.778918 22069 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:57.918797 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 70195.6us
I20260709 13:20:57.937098 14369 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:57.922094 14193 leader_election.cc:400] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19.
I20260709 13:20:57.938604 14193 leader_election.cc:403] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:57.781077 22026 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:57.926683 21823 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:57.931244 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:57.931555 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:57.934161 14342 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:57.942962 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:57.943584 14892 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:57.939028 14298 raft_consensus.cc:2468] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
W20260709 13:20:57.940367 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 279936us
I20260709 13:20:57.871685 21885 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:57.941121 14899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1625) took 2061 ms. Trace:
I20260709 13:20:57.947093 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:57.895342 22079 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:57.956212 14900 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:20:57.947767 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:57.950047 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:57.960683 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:57.961196 14896 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:57.952073 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:57.961851 14369 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 23: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:57.954389 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:57.956535 14342 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.927224 21998 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.927289 21995 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:57.962975 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.940200 22069 raft_consensus.cc:3060] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.970700 14342 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:57.957703 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:57.971547 14376 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:57.946907 21535 consensus_meta.cc:287] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.002s
I20260709 13:20:57.931087 21997 raft_consensus.cc:2804] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:57.932819 21679 raft_consensus.cc:697] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 25 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:57.968616 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:57.969380 14894 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 23: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:57.989740 14378 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:57.975456 14864 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:57.941763 22000 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:57.955078 21674 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 22. Current term is 23.
I20260709 13:20:57.967958 22103 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:57.959412 21885 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:57.965871 22057 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:58.009893 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:57.970803 21998 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:57.925673 21984 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:57.987743 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:58.018417 14369 raft_consensus.cc:2468] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:57.954949 21470 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 18. Current term is 19.
I20260709 13:20:58.008747 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:57.955662 14899 rpcz_store.cc:276] 0709 13:20:55.879836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.809631 (+929795us) service_pool.cc:224] Handling call
0709 13:20:56.810008 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:56.810246 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:20:56.810584 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 13:20:57.361776 (+551192us) log.cc:844] Serialized 14 byte log entry
0709 13:20:57.513698 (+151922us) log.cc:844] Serialized 14 byte log entry
0709 13:20:57.940814 (+427116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:57.940863 (+    49us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:57.940902 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.940978 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.941074 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":418125,"prepare.queue_time_us":1806,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":2068,"raft.queue_time_us":520084,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":8386,"spinlock_wait_cycles":53248,"thread_start_us":710373,"threads_started":3,"wal-append.queue_time_us":197161}
I20260709 13:20:58.021451 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:57.991011 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 431892us
I20260709 13:20:58.013037 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.010767 14892 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:58.014670 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:57.930378 22052 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.014921 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:57.853928 14119 catalog_manager.cc:5697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:57.988655 22101 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:58.011914 22100 raft_consensus.cc:2804] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:57.978189 21731 raft_consensus.cc:697] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:58.021638 14303 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:57.949945 21528 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:57.966012 22073 consensus_queue.cc:1059] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:20:58.025339 14894 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:57.995713 22051 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:58.011746 22057 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:58.032829 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:57.970037 21991 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.009807 21997 raft_consensus.cc:697] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 25 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:58.034301 14378 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
I20260709 13:20:58.036655 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:58.038373 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:58.017679 21963 raft_consensus.cc:2804] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:57.987006 21903 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.022552 14900 raft_consensus.cc:2468] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
W20260709 13:20:58.022917 21904 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.004s
I20260709 13:20:57.990828 21535 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.035127 21512 consensus_queue.cc:1048] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:20:58.030858 22101 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:58.066524 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 101288us
I20260709 13:20:58.071619 14193 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:58.043592 22057 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:58.043174 22051 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.027444 21811 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:58.028440 22103 raft_consensus.cc:697] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:58.059744 14376 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:58.053610 14341 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:58.059240 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:58.020367 21725 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:20:58.054160 14373 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:58.075408 14303 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:58.034857 22079 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:20:58.043361 22026 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:20:58.068174 22101 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:58.062235 22061 raft_consensus.cc:3055] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:58.055764 22100 raft_consensus.cc:697] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:58.042948 22015 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:20:58.060590 22113 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:20:58.074628 21963 raft_consensus.cc:697] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:58.090337 21903 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.082986 22062 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:58.064895 21997 consensus_queue.cc:237] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.095209 21535 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.063293 21904 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.096195 22103 consensus_queue.cc:237] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.074973 22060 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.080515 22051 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:58.105883 14301 raft_consensus.cc:1240] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 24. Current term is 25. Ops: [23.16-24.17]
I20260709 13:20:58.094574 22022 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.109062 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:58.109549 14378 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:58.139179 14375 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:58.087006 21470 raft_consensus.cc:2804] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:58.098302 22061 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:58.099123 22056 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.076712 21811 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.125880 14299 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:58.134835 22052 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:20:58.162482 22112 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:20:58.062844 21679 consensus_queue.cc:237] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.110033 22113 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.197620 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:58.167305 21904 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.135002 21733 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:58.157624 22022 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.191259 14377 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 26.
I20260709 13:20:58.178020 21963 consensus_queue.cc:237] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.200747 22086 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.204069 21528 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:58.204730 22100 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.118458 21731 consensus_queue.cc:237] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.201638 21470 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.211035 22061 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:58.212101 22118 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:20:58.212568 21935 raft_consensus.cc:3055] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:58.212682 21984 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.214603 21811 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:58.216154 22053 consensus_meta.cc:287] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.002s
I20260709 13:20:58.224946 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:58.226118 14901 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:20:58.292997 14901 pending_rounds.cc:85] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 14
I20260709 13:20:58.293280 14901 pending_rounds.cc:107] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:20:58.293503 14901 raft_consensus.cc:2889] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:58.231387 21998 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.259929 14376 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 19.
I20260709 13:20:58.266129 14373 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:58.266716 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:58.264506 21512 consensus_queue.cc:1048] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:20:58.250185 21675 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.282582 21995 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445) with higher term. Message: Invalid argument: T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21.
I20260709 13:20:58.283008 21885 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.272588 21470 raft_consensus.cc:3060] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:58.270318 21733 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:58.295884 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 242379us
I20260709 13:20:58.259124 22101 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.278326 21935 raft_consensus.cc:740] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:20:58.304674 14867 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.298185 21903 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:58.268128 22026 consensus_queue.cc:1048] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:20:58.268805 22086 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.297034 22053 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.273624 21528 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:20:58.322144 14893 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:58.314472 21733 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.331064 21725 consensus_queue.cc:1059] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:58.314550 22051 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.332007 21885 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:58.330142 21903 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 26 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:58.333736 21903 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.335634 21733 raft_consensus.cc:3055] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:58.336105 21733 raft_consensus.cc:740] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:58.300338 21675 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.366863 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:58.356030 22089 consensus_meta.cc:287] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.678s	user 0.002s	sys 0.010s
W20260709 13:20:58.368651 14867 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.374722 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:58.354898 21674 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:58.328320 21823 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.375625 14301 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 17.
I20260709 13:20:58.384516 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:58.384907 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.385228 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.384742 14376 raft_consensus.cc:1240] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:58.389204 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.389963 14900 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:20:58.391566 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:20:58.394690 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 90656.3us
I20260709 13:20:58.385905 14897 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:20:58.396318 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:58.406113 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.408185 14375 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
W20260709 13:20:58.390101 21647 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.006s
I20260709 13:20:58.412437 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.419257 14892 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 16.
I20260709 13:20:58.420383 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.421464 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.360044 22109 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 13:20:58.427630 14892 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:58.428939 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:20:58.415464 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 112832us
I20260709 13:20:58.417505 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:58.429988 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.419204 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:58.378890 21528 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:58.381193 21674 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:58.347651 21733 consensus_queue.cc:260] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.441239 21733 raft_consensus.cc:3060] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:58.441326 21674 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.442845 21674 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:58.386739 22126 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:58.446096 22126 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.446857 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:58.447711 14373 raft_consensus.cc:2393] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 21: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:20:58.397413 22044 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.006s
I20260709 13:20:58.449100 22044 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.450260 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:58.450851 21675 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:58.451617 21957 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:58.397107 22122 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:58.452466 21957 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:58.452584 22122 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.453137 21957 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:58.430140 14369 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 23: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:58.454072 22083 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:58.454500 22083 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:58.454917 22122 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:58.428844 22103 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.455377 22083 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.455991 22103 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.456735 22083 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:58.417088 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.458678 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.459270 14901 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:58.460057 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.412006 22072 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:58.466164 22072 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.466575 22072 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.380584 22089 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.470813 21998 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.472882 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:58.473740 14370 raft_consensus.cc:2393] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 22: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:58.474954 14370 raft_consensus.cc:1240] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:58.475889 22126 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.395114 22125 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:20:58.436959 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:58.491443 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58123us
I20260709 13:20:58.438376 14371 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260709 13:20:58.451813 22044 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:58.494755 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:58.495687 14298 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.452320 22026 consensus_queue.cc:1059] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:58.453219 14221 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 22: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:58.417922 14372 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: []
W20260709 13:20:58.483268 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:58.434836 22127 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:20:58.485603 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:58.425339 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.396147 21997 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.461109 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.426641 14295 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:20:58.429682 22022 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.513469 21733 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:58.510967 21997 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.516390 21997 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:58.497545 21998 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:58.518042 21998 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.520241 21998 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:58.522004 21995 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:58.522454 21995 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:58.522822 21995 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:58.528295 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.529032 14895 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:58.529096 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 121868us
I20260709 13:20:58.530166 14192 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:58.535938 21957 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.539515 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:58.542546 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:58.548731 14892 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:20:58.551050 14298 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:58.552237 14895 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:58.557085 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.557358 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.557835 14892 raft_consensus.cc:3060] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:58.559619 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:58.560539 14298 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 24.
I20260709 13:20:58.560897 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.562041 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.562566 14895 raft_consensus.cc:3060] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.562181 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.563508 14901 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:58.504992 21904 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:58.570235 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.571201 14896 raft_consensus.cc:2410] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 19 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:20:58.572866 14900 raft_consensus.cc:1275] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:58.554283 21998 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:58.583748 14895 raft_consensus.cc:2468] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
W20260709 13:20:58.565850 22069 consensus_meta.cc:287] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.005s
I20260709 13:20:58.585088 14900 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:58.560767 22125 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:58.586028 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:58.589042 14369 raft_consensus.cc:2368] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17.
I20260709 13:20:58.590838 14864 leader_election.cc:400] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17.
I20260709 13:20:58.591282 14864 leader_election.cc:403] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:20:58.592226 21731 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17.
I20260709 13:20:58.567513 22103 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.604614 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:58.565038 22013 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:20:58.566627 22122 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:20:58.587044 22053 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.582621 22101 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:58.609309 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:58.618443 14892 raft_consensus.cc:2468] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
W20260709 13:20:58.629781 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 83549us
I20260709 13:20:58.575569 21904 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.634634 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:58.637315 22137 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:58.638723 22053 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.639359 22053 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.632607 21998 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:58.643955 21935 consensus_queue.cc:260] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.641975 22026 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:58.647954 22053 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:58.648090 22086 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.650535 14296 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:20:58.645980 21998 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:58.655763 22129 log.cc:927] Time spent T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:20:58.669480 14341 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:58.670493 14341 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:58.674118 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:58.594337 22069 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:58.689389 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.613862 21962 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:58.690883 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.691882 14892 raft_consensus.cc:2410] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 21 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:20:58.681032 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46701.5us
I20260709 13:20:58.681214 14341 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:58.694234 14344 leader_election.cc:336] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.645735 21935 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.650118 21904 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.703002 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.681442 21997 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:58.705487 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.680132 22086 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:58.681638 21535 raft_consensus.cc:2764] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:20:58.708572 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:58.708763 14899 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
W20260709 13:20:58.696722 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.683346 22000 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:58.680335 22142 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:58.696929 21954 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:58.697057 21962 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:20:58.712090 22057 consensus_meta.cc:287] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.003s
W20260709 13:20:58.716391 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 164503us
I20260709 13:20:58.700035 22126 raft_consensus.cc:2804] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:58.731451 14341 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:58.732285 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:58.709733 22089 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.739275 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:58.682265 21963 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
W20260709 13:20:58.745425 14867 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.729511 22086 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:58.730962 21962 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:58.750854 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:58.784917 22072 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.738052 22057 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.787760 14378 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:58.747730 22143 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:20:58.776396 21733 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:58.794214 22086 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:58.741293 22126 raft_consensus.cc:697] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:58.741964 22148 raft_consensus.cc:2804] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:58.746675 22062 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:58.735916 21954 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:58.802902 22069 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:58.729336 22000 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:58.810458 22144 log.cc:927] Time spent T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:20:58.814219 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 63464.7us
I20260709 13:20:58.815593 22133 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:58.817304 21470 consensus_meta.cc:287] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
W20260709 13:20:58.818817 22132 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:20:58.818668 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:58.821903 21935 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:20:58.822701 22128 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:20:58.824157 21823 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:58.839040 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:58.837654 14901 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 26.
W20260709 13:20:58.838173 14867 leader_election.cc:336] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:58.852479 14369 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:58.954205 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1635) took 1033 ms. Trace:
I20260709 13:20:58.880846 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:58.985761 14893 rpcz_store.cc:276] 0709 13:20:57.920654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.931214 (+ 10560us) service_pool.cc:224] Handling call
0709 13:20:58.953947 (+1022733us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54006bcbd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:58.954112 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839103360}
I20260709 13:20:58.986387 14192 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:58.879446 21954 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:58.936748 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:58.849891 22143 consensus_queue.cc:1243] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:58.990803 14894 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 21: Already voted for candidate a9b2cf49ceed478480fb0f27ccf55d81 in this term.
I20260709 13:20:58.854218 21733 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:20:58.987991 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 149869us
I20260709 13:20:58.995411 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:58.995637 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:59.002032 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:59.007248 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:58.951642 22051 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:59.009971 22146 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:58.939368 22125 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:58.855499 21997 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:58.865510 22109 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.147s
I20260709 13:20:59.015601 21962 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.016649 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:59.019673 22137 raft_consensus.cc:2804] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:59.018160 14221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53830 (request call id 3044) took 1243 ms. Trace:
I20260709 13:20:58.940611 22044 raft_consensus.cc:3055] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:58.863256 22062 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.938563 22057 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:59.020694 14267 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:20:59.067237 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46624.8us
I20260709 13:20:59.068881 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:59.021448 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:58.875692 22151 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:59.022106 14269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:58.944976 22113 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:20:58.939805 22072 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:58.860384 22148 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:59.044109 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.900743 21995 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.046705 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:59.084959 14894 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 19: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:20:59.008613 21998 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:58.933518 22126 consensus_queue.cc:237] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.021425 21935 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.017557 21988 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:59.054311 14221 rpcz_store.cc:276] 0709 13:20:57.775143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.775292 (+   149us) service_pool.cc:224] Handling call
0709 13:20:59.017874 (+1242582us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54000942d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:59.018086 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331750144}
I20260709 13:20:59.058286 22044 raft_consensus.cc:740] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:58.991683 21470 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:59.070173 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 48815.9us
I20260709 13:20:59.042631 22125 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:59.108331 14897 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:59.081183 14303 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:59.081722 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:59.034335 22089 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:59.054184 22137 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:59.083468 22015 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:58.996403 21733 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:59.067128 22062 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:59.092279 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:59.117285 14297 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:59.093602 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:59.098421 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:59.119596 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:59.076965 22109 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:59.121922 22015 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.115877 22137 raft_consensus.cc:3060] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:59.124290 22015 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:59.124699 22130 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.556s	user 0.003s	sys 0.000s
I20260709 13:20:59.125852 22089 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:59.054512 22052 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:20:59.076265 22083 raft_consensus.cc:2804] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:59.118252 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 68384.6us
I20260709 13:20:59.110431 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:59.112166 14301 raft_consensus.cc:2393] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 22: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:59.109943 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:59.086943 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:59.129312 14302 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:59.086001 21674 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:20:59.086001 22148 raft_consensus.cc:3060] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:59.102342 21725 consensus_queue.cc:1059] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:20:59.125981 22000 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:20:59.076503 21903 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:59.105144 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:20:59.046411 22133 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.090s
I20260709 13:20:59.136852 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:59.138152 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:59.141563 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:59.148383 14302 raft_consensus.cc:2393] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 23: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:59.130864 22115 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:59.143388 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:59.152530 14894 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:59.152702 14900 raft_consensus.cc:2393] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 20: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:59.133921 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:59.042675 22146 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.152740 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:59.145331 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:59.147533 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:59.142815 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:59.079813 22151 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:59.150472 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.161182 14301 raft_consensus.cc:1240] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:59.158342 14344 leader_election.cc:336] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.162164 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:59.144320 22083 raft_consensus.cc:697] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:20:59.162972 21962 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:59.156306 21731 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:59.169364 21731 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:59.170379 21731 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:59.174957 14344 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.152171 22115 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:20:59.178190 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:59.182842 14344 leader_election.cc:336] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.183247 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:59.183609 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:59.188246 14344 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.149945 21674 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.207891 21674 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:59.175920 22125 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.210114 22120 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:59.210745 22120 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.211553 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:59.212302 14304 raft_consensus.cc:2368] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17.
I20260709 13:20:59.212730 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:59.216270 21470 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:59.217635 21935 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:20:59.204305 14867 leader_election.cc:336] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.218709 14867 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:20:59.222558 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.222183 14193 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:59.188771 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:59.130452 21997 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.177996 22057 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:20:59.223246 14867 leader_election.cc:336] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.226434 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:20:59.227011 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.225836 14193 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:20:59.192793 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:59.193399 22110 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.195052 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:59.195539 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:59.164021 22089 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.196571 21995 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:59.202553 22083 consensus_queue.cc:237] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.203296 21998 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:59.204393 22072 raft_consensus.cc:3055] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:59.188418 22051 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:59.205849 22159 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:20:59.224735 14344 leader_election.cc:336] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.238404 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:59.241582 14301 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260709 13:20:59.219537 22155 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:59.243991 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:59.245674 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:59.247354 14295 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:20:59.256527 14295 raft_consensus.cc:1275] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:59.231025 21963 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:59.258466 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:59.224116 22113 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:59.270963 21991 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:59.249769 14296 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:20:59.227444 21470 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:59.275002 14897 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:20:59.305897 21998 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.306877 21998 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.310464 22125 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:59.314543 22113 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.315176 22113 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:59.321501 14867 leader_election.cc:336] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.333113 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:59.334084 14373 raft_consensus.cc:2368] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:59.335359 14377 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:59.337857 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:59.338671 14303 raft_consensus.cc:2368] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:59.341053 14864 leader_election.cc:400] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:59.341385 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:59.342377 14893 raft_consensus.cc:2368] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19.
I20260709 13:20:59.341425 14864 leader_election.cc:403] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:20:59.343786 22113 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:59.344375 22113 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:59.347934 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:59.350231 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:59.352739 14341 leader_election.cc:400] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19.
I20260709 13:20:59.252797 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:20:59.262935 14301 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:59.355765 14341 leader_election.cc:403] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:20:59.257704 14295 raft_consensus.cc:1275] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:59.261936 21675 consensus_queue.cc:1059] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:20:59.265282 22066 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:59.266019 21733 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.359854 21733 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:59.248189 22110 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.363093 22110 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:20:59.364979 22044 consensus_queue.cc:260] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:59.366577 22044 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:59.368932 21823 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19.
I20260709 13:20:59.370047 14901 pending_rounds.cc:85] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 13
I20260709 13:20:59.370386 14901 pending_rounds.cc:107] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:20:59.353605 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:20:59.370628 14895 raft_consensus.cc:1275] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:20:59.371137 14893 raft_consensus.cc:2393] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:59.370674 14901 raft_consensus.cc:2889] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:59.372942 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:59.385036 21998 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:59.387099 21988 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:59.398712 21823 consensus_queue.cc:1048] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:59.400943 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:20:59.401938 21823 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:59.402792 21823 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:20:59.403936 21823 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.408829 14297 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:59.244793 21935 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:59.410331 14898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50026 (request call id 1638) took 1484 ms. Trace:
I20260709 13:20:59.410864 14898 rpcz_store.cc:276] 0709 13:20:57.925555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.925711 (+   156us) service_pool.cc:224] Handling call
0709 13:20:59.410105 (+1484394us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b5400775e54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:20:59.410271 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418198912}
I20260709 13:20:59.245230 22072 raft_consensus.cc:740] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:59.249079 22052 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:59.251626 14344 leader_election.cc:336] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.430280 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 178666us
W20260709 13:20:59.432314 14344 leader_election.cc:336] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.250770 21725 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:59.441695 14865 leader_election.cc:400] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 16 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 16. Current term is 17.
I20260709 13:20:59.442761 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:59.452020 14192 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:59.433458 14344 consensus_peers.cc:597] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:59.453075 14867 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.275080 22146 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:59.475229 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:20:59.475745 14344 leader_election.cc:336] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.476027 14376 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
W20260709 13:20:59.476761 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.483916 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:20:59.477573 14344 leader_election.cc:336] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.451165 21725 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:59.496371 14344 leader_election.cc:336] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.497578 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 957119us
I20260709 13:20:59.454535 22142 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.454810 22143 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:20:59.504858 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 74908us
W20260709 13:20:59.509063 14344 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.511914 14864 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:59.454325 21675 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:59.469426 21470 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:20:59.482923 21733 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:20:59.562062 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 50237.3us
W20260709 13:20:59.564779 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 55768.8us
I20260709 13:20:59.441362 22052 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:59.571399 14344 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.486835 22013 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:59.502940 21778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.004s	sys 0.009s
I20260709 13:20:59.504472 22110 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:59.513223 22120 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:59.482282 22158 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:20:59.575901 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:59.573203 14270 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:59.579885 14897 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 17. (term mismatch)
I20260709 13:20:59.274010 22115 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.504200 21725 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:59.621873 14897 pending_rounds.cc:85] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Aborting all ops after (but not including) 16
I20260709 13:20:59.624432 14897 pending_rounds.cc:107] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Aborting uncommitted NO_OP operation due to leader change: 19.17
I20260709 13:20:59.624897 14897 raft_consensus.cc:2889] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:59.625726 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54340.6us
W20260709 13:20:59.626925 14344 leader_election.cc:336] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.627369 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:59.632356 14344 leader_election.cc:336] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.633350 14344 leader_election.cc:336] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.633728 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:20:59.635218 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.578146 21675 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.638718 21675 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:59.578449 21470 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.641325 21470 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:59.628868 21935 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.576511 22079 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:59.635929 14344 leader_election.cc:336] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.609431 21674 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:59.622371 21778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.009s	sys 0.009s
I20260709 13:20:59.612638 21733 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:20:59.571633 21988 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.080s
W20260709 13:20:59.664692 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 91591.6us
W20260709 13:20:59.646023 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 412891us
I20260709 13:20:59.503584 22072 consensus_queue.cc:260] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:59.662796 14344 leader_election.cc:336] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.697985 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:59.741909 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 79152.6us
W20260709 13:20:59.742995 14344 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.743729 14894 consensus_meta.cc:287] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.000s
I20260709 13:20:59.744270 14894 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:20:59.589090 22142 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:59.751569 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 279921us
I20260709 13:20:59.659544 22155 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:59.642179 22060 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:59.644023 22057 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:59.663465 22115 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:59.756842 14343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.022s
I20260709 13:20:59.761125 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:59.571236 22143 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:20:59.765434 14375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.014s	sys 0.073s
W20260709 13:20:59.792873 14375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.014s	sys 0.073s
W20260709 13:20:59.768535 14343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.004s	sys 0.022s
I20260709 13:20:59.743575 14344 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:59.770192 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:20:59.740031 22000 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:59.797727 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 224355us
I20260709 13:20:59.808125 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:20:59.811040 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 58691.9us
W20260709 13:20:59.809732 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 319314us
I20260709 13:20:59.820801 14865 leader_election.cc:400] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18.
I20260709 13:20:59.684015 22079 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:59.848778 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:59.850425 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:59.849654 14303 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 21: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:20:59.851366 14296 raft_consensus.cc:2468] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
I20260709 13:20:59.852772 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:20:59.683750 21935 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:59.855944 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:59.865615 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 122659us
W20260709 13:20:59.884654 14344 leader_election.cc:336] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.885612 14344 leader_election.cc:336] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:59.888576 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 118423us
I20260709 13:20:59.890293 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:59.689996 21904 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:59.769850 22053 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:59.942739 14304 consensus_meta.cc:287] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.006s
I20260709 13:20:59.943967 14304 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:20:59.895278 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:20:59.898238 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:20:59.900032 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:59.945304 14300 raft_consensus.cc:2393] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:20:59.946163 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:59.947659 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:59.820627 22155 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.950160 22155 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.952775 22155 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:20:59.902400 14375 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:59.902753 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:20:59.829463 21470 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:59.844880 22122 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:20:59.955490 22122 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.900636 22057 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:59.922835 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:59.689831 21674 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:20:59.645081 22158 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:20:59.905702 22137 consensus_meta.cc:287] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.778s	user 0.012s	sys 0.000s
I20260709 13:20:59.940825 21512 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:20:59.902549 22148 consensus_meta.cc:287] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.747s	user 0.011s	sys 0.000s
I20260709 13:20:59.883000 22069 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:59.935433 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:20:59.818079 22072 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:59.757858 22066 consensus_queue.cc:1048] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
W20260709 13:20:59.995806 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:59.974355 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 79198.5us
I20260709 13:21:00.017042 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:20:59.966948 22122 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.854269 21995 consensus_queue.cc:1048] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 13:20:59.900173 22125 consensus_queue.cc:1059] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
W20260709 13:21:00.021306 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 135004us
W20260709 13:21:00.016064 14270 leader_election.cc:336] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.978322 22171 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:00.025264 14342 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:21:00.028929 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:20:59.937750 21733 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.038702 14304 raft_consensus.cc:1275] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:59.975536 22177 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.067760 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 27 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:00.039191 14301 raft_consensus.cc:1275] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:21:00.027035 22057 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:00.035928 22069 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:21:00.075848 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:00.026732 21984 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:59.955991 22053 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:00.070005 22166 log.cc:927] Time spent T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.409s	user 0.000s	sys 0.001s
W20260709 13:21:00.097699 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 185252us
I20260709 13:21:00.037189 22171 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:00.015280 21512 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:20:59.992013 22137 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:00.077486 22172 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 13:21:00.055352 22170 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:00.119654 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.059841 22052 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.130934 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.131114 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:00.036182 22155 consensus_queue.cc:1048] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:21:00.014889 22148 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.092749 22142 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.155503 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:00.137575 21725 consensus_meta.cc:287] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.004s
W20260709 13:20:59.683789 22109 consensus_queue.cc:1175] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "181bbac22422408c87cd13b7fe3008f9" responder_term: 23 status { last_received { term: 22 index: 17 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:21:00.134624 22171 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:00.158569 22188 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:00.198694 21674 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.173071 22185 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.199052 22188 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.199419 22185 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.201264 22188 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.174954 21904 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:00.176544 22142 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:00.186017 22168 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:21:00.203202 22142 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:00.185554 22174 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:21:00.170190 21725 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:00.139365 22143 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.174044 22182 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:00.076050 22177 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:00.206806 22182 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.197746 22069 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.208520 22177 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.092849 22057 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:00.210028 22182 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:00.211623 22057 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:00.212045 22185 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.212996 22142 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.215112 22151 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.160526 22079 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:00.218146 22044 consensus_meta.cc:287] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.851s	user 0.012s	sys 0.000s
I20260709 13:21:00.220834 22142 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:00.170372 22164 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:21:00.221597 22142 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:00.222910 14298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3472) took 1142 ms. Trace:
I20260709 13:21:00.223278 14298 rpcz_store.cc:276] 0709 13:20:59.080081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.082191 (+  2110us) service_pool.cc:224] Handling call
0709 13:20:59.082534 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:59.094272 (+ 11738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:59.094305 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:59.115699 (+ 21394us) log.cc:844] Serialized 52 byte log entry
0709 13:20:59.275909 (+160210us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:59.275956 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:59.276033 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:00.222683 (+946650us) raft_consensus.cc:1685] finished
0709 13:21:00.222705 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:00.222851 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5054,"raft.queue_time_us":11597,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5657,"thread_start_us":129919,"threads_started":1,"wal-append.queue_time_us":531712}
I20260709 13:21:00.224347 22142 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.230342 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:00.221262 22079 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:00.169965 22113 consensus_queue.cc:1175] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bee4f7fc1b4740dc875537c79309664f" responder_term: 22 status { last_received { term: 22 index: 17 } last_committed_idx: 17 last_received_current_leader { term: 22 index: 17 } }
W20260709 13:21:00.193867 22178 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:21:00.242347 21725 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.197245 22122 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.191781 22180 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:00.190709 22175 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:21:00.239266 22079 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.246584 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:00.185262 21675 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:00.179298 21512 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.194336 21935 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.193130 22053 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.263850 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:00.184187 22148 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.198385 22187 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:00.298782 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:00.180676 22158 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.301863 14304 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:21:00.302804 14303 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:21:00.304239 14865 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:00.260854 22191 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:00.307722 14303 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:21:00.313091 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:00.269659 22057 consensus_queue.cc:1048] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:21:00.339614 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1657) took 1018 ms. Trace:
I20260709 13:21:00.345343 14900 rpcz_store.cc:276] 0709 13:20:59.321416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.323233 (+  1817us) service_pool.cc:224] Handling call
0709 13:20:59.323536 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:59.323898 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:59.323923 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:59.324438 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:20:59.760315 (+435877us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:59.760363 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:59.760930 (+   567us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:00.339385 (+578455us) raft_consensus.cc:1685] finished
0709 13:21:00.339404 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:00.339543 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5176,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":435467,"threads_started":1,"wal-append.queue_time_us":712223}
I20260709 13:21:00.315244 22122 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:21:00.337388 22062 consensus_meta.cc:287] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 1.200s	user 0.013s	sys 0.000s
I20260709 13:21:00.354367 22083 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.314438 22191 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.366106 22083 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.366652 22079 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.336853 22193 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:21:00.368291 22191 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.368557 22083 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.368494 22000 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:00.370000 22000 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:00.374516 21778 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:00.375005 21778 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:00.375922 21778 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.377192 21778 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:00.378844 22000 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.381084 22061 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:00.386394 22198 consensus_queue.cc:1048] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:00.368642 22137 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:00.363317 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 347275us
W20260709 13:21:00.399367 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:00.400219 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.308888 22187 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.363279 22122 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:00.404958 22115 consensus_meta.cc:287] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
I20260709 13:21:00.436689 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:00.439849 14304 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 17: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:00.381199 22000 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:00.428635 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.377393 22171 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:00.449921 14270 leader_election.cc:336] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.437191 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 281943us
W20260709 13:21:00.438921 21823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.032s	sys 0.036s
I20260709 13:21:00.429111 22170 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:00.430202 22122 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:00.468475 14192 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:00.405220 22062 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:00.450938 14378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.008s	sys 0.012s
W20260709 13:21:00.486915 14378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.008s	sys 0.012s
W20260709 13:21:00.472509 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 345082us
I20260709 13:21:00.466610 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:00.477608 14864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.002s	sys 0.020s
W20260709 13:21:00.497853 14864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.003s	sys 0.020s
I20260709 13:21:00.484306 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:00.498838 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 586281us
W20260709 13:21:00.472121 21823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.032s	sys 0.036s
W20260709 13:21:00.509097 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:00.541644 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.545802 14377 raft_consensus.cc:2368] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22.
I20260709 13:21:00.544755 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:00.556107 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 106208us
W20260709 13:21:00.557178 14270 leader_election.cc:336] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.485502 22137 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:21:00.562477 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 418617us
I20260709 13:21:00.557256 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:00.570137 22189 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:00.574066 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.548756 21731 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.536408 22125 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:00.549311 22072 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:00.548799 22060 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:00.550827 22191 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:00.583132 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.581352 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.584498 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.589421 14898 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:21:00.590778 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.566349 21675 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:00.591888 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:00.585830 14270 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.589330 14900 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:21:00.596349 14270 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:00.596951 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.593348 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.601001 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:00.601428 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.573683 22181 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.630409 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.630717 22181 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.566110 22053 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:21:00.631834 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:00.633066 22181 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.633668 22200 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 13:21:00.633961 22205 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:21:00.596112 22191 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.635411 22185 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:00.641866 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.646164 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.652132 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:00.621438 22103 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:00.658633 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.658692 14895 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
W20260709 13:21:00.661453 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 60470.5us
I20260709 13:21:00.662946 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:00.584336 21731 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.671094 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.676549 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.587574 22125 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.641299 22180 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:00.680761 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.678712 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:00.686136 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.683856 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:00.689944 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:00.690816 14892 raft_consensus.cc:1275] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 13:21:00.694043 14374 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:21:00.671860 22205 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:00.697351 14897 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:21:00.698232 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.698683 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.699867 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.702487 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.733577 22203 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:00.734129 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.732872 22214 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.731686 22213 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.734359 22216 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.699383 22187 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:00.692912 21733 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:00.746512 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:00.763491 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 79713.3us
I20260709 13:21:00.761381 22115 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.694888 22051 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.698555 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:00.773851 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.627362 22170 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.683569 22180 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:00.792721 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:00.793288 22212 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:21:00.794405 22210 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:21:00.764643 22083 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:21:00.797209 22197 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:21:00.810731 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 112242us
I20260709 13:21:00.810916 22133 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:00.794413 22220 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:21:00.771315 22203 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:00.829504 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:00.769517 22214 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:00.769632 22213 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.867446 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.900934 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:00.915467 14375 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 22
W20260709 13:21:00.856252 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 63617.4us
I20260709 13:21:00.914915 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:00.865890 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:21:00.896672 22061 consensus_meta.cc:287] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.006s
I20260709 13:21:00.811295 22171 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.924705 22206 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:00.927354 14373 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:21:00.876879 22062 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.863673 22000 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:00.929066 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.820452 22191 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.862680 21731 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:00.814339 22122 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.931064 14369 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:21:00.931258 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:00.866477 22195 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:00.919070 22083 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:00.920013 22203 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:00.811998 22115 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.928951 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.922717 22089 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:00.936482 22215 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:21:00.937906 22214 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.938305 22103 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:00.935228 14374 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:21:00.928488 22230 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:00.797744 22216 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.924127 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:00.944345 14375 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:21:00.816179 22051 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.945106 22083 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:00.947507 21811 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.950834 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:00.954636 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.950191 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.919855 22212 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.962191 14375 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:21:00.963635 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:00.962270 21811 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:00.950081 22103 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:00.951092 22207 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:00.939164 22205 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 13:21:00.975102 14370 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
W20260709 13:21:00.966223 21778 consensus_meta.cc:287] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.008s
I20260709 13:21:00.979732 14898 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:21:00.961192 22089 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:00.984824 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1659) took 1640 ms. Trace:
I20260709 13:21:00.985229 14901 rpcz_store.cc:276] 0709 13:20:59.344750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.347660 (+  2910us) service_pool.cc:224] Handling call
0709 13:20:59.348021 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:59.373310 (+ 25289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:59.373344 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:59.374978 (+  1634us) log.cc:844] Serialized 52 byte log entry
0709 13:20:59.690104 (+315126us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:59.690149 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:00.977278 (+1287129us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b54004bfad4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:21:00.977326 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:00.977371 (+    45us) raft_consensus.cc:1685] finished
0709 13:21:00.977387 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:00.984761 (+  7374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":616,"raft.queue_time_us":14259,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":50073984,"thread_start_us":314681,"threads_started":1,"wal-append.queue_time_us":618848}
I20260709 13:21:00.986863 22115 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:00.988045 22219 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:21:00.975687 22200 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:00.990025 22180 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.990242 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:00.965301 22208 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.990892 14298 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:00.991006 22208 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.982497 22125 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:00.982829 22212 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.990262 22200 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.995909 22200 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:00.998786 22169 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.880s	user 0.003s	sys 0.000s
I20260709 13:21:01.000574 22057 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:01.001228 22057 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.004339 22057 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:00.939079 22206 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.005669 14894 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:00.956193 22230 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:00.978861 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:00.940740 22000 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.009178 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:01.010619 14298 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:21:01.012106 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.012596 22122 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:01.013808 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.014591 22051 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:01.016036 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.017709 22000 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:01.018795 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.020251 14298 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:21:01.021183 22115 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.021503 22122 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.021737 22115 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.022035 22122 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.022358 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.024111 22115 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:01.024683 22115 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:01.025439 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:01.025254 22115 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.028523 22115 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:01.034116 14378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 3179) took 1149 ms. Trace:
I20260709 13:21:01.048264 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54360 (request call id 3491) took 1201 ms. Trace:
I20260709 13:21:01.048894 14297 rpcz_store.cc:276] 0709 13:20:59.847310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.848937 (+  1627us) service_pool.cc:224] Handling call
0709 13:20:59.849402 (+   465us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:00.245834 (+396432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:00.245863 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:00.263775 (+ 17912us) log.cc:844] Serialized 52 byte log entry
0709 13:21:00.552943 (+289168us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:21:00.571819 (+ 18876us) log.cc:844] Serialized 14 byte log entry
0709 13:21:00.577805 (+  5986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:00.577882 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:01.048033 (+470151us) raft_consensus.cc:1685] finished
0709 13:21:01.048066 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:01.048202 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5725,"prepare.queue_time_us":19389,"prepare.run_wall_time_us":4215,"raft.queue_time_us":262140,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":77695,"spinlock_wait_cycles":22566912,"thread_start_us":626722,"threads_started":2,"wal-append.queue_time_us":665195}
I20260709 13:21:01.052726 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:01.054998 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:01.055807 22089 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:01.055912 14299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54360 (request call id 3478) took 1972 ms. Trace:
I20260709 13:21:01.056177 14192 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:21:01.056344 14299 rpcz_store.cc:276] 0709 13:20:59.088001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.088876 (+   875us) service_pool.cc:224] Handling call
0709 13:21:01.055695 (+1966819us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000fcdd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:21:01.055846 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2796099968}
W20260709 13:21:01.043705 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.058809 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 440191us
W20260709 13:21:01.059402 22176 log.cc:927] Time spent T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.884s	user 0.003s	sys 0.001s
I20260709 13:21:01.061913 14371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37700 (request call id 1789) took 1730 ms. Trace:
I20260709 13:21:01.062947 21675 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:01.063192 22206 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:01.063428 22120 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:01.064119 22120 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:01.035308 22213 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:01.044531 22224 log.cc:927] Time spent T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:21:01.030577 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.043849 22230 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:01.062309 14371 rpcz_store.cc:276] 0709 13:20:59.331646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.337858 (+  6212us) service_pool.cc:224] Handling call
0709 13:20:59.338228 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:59.338668 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:59.338982 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:20:59.887595 (+548613us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:59.924687 (+ 37092us) log.cc:844] Serialized 52 byte log entry
0709 13:20:59.924911 (+   224us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:00.395738 (+470827us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b180047f500. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8de9f19c0a 00007f8df3659219 00007f8de9fa1a40 00007f8de9f9c4e4 00007f8de9f9c455 00007f8df0a843c7 00007f8ded0969a7 00007f8ded0a60bf 00007f8ded0a6038
0709 13:21:00.665634 (+269896us) log.cc:844] Serialized 14 byte log entry
0709 13:21:00.666804 (+  1170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:00.666935 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:01.058717 (+391782us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:21:01.061644 (+  2927us) raft_consensus.cc:1685] finished
0709 13:21:01.061670 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:01.061854 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102851,"prepare.queue_time_us":564700,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":122,"raft.queue_time_us":113013,"raft.run_cpu_time_us":437,"raft.run_wall_time_us":24983,"spinlock_wait_cycles":202702976,"thread_start_us":727296,"threads_started":2,"wal-append.queue_time_us":836198}
W20260709 13:21:01.071167 22184 log.cc:927] Time spent T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.911s	user 0.003s	sys 0.000s
I20260709 13:21:01.074380 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:01.075747 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:01.076381 14370 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 23.
I20260709 13:21:01.077318 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:01.077646 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:01.078423 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50016 (request call id 1755) took 1613 ms. Trace:
I20260709 13:21:01.009089 22208 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:01.078867 14893 rpcz_store.cc:276] 0709 13:20:59.465363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.486705 (+ 21342us) service_pool.cc:224] Handling call
0709 13:20:59.487070 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:59.487530 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:59.487561 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:59.515642 (+ 28081us) log.cc:844] Serialized 26 byte log entry
0709 13:20:59.807718 (+292076us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:59.807781 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:59.807880 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:01.070543 (+1262663us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:21:01.078112 (+  7569us) raft_consensus.cc:1685] finished
0709 13:21:01.078140 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:01.078359 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1660,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":13241,"spinlock_wait_cycles":209545984,"thread_start_us":184719,"threads_started":1,"wal-append.queue_time_us":467555}
I20260709 13:21:01.048283 14378 rpcz_store.cc:276] 0709 13:20:59.884724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.884832 (+   108us) service_pool.cc:224] Handling call
0709 13:20:59.885235 (+   403us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:59.885632 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:59.885671 (+    39us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:59.898961 (+ 13290us) log.cc:844] Serialized 78 byte log entry
0709 13:21:00.487578 (+588617us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:00.543435 (+ 55857us) log.cc:844] Serialized 14 byte log entry
0709 13:21:00.547605 (+  4170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:00.547719 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:01.033856 (+486137us) raft_consensus.cc:1685] finished
0709 13:21:01.033880 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:01.034048 (+   168us) inbound_call.cc:177] Queueing success response
0709 13:21:01.049947 (+ 15899us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b4800130158. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df1fb5aa1 00007f8df1facb37 00007f8df1fac9ca 00007f8df20a426f 00007f8df20a3f37 00007f8df20b855c 00007f8df20b8508 00007f8df20b8488 00007f8df20b8443 00007f8df20b76ec 00007f8df0fe1a96
Metrics: {"mutex_wait_us":5650,"prepare.queue_time_us":89716,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":92837,"raft.run_cpu_time_us":2976,"raft.run_wall_time_us":429668,"spinlock_wait_cycles":9053440,"thread_start_us":588121,"threads_started":1,"wal-append.queue_time_us":784389}
I20260709 13:21:01.083150 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:01.084208 14372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47074 (request call id 3017) took 1192 ms. Trace:
I20260709 13:21:01.065107 22120 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:01.084446 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:01.103231 22204 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.089002 14370 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 16.
I20260709 13:21:01.084626 14372 rpcz_store.cc:276] 0709 13:20:59.892115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.893598 (+  1483us) service_pool.cc:224] Handling call
0709 13:20:59.893919 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:59.894128 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:21:00.257906 (+363778us) log.cc:844] Serialized 14 byte log entry
0709 13:21:01.083621 (+825715us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b1800428f80. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df2e67de1 00007f8df2e745b1 00007f8decc344bc 00007f8de9f8248b 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9ec02 00007f8decc2620b 00007f8decc2bd23 00007f8decc2c23a
0709 13:21:01.083849 (+   228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:01.083899 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:21:01.083942 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:01.084016 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:01.084148 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":543824,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":1203,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":13056256,"thread_start_us":546059,"threads_started":2,"wal-append.queue_time_us":537122}
I20260709 13:21:01.105901 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:01.094537 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:01.030433 22122 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:01.110302 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:01.103905 22204 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.113389 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:01.122078 14192 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:21:01.122182 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:01.124433 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:01.131481 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:01.129624 22208 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:01.129246 21995 raft_consensus.cc:3055] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:01.128825 22000 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:01.109866 22203 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.145936 22125 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.158449 22000 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.149741 22208 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.158198 21995 raft_consensus.cc:740] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:01.170903 14298 raft_consensus.cc:2368] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20.
I20260709 13:21:01.174252 22206 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:21:01.177716 22233 log.cc:927] Time spent T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:21:01.171665 22208 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:01.198020 13122 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 14210)
W20260709 13:21:01.196308 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.216285 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.217561 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.170342 22125 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.221551 14299 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:21:01.222493 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.262836 14297 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 17.
I20260709 13:21:01.228003 22204 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:01.250115 21995 consensus_queue.cc:260] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:01.254478 14270 leader_election.cc:336] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.257483 22170 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:01.186292 22231 log.cc:927] Time spent T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:21:01.268421 14270 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:01.219722 14193 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:01.275740 22195 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.283279 22180 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:01.284472 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 64813.1us
I20260709 13:21:01.285559 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:01.286461 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.266100 22216 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:01.283157 22195 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:01.293000 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.290129 22133 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:01.296339 22195 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:01.300222 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 27 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:01.300910 14898 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 26.
I20260709 13:21:01.301918 14897 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:21:01.302824 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:01.311669 14899 raft_consensus.cc:1275] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:21:01.315939 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:01.317196 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:01.298151 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.317745 14894 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:21:01.318097 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:01.324332 22125 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:01.318507 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:01.325366 14270 leader_election.cc:336] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.325839 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:01.326756 22195 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:01.327142 14270 leader_election.cc:336] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.330078 14898 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:21:01.324681 14899 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:01.330307 14377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 3184) took 1431 ms. Trace:
I20260709 13:21:01.330943 14377 rpcz_store.cc:276] 0709 13:20:59.899110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.907849 (+  8739us) service_pool.cc:224] Handling call
0709 13:21:01.330112 (+1422263us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54002ec054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:21:01.330255 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271162112}
I20260709 13:21:01.331574 14894 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:21:01.284091 22170 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.317832 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:01.333693 22170 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:01.334929 22230 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:01.335322 22230 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.335666 22230 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:01.340344 22083 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.341621 14296 raft_consensus.cc:1240] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:21:01.345031 22213 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:01.346455 22203 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:01.348104 22213 consensus_queue.cc:1048] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:01.291548 22243 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:01.352331 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:01.354110 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:01.291947 21995 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:01.356843 22230 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.330224 14270 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:01.369762 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:01.370467 14893 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
I20260709 13:21:01.185262 22000 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:01.378338 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51217.3us
W20260709 13:21:01.381058 14270 leader_election.cc:336] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.174325 22103 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:01.381773 22243 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:01.392596 14375 raft_consensus.cc:1240] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 24. Current term is 25. Ops: []
I20260709 13:21:01.393208 14899 raft_consensus.cc:2468] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:21:01.382066 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:01.384496 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:21:01.408008 14270 leader_election.cc:336] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.408812 14270 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:01.405814 14341 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:01.433307 22203 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:01.434954 14270 leader_election.cc:336] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.401155 22153 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:01.407289 22051 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:01.435417 14270 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:01.436326 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 301433us
I20260709 13:21:01.407341 22243 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:01.401826 22083 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:01.410528 21984 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:21:01.435927 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 346447us
I20260709 13:21:01.432732 22199 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:21:01.448168 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:01.448959 14893 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:21:01.440308 22051 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:01.454089 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 165967us
I20260709 13:21:01.463140 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:01.448194 14270 leader_election.cc:336] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.449586 22203 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:01.463748 22051 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:01.442525 22153 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:01.469776 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:01.478929 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:01.510385 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 47370.3us
I20260709 13:21:01.510849 14298 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 18.
I20260709 13:21:01.511053 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.451227 21984 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:01.515085 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.515753 14301 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 14.
I20260709 13:21:01.492429 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:01.494410 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.495116 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:01.517760 14304 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:01.470404 22148 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.506310 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.506449 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.507098 22103 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:01.453938 22199 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:01.511956 14302 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
W20260709 13:21:01.518548 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 48875us
I20260709 13:21:01.534512 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:01.535071 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:01.535808 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:01.536779 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:01.537305 14893 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 14.
I20260709 13:21:01.524524 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:01.521938 21998 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:01.513963 14865 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:01.493594 22158 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:01.523072 14303 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 19.
I20260709 13:21:01.526292 14300 raft_consensus.cc:1240] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:21:01.527740 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 27 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.556632 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:01.557543 14893 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:21:01.548349 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:01.519322 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:01.552538 21984 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:01.540380 21675 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:21:01.540478 22053 raft_consensus.cc:2804] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:01.514173 22216 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:21:01.535147 22208 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:01.570616 14304 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
I20260709 13:21:01.571265 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:01.573956 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 54678.7us
I20260709 13:21:01.577001 14897 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:21:01.535398 22148 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:01.578745 14897 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:21:01.576040 21675 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:01.580462 22053 raft_consensus.cc:697] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:01.587811 22053 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.598460 21998 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:01.599789 22163 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:01.575934 22230 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:01.627635 14893 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:21:01.570798 21733 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:21:01.663514 14304 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:21:01.667383 14299 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:21:01.681718 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:01.653374 22230 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:01.686468 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:01.687682 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 162999us
W20260709 13:21:01.694092 14270 leader_election.cc:336] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.694599 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:01.703265 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.672852 22195 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.708276 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 27 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:01.712453 14896 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:01.679347 22204 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:01.715121 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:01.707471 22247 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.235s	user 0.000s	sys 0.002s
I20260709 13:21:01.719348 22204 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:01.736353 22204 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:01.722333 22255 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:21:01.696209 22013 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:01.715854 14303 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:21:01.720827 22153 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:01.721570 22245 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:21:01.722299 22173 log.cc:927] Time spent T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 1.527s	user 0.005s	sys 0.006s
I20260709 13:21:01.722682 21811 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:01.726333 22083 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:01.727501 22163 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.661325 22199 consensus_queue.cc:237] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.701176 22230 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:01.716209 22195 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.754763 14303 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:01.774919 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:01.755344 21811 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.785462 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 27 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:21:01.792232 14867 leader_election.cc:336] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.794324 14867 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:01.791471 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 277583us
W20260709 13:21:01.792722 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 251566us
I20260709 13:21:01.799196 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:01.799252 22000 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.802003 22000 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:01.759392 22163 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:01.806195 14867 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.806685 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:01.809077 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:01.814941 14303 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: []
W20260709 13:21:01.810783 14867 leader_election.cc:336] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.817070 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:01.816076 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:01.823725 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:01.828156 14867 leader_election.cc:336] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:01.824550 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 130479us
W20260709 13:21:01.835855 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.836498 14270 leader_election.cc:336] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.836967 14270 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:01.833629 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:01.822693 22000 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:01.783846 21811 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:01.821880 22158 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:01.845204 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.846446 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:01.819123 22261 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:01.822536 22083 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:21:01.830682 14867 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.850301 14867 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:01.849504 14301 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:21:01.831626 22125 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:01.835572 22203 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 13:21:01.873219 22264 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:01.873659 21811 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:01.873863 22264 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:01.836616 22120 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:21:01.873850 22203 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:01.874838 22264 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.857152 22083 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:01.875873 22083 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:01.845227 22053 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:01.882539 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51899.8us
W20260709 13:21:01.883283 14867 leader_election.cc:336] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:01.822070 22089 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:21:01.848660 22158 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:01.890040 22000 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.862532 22230 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:01.883731 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:01.850418 21998 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.059s
I20260709 13:21:01.878767 22051 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:01.895030 22261 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:01.909406 22158 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:01.976016 14373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 3190) took 1280 ms. Trace:
I20260709 13:21:01.976563 14373 rpcz_store.cc:276] 0709 13:21:00.696135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:00.697971 (+  1836us) service_pool.cc:224] Handling call
0709 13:21:01.975774 (+1277803us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54002599d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:21:01.975944 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525029248}
I20260709 13:21:01.982914 14374 raft_consensus.cc:1240] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 23. Current term is 24. Ops: []
I20260709 13:21:01.989055 14896 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 27.
I20260709 13:21:01.967945 22189 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:01.910547 22056 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:21:01.975358 22216 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:01.973160 22203 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:01.968607 22000 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:02.010125 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 176568us
I20260709 13:21:01.996321 22189 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:02.016609 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1717) took 1431 ms. Trace:
I20260709 13:21:02.020666 14378 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:21:02.022738 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.023102 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:02.024382 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:02.024958 14377 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:02.026758 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.027607 14378 raft_consensus.cc:2393] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 22: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:21:02.017074 14892 rpcz_store.cc:276] 0709 13:21:00.584944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:00.585075 (+   131us) service_pool.cc:224] Handling call
0709 13:21:00.585373 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:00.692247 (+106874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.016297 (+1324050us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400611054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:21:02.016525 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241619328}
W20260709 13:21:01.971594 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88119us
W20260709 13:21:02.036468 14867 leader_election.cc:336] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:02.037117 14867 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:02.038331 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 201854us
W20260709 13:21:02.039109 14270 leader_election.cc:336] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:02.039499 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:02.037277 14377 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
W20260709 13:21:02.047003 14867 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:02.055990 14373 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 26. Current term is 27. Ops: [24.18-26.19]
W20260709 13:21:02.056547 14270 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:02.057078 14867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:02.006440 22195 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.057032 14270 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:02.055792 22216 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:02.030057 22268 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:21:02.068387 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:02.068636 14896 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 26. Current term is 27. Ops: [24.18-26.19]
I20260709 13:21:02.069051 14299 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 24
W20260709 13:21:02.070552 14270 leader_election.cc:336] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:02.071025 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:02.030473 22126 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:02.033552 22230 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:02.087514 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:02.089730 14896 raft_consensus.cc:2410] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:21:02.014596 22203 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.086575 22204 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:02.100019 22163 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.066946 22206 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:02.101675 22206 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:02.107179 22189 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.067819 22195 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:02.109030 22195 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:02.091675 22126 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:02.113332 22126 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:02.117244 22272 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:02.118597 22051 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:02.128053 14867 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 99 similar messages]
I20260709 13:21:02.140640 14299 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 24.
W20260709 13:21:02.142143 14369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47084 (request call id 3172) took 2991 ms (client timeout 1736 ms). Trace:
W20260709 13:21:02.142665 14369 rpcz_store.cc:269] 0709 13:20:59.131948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.132204 (+   256us) service_pool.cc:224] Handling call
0709 13:21:02.091471 (+2959267us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b540004bfd4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded0902fa 00007f8df2051b17 00007f8deb5cc6d4 00007f8deb5cc662 00007f8deb5cc591 00007f8deb5cc50c 00007f8deb5cb7c2 00007f8deb3c748c 00007f8deb3c68c6 00007f8deb3c626f
0709 13:21:02.122858 (+ 31387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4083511040}
W20260709 13:21:02.207778 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 239969us
I20260709 13:21:02.226419 14192 leader_election.cc:400] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22.
I20260709 13:21:02.122109 22230 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:02.235729 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 165551us
I20260709 13:21:02.205083 22272 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:02.233428 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.232530 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:02.239894 14299 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:21:02.208415 22216 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:02.251247 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:02.255416 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 184883us
I20260709 13:21:02.256573 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:21:02.257048 14270 leader_election.cc:336] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:02.257612 14270 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:02.258430 14373 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:02.262271 14369 raft_consensus.cc:2410] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:21:02.263031 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:02.252882 22216 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.273295 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.248796 22052 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:02.274329 14369 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
W20260709 13:21:02.280735 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 421935us
I20260709 13:21:02.281649 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:02.266516 22241 log.cc:927] Time spent T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.944s	user 0.001s	sys 0.011s
I20260709 13:21:02.286633 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.289103 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:02.247789 22272 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:02.292475 14342 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:02.262205 22274 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:02.281118 22264 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:02.298470 14342 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:02.302872 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:02.303295 22230 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:02.303881 22230 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:02.291841 22267 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:02.265606 22273 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.044s
I20260709 13:21:02.295372 22153 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:02.324522 14865 leader_election.cc:400] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20.
I20260709 13:21:02.325829 14865 leader_election.cc:403] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:02.330159 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.330727 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.331439 14302 raft_consensus.cc:2410] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 23 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:21:02.287413 22206 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.333588 14865 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:21:02.335039 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.340500 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.310650 22205 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:21:02.320506 22230 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.304497 22277 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:02.324486 22126 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:02.316701 22051 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:21:02.355836 22230 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:02.356555 22126 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.335374 22053 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260709 13:21:02.336822 22069 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:21:02.390586 22126 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:02.390863 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.391752 14371 raft_consensus.cc:2393] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 18: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:21:02.368062 22286 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 19. Current term is 20.
I20260709 13:21:02.392776 22286 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:02.392930 22051 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:02.393250 22286 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:02.393510 22051 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:02.393760 22286 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:21:02.394352 22278 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:21:02.394622 22051 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.395900 22051 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:02.354601 22283 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 13:21:02.398423 22283 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:21:02.398828 22283 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:02.399721 22283 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.401117 22283 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:02.360261 22158 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.403954 22158 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.368908 22205 consensus_queue.cc:1048] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:21:02.406529 22148 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.409847 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:02.344234 22083 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.415280 22083 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.415421 22284 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:21:02.416049 22284 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 27 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:02.418629 14296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54356 (request call id 3633) took 2019 ms. Trace:
I20260709 13:21:02.419041 14892 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:02.415468 14371 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:02.421271 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:02.422075 14898 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:02.419076 14296 rpcz_store.cc:276] 0709 13:21:00.399447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:00.970183 (+570736us) service_pool.cc:224] Handling call
0709 13:21:00.982031 (+ 11848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:01.342006 (+359975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.418374 (+1076368us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540020b554. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:21:02.418571 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826398976}
I20260709 13:21:02.434337 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.417047 22284 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.445034 14893 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:21:02.447530 22272 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:02.450181 22237 log.cc:927] Time spent T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: Append to log took a long time: real 1.417s	user 0.000s	sys 0.007s
W20260709 13:21:02.393568 22262 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.397s	user 0.003s	sys 0.000s
I20260709 13:21:02.451898 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:02.453989 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.454160 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.387251 22216 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:02.425964 22133 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.434947 21675 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:02.490517 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 156991us
I20260709 13:21:02.484421 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:02.504570 14865 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:02.483769 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:02.504832 14296 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:02.512135 22206 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.513026 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.513441 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:02.513688 14300 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:21:02.515115 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:02.515918 22053 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:02.516325 22053 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.516700 22053 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:21:02.421377 22292 consensus_queue.cc:1175] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cebb34ac155340899a38c728707ddc0d" responder_term: 27 status { last_received { term: 22 index: 17 } last_committed_idx: 17 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 26. Current term is 27. Ops: [24.18-26.19]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:21:02.519109 22291 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:02.519807 22291 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:02.521922 22286 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.523077 14897 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:02.520211 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:21:02.524755 22206 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:02.525154 22206 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:02.525554 22206 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:02.527238 22053 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:02.530433 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:02.532372 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 108563us
I20260709 13:21:02.533723 14865 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:21:02.541425 14303 raft_consensus.cc:2393] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 21: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:02.540756 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:02.495682 22153 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:02.553167 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:02.558454 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:02.559585 14304 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:21:02.480721 21675 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:02.553491 22291 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:02.478647 22133 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:02.555016 22148 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:02.541594 21998 consensus_queue.cc:1059] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:21:02.571313 22056 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:02.589752 22286 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.575438 22053 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.566676 22153 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.582472 22291 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:02.624076 22291 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.628739 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.629596 14369 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 24: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:21:02.629468 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:02.630136 14378 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:02.630455 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:02.631698 14369 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:02.628623 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:02.595825 22216 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:02.582810 22148 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.646950 14378 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 24.
I20260709 13:21:02.623041 21998 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:02.685586 14304 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
I20260709 13:21:02.648144 14296 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
I20260709 13:21:02.649895 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 27 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.605973 22056 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:02.649212 22287 log.cc:927] Time spent T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
I20260709 13:21:02.608923 22126 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:02.720669 14900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50026 (request call id 1676) took 2070 ms. Trace:
I20260709 13:21:02.643949 22263 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:02.606202 22230 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.733676 14900 rpcz_store.cc:276] 0709 13:21:00.650473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:00.762243 (+111770us) service_pool.cc:224] Handling call
0709 13:21:00.778113 (+ 15870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:01.007130 (+229017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:01.007171 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:01.007206 (+    35us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:21:01.007237 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.720295 (+1713058us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54005014d4. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:21:02.720375 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:02.720588 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526284544}
I20260709 13:21:02.649886 22216 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 24 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:02.706619 22272 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:02.754372 14375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47084 (request call id 3204) took 1678 ms. Trace:
I20260709 13:21:02.754833 14375 rpcz_store.cc:276] 0709 13:21:01.076193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:01.145078 (+ 68885us) service_pool.cc:224] Handling call
0709 13:21:01.145394 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:01.393018 (+247624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.754133 (+1361115us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400334d54. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded08ce01 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c 00007f8deb5c6cc2 00007f8deb3c748c 00007f8deb3c68c6
0709 13:21:02.754309 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568049024}
I20260709 13:21:02.727102 21998 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.766438 22153 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.771996 22126 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:02.753620 22272 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:02.774333 22272 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.774669 21998 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.775364 21675 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.776753 22148 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.778295 22056 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:02.778970 22216 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.778484 22206 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.751587 22305 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:02.756852 22052 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:02.795969 22133 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.741143 22263 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:02.830123 22242 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 1.508s	user 0.015s	sys 0.018s
I20260709 13:21:02.832183 14901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50036 (request call id 1718) took 2038 ms. Trace:
I20260709 13:21:02.832599 14901 rpcz_store.cc:276] 0709 13:21:00.793740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:00.986831 (+193091us) service_pool.cc:224] Handling call
0709 13:21:00.987124 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:01.006934 (+ 19810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:01.006963 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:01.009320 (+  2357us) log.cc:844] Serialized 26 byte log entry
0709 13:21:01.171258 (+161938us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:21:01.171322 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:01.171441 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:02.822033 (+1650592us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:21:02.831770 (+  9737us) raft_consensus.cc:1685] finished
0709 13:21:02.831796 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:02.832103 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19451,"raft.queue_time_us":20051,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":1918,"spinlock_wait_cycles":64123648,"thread_start_us":159761,"threads_started":1,"wal-append.queue_time_us":179884}
W20260709 13:21:02.871740 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:02.873126 22013 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:02.873750 22013 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.870452 22153 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:02.875892 22013 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.876129 22153 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:02.878299 22153 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:02.879632 22195 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:02.880113 22133 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.880211 22195 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.880754 22133 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.882907 22263 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.884125 22204 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:02.884629 22204 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:02.887161 22299 raft_consensus.cc:3055] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:02.887605 22299 raft_consensus.cc:740] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:02.888397 22299 consensus_queue.cc:260] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.888846 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.891955 22126 consensus_queue.cc:1059] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:02.892894 22126 consensus_queue.cc:1243] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:21:02.892252 22230 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.895825 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.897814 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:02.898558 14297 raft_consensus.cc:3060] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:02.901603 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.893646 22060 raft_consensus.cc:3055] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:02.904146 22060 raft_consensus.cc:740] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:21:02.900128 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:02.912863 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:02.913750 14298 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:02.918650 14344 leader_election.cc:336] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:02.921213 14301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1560) took 1005 ms. Trace:
I20260709 13:21:02.920032 14344 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:02.921617 14301 rpcz_store.cc:276] 0709 13:21:01.916352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:01.928371 (+ 12019us) service_pool.cc:224] Handling call
0709 13:21:02.020611 (+ 92240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:02.797335 (+776724us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b54001a8c20. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff5571 00007f8ded003dc0 00007f8ded08e1c0 00007f8ded08f231 00007f8ded08bd8f 00007f8ded08b83e 00007f8df2050419 00007f8deb5c7bd4 00007f8deb5c7b62 00007f8deb5c7a91 00007f8deb5c7a0c
0709 13:21:02.797721 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:02.797756 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:02.798267 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:21:02.849559 (+ 51292us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:21:02.849847 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.849947 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:02.901284 (+ 51337us) raft_consensus.cc:1685] finished
0709 13:21:02.901304 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:02.921127 (+ 19823us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4484,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":4644,"spinlock_wait_cycles":10352000,"thread_start_us":48899,"threads_started":1,"wal-append.queue_time_us":87518}
I20260709 13:21:02.920217 22060 consensus_queue.cc:260] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.931545 22206 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.927906 22230 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:02.940130 22307 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 13:21:02.941776 22308 log.cc:927] Time spent T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:21:02.943799 22195 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.944963 14296 raft_consensus.cc:1240] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:02.945154 22208 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:02.949942 22263 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:02.950568 22263 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:02.952118 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.953202 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54356 (request call id 3645) took 1162 ms. Trace:
I20260709 13:21:02.953636 14295 rpcz_store.cc:276] 0709 13:21:01.790911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.951737 (+1160826us) service_pool.cc:224] Handling call
0709 13:21:02.953125 (+  1388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:02.955634 14371 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:21:02.958885 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.960949 22263 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:02.964989 22151 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:02.965822 22151 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.968761 22151 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.969681 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.970394 14374 raft_consensus.cc:2468] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:21:02.970482 14193 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:02.970901 22213 consensus_queue.cc:1059] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:02.971411 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.972451 14369 raft_consensus.cc:2410] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:21:02.972462 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.931375 22133 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.974542 22133 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:02.972757 22126 raft_consensus.cc:3055] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:02.975368 22126 raft_consensus.cc:740] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:02.976527 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:02.976766 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.977756 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:02.974035 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:02.979604 22309 log.cc:927] Time spent T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:21:02.979997 14296 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 23: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:02.980605 22000 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:02.980849 22013 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:02.976238 22126 consensus_queue.cc:260] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.982820 22126 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:02.981961 22200 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.984839 22200 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:02.986964 22200 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:02.987748 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:02.988446 14894 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
I20260709 13:21:02.991155 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:02.992636 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:02.993031 14899 raft_consensus.cc:1240] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:02.994221 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:02.995666 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:02.992951 22274 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
W20260709 13:21:02.999364 22310 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:21:03.000725 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:02.971472 14193 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:21:02.992654 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 726540us
I20260709 13:21:02.974743 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:03.007231 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:03.007649 14375 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:03.008656 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.010324 14298 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:21:02.934151 22060 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:03.014220 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:03.020045 14898 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:03.020411 14297 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
I20260709 13:21:03.018131 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:21:03.022538 14867 leader_election.cc:336] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.025271 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:03.031876 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.032145 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:03.031903 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.033763 14896 raft_consensus.cc:2410] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:21:03.035125 22261 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:03.035650 22261 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.038264 14892 raft_consensus.cc:2393] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 15: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:21:03.041677 14894 raft_consensus.cc:1275] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:21:03.063812 14867 leader_election.cc:336] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:02.981446 22013 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.025748 22072 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:21:03.026912 22137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.684s	user 0.012s	sys 0.015s
I20260709 13:21:03.022770 22206 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:03.092600 14342 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:21:03.098105 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 77286.4us
I20260709 13:21:03.037973 22133 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:03.037739 22261 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:03.114713 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 88766.6us
I20260709 13:21:03.087786 22208 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:03.094856 22137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.752s	user 0.013s	sys 0.015s
I20260709 13:21:03.119606 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.127064 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:03.134470 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.136864 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.137207 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:03.137845 14896 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:21:03.122335 22284 raft_consensus.cc:2804] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:03.110982 22206 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.141924 22204 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.142961 22133 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:03.123991 22208 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:03.132603 22072 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:03.151104 22282 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:03.132812 22283 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:03.110872 22214 consensus_queue.cc:1059] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:21:03.126004 22250 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:21:03.163533 14867 leader_election.cc:336] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.165938 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.168118 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:03.198012 14301 raft_consensus.cc:1240] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:03.202064 14896 raft_consensus.cc:2468] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:21:03.204286 14901 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:21:03.175436 22284 raft_consensus.cc:697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:21:03.208741 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:03.170102 14375 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
W20260709 13:21:03.171892 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 249126us
W20260709 13:21:03.180392 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 60903us
I20260709 13:21:03.216135 14341 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:03.176784 22189 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
W20260709 13:21:03.219700 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 53837.9us
I20260709 13:21:03.202659 22272 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:21:03.216703 22069 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.226640 14341 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:03.208196 22126 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.208983 22052 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:03.225318 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.211388 22089 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:03.233418 22137 consensus_queue.cc:1059] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:03.234391 22137 consensus_queue.cc:1243] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer 181bbac22422408c87cd13b7fe3008f9 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:21:03.233917 22089 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:03.223752 22148 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:03.224155 22056 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:03.202926 22250 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.220497 22170 consensus_queue.cc:1048] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:21:03.231197 22230 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:03.242074 22263 raft_consensus.cc:2804] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:03.239408 22053 raft_consensus.cc:3055] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:03.236074 22126 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:03.229765 22069 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.282665 14369 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:03.251873 22052 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:03.253312 22293 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.244166 22209 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 13:21:03.230015 22072 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:03.276649 22148 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.278754 22053 raft_consensus.cc:740] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
W20260709 13:21:03.294787 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 288847us
I20260709 13:21:03.286896 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:21:03.282716 22263 raft_consensus.cc:697] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:03.307370 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.318781 14369 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 18.
W20260709 13:21:03.319620 14270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.320655 22052 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:03.321087 22204 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:03.257140 22284 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:03.330546 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.323688 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:03.294724 22163 consensus_queue.cc:1059] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:21:03.334666 22189 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:03.334905 22163 raft_consensus.cc:3055] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:21:03.302978 22148 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.292963 22293 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.314283 22305 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:03.357995 22305 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:03.363456 22272 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:03.364087 22272 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.368230 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:03.347919 22326 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:21:03.349260 22263 consensus_queue.cc:237] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.351212 22126 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:03.352070 22250 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:03.338805 22208 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:03.335294 22163 raft_consensus.cc:740] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:03.313709 22069 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:03.308444 22089 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:03.321902 22151 raft_consensus.cc:2804] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:03.370422 14901 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:03.361452 22299 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:03.377420 22272 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:03.379036 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.403630 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.404640 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:03.405589 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:03.406921 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:03.416278 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:03.420301 22125 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:03.375456 22053 consensus_queue.cc:260] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:03.422451 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.422094 22163 consensus_queue.cc:260] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:03.422130 22053 raft_consensus.cc:3060] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:03.438169 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:03.439131 22148 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:03.440219 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:03.441102 22272 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:03.443269 22206 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:03.443867 22206 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:03.449000 14300 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 18. (term mismatch)
I20260709 13:21:03.449421 14300 pending_rounds.cc:85] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 17
I20260709 13:21:03.449635 14300 pending_rounds.cc:107] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 24.18
I20260709 13:21:03.449877 14300 raft_consensus.cc:2889] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:03.450174 14300 pending_rounds.cc:107] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 26.19
I20260709 13:21:03.450380 14300 raft_consensus.cc:2889] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:03.418740 14303 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:21:03.471887 14344 leader_election.cc:336] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:03.479017 14344 leader_election.cc:336] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:03.480032 14344 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:03.480929 14344 leader_election.cc:336] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.481280 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:03.474272 14300 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 13:21:03.470734 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 52040.8us
I20260709 13:21:03.493932 22281 consensus_queue.cc:1059] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:21:03.494865 22148 raft_consensus.cc:3055] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:03.411732 22151 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:03.495347 22148 raft_consensus.cc:740] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:03.495573 22151 raft_consensus.cc:3060] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:03.496273 22148 consensus_queue.cc:260] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.497974 21995 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:21:03.499949 14344 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:03.500962 14344 leader_election.cc:336] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.509117 14344 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.497656 22148 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:03.520648 14344 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:03.519337 14270 leader_election.cc:336] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.521271 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.502617 22056 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:03.523655 14344 leader_election.cc:336] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.524207 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:03.526221 14867 leader_election.cc:336] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:03.515997 22331 log.cc:927] Time spent T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:21:03.465538 22230 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 13:21:03.501811 22283 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:03.537489 14344 leader_election.cc:336] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.522935 22209 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:21:03.542033 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 135186us
I20260709 13:21:03.498780 22206 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:21:03.533625 22126 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:03.535002 21984 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:03.551631 14344 leader_election.cc:336] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.552066 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:03.557269 14344 leader_election.cc:336] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.561678 22305 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.584986 22305 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:03.586354 22293 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:03.565043 14344 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.562949 22056 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:03.582787 22060 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:03.626005 22322 log.cc:927] Time spent T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:21:03.599100 22125 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:03.547605 14864 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:03.672741 14867 leader_election.cc:336] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:03.683172 22340 log.cc:927] Time spent T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.079s	user 0.001s	sys 0.003s
I20260709 13:21:03.676996 22060 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:03.688498 14867 leader_election.cc:336] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.688912 22060 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:03.692034 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 144556us
W20260709 13:21:03.675076 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 117829us
I20260709 13:21:03.666436 22069 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.693288 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.676275 22155 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:03.695088 14344 leader_election.cc:336] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.698251 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:03.699396 14344 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.699798 14344 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:03.700814 14344 leader_election.cc:336] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.701217 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.702886 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.694833 22206 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:21:03.704218 14344 leader_election.cc:336] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.705420 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:03.707295 14344 leader_election.cc:336] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:03.708747 14344 leader_election.cc:336] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.709390 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.709518 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:03.711272 14371 raft_consensus.cc:2410] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:21:03.704447 22151 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.713747 22151 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:03.708043 22155 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:03.716723 22213 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:03.704336 22203 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:03.736351 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:03.695834 22069 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:03.702929 22056 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:03.739073 14344 leader_election.cc:336] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.705912 22060 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:03.739810 14344 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.706599 22125 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:03.705597 22230 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:21:03.741688 22230 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:03.741624 14344 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.697954 22347 consensus_queue.cc:1059] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:21:03.743829 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:03.744239 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:03.745489 22069 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:03.746263 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:03.705621 22216 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:21:03.748063 14344 leader_election.cc:336] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.748757 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.749279 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:03.751513 14344 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:03.752187 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.755764 22305 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.756333 22305 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.758914 22305 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:03.759701 21998 raft_consensus.cc:3055] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:03.760134 21998 raft_consensus.cc:740] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:03.761009 21998 consensus_queue.cc:260] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.762624 22060 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:03.763861 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.764914 14896 raft_consensus.cc:1240] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:03.776736 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.783865 14375 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:21:03.783885 14371 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:21:03.784523 14375 pending_rounds.cc:85] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 15
I20260709 13:21:03.784819 14375 pending_rounds.cc:107] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:21:03.785045 14375 raft_consensus.cc:2889] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:03.786880 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:03.787549 14377 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:21:03.789428 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:03.790364 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.790907 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:03.792083 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:03.792220 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:03.794085 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:03.794639 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:03.781342 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:03.797520 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.797881 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.798820 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.799362 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.807602 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.744010 22347 raft_consensus.cc:3055] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:03.809760 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:03.771735 21811 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:03.807183 22216 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:03.801851 22000 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:03.802205 22261 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:03.804207 22072 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.834800 22072 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:03.837070 22072 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:03.818218 22158 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:03.803874 22133 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:03.832790 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.809181 22299 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.839398 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:03.822388 21998 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:03.841607 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:03.819242 22347 raft_consensus.cc:740] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:03.856813 22347 consensus_queue.cc:260] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.858186 22347 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:03.780738 22056 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:21:03.860972 22133 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:03.864073 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:03.864733 14372 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:21:03.850896 22299 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:03.852391 22053 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:03.868469 14303 raft_consensus.cc:1240] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:03.872187 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:03.881857 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:03.867228 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:03.884577 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:03.890447 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:03.892561 14297 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:21:03.904840 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:03.893293 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47443.1us
I20260709 13:21:03.893899 14303 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:21:03.908185 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:03.914033 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:03.906328 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.914937 22230 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:21:03.917660 14867 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:03.912995 22327 log.cc:927] Time spent T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.701s	user 0.005s	sys 0.000s
I20260709 13:21:03.918526 14192 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:03.884351 22053 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:03.926820 14369 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:21:03.926705 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:03.893038 22158 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:03.935142 22158 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:03.925079 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:03.939152 21995 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:03.931746 22053 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:03.916234 22013 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:03.919075 22206 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:03.961526 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:03.933347 22216 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:03.916610 22261 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
W20260709 13:21:03.983192 22339 log.cc:927] Time spent T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.444s	user 0.003s	sys 0.000s
I20260709 13:21:03.926255 22125 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:21:03.987789 14297 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:03.978647 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:03.959945 22206 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:03.954475 22260 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:21:03.979543 22000 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:03.980036 21675 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:03.998221 22206 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:21:04.036585 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 106499us
I20260709 13:21:03.997771 22213 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:04.049551 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:04.051153 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 132731us
I20260709 13:21:04.035044 22230 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:04.069186 14297 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:04.031899 22053 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.053383 22148 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.078369 22195 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:04.076793 22299 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:04.075347 22230 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:04.114972 22366 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:21:04.104585 22363 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:04.116020 22363 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:04.118454 22363 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:04.123262 22230 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:04.128216 22056 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:04.131397 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:04.134402 22053 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:04.135593 22356 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:21:04.136896 22364 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:21:04.140107 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:04.142707 14892 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:04.105698 22195 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:04.156527 14892 raft_consensus.cc:1240] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:04.158492 14377 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:04.159081 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:04.105527 22148 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.176532 22370 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.177153 22370 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:04.145728 22195 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.172892 22208 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.182703 22208 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.181998 21984 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:04.183657 21984 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:04.172573 22365 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.190856 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.194205 21984 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.181999 22195 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:04.209502 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.212433 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.186997 22133 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:04.184551 22203 consensus_queue.cc:1175] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cebb34ac155340899a38c728707ddc0d" responder_term: 21 status { last_received { term: 20 index: 17 } last_committed_idx: 16 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 20. Current term is 21. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:21:04.223136 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:04.214875 22214 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:04.215111 22364 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:04.231135 22208 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:04.224887 22368 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:04.258450 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.245198 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:04.245949 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:04.247248 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:04.248167 22148 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:04.249748 22261 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.220938 22243 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:04.253921 22133 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:04.214394 22365 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.261334 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:04.266826 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:04.276144 14297 raft_consensus.cc:2393] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 23: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:04.277050 14192 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:04.279168 22314 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:04.299978 22314 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.284400 22261 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.304889 22261 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:04.281683 21675 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:04.279999 22126 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:04.306951 22126 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.309873 22365 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:04.302836 22314 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:04.316967 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:04.317654 14300 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
W20260709 13:21:04.321098 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 44129.7us
W20260709 13:21:04.322434 14867 leader_election.cc:336] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.326963 22362 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:04.320070 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:04.331363 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:04.331878 14867 leader_election.cc:336] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.335409 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:04.338169 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:04.338949 14377 raft_consensus.cc:2410] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:21:04.339044 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:04.339223 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.339476 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:04.341635 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:04.342933 21675 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:04.312952 22206 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.334228 22347 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:04.344504 22347 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:04.344878 22347 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:04.347573 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:04.349483 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:04.351092 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:04.360875 22126 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:04.361649 22347 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.364544 22347 leader_election.cc:290] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:04.368966 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:04.345041 22206 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:04.377918 14892 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:21:04.383940 14896 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
W20260709 13:21:04.385541 14270 leader_election.cc:336] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.387090 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:04.388996 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:04.389469 14270 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:04.391247 22203 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:04.388177 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:04.392170 14302 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:04.400738 22282 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:21:04.402122 14270 leader_election.cc:336] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.402592 14270 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:04.404493 14270 leader_election.cc:336] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.405032 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:04.405865 22195 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:04.409529 22126 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.410156 22126 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.412848 21811 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.413511 21811 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.416329 21811 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:04.417910 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 94668.6us
I20260709 13:21:04.412403 22126 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:04.418776 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:04.419447 14300 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
I20260709 13:21:04.420320 14302 raft_consensus.cc:2468] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
W20260709 13:21:04.420377 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 81229.4us
I20260709 13:21:04.420933 22282 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:04.421460 22089 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:04.422060 22163 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:04.422237 22089 consensus_queue.cc:1059] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:21:04.423240 22281 raft_consensus.cc:3055] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:04.423599 22281 raft_consensus.cc:740] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:04.424399 22281 consensus_queue.cc:260] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.425860 14865 leader_election.cc:304] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:04.427917 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:04.428197 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:04.428895 14299 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
W20260709 13:21:04.427919 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 77102.4us
I20260709 13:21:04.426887 22281 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:04.431028 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:04.437862 14192 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:04.438235 21811 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:04.439489 21811 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:04.436473 22126 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:04.448053 21811 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:04.448410 22126 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:04.448926 22126 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:04.434597 22206 raft_consensus.cc:2804] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:04.450436 22206 raft_consensus.cc:697] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:04.451308 22206 consensus_queue.cc:237] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.441681 22053 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:04.453626 22053 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:04.453717 21984 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:04.454583 22053 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.442538 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.461604 14894 raft_consensus.cc:1275] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:04.461709 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:04.465525 14193 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.466203 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:04.467137 14895 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:04.467651 22365 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:04.464351 22089 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.469164 22363 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:04.469573 22089 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.471860 22089 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:04.473536 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:04.475783 22370 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:04.476631 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 72178.9us
W20260709 13:21:04.477370 14270 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.474365 14192 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:04.482702 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:04.483531 14895 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 15.
W20260709 13:21:04.484858 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:04.477869 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:04.486734 14192 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:04.487406 22353 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:04.488915 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:04.489288 14270 leader_election.cc:336] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.489907 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.490720 22353 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:04.491389 14270 leader_election.cc:336] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.492013 14270 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.492774 22353 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:04.493283 14270 leader_election.cc:336] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:04.494939 14194 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:04.493764 14270 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.503875 14192 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:04.500860 22089 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:04.498358 22216 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:04.506904 22250 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:04.509662 22133 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.509918 22263 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.510593 22353 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:04.511585 22363 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:04.482872 22125 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:04.534795 14341 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.535128 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:04.570963 14192 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:04.547195 14304 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:04.575943 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.583453 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:04.585736 22250 raft_consensus.cc:2804] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:04.586315 22250 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:04.586790 22250 raft_consensus.cc:3060] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:21:04.619860 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 85348.6us
W20260709 13:21:04.620011 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 126740us
W20260709 13:21:04.643909 14270 leader_election.cc:336] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.580150 22370 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:04.536041 22052 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:04.535923 22133 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.619035 22137 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:04.674229 22378 log.cc:927] Time spent T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:21:04.641543 21811 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.699888 22137 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.706981 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:04.716244 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.733009 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 237776us
I20260709 13:21:04.567631 22263 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.620780 22360 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:21:04.672772 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 191610us
I20260709 13:21:04.535156 22216 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.635582 22284 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:04.574239 22151 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:04.648694 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 92680.7us
I20260709 13:21:04.595898 22214 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:04.777355 14867 leader_election.cc:336] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.778023 22263 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:04.756639 22230 consensus_queue.cc:1048] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:21:04.779974 22137 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:04.777966 14867 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:04.781589 22305 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:21:04.820312 22158 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.850888 22133 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:04.854343 22382 log.cc:927] Time spent T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:21:04.822446 22214 consensus_queue.cc:1059] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:21:04.855166 22214 raft_consensus.cc:3055] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:04.855552 22214 raft_consensus.cc:740] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:04.856478 22214 consensus_queue.cc:260] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.754201 22360 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.824294 22158 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:04.859704 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:04.906920 14299 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
W20260709 13:21:04.878947 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:04.894918 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:04.896214 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:04.913259 14300 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:04.908366 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:21:04.886922 14867 leader_election.cc:336] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:04.887809 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:04.917419 14892 raft_consensus.cc:1240] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 21. Current term is 22. Ops: []
W20260709 13:21:04.919947 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 274404us
W20260709 13:21:04.870850 22381 log.cc:927] Time spent T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:21:04.870378 22372 log.cc:927] Time spent T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:21:04.853363 22250 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:04.924814 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 254935us
I20260709 13:21:04.931648 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:04.873723 22305 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:04.942700 14894 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
I20260709 13:21:04.939038 14899 raft_consensus.cc:1240] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Rejecting Update request from peer a9b2cf49ceed478480fb0f27ccf55d81 for earlier term 22. Current term is 23. Ops: []
I20260709 13:21:04.932090 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:04.943625 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:04.872823 21811 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:04.884882 22360 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:04.919925 22267 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:04.878961 22216 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:04.874493 22261 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:04.935117 22314 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.920244 22364 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.857780 22214 raft_consensus.cc:3060] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:04.940277 22072 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:04.874327 22126 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.952375 22267 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:04.951980 22305 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.967482 22267 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:04.957723 22261 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.963475 22364 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.961668 22314 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:04.980880 22364 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:05.019937 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 84746.4us
I20260709 13:21:05.045760 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.052374 14304 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:21:05.054538 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 100424us
W20260709 13:21:05.055876 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 100783us
I20260709 13:21:05.067808 14304 raft_consensus.cc:1275] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:21:05.077708 14899 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:05.082818 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.084252 14895 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:21:05.086392 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.088109 14897 raft_consensus.cc:2393] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 21: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:21:05.090109 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:05.091279 14898 raft_consensus.cc:3060] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:05.095328 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.096808 14894 raft_consensus.cc:2393] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:21:05.105439 21811 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:05.106704 21811 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.110910 22000 consensus_queue.cc:1048] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:05.116281 22158 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:05.118512 22126 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.125365 21675 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:05.127617 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:05.128710 14303 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:05.131724 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.139317 21811 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.145138 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:05.146683 22158 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:05.147281 22158 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.147260 21675 consensus_queue.cc:1059] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:05.148231 22158 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:05.148770 14192 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:05.150148 22072 raft_consensus.cc:3055] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:05.150751 22072 raft_consensus.cc:740] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:05.149230 21675 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:21:05.151624 22120 raft_consensus.cc:3060] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:05.152588 22072 consensus_queue.cc:260] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.160429 22072 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:21:05.163858 14344 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:05.164595 14344 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:05.170109 21811 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:05.173718 14867 leader_election.cc:336] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:05.176640 22148 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.177697 22148 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.180965 22148 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.175259 14867 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:05.221210 22250 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:05.224690 22261 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:05.224936 22314 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:05.206045 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.237309 14898 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:21:05.239555 14303 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 24.
I20260709 13:21:05.241217 14342 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:05.246165 14302 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:21:05.247839 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.248639 14900 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 24.
I20260709 13:21:05.253513 22305 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:05.269341 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:05.272905 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.277374 14302 raft_consensus.cc:2368] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 23. Current term is 24.
I20260709 13:21:05.280926 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:05.281864 14300 raft_consensus.cc:2468] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 16.
I20260709 13:21:05.277045 22314 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:05.294806 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.278674 22158 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.314965 14297 raft_consensus.cc:2393] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 22: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:05.324685 22230 raft_consensus.cc:2804] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:05.283237 22250 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.325769 22393 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:21:05.376885 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 220292us
I20260709 13:21:05.380606 22363 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.381494 22363 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:05.384521 22363 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:05.320926 14120 catalog_manager.cc:5697] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:05.365931 22393 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:05.361562 22230 raft_consensus.cc:697] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 24 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:21:05.414649 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 125933us
I20260709 13:21:05.405352 14342 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:05.416929 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.410559 22393 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:05.457286 14865 leader_election.cc:400] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 23. Current term is 24.
I20260709 13:21:05.457719 14865 leader_election.cc:403] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:21:05.458357 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 97153.1us
W20260709 13:21:05.462800 13122 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 14254)
I20260709 13:21:05.467569 22360 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:05.468353 22360 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.472456 22303 raft_consensus.cc:3060] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 24
W20260709 13:21:05.474776 22267 consensus_meta.cc:287] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.003s
I20260709 13:21:05.416559 22250 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:05.486116 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:05.480931 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:21:05.492827 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 133840us
I20260709 13:21:05.494208 22397 raft_consensus.cc:2804] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:05.494882 22397 raft_consensus.cc:697] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:05.495683 22398 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:05.496007 22397 consensus_queue.cc:237] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.496445 22398 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.499198 22398 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.475302 22267 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.488128 22305 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.517468 22360 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:05.511509 14119 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36074 (request call id 218) took 30293 ms (client timeout 15000 ms). Trace:
I20260709 13:21:05.489843 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:05.518532 22072 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:21:05.518908 22399 log.cc:927] Time spent T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.250s	user 0.000s	sys 0.003s
I20260709 13:21:05.520026 22230 consensus_queue.cc:237] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:05.523139 22403 log.cc:927] Time spent T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:21:05.523368 22250 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:05.476301 22158 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.541235 22305 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:05.538772 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.551414 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 62160.1us
I20260709 13:21:05.538075 22072 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.553009 22072 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:05.542346 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:05.554013 14892 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:05.553153 22389 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.558120 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:05.493022 14120 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 15 to 18, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 18 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:05.556268 14373 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 20.
W20260709 13:21:05.566350 14344 leader_election.cc:336] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:05.567023 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.571882 22305 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:05.556133 22389 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.574580 22389 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.578126 22263 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:05.578761 22263 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:05.580153 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.581055 22263 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:05.535537 14119 rpcz_store.cc:269] 0709 13:20:35.221441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.221722 (+   281us) service_pool.cc:224] Handling call
0709 13:21:05.511188 (+30289466us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:58.942774 (+     0us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8de9f820ac 00007f8df2ddcab9 00007f8de9f9e69b 00007f8de9f9c93f 00007f8de9f9c455 00007f8df0ac116c
0709 13:20:59.264142 (+321368us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:00.309410 (+1045268us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5400151ea8. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8df34489e1 00007f8df344764c 00007f8df0ad6d5d 00007f8df0ac20a6 00007f8df0ac1d58 00007f8df0ac69f1 00007f8df0ac69a9 00007f8df0ac6939 00007f8df0ac6901 00007f8df0ac5b2d 000000000038f354
0709 13:21:00.344972 (+ 35562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:00.362524 (+ 17552us) write_op.cc:435] Acquired schema lock
0709 13:21:00.364113 (+  1589us) tablet.cc:662] Decoding operations
0709 13:21:00.380351 (+ 16238us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:00.380480 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:00.380528 (+    48us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:21:00.650848 (+270320us) tablet.cc:701] Row locks acquired
0709 13:21:00.672640 (+ 21792us) write_op.cc:260] PREPARE: finished
0709 13:21:00.694781 (+ 22141us) write_op.cc:270] Start()
0709 13:21:00.766892 (+ 72111us) write_op.cc:276] Timestamp: P: 1783603260683760 usec, L: 0
0709 13:21:00.777433 (+ 10541us) op_driver.cc:348] REPLICATION: starting
0709 13:21:00.795336 (+ 17903us) log.cc:844] Serialized 7938 byte log entry
0709 13:21:02.122152 (+1326816us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b4400022b4c. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9ec5c85 00007f8de9ec66a2 00007f8decc381db 00007f8decc33aaf 00007f8decc2786e 00007f8decc26bb6 00007f8decc267d8 00007f8decc30221 00007f8decc301d9 00007f8decc30169
0709 13:21:02.838819 (+716667us) op_driver.cc:464] REPLICATION: finished
0709 13:21:03.223861 (+385042us) write_op.cc:301] APPLY: starting
0709 13:21:03.228596 (+  4735us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:03.707319 (+478723us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:03.710821 (+  3502us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:04.143554 (+432733us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:04.144051 (+   497us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:21:04.144112 (+    61us) write_op.cc:312] APPLY: finished
0709 13:21:04.144604 (+   492us) log.cc:844] Serialized 180 byte log entry
0709 13:21:04.324318 (+179714us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:04.324489 (+   171us) write_op.cc:454] Released schema lock
0709 13:21:04.324564 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:04.384659 (+ 60095us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:04.384692 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3894137,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":375365,"apply.run_cpu_time_us":45046,"apply.run_wall_time_us":1112294,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87767,"num_ops":20,"prepare.queue_time_us":571747,"prepare.run_cpu_time_us":49393,"prepare.run_wall_time_us":1695829,"raft.queue_time_us":314098,"raft.run_cpu_time_us":146007,"raft.run_wall_time_us":381211,"replication_time_us":2026908,"spinlock_wait_cycles":211268352,"thread_start_us":1303283,"threads_started":5,"wal-append.queue_time_us":364269,"wal-append.run_cpu_time_us":34505,"wal-append.run_wall_time_us":3827991}]]}
I20260709 13:21:05.589879 14120 catalog_manager.cc:5697] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 4 to 14, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 14 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.591307 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.594043 22363 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:21:05.601356 14195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:05.603421 22267 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.604389 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:05.610260 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 47612us
I20260709 13:21:05.607062 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.630254 14892 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:21:05.624461 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:21:05.631134 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:05.623598 14301 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
W20260709 13:21:05.622229 14344 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:05.646642 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:05.647439 14370 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 24.
I20260709 13:21:05.648927 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:05.649541 14369 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:21:05.649472 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:05.641625 14192 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:21:05.642853 14867 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:05.630155 22214 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.577440 22393 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.659991 14867 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:05.658315 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:05.667497 14299 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:05.653551 22305 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:05.686898 22216 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:05.687477 22216 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.687263 22305 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.687965 22216 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:05.688695 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.677320 22214 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.669333 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.641335 22363 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:05.684713 14373 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 25.
I20260709 13:21:05.686152 22163 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:05.691953 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:21:05.669322 22120 consensus_meta.cc:287] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.004s
I20260709 13:21:05.697249 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:05.697952 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:05.704274 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:05.721757 22214 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.697286 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:05.732440 22163 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:05.732817 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.689764 22305 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:21:05.733611 14901 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:21:05.740041 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:05.746276 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.736117 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:05.729470 14344 leader_election.cc:336] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:05.758076 14373 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
W20260709 13:21:05.759438 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 119294us
W20260709 13:21:05.760849 14344 leader_election.cc:336] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:05.737442 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:05.799211 22393 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.806154 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:05.745615 22072 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.806895 14896 raft_consensus.cc:3060] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:05.809268 22072 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.812700 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:05.815883 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.816598 14304 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:21:05.728682 22120 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:05.823980 14193 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:21:05.827390 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 90027us
I20260709 13:21:05.828610 14369 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:21:05.829207 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:05.762508 22303 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d for earlier term 23. Current term is 24.
I20260709 13:21:05.831233 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.760339 22261 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:05.734117 22089 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:05.795563 14344 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:05.835973 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:05.838052 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45596.2us
I20260709 13:21:05.842783 14895 raft_consensus.cc:2393] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 23: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:21:05.843499 22263 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:05.844427 22363 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:05.845058 22363 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:05.845921 22353 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:05.846583 22353 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.855515 22368 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:05.856022 22368 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.856385 22368 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:05.752388 22216 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.880119 14302 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:21:05.883874 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:05.883586 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:05.887306 14897 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 21.
W20260709 13:21:05.888945 14867 leader_election.cc:336] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:05.894157 14867 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:05.896287 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.881985 22353 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.733708 22163 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:05.900517 22408 log.cc:927] Time spent T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:21:05.900997 22208 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:05.891222 22397 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:05.907482 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:05.907945 22261 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:05.908533 14899 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 22: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:21:05.911980 22368 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.916217 14341 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:05.916683 14900 raft_consensus.cc:2368] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22.
I20260709 13:21:05.749681 14120 catalog_manager.cc:5697] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 9 to 12, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 12 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:05.898092 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:05.934355 14895 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:05.845642 22363 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.924723 22208 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.933518 14299 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:21:05.921765 14892 raft_consensus.cc:2468] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 24.
I20260709 13:21:05.934088 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:05.922149 22230 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:05.943509 22363 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.937254 22397 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:05.940164 14342 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:05.956188 22397 raft_consensus.cc:2804] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:05.956468 22208 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.956862 22397 raft_consensus.cc:697] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:05.970444 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.972034 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:05.946978 22360 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:05.979714 22360 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.980158 22360 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:05.975898 22230 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:05.974495 14896 raft_consensus.cc:2468] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:21:05.983949 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:05.985823 14341 leader_election.cc:400] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22.
I20260709 13:21:05.990124 22267 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:05.990279 22293 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:05.991674 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:05.992347 14378 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:05.992233 22293 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:05.994100 22353 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:05.994635 22293 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:05.994750 22353 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:05.997320 22353 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:06.005122 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.007431 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.007611 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.007102 14895 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 25.
W20260709 13:21:06.017233 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 123882us
I20260709 13:21:06.018671 14192 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:06.022737 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 113973us
I20260709 13:21:06.031086 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.029615 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.035856 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:06.036939 14896 raft_consensus.cc:2368] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22.
I20260709 13:21:06.042034 14377 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 25: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:21:06.046204 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:06.048749 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 220523us
I20260709 13:21:06.051705 14897 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:21:06.052778 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:06.057847 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:06.058449 14302 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:06.061620 22230 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.074910 22368 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:06.076673 22370 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:06.077303 22370 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:06.077741 22370 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:06.095319 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:06.095990 14299 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:06.103483 22206 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:06.104251 22206 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.004743 22397 consensus_queue.cc:237] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.115788 22216 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:06.130653 14302 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:21:06.137367 14378 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 25.
I20260709 13:21:06.137962 14299 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
I20260709 13:21:06.139707 14193 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:06.140792 22158 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:06.141422 22158 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:06.102280 22267 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:06.143802 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:21:06.189761 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46054.3us
W20260709 13:21:06.199211 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 126991us
W20260709 13:21:06.204689 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 151977us
I20260709 13:21:06.204975 22125 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.205538 14192 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:06.206795 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:06.210181 22364 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:21:06.219671 22158 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:06.227578 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 160599us
I20260709 13:21:06.237278 14192 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:06.204110 22314 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:06.221848 22261 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:06.245039 22314 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:06.223497 22072 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:06.246137 22314 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.247601 22206 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:06.255816 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:06.256685 14892 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:06.240294 22368 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:06.294864 22360 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.205562 22125 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.297509 14375 raft_consensus.cc:2368] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 20. Current term is 21.
I20260709 13:21:06.298296 22125 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:06.301220 22360 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:06.302126 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:06.311928 14304 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:21:06.312530 14867 leader_election.cc:336] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:06.268100 22214 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:06.306963 14302 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:21:06.319707 22421 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:06.344027 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:06.351684 14894 raft_consensus.cc:1275] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:21:06.350445 14267 leader_election.cc:400] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 20. Current term is 21.
I20260709 13:21:06.352403 14267 leader_election.cc:403] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:06.358956 14341 leader_election.cc:400] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22.
I20260709 13:21:06.366390 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:06.370764 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:06.371438 14299 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:21:06.335002 22163 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.374785 22163 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:06.377266 22163 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:06.369172 22370 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:06.380021 22370 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:06.386790 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.388219 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:06.388829 14899 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:06.389108 14299 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:21:06.397984 14304 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:21:06.398355 14892 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
I20260709 13:21:06.401136 14342 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:21:06.403407 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 60617.1us
I20260709 13:21:06.413666 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:06.415261 14299 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:21:06.405894 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:06.417098 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:06.419338 22431 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:06.419898 22431 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:06.420318 22431 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:06.421878 22368 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.422596 22368 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:06.424995 22368 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:06.425596 22195 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203) with higher term. Message: Invalid argument: T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f for earlier term 20. Current term is 21.
I20260709 13:21:06.405891 22214 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:06.426394 22214 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:06.404525 22089 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.428860 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:06.430775 14192 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:21:06.438050 14270 leader_election.cc:336] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:06.438408 22426 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:06.438618 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:06.439182 22426 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:21:06.440335 14270 leader_election.cc:336] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:06.440678 22250 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:06.440896 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:06.442773 22416 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:06.445853 22429 consensus_queue.cc:1048] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
W20260709 13:21:06.446425 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:06.447440 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:06.450105 22347 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.440263 22426 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.433277 22089 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.483745 22089 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:06.406598 22421 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:21:06.484856 22421 consensus_queue.cc:1243] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:21:06.416451 22158 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:06.463351 13122 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 14254)
I20260709 13:21:06.481026 22347 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.459913 22214 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:06.490075 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 80557.9us
I20260709 13:21:06.494604 14899 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
I20260709 13:21:06.503934 14303 pending_rounds.cc:85] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Aborting all ops after (but not including) 14
I20260709 13:21:06.510744 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:06.504413 14303 pending_rounds.cc:107] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:21:06.514919 14303 raft_consensus.cc:2889] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:21:06.508575 14867 leader_election.cc:336] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:06.526856 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 116726us
I20260709 13:21:06.502007 22158 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.535305 22158 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:06.542927 22347 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:06.548396 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:06.548272 22431 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:06.555480 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:06.560173 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 120316us
I20260709 13:21:06.580665 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:06.582527 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:06.588105 14897 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 23: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:21:06.589445 14899 raft_consensus.cc:1275] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:21:06.587070 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:06.591792 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51689.2us
I20260709 13:21:06.604064 22431 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:06.588641 22416 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:06.559912 22250 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:06.607558 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:06.611804 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:06.612141 14304 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 22.
I20260709 13:21:06.613168 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:06.615317 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 110600us
I20260709 13:21:06.617717 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.623741 22163 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:06.625206 22208 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:06.632290 22370 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.633056 22370 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.635576 22370 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:06.620402 22431 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:06.619091 14867 leader_election.cc:336] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:06.640849 14299 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 26.
I20260709 13:21:06.653764 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.654196 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:06.655058 14374 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:21:06.643671 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:06.668859 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.670158 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.671388 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:06.673259 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:06.679113 14895 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:06.690826 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:06.692548 22427 consensus_queue.cc:1048] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:21:06.694446 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.695621 14378 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:21:06.705969 14896 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:06.710039 22370 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.710726 22370 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.712806 14302 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:06.713027 22370 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:06.658419 22195 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:06.716041 14192 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:06.658828 22250 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.721395 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.722020 14900 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:21:06.728709 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:06.729382 14299 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:06.729717 14192 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:06.736955 22358 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:21:06.738390 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 48013.3us
I20260709 13:21:06.759589 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:06.738948 14193 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:21:06.738550 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:06.685889 22125 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:06.768723 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:06.770663 14192 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:06.775606 14192 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:06.737954 22358 consensus_queue.cc:1243] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer cebb34ac155340899a38c728707ddc0d log is divergent from this leader: its last log entry 22.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
W20260709 13:21:06.766719 14867 leader_election.cc:336] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:06.737991 22364 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:06.793152 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 93443us
I20260709 13:21:06.758667 22120 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:06.797003 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:06.797821 14374 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 26.
W20260709 13:21:06.799731 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:06.808785 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:06.812657 22435 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:06.813441 22436 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:21:06.786031 22216 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:06.814097 22213 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 13:21:06.795179 22148 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:06.798655 22368 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:06.772538 22426 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:21:06.788766 22163 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
W20260709 13:21:06.845505 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 51893.2us
I20260709 13:21:06.851435 14302 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:21:06.862320 22216 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:21:06.825971 22436 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 26 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:06.870604 22436 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:06.872776 22435 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.873322 22435 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:06.877733 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 61222.7us
I20260709 13:21:06.882690 22072 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:06.898062 14299 raft_consensus.cc:2468] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 23.
I20260709 13:21:06.849516 22364 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:06.923791 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 143400us
I20260709 13:21:06.913978 14865 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:06.928735 14900 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:06.959347 14369 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:06.959796 14369 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:06.936136 22216 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:06.935178 22120 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.966778 14369 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:06.971413 14369 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:06.982920 22364 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:06.984068 14369 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 18. (term mismatch)
I20260709 13:21:06.984591 14369 pending_rounds.cc:85] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Aborting all ops after (but not including) 17
I20260709 13:21:06.984946 14369 pending_rounds.cc:107] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: Aborting uncommitted NO_OP operation due to leader change: 21.18
I20260709 13:21:06.985338 14369 raft_consensus.cc:2889] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:21:06.986974 22360 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:21:06.987174 22303 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:21:06.988358 22435 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:06.992116 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.995263 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.995857 14374 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
I20260709 13:21:06.997093 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81; no voters: 
I20260709 13:21:07.008129 22158 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:07.008812 22158 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.009294 22158 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:07.014521 22120 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:07.016809 22120 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:07.045117 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:06.996598 22364 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.085s
I20260709 13:21:07.075906 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:21:07.047956 22216 raft_consensus.cc:697] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 23 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:07.102276 14193 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:07.103070 14299 raft_consensus.cc:1275] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:07.116175 22214 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.116747 22368 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:07.116991 22214 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:07.119215 22214 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:07.120359 22364 raft_consensus.cc:2804] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:07.120887 22364 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.121320 22364 raft_consensus.cc:3060] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:07.122038 14193 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:07.123479 22370 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:07.128268 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:07.128894 14867 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 175 similar messages]
I20260709 13:21:07.134038 14300 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:21:07.093847 22216 consensus_queue.cc:237] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:07.154076 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:07.155930 14298 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:07.156987 22213 consensus_queue.cc:1048] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:07.162235 22421 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:21:07.164453 14344 consensus_peers.cc:597] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:07.187491 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:07.197511 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:07.202404 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:07.206290 14897 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 23.
I20260709 13:21:07.209719 22364 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:07.210884 22214 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.211624 22214 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:07.212286 22364 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:07.213657 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:07.172145 22158 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:07.226349 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:07.233969 22158 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:07.236080 22214 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:07.239029 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:07.239784 14369 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:07.240188 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:07.253129 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:07.254208 14897 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:07.247810 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:07.267367 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:07.278992 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:07.273434 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:07.298748 14373 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:21:07.300953 22370 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:07.301544 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:07.311345 14898 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:21:07.314277 14373 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:21:07.318904 22214 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:07.319832 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:07.320710 14299 raft_consensus.cc:2393] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a9b2cf49ceed478480fb0f27ccf55d81 in current term 23: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:21:07.267743 14897 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 24.
I20260709 13:21:07.333997 14369 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b2cf49ceed478480fb0f27ccf55d81 in term 24.
I20260709 13:21:07.382522 14192 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:07.396700 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:07.427567 14193 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:07.419034 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:07.435483 22368 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:07.436967 14192 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:07.438418 22208 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:07.438979 22208 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 LEADER]: Becoming Leader. State: Replica: a9b2cf49ceed478480fb0f27ccf55d81, State: Running, Role: LEADER
I20260709 13:21:07.439915 22208 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:07.442261 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:07.426523 22393 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:21:07.443632 22072 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:07.418883 22214 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:07.445616 22250 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:07.448463 14193 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:07.449653 22250 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:21:07.454145 14193 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:07.455189 22214 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:07.466184 14900 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:21:07.460389 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:07.485617 22163 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:21:07.489656 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:07.492899 13122 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 14254)
W20260709 13:21:07.531072 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:07.533736 14303 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:21:07.539572 22120 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:07.545447 14125 catalog_manager.cc:5697] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 17 to 21, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 21 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.547375 14125 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 12 to 19, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 19 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.548846 14125 catalog_manager.cc:5697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 10 to 20, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 20 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.572451 22364 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.573056 22364 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:07.578135 22469 log.cc:927] Time spent T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:21:07.580430 14125 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:07.585976 14120 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37080 (request call id 333) took 58947 ms (client timeout 15000 ms). Trace:
I20260709 13:21:07.589530 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:07.590728 22364 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:07.586479 14120 rpcz_store.cc:269] 0709 13:20:08.638244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.638679 (+   435us) service_pool.cc:224] Handling call
0709 13:21:07.585881 (+58947202us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:06.318262 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:06.319047 (+   785us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:06.319103 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:21:06.319115 (+    12us) tablet.cc:662] Decoding operations
0709 13:21:06.319803 (+   688us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:06.319898 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:06.319925 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:21:06.320415 (+   490us) tablet.cc:701] Row locks acquired
0709 13:21:06.320462 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:21:06.320632 (+   170us) write_op.cc:270] Start()
0709 13:21:06.320771 (+   139us) write_op.cc:276] Timestamp: P: 1783603266320565 usec, L: 0
0709 13:21:06.320806 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:21:06.326586 (+  5780us) log.cc:844] Serialized 1703 byte log entry
0709 13:21:06.679587 (+353001us) op_driver.cc:464] REPLICATION: finished
0709 13:21:06.747909 (+ 68322us) write_op.cc:301] APPLY: starting
0709 13:21:06.748037 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:06.871842 (+123805us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:06.871960 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:06.983934 (+111974us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:06.989995 (+  6061us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:21:06.990061 (+    66us) write_op.cc:312] APPLY: finished
0709 13:21:06.990383 (+   322us) log.cc:844] Serialized 49 byte log entry
0709 13:21:06.990592 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:06.990691 (+    99us) write_op.cc:454] Released schema lock
0709 13:21:06.990747 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:06.991235 (+   488us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:06.991263 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2022146,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":67958,"apply.run_cpu_time_us":17953,"apply.run_wall_time_us":243309,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20855,"num_ops":4,"prepare.queue_time_us":200000,"prepare.run_cpu_time_us":20641,"prepare.run_wall_time_us":85966,"raft.queue_time_us":215608,"raft.run_cpu_time_us":10307,"raft.run_wall_time_us":68347,"replication_time_us":358541,"thread_start_us":427034,"threads_started":4,"wal-append.queue_time_us":133771}]]}
I20260709 13:21:07.605258 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:07.585150 14125 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 14 to 19, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 19 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.612102 14192 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:07.614387 14125 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 19 to 21, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 21 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.616102 14125 catalog_manager.cc:5697] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 11 to 17, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 17 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.622510 22072 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:07.623296 14125 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 16 to 22, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 22 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.631803 22072 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.632422 22072 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:07.634572 22072 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:07.637666 22250 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.638350 22250 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:07.641139 22250 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:07.642946 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:07.635612 14125 catalog_manager.cc:5697] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.645836 14125 catalog_manager.cc:5697] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 15 to 18, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 18 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.652376 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:07.653100 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:07.655596 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:07.662688 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:07.662551 14125 catalog_manager.cc:5697] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.668906 14125 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 14 to 21, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 21 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.672565 14125 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 15 to 16, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 16 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.687448 14125 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.693341 14125 catalog_manager.cc:5697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.696084 14302 raft_consensus.cc:1275] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:21:07.696481 14125 catalog_manager.cc:5697] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 13 to 22, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 22 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:07.694808 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:07.679302 14192 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:07.700543 22250 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:07.701488 22125 consensus_queue.cc:1048] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 13:21:07.702288 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:07.707841 14192 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:07.715164 22250 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:07.753319 14125 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 17 to 19, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 19 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.759594 14125 catalog_manager.cc:5697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 17 to 20, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 20 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.767833 14125 catalog_manager.cc:5697] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 12 to 20, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 20 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.779445 14125 catalog_manager.cc:5697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 12 to 14, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 14 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.806100 14125 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 12 to 15, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 15 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:07.817363 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:07.820007 14125 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 17 to 20, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 20 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.822085 14125 catalog_manager.cc:5697] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.828490 14125 catalog_manager.cc:5697] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 16 to 19, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 19 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.830458 14125 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 15 to 24, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 24 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.849530 14125 catalog_manager.cc:5697] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 15 to 23, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 23 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:07.871574 14896 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:21:07.876293 22072 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:07.864588 14125 catalog_manager.cc:5697] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 13 to 19, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 19 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:07.891858 14371 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Refusing update from remote peer a9b2cf49ceed478480fb0f27ccf55d81: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:21:07.893952 22364 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:07.986212 22364 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.986771 22364 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:07.989739 22364 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:08.000010 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:07.994725 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:07.998942 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:08.006361 14193 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:08.007213 22364 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:08.133832 22364 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.134462 22364 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:08.136610 22364 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:08.148250 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:08.157990 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:08.164263 14192 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:08.166401 22364 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:08.300495 14121 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 16 to 17, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 17 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:08.303205 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.303943 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:08.303992 14121 catalog_manager.cc:5697] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 12 to 20, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 20 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:08.308796 14121 catalog_manager.cc:5697] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 9 to 22, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 22 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:08.311753 14121 catalog_manager.cc:5697] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 17 to 23, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 23 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
W20260709 13:21:08.307286 14125 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36074 (request call id 219) took 12385 ms (client timeout 15000 ms). Trace:
W20260709 13:21:08.313453 14125 rpcz_store.cc:269] 0709 13:20:55.922179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.922478 (+   299us) service_pool.cc:224] Handling call
0709 13:21:08.307177 (+12384699us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:07.995062 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:07.995599 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:07.995641 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:21:07.995663 (+    22us) tablet.cc:662] Decoding operations
0709 13:21:07.997615 (+  1952us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:07.997706 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:07.997743 (+    37us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:21:08.011176 (+ 13433us) tablet.cc:701] Row locks acquired
0709 13:21:08.011198 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:21:08.011343 (+   145us) write_op.cc:270] Start()
0709 13:21:08.011465 (+   122us) write_op.cc:276] Timestamp: P: 1783603268011294 usec, L: 0
0709 13:21:08.011491 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:21:08.025440 (+ 13949us) log.cc:844] Serialized 10636 byte log entry
0709 13:21:08.056288 (+ 30848us) op_driver.cc:464] REPLICATION: finished
0709 13:21:08.119239 (+ 62951us) write_op.cc:301] APPLY: starting
0709 13:21:08.119334 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:08.191522 (+ 72188us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:08.191628 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:08.241244 (+ 49616us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:08.241669 (+   425us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:21:08.241724 (+    55us) write_op.cc:312] APPLY: finished
0709 13:21:08.242290 (+   566us) log.cc:844] Serialized 236 byte log entry
0709 13:21:08.243187 (+   897us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:08.243426 (+   239us) write_op.cc:454] Released schema lock
0709 13:21:08.243498 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:08.266041 (+ 22543us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:08.266071 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":149009,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":62656,"apply.run_cpu_time_us":36174,"apply.run_wall_time_us":146811,"cfile_cache_hit":110,"cfile_cache_hit_bytes":117041,"num_ops":27,"prepare.queue_time_us":43725,"prepare.run_cpu_time_us":7187,"prepare.run_wall_time_us":49035,"raft.queue_time_us":18376,"raft.run_cpu_time_us":5932,"raft.run_wall_time_us":59646,"replication_time_us":44628,"thread_start_us":114146,"threads_started":4,"wal-append.queue_time_us":8983}]]}
W20260709 13:21:08.327791 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:08.333847 22435 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.337988 22435 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:08.341763 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:08.343039 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:08.343989 22435 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:08.345908 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:08.335877 14121 catalog_manager.cc:5697] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 7 to 19, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 19 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:08.352319 14192 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:08.354916 22208 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:08.362226 14121 catalog_manager.cc:5697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 16 to 22, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 22 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:08.370596 14121 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 15 to 19, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 19 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.375656 22208 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.372370 14121 catalog_manager.cc:5697] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:08.376310 22208 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:08.382508 22208 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:08.383028 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:08.384932 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:08.387929 14192 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:08.389724 22435 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:08.381961 14121 catalog_manager.cc:5697] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 12 to 18, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 18 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:08.392931 14121 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 16 to 18, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 18 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:08.395228 14121 catalog_manager.cc:5697] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 9 to 13, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 13 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:08.397236 14121 catalog_manager.cc:5697] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 12 to 16, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 16 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:08.398751 14121 catalog_manager.cc:5697] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 16 to 21, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 21 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:08.407919 14303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37975f772fc648329a8acae36d33a345"
dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36836
I20260709 13:21:08.408762 14303 raft_consensus.cc:606] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Received request to transfer leadership
I20260709 13:21:08.409106 14303 raft_consensus.cc:614] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:08.400218 14121 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 15 to 18, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 18 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:08.434695 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:08.436738 14121 catalog_manager.cc:5697] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 10 to 18, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 18 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:08.438478 14121 catalog_manager.cc:5697] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 17 to 24, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 24 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
W20260709 13:21:08.493423 13122 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 14254)
I20260709 13:21:08.523330 22435 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.524099 22435 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:08.533614 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:08.535822 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:08.537308 22364 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.537910 22364 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:08.540321 22364 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:08.543290 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:08.544148 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:08.555536 14193 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:08.555691 22435 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:08.557551 22208 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:08.559322 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:08.582537 14175 auto_rebalancer.cc:893] Removing replace marker failed: Replica bee4f7fc1b4740dc875537c79309664f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:08.583076 14175 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:21:08.583411 14175 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:21:08.586117 14192 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:08.590431 22435 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:08.664906 22364 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.665561 22364 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:08.667831 22364 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:08.663597 22435 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:21:08.669632 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:08.668865 22435 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:08.672205 14119 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 15 to 23, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 23 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.674063 14119 catalog_manager.cc:5697] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 12 to 18, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 18 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.674767 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:08.676146 14119 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 19 to 20, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 20 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.683763 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:08.691987 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:08.674764 22435 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:08.698609 14119 catalog_manager.cc:5697] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 8 to 24, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 24 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.700037 14193 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:08.700788 14119 catalog_manager.cc:5697] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:08.703293 14119 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.707829 22364 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.708117 22435 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:08.708514 22364 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:08.710856 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:08.713284 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:08.715047 22364 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:08.722692 14121 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37096 (request call id 358) took 11227 ms. Trace:
I20260709 13:21:08.705001 14119 catalog_manager.cc:5697] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 15 to 21, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 21 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.723192 14121 rpcz_store.cc:276] 0709 13:20:57.495806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.497909 (+  2103us) service_pool.cc:224] Handling call
0709 13:21:08.722623 (+11224714us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:08.467118 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:08.467630 (+   512us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:08.467662 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:21:08.467679 (+    17us) tablet.cc:662] Decoding operations
0709 13:21:08.468963 (+  1284us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:08.469023 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:08.469048 (+    25us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:21:08.470471 (+  1423us) tablet.cc:701] Row locks acquired
0709 13:21:08.470494 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:21:08.470625 (+   131us) write_op.cc:270] Start()
0709 13:21:08.470737 (+   112us) write_op.cc:276] Timestamp: P: 1783603268470588 usec, L: 0
0709 13:21:08.470757 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:21:08.471605 (+   848us) log.cc:844] Serialized 6386 byte log entry
0709 13:21:08.474019 (+  2414us) op_driver.cc:464] REPLICATION: finished
0709 13:21:08.474620 (+   601us) write_op.cc:301] APPLY: starting
0709 13:21:08.474719 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:08.484734 (+ 10015us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:08.484863 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:08.568622 (+ 83759us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:08.568888 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:21:08.568936 (+    48us) write_op.cc:312] APPLY: finished
0709 13:21:08.569311 (+   375us) log.cc:844] Serialized 148 byte log entry
0709 13:21:08.598838 (+ 29527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:08.599010 (+   172us) write_op.cc:454] Released schema lock
0709 13:21:08.599153 (+   143us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:08.605291 (+  6138us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:08.605325 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10755,"reported_tablets":47,"spinlock_wait_cycles":10624,"child_traces":[["op",{"apply.queue_time_us":340,"apply.run_cpu_time_us":22963,"apply.run_wall_time_us":130602,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66912,"num_ops":16,"prepare.queue_time_us":922,"prepare.run_cpu_time_us":4503,"prepare.run_wall_time_us":6719,"replication_time_us":3097}]]}
I20260709 13:21:08.738559 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 21 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:08.745082 14193 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:08.745970 22435 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:08.748330 14193 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:08.751634 14119 catalog_manager.cc:5697] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 reported cstate change: term changed from 17 to 24. New cstate: current_term: 24 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:08.760195 22364 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:08.760917 22364 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:08.766532 22364 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:08.773533 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:08.787488 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:08.749112 22435 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:08.947738 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:08.973698 14193 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:08.974510 22495 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:08.996315 14192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 77931.6us
W20260709 13:21:09.005402 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.008224 22435 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.008939 22435 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:09.008404 22072 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.010063 22072 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:09.012604 22072 leader_election.cc:290] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:09.014791 22435 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:09.018186 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:09.025012 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:09.057955 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:09.061190 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:09.107060 14192 leader_election.cc:304] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:09.107946 22364 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:09.112869 14192 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:09.114554 14125 catalog_manager.cc:5697] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.116456 14125 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.118028 14125 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.119359 14125 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 18 to 27. New cstate: current_term: 27 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.120684 14125 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 22 to 23, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 23 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.122148 14125 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.125135 22364 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:09.123858 14125 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.158628 14125 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 21 to 22, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 22 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.160579 14125 catalog_manager.cc:5697] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 17 to 19, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 19 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:09.175374 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.176532 14125 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.178898 14119 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37072 (request call id 328) took 9060 ms. Trace:
I20260709 13:21:09.187403 14125 catalog_manager.cc:5697] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.208253 14125 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 18 to 20, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 20 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.212672 14125 catalog_manager.cc:5697] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.188217 14119 rpcz_store.cc:276] 0709 13:21:00.134474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.714424 (+5579950us) service_pool.cc:224] Handling call
0709 13:21:09.178797 (+3464373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:08.770110 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:08.770669 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:08.770711 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:21:08.770730 (+    19us) tablet.cc:662] Decoding operations
0709 13:21:08.771620 (+   890us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:08.771676 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:08.771707 (+    31us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:21:08.772401 (+   694us) tablet.cc:701] Row locks acquired
0709 13:21:08.772423 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:21:08.772572 (+   149us) write_op.cc:270] Start()
0709 13:21:08.772699 (+   127us) write_op.cc:276] Timestamp: P: 1783603268772524 usec, L: 0
0709 13:21:08.772721 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:21:08.773506 (+   785us) log.cc:844] Serialized 3257 byte log entry
0709 13:21:08.790693 (+ 17187us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b54001525a0. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff6090 00007f8ded0036b8 00007f8ded0032fa 00007f8ded087965 00007f8ded087e09 00007f8df0ac2581 00007f8df0ac1d58 00007f8df0ac69f1 00007f8df0ac69a9 00007f8df0ac6939 00007f8df0ac6901
0709 13:21:08.793830 (+  3137us) op_driver.cc:464] REPLICATION: finished
0709 13:21:08.795555 (+  1725us) write_op.cc:301] APPLY: starting
0709 13:21:08.795651 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:08.815580 (+ 19929us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:08.815614 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:08.857096 (+ 41482us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:08.857316 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:21:08.857363 (+    47us) write_op.cc:312] APPLY: finished
0709 13:21:08.857654 (+   291us) log.cc:844] Serialized 81 byte log entry
0709 13:21:08.923595 (+ 65941us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:08.935722 (+ 12127us) write_op.cc:454] Released schema lock
0709 13:21:08.937038 (+  1316us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:08.950895 (+ 13857us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:08.950929 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20450,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":1478,"apply.run_cpu_time_us":12626,"apply.run_wall_time_us":155310,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33456,"num_ops":8,"prepare.queue_time_us":5227,"prepare.run_cpu_time_us":6426,"prepare.run_wall_time_us":20825,"replication_time_us":20874,"spinlock_wait_cycles":18941696}]]}
I20260709 13:21:09.253589 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:09.255364 13122 tablet_replica.cc:333] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.257326 13122 raft_consensus.cc:2243] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.258128 13122 pending_rounds.cc:70] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Trying to abort 1 pending ops.
I20260709 13:21:09.265058 13122 pending_rounds.cc:77] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81: Aborting op as it isn't in flight: id { term: 21 index: 14 } timestamp: 7305638901219381248 op_type: NO_OP noop_request { }
I20260709 13:21:09.267681 13122 raft_consensus.cc:2889] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:09.268182 13122 raft_consensus.cc:2272] T 3e1da5440c0e48a6bc637b43fa41215e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.276778 13122 tablet_replica.cc:333] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
W20260709 13:21:09.305974 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.308497 22250 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:09.309325 22250 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:09.312072 22250 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:09.312731 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:09.313455 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:09.318904 14192 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:09.320834 13122 raft_consensus.cc:2243] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.322046 13122 raft_consensus.cc:2272] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:09.325497 14192 raft_consensus.cc:2686] T e674623b78de49129be2dde67c041ef9 P a9b2cf49ceed478480fb0f27ccf55d81: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:21:09.325645 13122 tablet_replica.cc:333] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.337419 13122 raft_consensus.cc:2243] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.326514 14125 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.340971 14125 catalog_manager.cc:5697] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 16 to 18, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 18 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.342623 14125 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.343945 14125 catalog_manager.cc:5697] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 17 to 19, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 19 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.354307 13122 raft_consensus.cc:2272] T a7157daf9a3647f4af1d12bf4530f984 P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.371366 13122 tablet_replica.cc:333] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.372594 13122 raft_consensus.cc:2243] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.373768 13122 raft_consensus.cc:2272] T dd40ac1ac2b5420abcc4468ffaf0c1fe P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.376869 13122 tablet_replica.cc:333] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.368855 14125 catalog_manager.cc:5697] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.379235 14125 catalog_manager.cc:5697] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.380856 14125 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.390417 14125 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.392088 14125 catalog_manager.cc:5697] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.406198 13122 raft_consensus.cc:2243] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.407111 13122 raft_consensus.cc:2272] T 18418e3cab2e42b1a301f8068587c987 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.410430 13122 tablet_replica.cc:333] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.411813 13122 raft_consensus.cc:2243] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.412590 13122 raft_consensus.cc:2272] T 808ea406abb545e0aae5a5ddd3964180 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.393663 14125 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.414777 14125 catalog_manager.cc:5697] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 20 to 22, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 22 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.416401 14125 catalog_manager.cc:5697] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 20 to 24, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 24 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.417990 14125 catalog_manager.cc:5697] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 16 to 18, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 18 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.419556 14125 catalog_manager.cc:5697] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.432642 22364 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.433331 22364 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:09.436584 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:09.421003 14125 catalog_manager.cc:5697] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 24 to 25, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 25 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:09.451468 13122 tablet_replica.cc:333] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.458101 13122 raft_consensus.cc:2243] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.459535 13122 raft_consensus.cc:2272] T f235d077faa24a89832f2f8f181b0ef1 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.462978 13122 tablet_replica.cc:333] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
W20260709 13:21:09.470326 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.474291 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:09.471614 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.477016 13122 raft_consensus.cc:2243] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.482614 13122 raft_consensus.cc:2272] T 2ac406834d504a57b52386e2ae4c5235 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.493418 13122 tablet_replica.cc:333] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.498905 13122 raft_consensus.cc:2243] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.501611 13122 raft_consensus.cc:2272] T 487d8e21fe1a4de4a365bd3c1f91947b P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.504549 14192 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:09.472509 22364 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:09.511397 22364 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:09.515628 13122 tablet_replica.cc:333] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.524325 13122 raft_consensus.cc:2243] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.525144 22364 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:09.531163 22364 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:09.540076 13122 raft_consensus.cc:2272] T 25d39c5ba6de4fbd8f025024428fbd57 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:09.544481 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.546460 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:09.549769 22364 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:09.544680 13122 tablet_replica.cc:333] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.555593 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:09.560010 13122 raft_consensus.cc:2243] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.567015 13122 raft_consensus.cc:2272] T bbf8c75a86f64f6cb1dd8780d0365f85 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:09.568264 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.572747 13122 tablet_replica.cc:333] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.591501 13122 raft_consensus.cc:2243] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:09.584507 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:09.594835 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.584199 14192 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:09.596115 13122 raft_consensus.cc:2272] T a4e025a69a5c42f3be03aeed0ac9a998 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.596127 22364 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:09.608184 13122 tablet_replica.cc:333] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.622711 13122 raft_consensus.cc:2243] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.623728 13122 raft_consensus.cc:2272] T e531770baa044bc49820df7e47c608eb P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.627038 13122 tablet_replica.cc:333] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.634742 13122 raft_consensus.cc:2243] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.635471 13122 raft_consensus.cc:2272] T fa1054f387364ae4b11260c5ab742790 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:09.645905 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.650054 13122 tablet_replica.cc:333] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.656780 13122 raft_consensus.cc:2243] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.662245 13122 pending_rounds.cc:70] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Trying to abort 3 pending ops.
I20260709 13:21:09.666512 13122 pending_rounds.cc:77] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting op as it isn't in flight: id { term: 24 index: 17 } timestamp: 7305638933484253184 op_type: NO_OP noop_request { }
I20260709 13:21:09.667135 13122 raft_consensus.cc:2889] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:09.667564 13122 pending_rounds.cc:77] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting op as it isn't in flight: id { term: 23 index: 16 } timestamp: 7305638902047150080 op_type: NO_OP noop_request { }
I20260709 13:21:09.668388 13122 raft_consensus.cc:2889] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:09.668882 13122 pending_rounds.cc:77] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting op as it isn't in flight: id { term: 22 index: 15 } timestamp: 7305638878416179200 op_type: NO_OP noop_request { }
I20260709 13:21:09.669335 13122 raft_consensus.cc:2889] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:09.669945 13122 raft_consensus.cc:2272] T 402f68d4d3464bffb55e8bd010ec0133 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.673477 13122 tablet_replica.cc:333] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.689689 13122 raft_consensus.cc:2243] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.691454 13122 raft_consensus.cc:2272] T 2359e4575c5b49208e2395d3f12a7da9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:09.700986 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.701139 13122 tablet_replica.cc:333] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.715030 13122 raft_consensus.cc:2243] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.716379 13122 raft_consensus.cc:2272] T 99c124265b9c42a5a1adf047554812b4 P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.726650 13122 tablet_replica.cc:333] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.727726 13122 raft_consensus.cc:2243] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.738857 13122 raft_consensus.cc:2272] T 2b16e1f580c44c1f984f63473c6a267d P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:09.744642 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.746500 13122 tablet_replica.cc:333] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.750656 13122 raft_consensus.cc:2243] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.758517 13122 raft_consensus.cc:2272] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:09.758966 22364 consensus_queue.cc:1175] T ebe53e62fb464cccbd45d08ede5b5c4e P a9b2cf49ceed478480fb0f27ccf55d81 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "181bbac22422408c87cd13b7fe3008f9" responder_term: 23 status { last_received { term: 23 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 23 index: 12 } }
I20260709 13:21:09.764911 13122 tablet_replica.cc:333] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.769133 13122 raft_consensus.cc:2243] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.770815 13122 raft_consensus.cc:2272] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.778793 13122 tablet_replica.cc:333] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.793731 13122 raft_consensus.cc:2243] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.795884 13122 raft_consensus.cc:2272] T f6ebdaafff10446f814e66697ebf67ef P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.802330 13122 tablet_replica.cc:333] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.807448 13122 raft_consensus.cc:2243] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.807951 22072 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.808750 22072 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:09.819171 22072 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:09.819456 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:09.820413 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:09.822540 14193 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9b2cf49ceed478480fb0f27ccf55d81; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:09.824127 22072 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:09.830981 13122 raft_consensus.cc:2272] T 2582e91d201c4063b3eff5158b611448 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.842046 13122 tablet_replica.cc:333] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.843272 13122 raft_consensus.cc:2243] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.854295 13122 raft_consensus.cc:2272] T ca72c82f0b3e4842b7c74a63118d3360 P a9b2cf49ceed478480fb0f27ccf55d81 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.868527 13122 tablet_replica.cc:333] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.869831 13122 raft_consensus.cc:2243] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:09.872632 14344 consensus_peers.cc:597] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:09.875775 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:09.889897 13122 raft_consensus.cc:2272] T 42c37f8aa458494687312360eddb12a9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.893074 13122 tablet_replica.cc:333] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.894032 13122 raft_consensus.cc:2243] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.894703 13122 raft_consensus.cc:2272] T 475079f88bce40fea814453c8c4bfaac P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.897535 13122 tablet_replica.cc:333] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.898401 13122 raft_consensus.cc:2243] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.899080 13122 raft_consensus.cc:2272] T e8fbf1e78cfb4a15820b9812967ec58c P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.902158 13122 tablet_replica.cc:333] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.903039 13122 raft_consensus.cc:2243] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.904253 13122 raft_consensus.cc:2272] T 1f44936b303148f4848621766631d925 P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:09.906443 14175 auto_rebalancer.cc:629] Failed to schedule move for tablet bddcf0184f1049499e0383b72e34ef74: Illegal state: Replica 181bbac22422408c87cd13b7fe3008f9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:09.907040 13122 tablet_replica.cc:333] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.908057 13122 raft_consensus.cc:2243] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.908895 13122 raft_consensus.cc:2272] T 98310add35f94d0685fee6cc0aba55a2 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.911867 13122 tablet_replica.cc:333] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.912076 14371 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:21:09.912879 13122 raft_consensus.cc:2243] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.914039 13122 raft_consensus.cc:2272] T 439318510aaf4073b4ca2996d73b9d8e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.917017 13122 tablet_replica.cc:333] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.917891 13122 raft_consensus.cc:2243] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.918977 13122 raft_consensus.cc:2272] T 8c137013238f4b1dbae260e32cb316dc P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.921872 13122 tablet_replica.cc:333] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.922778 13122 raft_consensus.cc:2243] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.923388 13122 raft_consensus.cc:2272] T c38fd596811644f8b5ab0c134b279676 P a9b2cf49ceed478480fb0f27ccf55d81 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.926216 13122 tablet_replica.cc:333] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.927013 13122 raft_consensus.cc:2243] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.927543 13122 raft_consensus.cc:2272] T 78b3fe008c45425b8fd1c2bac8020950 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.930575 13122 tablet_replica.cc:333] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.931339 13122 raft_consensus.cc:2243] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.932026 13122 pending_rounds.cc:70] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Trying to abort 2 pending ops.
I20260709 13:21:09.932264 13122 pending_rounds.cc:77] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting op as it isn't in flight: id { term: 19 index: 9 } timestamp: 7305638899637805056 op_type: NO_OP noop_request { }
I20260709 13:21:09.932884 13122 raft_consensus.cc:2889] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:09.933198 13122 pending_rounds.cc:77] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting op as it isn't in flight: id { term: 17 index: 8 } timestamp: 7305638833966043136 op_type: NO_OP noop_request { }
I20260709 13:21:09.933522 13122 raft_consensus.cc:2889] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:09.933907 13122 raft_consensus.cc:2272] T b03bb64d471f488094a4e3dd7d934b67 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.947144 13122 tablet_replica.cc:333] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.948266 13122 raft_consensus.cc:2243] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.949378 13122 raft_consensus.cc:2272] T ede0d59e482a4cff952455ca90001863 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.952260 13122 tablet_replica.cc:333] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.953055 13122 raft_consensus.cc:2243] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.954452 13122 raft_consensus.cc:2272] T 08fd6b58648f4a6ca27b84f4fd829df9 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.957530 13122 tablet_replica.cc:333] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.958320 13122 raft_consensus.cc:2243] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.959509 13122 raft_consensus.cc:2272] T 87ac8217d9b74cd1a2ee70c8667d998a P a9b2cf49ceed478480fb0f27ccf55d81 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.962329 13122 tablet_replica.cc:333] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
W20260709 13:21:09.962380 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.963194 13122 raft_consensus.cc:2243] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.964035 13122 raft_consensus.cc:2272] T 37975f772fc648329a8acae36d33a345 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.967653 13122 tablet_replica.cc:333] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.968758 13122 raft_consensus.cc:2243] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:09.970216 13122 raft_consensus.cc:2272] T cde980445ec54bac8c99f8e77669bffa P a9b2cf49ceed478480fb0f27ccf55d81 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:09.974372 13122 tablet_replica.cc:333] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.975746 13122 raft_consensus.cc:2243] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.976843 13122 raft_consensus.cc:2272] T 52ca7fe34f2a4185a741b8aebabd8bfc P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:09.985306 14341 consensus_peers.cc:597] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78b3fe008c45425b8fd1c2bac8020950. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:09.989176 14302 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:21:09.990743 13122 tablet_replica.cc:333] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:09.991559 13122 raft_consensus.cc:2243] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:09.992054 22485 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:09.992427 13122 pending_rounds.cc:70] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Trying to abort 2 pending ops.
I20260709 13:21:09.992777 13122 pending_rounds.cc:77] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Aborting op as it isn't in flight: id { term: 21 index: 17 } timestamp: 7305638969126539264 op_type: NO_OP noop_request { }
I20260709 13:21:09.993158 13122 raft_consensus.cc:2889] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:09.993450 13122 pending_rounds.cc:77] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81: Aborting op as it isn't in flight: id { term: 20 index: 16 } timestamp: 7305638929602273280 op_type: NO_OP noop_request { }
I20260709 13:21:09.993773 13122 raft_consensus.cc:2889] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:09.994158 13122 raft_consensus.cc:2272] T f80782a117e14a308698329b8639179e P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.011487 13122 tablet_replica.cc:333] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:10.012349 13122 raft_consensus.cc:2243] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.021898 13122 raft_consensus.cc:2272] T cf286f2db09c4718a255c14e95c7e781 P a9b2cf49ceed478480fb0f27ccf55d81 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.027436 13122 tablet_replica.cc:333] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:10.029073 13122 raft_consensus.cc:2243] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.029757 13122 raft_consensus.cc:2272] T a1479f9f47ee4f9984bc3dae70e66f3a P a9b2cf49ceed478480fb0f27ccf55d81 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.034128 13122 tablet_replica.cc:333] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:10.034896 13122 raft_consensus.cc:2243] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.035415 13122 raft_consensus.cc:2272] T bddcf0184f1049499e0383b72e34ef74 P a9b2cf49ceed478480fb0f27ccf55d81 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:10.037328 14344 consensus_peers.cc:597] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:10.038164 13122 tablet_replica.cc:333] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:10.039175 13122 raft_consensus.cc:2243] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.040271 13122 raft_consensus.cc:2272] T a24d1f6f6adb4246b65902328e51dfdf P a9b2cf49ceed478480fb0f27ccf55d81 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.052488 13122 tablet_replica.cc:333] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:10.053400 13122 raft_consensus.cc:2243] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.054299 13122 pending_rounds.cc:70] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Trying to abort 1 pending ops.
I20260709 13:21:10.054580 13122 pending_rounds.cc:77] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81: Aborting op as it isn't in flight: id { term: 21 index: 16 } timestamp: 7305638959828578304 op_type: NO_OP noop_request { }
I20260709 13:21:10.054980 13122 raft_consensus.cc:2889] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:10.058832 13122 raft_consensus.cc:2272] T fde6831a789b45549658b2c2146dd650 P a9b2cf49ceed478480fb0f27ccf55d81 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.060808 14125 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36074 (request call id 220) took 1656 ms. Trace:
I20260709 13:21:10.061849 13122 tablet_replica.cc:333] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81: stopping tablet replica
I20260709 13:21:10.062676 13122 raft_consensus.cc:2243] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.063197 13122 raft_consensus.cc:2272] T 0694154dd8ad41ad93089be880f2e363 P a9b2cf49ceed478480fb0f27ccf55d81 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:10.067171 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:10.061264 14125 rpcz_store.cc:276] 0709 13:21:08.404123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:08.404333 (+   210us) service_pool.cc:224] Handling call
0709 13:21:10.060706 (+1656373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:09.605328 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:09.605883 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:09.605925 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:21:09.605945 (+    20us) tablet.cc:662] Decoding operations
0709 13:21:09.608113 (+  2168us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:09.608202 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:09.608234 (+    32us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:21:09.691675 (+ 83441us) tablet.cc:701] Row locks acquired
0709 13:21:09.691694 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:21:09.691837 (+   143us) write_op.cc:270] Start()
0709 13:21:09.691965 (+   128us) write_op.cc:276] Timestamp: P: 1783603269691794 usec, L: 0
0709 13:21:09.691988 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:21:09.692759 (+   771us) log.cc:844] Serialized 11090 byte log entry
0709 13:21:09.826084 (+133325us) op_driver.cc:464] REPLICATION: finished
0709 13:21:09.846759 (+ 20675us) write_op.cc:301] APPLY: starting
0709 13:21:09.846883 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:09.931711 (+ 84828us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:09.931863 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:09.994786 (+ 62923us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:09.995222 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 13:21:09.995284 (+    62us) write_op.cc:312] APPLY: finished
0709 13:21:09.995848 (+   564us) log.cc:844] Serialized 244 byte log entry
0709 13:21:09.996761 (+   913us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:09.997010 (+   249us) write_op.cc:454] Released schema lock
0709 13:21:09.997089 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:10.018077 (+ 20988us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:10.018116 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52347,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":20327,"apply.run_cpu_time_us":40294,"apply.run_wall_time_us":171310,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121223,"num_ops":28,"prepare.queue_time_us":133168,"prepare.run_cpu_time_us":6504,"prepare.run_wall_time_us":87733,"replication_time_us":133912,"thread_start_us":151826,"threads_started":2}]]}
W20260709 13:21:10.099439 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 75224.5us
I20260709 13:21:10.137676 14118 catalog_manager.cc:5697] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 14 to 17, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 17 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:10.142180 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:10.181908 22508 raft_consensus.cc:2955] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:21:10.193861 14303 raft_consensus.cc:2955] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:21:10.195891 14118 catalog_manager.cc:5697] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 12 to 16, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129). New cstate: current_term: 16 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
W20260709 13:21:10.236639 14122 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37080 (request call id 332) took 92355 ms (client timeout 15000 ms). Trace:
W20260709 13:21:10.237149 14122 rpcz_store.cc:269] 0709 13:19:38.159120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.159342 (+   222us) service_pool.cc:224] Handling call
0709 13:19:39.489775 (+1330433us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54002c0010. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f680b2 00007f8df2ee1a89 00007f8df2e79da6 00007f8df2e4b088 00007f8df2f4937e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc
0709 13:21:10.236529 (+90746754us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":270,"mutex_wait_us":17953,"reported_tablets":47,"spinlock_wait_cycles":27527040}
W20260709 13:21:10.256160 14175 auto_rebalancer.cc:629] Failed to schedule move for tablet 25d39c5ba6de4fbd8f025024428fbd57: Illegal state: Replica bee4f7fc1b4740dc875537c79309664f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
W20260709 13:21:10.319518 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:10.337232 14895 consensus_queue.cc:237] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:10.374310 14175 auto_rebalancer.cc:629] Failed to schedule move for tablet 402f68d4d3464bffb55e8bd010ec0133: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:10.384717 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:10.391636 14302 raft_consensus.cc:1275] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:21:10.417795 22496 consensus_queue.cc:1048] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:21:10.430377 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:10.446571 14118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37080 (request call id 334) took 29918 ms (client timeout 15000 ms). Trace:
I20260709 13:21:10.449808 14302 raft_consensus.cc:2955] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 5 to 15, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:10.452246 22496 raft_consensus.cc:2955] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 5 to 15, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:10.447088 14118 rpcz_store.cc:269] 0709 13:20:40.528299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.529966 (+  1667us) service_pool.cc:224] Handling call
0709 13:21:10.446468 (+29916502us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:10.259492 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:10.260111 (+   619us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:10.260151 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:21:10.260173 (+    22us) tablet.cc:662] Decoding operations
0709 13:21:10.260593 (+   420us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:10.270328 (+  9735us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:10.270708 (+   380us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:21:10.293421 (+ 22713us) tablet.cc:701] Row locks acquired
0709 13:21:10.293575 (+   154us) write_op.cc:260] PREPARE: finished
0709 13:21:10.298422 (+  4847us) write_op.cc:270] Start()
0709 13:21:10.298581 (+   159us) write_op.cc:276] Timestamp: P: 1783603270298359 usec, L: 0
0709 13:21:10.298606 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:21:10.299411 (+   805us) log.cc:844] Serialized 935 byte log entry
0709 13:21:10.306461 (+  7050us) op_driver.cc:464] REPLICATION: finished
0709 13:21:10.308781 (+  2320us) write_op.cc:301] APPLY: starting
0709 13:21:10.308869 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:10.310449 (+  1580us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:10.310579 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:10.314528 (+  3949us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:10.314761 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:21:10.314819 (+    58us) write_op.cc:312] APPLY: finished
0709 13:21:10.315114 (+   295us) log.cc:844] Serialized 33 byte log entry
0709 13:21:10.316324 (+  1210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:10.316430 (+   106us) write_op.cc:454] Released schema lock
0709 13:21:10.316476 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:10.318880 (+  2404us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:10.318913 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28199,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":2048,"apply.run_cpu_time_us":4726,"apply.run_wall_time_us":8108,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":57630,"prepare.run_cpu_time_us":3858,"prepare.run_wall_time_us":46709,"replication_time_us":7685,"thread_start_us":38073,"threads_started":1}]]}
I20260709 13:21:10.471621 14126 catalog_manager.cc:5697] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 14 to 17, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 17 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:10.483681 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a4e025a69a5c42f3be03aeed0ac9a998 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:21:10.493670 14123 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37072 (request call id 327) took 36285 ms (client timeout 15000 ms). Trace:
I20260709 13:21:10.499570 22458 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.510597 22458 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.501430 14118 catalog_manager.cc:5697] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d reported cstate change: config changed from index 5 to 15, VOTER 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) evicted. New cstate: current_term: 20 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.512964 22458 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:10.509488 14123 rpcz_store.cc:269] 0709 13:20:34.208550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.210283 (+  1733us) service_pool.cc:224] Handling call
0709 13:20:34.677922 (+467639us) spinlock_profiling.cc:243] Waited 9.85 ms on lock 0x7b5400152054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff6090 00007f8ded094f3a 00007f8df2e4b1cc 00007f8df2f4937e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc 00007f8df1409392 00007f8deb3c748c 00007f8deb3c68c6
0709 13:21:10.493466 (+35815544us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124237,"reported_tablets":46,"spinlock_wait_cycles":22661888}
I20260709 13:21:10.515141 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:10.545051 14126 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37096 (request call id 357) took 35980 ms (client timeout 15000 ms). Trace:
I20260709 13:21:10.551323 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet a4e025a69a5c42f3be03aeed0ac9a998 with delete_type TABLET_DATA_TOMBSTONED (TS 181bbac22422408c87cd13b7fe3008f9 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:47058
I20260709 13:21:10.556686 22496 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.557300 22496 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.559645 22496 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:10.545518 14126 rpcz_store.cc:269] 0709 13:20:34.564267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.564551 (+   284us) service_pool.cc:224] Handling call
0709 13:21:10.544969 (+35980418us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:10.480571 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:10.481104 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:10.481142 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:21:10.481160 (+    18us) tablet.cc:662] Decoding operations
0709 13:21:10.481479 (+   319us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:10.481531 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:10.481559 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:21:10.481747 (+   188us) tablet.cc:701] Row locks acquired
0709 13:21:10.481765 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:21:10.481930 (+   165us) write_op.cc:270] Start()
0709 13:21:10.482042 (+   112us) write_op.cc:276] Timestamp: P: 1783603270481877 usec, L: 0
0709 13:21:10.482063 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:21:10.482674 (+   611us) log.cc:844] Serialized 544 byte log entry
0709 13:21:10.484724 (+  2050us) op_driver.cc:464] REPLICATION: finished
0709 13:21:10.485193 (+   469us) write_op.cc:301] APPLY: starting
0709 13:21:10.485278 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:10.486204 (+   926us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:10.486298 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:10.487109 (+   811us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:10.487316 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:21:10.487375 (+    59us) write_op.cc:312] APPLY: finished
0709 13:21:10.487579 (+   204us) log.cc:844] Serialized 25 byte log entry
0709 13:21:10.487777 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:10.487864 (+    87us) write_op.cc:454] Released schema lock
0709 13:21:10.487908 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:10.488349 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:10.488381 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":110975,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":272,"apply.run_cpu_time_us":3101,"apply.run_wall_time_us":3101,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4182,"num_ops":1,"prepare.queue_time_us":98,"prepare.run_cpu_time_us":2401,"prepare.run_wall_time_us":2401,"replication_time_us":2522}]]}
I20260709 13:21:10.561345 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:10.572518 22496 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.573117 22496 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.575189 22496 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:10.577092 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:10.602954 14344 leader_election.cc:336] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:10.603546 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:10.607084 22458 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:10.628201 22520 ts_tablet_manager.cc:933] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:10.636729 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:10.648819 22521 tablet_replica.cc:333] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
W20260709 13:21:10.682747 14867 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:10.683341 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:10.684324 22496 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:10.684569 14867 leader_election.cc:336] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:10.685086 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:10.685851 22496 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:10.692967 22496 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.692591 14120 catalog_manager.cc:5697] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 19 to 21, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 21 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.693615 22496 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.695454 22520 tablet_copy_client.cc:323] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:21:10.701490 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet 78b3fe008c45425b8fd1c2bac8020950 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:21:10.702148 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet 78b3fe008c45425b8fd1c2bac8020950 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-78b3fe008c45425b8fd1c2bac8020950
I20260709 13:21:10.720113 14120 catalog_manager.cc:5697] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 24 to 25, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 25 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
W20260709 13:21:10.721570 14867 leader_election.cc:336] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:10.722187 14120 catalog_manager.cc:5697] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 18 to 19, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 19 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.724826 22505 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.725941 14120 catalog_manager.cc:5697] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 17 to 22, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 22 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
W20260709 13:21:10.727491 14127 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37096 (request call id 355) took 97679 ms (client timeout 15000 ms). Trace:
I20260709 13:21:10.727852 14366 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c137013238f4b1dbae260e32cb316dc with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:47058
W20260709 13:21:10.727890 14127 rpcz_store.cc:269] 0709 13:19:33.048565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.048833 (+   268us) service_pool.cc:224] Handling call
0709 13:19:33.214539 (+165706us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b5400152054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff6090 00007f8ded094f3a 00007f8df2e4b1cc 00007f8df2f4937e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc 00007f8df1409392 00007f8deb3c748c 00007f8deb3c68c6
0709 13:21:10.727277 (+97512738us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34756,"reported_tablets":47,"spinlock_wait_cycles":17761920}
I20260709 13:21:10.725558 22505 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.732353 22505 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:10.737435 22487 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.738029 22487 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.740335 22487 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:10.743552 14120 catalog_manager.cc:5697] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.746587 14120 catalog_manager.cc:5697] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 16 to 20, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 20 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:10.754128 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:10.754808 14371 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 24.
W20260709 13:21:10.756098 14270 leader_election.cc:336] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:10.763866 22485 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.764559 22485 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:10.767408 14124 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37072 (request call id 325) took 93144 ms (client timeout 15000 ms). Trace:
W20260709 13:21:10.776350 14344 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:10.776110 14124 rpcz_store.cc:269] 0709 13:19:37.622715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.625965 (+  3250us) service_pool.cc:224] Handling call
0709 13:21:10.767192 (+93141227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":802716,"reported_tablets":46}
W20260709 13:21:10.779008 14113 connection.cc:466] server connection from 127.0.0.1:37072 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37072 (request call id 325) could send its response
I20260709 13:21:10.799115 22521 raft_consensus.cc:2243] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.800786 22485 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:10.801438 14270 leader_election.cc:336] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:10.803295 14388 tablet_copy_source_session.cc:215] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:10.805966 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:10.803746 22496 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:10.807085 22496 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:10.807463 22305 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.807529 22496 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.808205 22305 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.810702 22305 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:10.811283 22496 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:10.812021 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:10.813735 14895 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
W20260709 13:21:10.815608 14867 leader_election.cc:336] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:10.814759 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:10.816520 14302 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:21:10.817806 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:10.819056 22305 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:10.819507 22305 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.820124 22305 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:10.831776 22496 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.834528 22496 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:10.820565 22458 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.835794 22458 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:10.838199 22458 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:10.839162 14867 leader_election.cc:336] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:10.846568 14121 catalog_manager.cc:5697] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:10.878844 14121 catalog_manager.cc:5697] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:10.849431 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:10.855791 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 126529us
I20260709 13:21:10.887008 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:10.862648 22521 raft_consensus.cc:2272] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.917120 22524 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.871666 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:10.875808 14120 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37080 (request call id 335) took 8496 ms. Trace:
W20260709 13:21:10.876904 14344 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:10.927474 22487 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:21:10.928015 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 51138us
I20260709 13:21:10.927695 22524 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.928184 22487 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.927361 14120 rpcz_store.cc:276] 0709 13:21:02.378996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:07.607409 (+5228413us) service_pool.cc:224] Handling call
0709 13:21:10.875742 (+3268333us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:10.754140 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:10.754710 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:10.754749 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:21:10.754771 (+    22us) tablet.cc:662] Decoding operations
0709 13:21:10.755591 (+   820us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:10.755650 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:10.755680 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:21:10.756225 (+   545us) tablet.cc:701] Row locks acquired
0709 13:21:10.756246 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:21:10.756415 (+   169us) write_op.cc:270] Start()
0709 13:21:10.756530 (+   115us) write_op.cc:276] Timestamp: P: 1783603270756362 usec, L: 0
0709 13:21:10.756555 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:21:10.757212 (+   657us) log.cc:844] Serialized 2500 byte log entry
0709 13:21:10.768187 (+ 10975us) op_driver.cc:464] REPLICATION: finished
0709 13:21:10.769866 (+  1679us) write_op.cc:301] APPLY: starting
0709 13:21:10.769993 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:10.774676 (+  4683us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:10.774776 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:10.778542 (+  3766us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:10.778764 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:21:10.778818 (+    54us) write_op.cc:312] APPLY: finished
0709 13:21:10.780713 (+  1895us) log.cc:844] Serialized 65 byte log entry
0709 13:21:10.781466 (+   753us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:10.781570 (+   104us) write_op.cc:454] Released schema lock
0709 13:21:10.781618 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:10.792887 (+ 11269us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:10.792922 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38715,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1418,"apply.run_cpu_time_us":9091,"apply.run_wall_time_us":22965,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25092,"num_ops":6,"prepare.queue_time_us":155,"prepare.run_cpu_time_us":3434,"prepare.run_wall_time_us":5453,"replication_time_us":11455,"spinlock_wait_cycles":11904}]]}
I20260709 13:21:10.932134 22487 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:10.934441 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:10.901453 22305 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.912981 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:10.864020 22485 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.935511 22485 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.937714 22485 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:10.939199 14895 raft_consensus.cc:2393] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 22: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:21:10.942665 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 71086.9us
I20260709 13:21:10.945101 22485 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:10.945524 22485 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.945894 22485 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:10.949620 22512 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.950101 22458 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:10.950277 22512 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.951942 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:10.952617 14371 raft_consensus.cc:3060] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:10.952849 22512 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:10.958174 14344 leader_election.cc:336] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:10.958576 22305 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:10.959954 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:10.960585 14303 raft_consensus.cc:3060] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:10.961184 14344 leader_election.cc:336] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:10.962565 14867 leader_election.cc:336] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:10.963605 22496 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.964174 22496 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.966913 22524 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:10.973069 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:10.973822 14298 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:21:10.976323 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:10.976643 22525 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.977185 22305 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:10.977672 22305 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:10.978112 22305 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:10.977249 22525 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.988751 14303 raft_consensus.cc:2468] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:21:10.988775 22525 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:10.992415 22521 ts_tablet_manager.cc:1916] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:10.893476 14121 catalog_manager.cc:5697] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:10.995067 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:10.995491 14865 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:10.996389 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:10.996614 22525 raft_consensus.cc:2804] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:10.997138 22525 raft_consensus.cc:697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:10.997496 14121 catalog_manager.cc:5697] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } }
I20260709 13:21:10.998953 22496 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:10.999154 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:10.998772 22525 consensus_queue.cc:237] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:10.999516 22485 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.002472 14371 raft_consensus.cc:2468] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 25.
I20260709 13:21:11.008492 14121 catalog_manager.cc:5697] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:11.027756 14121 catalog_manager.cc:5697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 17 to 23, leader changed from bee4f7fc1b4740dc875537c79309664f (127.12.208.130) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 23 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:11.018718 14900 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:21:11.019479 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:11.030584 14303 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 23.
I20260709 13:21:11.036275 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:11.033277 14267 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:11.050616 22524 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:21:11.051009 14867 leader_election.cc:336] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.051270 22524 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.053949 22487 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.054512 22487 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.057515 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:11.053586 22524 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.069108 22524 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:11.069533 22524 raft_consensus.cc:493] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.069950 22524 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:11.078665 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 45485.5us
I20260709 13:21:11.080257 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:11.063870 22496 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:21:11.094410 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 79905.1us
I20260709 13:21:11.096582 14341 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:11.103863 22527 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.104569 22527 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.105927 22496 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.109225 22496 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:11.111419 14270 leader_election.cc:336] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.138244 14341 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:11.077597 22528 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.082456 22523 raft_consensus.cc:2749] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:11.082103 22505 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:21:11.142218 14867 leader_election.cc:336] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.155071 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:11.155668 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:11.156414 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:11.165654 22533 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:11.166342 22533 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.180954 22533 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.156150 22530 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:11.184178 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 104205us
I20260709 13:21:11.179008 22487 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:11.159852 22505 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:11.216547 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 74361.9us
W20260709 13:21:11.251868 14867 leader_election.cc:336] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.197757 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 179968us
W20260709 13:21:11.239527 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.211400 14270 leader_election.cc:336] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.160006 22528 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:11.253042 14344 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.254320 22485 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:11.196640 22520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3fe008c45425b8fd1c2bac8020950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:11.239955 14124 catalog_manager.cc:5697] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 21 to 22, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 22 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:11.252730 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:11.182400 22512 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.185591 22523 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:11.292356 22535 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.295137 22540 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:11.307315 22505 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:11.317049 22305 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:11.317978 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 231804us
I20260709 13:21:11.324319 14864 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:11.202664 22508 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.235566 22526 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.329910 14900 raft_consensus.cc:2393] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 22: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
W20260709 13:21:11.329973 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 71439.3us
W20260709 13:21:11.320416 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 159429us
I20260709 13:21:11.328750 22305 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.316998 22485 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.323428 22527 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.331830 22531 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.341562 22548 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.330607 22523 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.351477 22531 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.351609 22548 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.351976 22523 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.328073 22505 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.331732 22508 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.335198 22525 raft_consensus.cc:2804] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:11.331607 22526 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.344146 22485 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.355382 22305 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.312260 22533 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.318693 22512 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.369510 22305 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.342641 22547 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.354156 22523 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:11.376077 22526 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:11.377960 22485 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.382052 22548 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.384071 22508 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.385970 22527 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.433277 22305 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:11.432595 22527 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:11.425122 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 83408.7us
I20260709 13:21:11.353763 22531 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.436439 22533 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:11.366961 22505 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.437888 22527 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:11.439672 22512 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:11.443171 22528 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:11.448442 22505 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:11.323771 22535 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.453092 22535 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:11.371760 22525 raft_consensus.cc:697] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 25 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
W20260709 13:21:11.459627 14867 leader_election.cc:336] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.460147 14867 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:11.463155 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:11.463472 14867 leader_election.cc:336] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.463872 14300 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
I20260709 13:21:11.468927 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:11.469244 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:11.469630 14300 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
I20260709 13:21:11.470103 14298 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 26.
I20260709 13:21:11.484460 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:11.485169 14378 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 25.
I20260709 13:21:11.485750 22546 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.486353 22546 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.489638 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:11.488555 22546 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:11.491838 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:11.492528 14371 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
W20260709 13:21:11.493400 14270 leader_election.cc:336] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.494179 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:21:11.494364 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:11.494858 14896 raft_consensus.cc:3060] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:11.501312 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:11.502072 14895 raft_consensus.cc:3060] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.502597 14896 raft_consensus.cc:2468] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
I20260709 13:21:11.514166 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:11.425653 22547 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.527112 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:11.527166 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:11.527988 22547 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:11.527843 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:11.529067 14899 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 23.
I20260709 13:21:11.527848 14900 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:21:11.531664 14298 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:21:11.532652 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:11.533252 14900 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 25.
I20260709 13:21:11.534180 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:11.531687 14895 raft_consensus.cc:2468] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:21:11.465931 22527 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:11.493132 22526 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.537231 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:11.537191 22526 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.538245 22529 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:11.538378 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:11.538673 22529 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.539062 22529 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:11.539158 14892 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:21:11.539506 22526 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:11.539839 22530 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:11.540268 22530 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.540634 22530 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:11.466739 22542 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.542114 22542 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.543177 14896 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:21:11.543560 22521 ts_tablet_manager.cc:1929] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.14
I20260709 13:21:11.544246 22521 log.cc:1199] T a4e025a69a5c42f3be03aeed0ac9a998 P 181bbac22422408c87cd13b7fe3008f9: Deleting WAL directory at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/wals/a4e025a69a5c42f3be03aeed0ac9a998
I20260709 13:21:11.544358 22542 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.494081 22524 raft_consensus.cc:515] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.547081 22529 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.534970 22525 consensus_queue.cc:237] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.549247 22529 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:11.550653 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:11.548477 22524 leader_election.cc:290] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.552337 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:11.552928 22546 raft_consensus.cc:3060] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:11.551182 22530 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:11.554769 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59844us
W20260709 13:21:11.555507 14270 leader_election.cc:336] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.556089 14270 leader_election.cc:336] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.560226 22530 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.561652 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:11.562825 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:11.563593 22553 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:11.564034 22553 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.564399 22553 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:11.564473 22534 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:11.564922 22534 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.565306 22534 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:11.572641 22553 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.575567 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:11.577845 22547 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:11.578271 22547 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.578641 22547 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:11.579756 13122 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 14250)
I20260709 13:21:11.572651 22534 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.582418 22534 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:11.579720 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:11.587819 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:11.588667 14300 raft_consensus.cc:3060] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:11.588824 14270 leader_election.cc:336] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.551182 14344 leader_election.cc:336] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.590758 14344 leader_election.cc:336] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.591408 14344 leader_election.cc:336] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.592146 14344 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.592073 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:11.592875 14899 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
W20260709 13:21:11.598554 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 46290.1us
W20260709 13:21:11.590005 14270 leader_election.cc:336] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.607820 14270 leader_election.cc:336] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.607904 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:11.609558 14342 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:11.614774 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:11.611546 14867 leader_election.cc:336] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.616462 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:11.616909 14867 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.617638 14867 leader_election.cc:336] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.618605 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:11.621335 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:11.622143 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:11.616326 22523 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:11.627866 22523 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.628296 22523 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.625217 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:11.623983 22485 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.625959 22551 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:11.626299 22505 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:11.630642 22505 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.630456 22485 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.631062 22505 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:11.632830 22485 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.635191 22520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50016 (request call id 1955) took 1087 ms. Trace:
I20260709 13:21:11.635649 22520 rpcz_store.cc:276] 0709 13:21:10.548249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:10.548397 (+   148us) service_pool.cc:224] Handling call
0709 13:21:10.628580 (+ 80183us) ts_tablet_manager.cc:934] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
0709 13:21:11.082756 (+454176us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:21:11.492926 (+410170us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:11.508193 (+ 15267us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:21:11.624439 (+116246us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:21:11.634685 (+ 10246us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:11.635028 (+   343us) ts_tablet_manager.cc:989] Replica registered.
0709 13:21:11.635101 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":254,"tablet-copy.queue_time_us":79121,"thread_start_us":143969,"threads_started":2}
I20260709 13:21:11.630463 22551 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.638314 22551 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:11.638973 22520 tablet_copy_client.cc:806] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:11.620265 22526 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:11.641455 22526 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.621006 22524 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:11.641888 22526 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:11.627477 22531 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:11.642444 22531 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.642864 22531 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:11.644802 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:21:11.644863 14270 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.645527 14298 raft_consensus.cc:3060] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:11.645632 14270 leader_election.cc:336] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.647192 14341 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:11.644822 14867 leader_election.cc:336] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.653956 14270 leader_election.cc:336] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.654587 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:11.639581 22520 tablet_copy_client.cc:670] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:11.661540 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:11.663612 22554 raft_consensus.cc:2804] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:11.664168 22554 raft_consensus.cc:697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:11.664008 22551 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.665967 22508 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:11.666399 22508 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.666775 22508 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:11.667479 22505 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.665226 22554 consensus_queue.cc:237] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.621620 22546 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:11.677443 14341 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:11.679639 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:11.680290 14297 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:21:11.678268 22458 raft_consensus.cc:2804] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:11.619328 22530 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:11.608623 22553 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:11.649118 14300 raft_consensus.cc:2468] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 24.
I20260709 13:21:11.689711 14342 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:11.690503 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:11.693481 14895 raft_consensus.cc:3060] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:21:11.690637 14867 leader_election.cc:336] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.690765 14302 raft_consensus.cc:2468] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:21:11.691299 14298 raft_consensus.cc:2468] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 24.
I20260709 13:21:11.692909 14299 raft_consensus.cc:1275] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260709 13:21:11.699290 14867 leader_election.cc:336] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.702037 14895 raft_consensus.cc:2468] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 23.
I20260709 13:21:11.669706 22505 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:11.707916 14342 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:11.692047 22458 raft_consensus.cc:697] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:11.735286 22458 consensus_queue.cc:237] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.728981 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:11.730423 14267 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:11.706461 22512 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:11.744014 22512 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
I20260709 13:21:11.744505 22535 raft_consensus.cc:2804] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:11.745126 22535 raft_consensus.cc:697] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 23 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:11.746364 22535 consensus_queue.cc:237] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.744571 22512 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:11.692278 22530 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:21:11.757278 14344 leader_election.cc:336] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.732610 22551 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:11.755311 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
W20260709 13:21:11.758571 14344 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.758803 14895 raft_consensus.cc:3060] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:11.759729 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:11.760316 14378 raft_consensus.cc:3060] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:11.754933 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 47132.8us
W20260709 13:21:11.756161 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:11.757592 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:11.677350 22531 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.761363 14342 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:11.767618 14895 raft_consensus.cc:2468] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 19.
I20260709 13:21:11.772719 14267 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:11.776490 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b16e1f580c44c1f984f63473c6a267d" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:11.777281 14298 raft_consensus.cc:3060] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:11.778365 22537 raft_consensus.cc:2804] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:11.778906 22537 raft_consensus.cc:697] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 24 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:11.779353 22543 raft_consensus.cc:2804] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:11.779901 22543 raft_consensus.cc:697] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 24 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:11.779780 22537 consensus_queue.cc:237] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.780809 22543 consensus_queue.cc:237] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.782071 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:11.784551 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44278.8us
W20260709 13:21:11.785177 14867 leader_election.cc:336] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.785669 14867 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.786214 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:11.786417 14298 raft_consensus.cc:2468] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 24.
I20260709 13:21:11.797312 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:11.799661 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:11.799664 14270 leader_election.cc:336] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.803046 22526 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.804638 14302 raft_consensus.cc:2393] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 21: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:11.760581 22530 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:11.725505 22523 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.815600 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:11.816118 14120 catalog_manager.cc:5697] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index -1 to 14, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 18 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:21:11.819530 14121 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37096 (request call id 359) took 3041 ms. Trace:
I20260709 13:21:11.823307 14378 raft_consensus.cc:2468] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 21.
I20260709 13:21:11.816715 14124 catalog_manager.cc:5697] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 24 to 25, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 25 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:11.805682 22526 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:11.808120 22520 tablet_copy_client.cc:538] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:11.826064 14864 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:11.828922 22540 consensus_queue.cc:1048] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:21:11.830552 22538 raft_consensus.cc:2804] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:11.831224 22538 raft_consensus.cc:697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 21 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:11.832261 22538 consensus_queue.cc:237] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:11.834743 22556 log.cc:927] Time spent T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:21:11.827216 14865 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:11.806999 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:11.837350 14895 raft_consensus.cc:3060] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:11.838114 22547 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.839030 22531 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:11.842145 14303 raft_consensus.cc:2393] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 20: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:11.842506 22547 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:11.844347 22558 log.cc:927] Time spent T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:21:11.845391 22523 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:11.847474 14344 leader_election.cc:336] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.817011 22535 raft_consensus.cc:2804] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:11.850708 22305 raft_consensus.cc:2804] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:21:11.851086 14270 leader_election.cc:336] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.851259 14865 leader_election.cc:304] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:11.848423 14344 leader_election.cc:336] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.853071 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:11.857363 14303 raft_consensus.cc:3060] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:21:11.857412 14344 leader_election.cc:336] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.771323 22508 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.866267 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:11.867170 14378 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:21:11.869982 22305 raft_consensus.cc:697] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:11.870777 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:11.819936 14121 rpcz_store.cc:276] 0709 13:21:08.778203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:08.778363 (+   160us) service_pool.cc:224] Handling call
0709 13:21:08.792993 (+ 14630us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b5400152054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff6090 00007f8ded094f3a 00007f8df2e4b1cc 00007f8df2f4937e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc 00007f8df1409392 00007f8deb3c748c 00007f8deb3c68c6
0709 13:21:11.819465 (+3026472us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:11.038662 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:11.039431 (+   769us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:11.039477 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:21:11.039503 (+    26us) tablet.cc:662] Decoding operations
0709 13:21:11.040242 (+   739us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:11.040296 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:11.040334 (+    38us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:21:11.040850 (+   516us) tablet.cc:701] Row locks acquired
0709 13:21:11.040869 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:21:11.041022 (+   153us) write_op.cc:270] Start()
0709 13:21:11.041167 (+   145us) write_op.cc:276] Timestamp: P: 1783603271040963 usec, L: 0
0709 13:21:11.041189 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:21:11.065556 (+ 24367us) log.cc:844] Serialized 2496 byte log entry
0709 13:21:11.085914 (+ 20358us) op_driver.cc:464] REPLICATION: finished
0709 13:21:11.141697 (+ 55783us) write_op.cc:301] APPLY: starting
0709 13:21:11.154661 (+ 12964us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:11.566189 (+411528us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:11.566299 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:11.654466 (+ 88167us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:11.654728 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:21:11.654781 (+    53us) write_op.cc:312] APPLY: finished
0709 13:21:11.655083 (+   302us) log.cc:844] Serialized 65 byte log entry
0709 13:21:11.655280 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:11.655397 (+   117us) write_op.cc:454] Released schema lock
0709 13:21:11.655446 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:11.667167 (+ 11721us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:11.667200 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32843,"reported_tablets":41,"spinlock_wait_cycles":21482368,"child_traces":[["op",{"apply.queue_time_us":25136,"apply.run_cpu_time_us":12720,"apply.run_wall_time_us":525368,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25092,"num_ops":6,"prepare.queue_time_us":176,"prepare.run_cpu_time_us":3990,"prepare.run_wall_time_us":47553,"replication_time_us":41455,"spinlock_wait_cycles":28544}]]}
I20260709 13:21:11.884130 22534 raft_consensus.cc:2804] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:11.886637 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:11.893862 14303 raft_consensus.cc:2468] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
I20260709 13:21:11.893663 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:11.894982 14899 raft_consensus.cc:3060] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:11.900686 14270 leader_election.cc:336] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:11.901397 14270 leader_election.cc:336] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:11.900092 14342 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:11.890626 22305 consensus_queue.cc:237] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.906615 14267 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:11.908555 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:11.902935 22553 raft_consensus.cc:3060] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:21:11.909359 22560 log.cc:927] Time spent T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:21:11.903128 22534 raft_consensus.cc:697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 24 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:11.911062 22534 consensus_queue.cc:237] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.914582 22531 raft_consensus.cc:2804] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:11.915205 22531 raft_consensus.cc:697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:11.917183 14374 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 26: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:21:11.933000 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:11.941231 14895 raft_consensus.cc:2468] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:21:11.905755 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet a4e025a69a5c42f3be03aeed0ac9a998 (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:21:11.944114 14111 catalog_manager.cc:5028] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): tablet 8c137013238f4b1dbae260e32cb316dc (table test-workload [id=3a60586503ca4ae1977f1f1edfb94727]) successfully deleted
I20260709 13:21:11.949656 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:11.894953 22535 raft_consensus.cc:697] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:11.961411 14899 raft_consensus.cc:2468] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 24.
I20260709 13:21:11.944007 22524 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:11.945716 22526 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:11.961880 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:11.947600 22551 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:11.916255 22531 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:11.954406 22540 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:21:11.975605 22546 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:21:12.046715 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:12.047297 14270 leader_election.cc:336] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:12.048668 22508 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:12.024844 22535 consensus_queue.cc:237] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:11.995939 22546 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election (detected failure of leader a9b2cf49ceed478480fb0f27ccf55d81)
W20260709 13:21:12.056712 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 82042.3us
I20260709 13:21:12.064241 14267 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:12.066857 14267 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:12.061691 22546 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:12.092646 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:12.096985 14892 raft_consensus.cc:2393] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 26: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:21:12.088217 22547 raft_consensus.cc:2804] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:12.090489 22551 raft_consensus.cc:2804] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:21:12.100458 22569 log.cc:927] Time spent T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:21:12.124089 22530 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:12.125744 14369 raft_consensus.cc:2393] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 27: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:21:12.134436 14344 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111) [suppressed 304 similar messages]
W20260709 13:21:12.135023 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:12.142616 22553 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:12.142999 22547 raft_consensus.cc:697] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 21 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:12.144366 22547 consensus_queue.cc:237] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:12.148085 22551 raft_consensus.cc:697] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 24 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:12.149211 22551 consensus_queue.cc:237] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:12.152223 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45548.2us
W20260709 13:21:12.135360 14344 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:12.153846 14344 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:12.161397 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:12.098619 22512 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:12.163817 14377 raft_consensus.cc:2393] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 19: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:21:12.163964 22520 tablet_bootstrap.cc:492] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:21:12.164912 14900 raft_consensus.cc:2468] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:21:12.203045 14900 raft_consensus.cc:1275] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:12.204480 22550 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:21:12.224115 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:12.240532 22550 consensus_queue.cc:1048] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:12.250365 22530 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:12.256563 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:12.257442 14299 raft_consensus.cc:3060] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:21:12.267518 14270 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:12.268774 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 43853.3us
W20260709 13:21:12.269409 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:12.269833 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:12.272416 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:12.274361 22546 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:12.275795 22512 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:12.276666 22546 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:12.290222 14369 raft_consensus.cc:1275] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:21:12.292023 22524 consensus_queue.cc:1048] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:12.298098 14267 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:12.305282 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:12.305979 14302 raft_consensus.cc:3060] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:12.308681 14267 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:12.311524 14299 raft_consensus.cc:2468] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 27.
W20260709 13:21:12.309900 14344 leader_election.cc:336] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:12.326812 22536 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:12.328891 14267 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:12.332345 14899 raft_consensus.cc:1275] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:12.338388 22551 raft_consensus.cc:2804] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:12.338963 22551 raft_consensus.cc:697] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:12.338228 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:12.340035 14371 raft_consensus.cc:3060] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:12.341355 14342 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:12.350744 14899 raft_consensus.cc:1275] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:21:12.360709 14302 raft_consensus.cc:2468] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:21:12.375012 14378 raft_consensus.cc:1275] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:21:12.402978 22540 consensus_queue.cc:1048] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:12.372355 22574 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:12.406437 22567 raft_consensus.cc:2804] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:21:12.381696 22512 consensus_queue.cc:1048] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:12.406868 14342 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:12.407619 14302 raft_consensus.cc:1275] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:21:12.411417 14867 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:12.411986 14299 raft_consensus.cc:1275] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:21:12.415108 22305 consensus_queue.cc:1048] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:12.339843 22551 consensus_queue.cc:237] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:12.414855 22567 raft_consensus.cc:697] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 27 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:12.376354 22535 consensus_queue.cc:1048] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:21:12.428397 22567 consensus_queue.cc:237] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:12.414752 22530 raft_consensus.cc:2804] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:21:12.432349 14867 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:12.431910 14270 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:12.424309 22539 consensus_queue.cc:1048] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:21:12.449048 14371 raft_consensus.cc:2468] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 23.
I20260709 13:21:12.450217 22530 raft_consensus.cc:697] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:12.471925 22530 consensus_queue.cc:237] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:12.486665 14344 leader_election.cc:336] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:12.499348 14344 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:12.484663 14124 catalog_manager.cc:5697] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 20 to 21, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 21 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:12.499955 14344 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:12.564627 14302 raft_consensus.cc:1275] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:21:12.568136 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 155641us
I20260709 13:21:12.574680 14267 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:12.580273 13122 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:12.595896 14270 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:12.596632 14270 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:12.583940 22555 raft_consensus.cc:2804] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:12.568328 22512 consensus_queue.cc:1048] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:21:12.618865 14124 catalog_manager.cc:5697] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 23 to 24, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 24 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:12.620680 14124 catalog_manager.cc:5697] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 21 to 22, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 22 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:12.624435 14121 catalog_manager.cc:5697] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 19 to 20, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 20 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:12.626174 14121 catalog_manager.cc:5697] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 23 to 24, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 24 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:12.645542 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:12.646546 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 57038.9us
I20260709 13:21:12.660511 14121 catalog_manager.cc:5697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 22 to 23, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 23 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:12.666706 14121 catalog_manager.cc:5697] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 23 to 24, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 24 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:12.668895 14121 catalog_manager.cc:5697] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 22 to 23, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 23 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:12.678426 14300 raft_consensus.cc:1275] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 13:21:12.705142 14867 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:12.651856 22555 raft_consensus.cc:697] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 23 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:12.720866 14301 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:12.726605 22549 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:12.735083 22542 consensus_queue.cc:1048] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:21:12.764418 14867 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:12.764961 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:12.765568 14270 consensus_peers.cc:597] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:12.739614 22555 consensus_queue.cc:237] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:12.786564 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:12.792297 14892 raft_consensus.cc:1275] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:21:12.794212 14896 raft_consensus.cc:1275] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:21:12.806203 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:12.815006 22536 consensus_queue.cc:1048] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:12.816758 22536 consensus_queue.cc:1048] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:12.831766 14897 raft_consensus.cc:1275] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:21:12.833421 22590 consensus_queue.cc:1048] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:21:12.875898 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:12.876543 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 56387.8us
W20260709 13:21:12.881095 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:12.889079 14120 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37080 (request call id 336) took 1806 ms. Trace:
I20260709 13:21:12.889532 14120 rpcz_store.cc:276] 0709 13:21:11.082351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:11.082497 (+   146us) service_pool.cc:224] Handling call
0709 13:21:11.152548 (+ 70051us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b5400152054. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8decff6090 00007f8ded094f3a 00007f8df2e4b1cc 00007f8df2f4937e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc 00007f8df1409392 00007f8deb3c748c 00007f8deb3c68c6
0709 13:21:12.889015 (+1736467us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:12.287812 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:12.288574 (+   762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:12.288617 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:21:12.288642 (+    25us) tablet.cc:662] Decoding operations
0709 13:21:12.289063 (+   421us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:12.289151 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:12.289196 (+    45us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:21:12.289438 (+   242us) tablet.cc:701] Row locks acquired
0709 13:21:12.289463 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:21:12.289652 (+   189us) write_op.cc:270] Start()
0709 13:21:12.289818 (+   166us) write_op.cc:276] Timestamp: P: 1783603272289593 usec, L: 0
0709 13:21:12.289853 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:21:12.290635 (+   782us) log.cc:844] Serialized 603 byte log entry
0709 13:21:12.316596 (+ 25961us) op_driver.cc:464] REPLICATION: finished
0709 13:21:12.317039 (+   443us) write_op.cc:301] APPLY: starting
0709 13:21:12.317128 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:12.317961 (+   833us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:12.318058 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:12.318821 (+   763us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:12.318978 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:21:12.319017 (+    39us) write_op.cc:312] APPLY: finished
0709 13:21:12.319210 (+   193us) log.cc:844] Serialized 25 byte log entry
0709 13:21:12.327922 (+  8712us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:12.334412 (+  6490us) write_op.cc:454] Released schema lock
0709 13:21:12.334452 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:12.334831 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:12.334863 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":116155,"reported_tablets":37,"spinlock_wait_cycles":55686400,"child_traces":[["op",{"apply.queue_time_us":257,"apply.run_cpu_time_us":2874,"apply.run_wall_time_us":17764,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4182,"num_ops":1,"prepare.queue_time_us":409277,"prepare.run_cpu_time_us":3177,"prepare.run_wall_time_us":3177,"replication_time_us":26588}]]}
I20260709 13:21:13.013875 14300 raft_consensus.cc:1275] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
W20260709 13:21:13.017599 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:13.044997 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:13.055822 22529 consensus_queue.cc:1048] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:21:13.086944 22520 tablet_bootstrap.cc:492] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:13.093376 22520 tablet_bootstrap.cc:492] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
W20260709 13:21:13.145589 22603 log.cc:927] Time spent T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.002s
W20260709 13:21:13.146382 14344 consensus_peers.cc:597] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.148845 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:13.151024 22520 ts_tablet_manager.cc:1403] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.987s	user 0.061s	sys 0.004s
W20260709 13:21:13.154906 22602 log.cc:927] Time spent T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:21:13.158690 22520 raft_consensus.cc:359] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:21:13.176718 22520 raft_consensus.cc:740] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:21:13.182312 22520 consensus_queue.cc:260] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:21:13.185079 22520 ts_tablet_manager.cc:1434] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.034s	user 0.000s	sys 0.004s
W20260709 13:21:13.176301 22608 log.cc:927] Time spent T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:21:13.174438 14121 catalog_manager.cc:5697] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 20 to 21, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 21 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:13.186679 14121 catalog_manager.cc:5697] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 18 to 19, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 19 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:13.188166 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.188671 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 100075us
I20260709 13:21:13.188402 14121 catalog_manager.cc:5697] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 22 to 23, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 23 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:13.196255 14121 catalog_manager.cc:5697] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 23 to 24, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 24 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:13.199870 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-78b3fe008c45425b8fd1c2bac8020950 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:21:13.200407 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-78b3fe008c45425b8fd1c2bac8020950 on tablet 78b3fe008c45425b8fd1c2bac8020950 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:21:13.216931 14298 raft_consensus.cc:1275] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:21:13.222837 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 74890.1us
I20260709 13:21:13.240893 14124 catalog_manager.cc:5697] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 26 to 27, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 27 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:13.244192 14124 catalog_manager.cc:5697] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 18 to 19, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 19 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:13.252476 14896 raft_consensus.cc:1275] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:21:13.263485 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:13.274266 14369 raft_consensus.cc:1275] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:21:13.276026 22565 consensus_queue.cc:1048] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:13.282544 22590 consensus_queue.cc:1048] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:13.287005 22551 consensus_queue.cc:1048] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:13.288646 14120 catalog_manager.cc:5697] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 22 to 23, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 23 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:13.290767 14120 catalog_manager.cc:5697] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 19 to 20, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 20 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:13.351936 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.385040 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 113457us
W20260709 13:21:13.386804 14344 consensus_peers.cc:597] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.430317 14344 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.440156 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.452834 14270 consensus_peers.cc:597] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.467782 14344 consensus_peers.cc:597] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:13.474171 14892 raft_consensus.cc:1217] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 LEARNER]: Deduplicated request from leader. Original: 18.13->[18.14-18.14]   Dedup: 18.14->[]
W20260709 13:21:13.489300 14270 consensus_peers.cc:597] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.500011 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46587.5us
W20260709 13:21:13.519474 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:13.580796 13122 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 14250)
I20260709 13:21:13.673309 22540 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.674430 22540 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:13.676640 22540 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:13.677876 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:13.678596 14369 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 26.
I20260709 13:21:13.679890 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:13.680771 22540 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:13.681213 22540 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.681936 22540 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:21:13.688776 14867 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:13.692381 22540 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:13.729633 22540 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 election: Requested vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:13.730883 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:13.731590 14369 raft_consensus.cc:3060] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:21:13.732019 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:13.742816 14369 raft_consensus.cc:2468] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 27.
I20260709 13:21:13.744390 14864 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:13.745352 22553 raft_consensus.cc:2804] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:21:13.745967 14867 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:13.745987 22553 raft_consensus.cc:697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 27 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:13.747224 22553 consensus_queue.cc:237] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:13.784098 14124 catalog_manager.cc:5697] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 25 to 27, leader changed from a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 27 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:13.813462 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:13.875559 22565 raft_consensus.cc:1064] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:21:13.878592 22565 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:13.912822 14896 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:21:13.914959 22508 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:21:13.961644 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:14.021342 14344 consensus_peers.cc:597] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:14.043314 14295 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:21:14.051770 22548 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:21:14.063668 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:14.096163 22508 raft_consensus.cc:2955] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:14.105563 14301 raft_consensus.cc:2955] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:14.134752 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:14.138532 14369 raft_consensus.cc:1275] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:21:14.141085 22553 consensus_queue.cc:1048] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:14.148231 14896 raft_consensus.cc:2955] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:14.166005 14124 catalog_manager.cc:5697] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 14 to 15, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.199595 14377 consensus_queue.cc:237] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:14.210554 14867 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:14.212198 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:14.230883 14301 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:21:14.234944 22485 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:21:14.250303 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:14.254249 22565 raft_consensus.cc:2955] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:14.260650 14295 raft_consensus.cc:2955] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:14.267298 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:14.297250 14896 raft_consensus.cc:1275] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:21:14.300022 14120 catalog_manager.cc:5697] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 15 to 16, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New cstate: current_term: 18 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:14.304096 22485 consensus_queue.cc:1048] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:14.360437 14111 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78b3fe008c45425b8fd1c2bac8020950 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:21:14.380347 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:14.387104 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 86118.2us
W20260709 13:21:14.392077 14114 catalog_manager.cc:4755] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78b3fe008c45425b8fd1c2bac8020950: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:14.418020 14897 raft_consensus.cc:2955] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:14.580261 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:14.581339 13122 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:14.608539 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:14.700255 14867 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.744817 14867 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.797621 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:14.834714 14270 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.836098 14344 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.856897 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:14.917822 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:14.920809 14344 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.923897 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:14.948648 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.955296 14270 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:14.989598 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:15.018621 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:15.072091 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:15.136636 14867 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:15.200255 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:15.203994 14867 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:15.254889 14270 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:15.302399 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:15.521154 14270 consensus_peers.cc:597] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:15.546224 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:15.546933 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44650.6us
W20260709 13:21:15.558044 14270 consensus_peers.cc:597] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:15.576455 14344 consensus_peers.cc:597] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:15.582175 13122 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:15.588148 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:15.596028 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61659.9us
W20260709 13:21:15.667820 14270 consensus_peers.cc:597] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:15.688822 14344 consensus_peers.cc:597] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:15.690763 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:15.690761 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:15.728577 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:15.755625 14114 catalog_manager.cc:4755] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78b3fe008c45425b8fd1c2bac8020950: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:15.852425 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:15.917259 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:15.980633 14344 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:16.099618 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:16.127336 14371 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:21:16.159044 14298 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:21:16.165477 22565 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:21:16.168576 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:16.168933 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:16.172369 14341 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa1054f387364ae4b11260c5ab742790. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:16.202132 22565 raft_consensus.cc:2955] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:21:16.212092 14295 raft_consensus.cc:2955] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:21:16.227043 14377 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:21:16.246897 14120 catalog_manager.cc:5697] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 14, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 23 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.262893 14295 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:16.264683 22637 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:21:16.265625 14341 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 439318510aaf4073b4ca2996d73b9d8e. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:16.269143 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:16.298919 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:16.311350 22565 raft_consensus.cc:2955] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index -1 to 17, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:21:16.319658 14298 raft_consensus.cc:2955] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index -1 to 17, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:21:16.373979 14298 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
W20260709 13:21:16.407127 14267 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137): Couldn't send request to peer cebb34ac155340899a38c728707ddc0d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e531770baa044bc49820df7e47c608eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:16.406596 14121 catalog_manager.cc:5697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index -1 to 17, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 23 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.419792 14377 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:21:16.421531 22622 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:21:16.429205 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:16.460412 14377 raft_consensus.cc:2955] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Committing config change with OpId 22.11: config changed from index -1 to 11, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:21:16.457134 22590 raft_consensus.cc:2955] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Committing config change with OpId 22.11: config changed from index -1 to 11, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } } }
I20260709 13:21:16.507284 14121 catalog_manager.cc:5697] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index -1 to 11, NON_VOTER cebb34ac155340899a38c728707ddc0d (127.12.208.132) added. New cstate: current_term: 22 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:16.528119 14867 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:16.583112 13122 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:16.627380 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:16.640427 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:16.642168 22653 ts_tablet_manager.cc:933] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:16.690815 22653 tablet_copy_client.cc:323] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:21:16.705575 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet fa1054f387364ae4b11260c5ab742790 from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:21:16.706336 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet fa1054f387364ae4b11260c5ab742790 from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-fa1054f387364ae4b11260c5ab742790
I20260709 13:21:16.715770 14388 tablet_copy_source_session.cc:215] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:16.735277 22653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1054f387364ae4b11260c5ab742790. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:16.750551 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:16.768841 22653 tablet_copy_client.cc:806] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:16.776880 22653 tablet_copy_client.cc:670] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
W20260709 13:21:16.780438 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:16.793900 22653 tablet_copy_client.cc:538] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:16.823750 22653 tablet_bootstrap.cc:492] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
I20260709 13:21:16.844533 22655 ts_tablet_manager.cc:933] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:16.865195 14114 catalog_manager.cc:4755] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78b3fe008c45425b8fd1c2bac8020950: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:16.882864 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:16.891649 22659 ts_tablet_manager.cc:933] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: Initiating tablet copy from peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:16.902195 22655 tablet_copy_client.cc:323] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.130:44127
I20260709 13:21:16.988950 22659 tablet_copy_client.cc:323] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: tablet copy: Beginning tablet copy session from remote peer at address 127.12.208.131:41203
I20260709 13:21:17.007570 14314 tablet_copy_service.cc:140] P bee4f7fc1b4740dc875537c79309664f: Received BeginTabletCopySession request for tablet e531770baa044bc49820df7e47c608eb from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:45306)
I20260709 13:21:17.008383 14314 tablet_copy_service.cc:161] P bee4f7fc1b4740dc875537c79309664f: Beginning new tablet copy session on tablet e531770baa044bc49820df7e47c608eb from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:45306: session id = cebb34ac155340899a38c728707ddc0d-e531770baa044bc49820df7e47c608eb
I20260709 13:21:17.032508 14388 tablet_copy_service.cc:140] P 181bbac22422408c87cd13b7fe3008f9: Received BeginTabletCopySession request for tablet 439318510aaf4073b4ca2996d73b9d8e from peer cebb34ac155340899a38c728707ddc0d ({username='slave'} at 127.0.0.1:37700)
I20260709 13:21:17.033157 14388 tablet_copy_service.cc:161] P 181bbac22422408c87cd13b7fe3008f9: Beginning new tablet copy session on tablet 439318510aaf4073b4ca2996d73b9d8e from peer cebb34ac155340899a38c728707ddc0d at {username='slave'} at 127.0.0.1:37700: session id = cebb34ac155340899a38c728707ddc0d-439318510aaf4073b4ca2996d73b9d8e
I20260709 13:21:17.048319 14388 tablet_copy_source_session.cc:215] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:17.054262 22659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439318510aaf4073b4ca2996d73b9d8e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:17.057371 14867 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:17.066058 14867 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:17.076301 14325 debug-util.cc:398] Leaking SignalData structure 0x7b0800339da0 after lost signal to thread 13125
W20260709 13:21:17.077528 14325 debug-util.cc:398] Leaking SignalData structure 0x7b080037e000 after lost signal to thread 14161
W20260709 13:21:17.078933 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6460 after lost signal to thread 14328
W20260709 13:21:17.080130 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2f60 after lost signal to thread 14402
W20260709 13:21:17.081334 14325 debug-util.cc:398] Leaking SignalData structure 0x7b0800338b00 after lost signal to thread 14925
I20260709 13:21:17.069512 14314 tablet_copy_source_session.cc:215] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:17.089803 22655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e531770baa044bc49820df7e47c608eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.137945 22655 tablet_copy_client.cc:806] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:17.138576 22655 tablet_copy_client.cc:670] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
W20260709 13:21:17.143419 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:17.150522 22659 tablet_copy_client.cc:806] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 0 data blocks...
W20260709 13:21:17.152037 14344 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111) [suppressed 450 similar messages]
I20260709 13:21:17.157318 22659 tablet_copy_client.cc:670] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:17.163827 22655 tablet_copy_client.cc:538] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:17.163282 22659 tablet_copy_client.cc:538] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:17.179145 22653 tablet_bootstrap.cc:492] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=3 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:17.186679 22653 tablet_bootstrap.cc:492] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:21:17.193377 22653 ts_tablet_manager.cc:1403] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.370s	user 0.056s	sys 0.046s
I20260709 13:21:17.196946 22653 raft_consensus.cc:359] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:21:17.205945 22653 raft_consensus.cc:740] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:21:17.206779 22653 consensus_queue.cc:260] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:21:17.192452 22659 tablet_bootstrap.cc:492] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
W20260709 13:21:17.217167 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:17.220057 22653 ts_tablet_manager.cc:1434] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:21:17.228116 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-fa1054f387364ae4b11260c5ab742790 received from {username='slave'} at 127.0.0.1:37700
I20260709 13:21:17.228629 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-fa1054f387364ae4b11260c5ab742790 on tablet fa1054f387364ae4b11260c5ab742790 with peer cebb34ac155340899a38c728707ddc0d
I20260709 13:21:17.249302 22655 tablet_bootstrap.cc:492] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d: Bootstrap starting.
W20260709 13:21:17.284794 14270 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:17.423169 14270 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:17.439644 14867 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:17.449244 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:17.484695 22659 tablet_bootstrap.cc:492] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:17.485862 22659 tablet_bootstrap.cc:492] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:21:17.486637 22659 ts_tablet_manager.cc:1403] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.294s	user 0.039s	sys 0.022s
I20260709 13:21:17.512036 22659 raft_consensus.cc:359] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:21:17.512729 22659 raft_consensus.cc:740] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:21:17.515023 22655 tablet_bootstrap.cc:492] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:17.515982 22655 tablet_bootstrap.cc:492] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d: Bootstrap complete.
I20260709 13:21:17.516737 22655 ts_tablet_manager.cc:1403] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d: Time spent bootstrapping tablet: real 0.268s	user 0.037s	sys 0.006s
I20260709 13:21:17.513425 22659 consensus_queue.cc:260] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:21:17.525918 22659 ts_tablet_manager.cc:1434] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
W20260709 13:21:17.535851 14344 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:17.559962 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:17.561509 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:17.563511 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:17.573889 22655 raft_consensus.cc:359] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:21:17.574862 22655 raft_consensus.cc:740] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Initialized, Role: LEARNER
I20260709 13:21:17.575582 22655 consensus_queue.cc:260] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: NON_VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: true } }
I20260709 13:21:17.582259 14388 tablet_copy_service.cc:342] P 181bbac22422408c87cd13b7fe3008f9: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-439318510aaf4073b4ca2996d73b9d8e received from {username='slave'} at 127.0.0.1:37700
I20260709 13:21:17.582692 14388 tablet_copy_service.cc:434] P 181bbac22422408c87cd13b7fe3008f9: ending tablet copy session cebb34ac155340899a38c728707ddc0d-439318510aaf4073b4ca2996d73b9d8e on tablet 439318510aaf4073b4ca2996d73b9d8e with peer cebb34ac155340899a38c728707ddc0d
W20260709 13:21:17.583750 13122 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 14250)
I20260709 13:21:17.594637 14892 raft_consensus.cc:1217] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 LEARNER]: Deduplicated request from leader. Original: 23.13->[23.14-23.14]   Dedup: 23.14->[]
I20260709 13:21:17.598377 22655 ts_tablet_manager.cc:1434] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d: Time spent starting tablet: real 0.081s	user 0.010s	sys 0.000s
I20260709 13:21:17.600452 14314 tablet_copy_service.cc:342] P bee4f7fc1b4740dc875537c79309664f: Request end of tablet copy session cebb34ac155340899a38c728707ddc0d-e531770baa044bc49820df7e47c608eb received from {username='slave'} at 127.0.0.1:45306
I20260709 13:21:17.600915 14314 tablet_copy_service.cc:434] P bee4f7fc1b4740dc875537c79309664f: ending tablet copy session cebb34ac155340899a38c728707ddc0d-e531770baa044bc49820df7e47c608eb on tablet e531770baa044bc49820df7e47c608eb with peer cebb34ac155340899a38c728707ddc0d
W20260709 13:21:17.606667 14867 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:17.616400 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:17.619880 14344 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:17.639266 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:17.673108 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:17.699514 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:17.717727 14892 raft_consensus.cc:1217] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 LEARNER]: Deduplicated request from leader. Original: 23.16->[23.17-23.17]   Dedup: 23.17->[]
I20260709 13:21:17.753933 14892 raft_consensus.cc:1217] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 LEARNER]: Deduplicated request from leader. Original: 22.10->[22.11-22.11]   Dedup: 22.11->[]
W20260709 13:21:17.816679 14270 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:17.830909 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:17.949891 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:17.981503 14270 consensus_peers.cc:597] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:18.040086 22636 raft_consensus.cc:1064] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:21:18.043202 22636 consensus_queue.cc:237] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:18.049700 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:18.067168 14344 consensus_peers.cc:597] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:18.087001 14896 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:21:18.087338 14270 consensus_peers.cc:597] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:18.093240 22662 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:21:18.104368 14295 raft_consensus.cc:1275] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:21:18.105909 22630 consensus_queue.cc:1048] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:18.123939 22629 raft_consensus.cc:1064] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
I20260709 13:21:18.126876 22629 consensus_queue.cc:237] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 15, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:18.140941 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:18.152227 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.169764 22630 raft_consensus.cc:2955] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:18.173368 14301 raft_consensus.cc:2955] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:18.189116 14896 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 LEARNER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:21:18.191362 14295 raft_consensus.cc:1275] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:21:18.208740 14120 catalog_manager.cc:5697] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 14 to 15, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:18.196566 22636 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.020s
I20260709 13:21:18.223047 22662 consensus_queue.cc:1048] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.005s
W20260709 13:21:18.274156 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.293107 22590 raft_consensus.cc:1064] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: attempting to promote NON_VOTER cebb34ac155340899a38c728707ddc0d to VOTER
W20260709 13:21:18.297434 14344 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:18.298098 14270 consensus_peers.cc:597] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:18.297809 22590 consensus_queue.cc:237] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 9, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:18.316466 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:18.320350 14896 raft_consensus.cc:2955] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:18.330494 22669 raft_consensus.cc:2955] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Committing config change with OpId 23.18: config changed from index 17 to 18, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:18.336210 14295 raft_consensus.cc:2955] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:18.352010 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:18.377250 14896 raft_consensus.cc:2955] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:18.396878 14892 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 LEARNER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:18.400552 14377 raft_consensus.cc:1275] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:18.402261 22622 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:21:18.406364 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.423905 22590 consensus_queue.cc:1048] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:21:18.469873 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:18.478544 14120 catalog_manager.cc:5697] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: config changed from index 17 to 18, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:18.484099 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:18.498873 22622 raft_consensus.cc:2955] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Committing config change with OpId 22.12: config changed from index 11 to 12, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:18.530153 14344 consensus_peers.cc:597] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:18.539286 14896 raft_consensus.cc:2955] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Committing config change with OpId 22.12: config changed from index 11 to 12, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
W20260709 13:21:18.555960 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:18.555217 14377 raft_consensus.cc:2955] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Committing config change with OpId 22.12: config changed from index 11 to 12, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } } }
I20260709 13:21:18.576565 14121 catalog_manager.cc:5697] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f reported cstate change: config changed from index 11 to 12, cebb34ac155340899a38c728707ddc0d (127.12.208.132) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:18.584215 13122 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:18.871065 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:18.902657 14867 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:19.584789 13122 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:20.585492 13122 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:20.695519 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3860 after lost signal to thread 13125
I20260709 13:21:20.749826 14116 maintenance_manager.cc:419] P 2510e400b67647c7923cee16a251d2de: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033392
W20260709 13:21:21.195439 14115 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.392s	user 0.002s	sys 0.000s
I20260709 13:21:21.213941 14115 maintenance_manager.cc:643] P 2510e400b67647c7923cee16a251d2de: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.463s	user 0.040s	sys 0.001s Metrics: {"bytes_written":6921,"delete_count":0,"lbm_write_time_us":15379,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":5,"reinsert_count":0,"update_count":270,"wal-append.queue_time_us":391597}
I20260709 13:21:21.216032 14116 maintenance_manager.cc:419] P 2510e400b67647c7923cee16a251d2de: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.361428
I20260709 13:21:21.319296 22690 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.344602 22685 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.357195 22685 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.356665 22695 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.343310 22690 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.370178 22699 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.370410 22686 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.378575 22695 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.380587 22685 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.381454 22707 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.396747 22690 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.397929 22699 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.398900 22686 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.416672 22690 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.417274 22690 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.417860 22686 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.400259 22695 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.419520 22691 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.420135 22691 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.421430 22696 raft_consensus.cc:493] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.422854 22696 raft_consensus.cc:515] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.421921 22685 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.419529 22690 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.430572 22707 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.419049 22686 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.439179 22695 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.451885 22700 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.453534 22699 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.454857 22693 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.450752 22684 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.461418 22700 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:21.463521 14114 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 2.508s	user 0.041s	sys 0.060s
W20260709 13:21:21.468905 14114 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.513s	user 0.041s	sys 0.060s
I20260709 13:21:21.439673 22685 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:21.529546 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08001fc8a0 after lost signal to thread 14161
I20260709 13:21:21.449481 22686 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.541333 22700 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.542320 22686 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.464609 22695 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.474584 22684 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.483626 22693 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.470345 22691 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.469911 22699 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.490782 22689 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.546747 22690 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.545776 22686 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.550194 22694 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.581135 22707 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.582692 22690 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.584321 22694 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:21.586026 13122 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 14250)
I20260709 13:21:21.586921 22690 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.574833 22699 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.594661 22722 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.587498 22709 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.595608 22692 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.595681 22693 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.596064 22685 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.596314 22687 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.596695 22701 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.596767 22715 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.610723 22701 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.611732 22715 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.597436 22702 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.614125 22702 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.615057 22721 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.615667 22721 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.616089 22712 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.616371 22702 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.616745 22712 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.617426 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.617939 22685 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.616464 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.618525 22685 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.619686 22701 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.619769 22717 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.590631 22694 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.610836 22703 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.593834 22707 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.627126 22698 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.627472 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.581369 22689 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.627873 22695 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.620873 22709 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.611471 22711 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.629221 22704 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.629033 22703 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.629806 22716 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.631423 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.637094 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.585126 22686 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:21.638238 14114 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 168092us
I20260709 13:21:21.637626 22698 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.642164 22688 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.643435 22723 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.630167 22715 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.643826 22702 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.644450 22676 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
W20260709 13:21:21.649241 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 61980.1us
I20260709 13:21:21.630400 22720 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.641528 22711 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.631621 22721 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.640355 22694 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.630440 22696 leader_election.cc:290] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.609879 22692 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.648877 22684 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.620623 22722 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.642930 22707 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.639008 22717 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.675462 22685 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.711951 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.712841 22689 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.714082 22706 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.714628 22695 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.715118 22718 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.648711 22704 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.639448 22687 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.689287 22694 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.716547 22710 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.736913 22710 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.738549 22703 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.739126 22710 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:21.732074 14114 catalog_manager.cc:4755] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78b3fe008c45425b8fd1c2bac8020950: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:21.740914 22722 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.687477 22700 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.741281 22694 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.741657 22700 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.743086 22709 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.743297 22687 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.685206 22676 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.666435 22688 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.743886 22695 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.745446 22676 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.746140 22695 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.747228 22717 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.747553 22707 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.747949 22704 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.731619 22718 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.669629 22716 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.734099 22706 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.718545 22699 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.674633 22702 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.750440 22718 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.750645 22716 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.674214 22720 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.709776 22721 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.751591 22702 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.751379 22721 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.752549 22720 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.753477 22721 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.737277 22712 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.755052 22706 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.757381 22686 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:21.760676 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 63373.9us
I20260709 13:21:21.745446 22688 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.765264 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.765717 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.766856 22692 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.714120 22711 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.743765 22700 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.775309 14299 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:21:21.800220 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.801009 14374 raft_consensus.cc:2468] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:21:21.748627 22698 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.801455 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.802680 14371 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 20.
W20260709 13:21:21.786062 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2440 after lost signal to thread 14328
I20260709 13:21:21.803239 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.790571 22728 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.804176 22728 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:21.804785 14158 debug-util.cc:398] Leaking SignalData structure 0x7b0800091da0 after lost signal to thread 14402
I20260709 13:21:21.805040 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.803262 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:21.806248 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5560 after lost signal to thread 14925
I20260709 13:21:21.806389 22728 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.784396 22691 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.789915 22710 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.807148 22691 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.807333 22710 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.809290 22691 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.794153 22729 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.810103 22729 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:21.810354 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.809489 22710 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:21.812283 22729 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.800319 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.692817 22723 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.803253 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:21.806723 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08002b5f80 after lost signal to thread 22622
W20260709 13:21:21.825153 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3320 after lost signal to thread 22629
W20260709 13:21:21.825584 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08003fd240 after lost signal to thread 22669
W20260709 13:21:21.825865 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08001691e0 after lost signal to thread 22673
W20260709 13:21:21.826148 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08003eaee0 after lost signal to thread 22680
I20260709 13:21:21.794883 22730 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.833523 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.835027 22730 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.838052 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.839558 22723 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.831504 22710 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:21.863179 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:21.864549 22735 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.865149 22735 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.866653 22691 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:21.867231 22691 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:21.867435 22735 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.867717 22691 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:21.867797 22728 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.868564 22728 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.849418 22710 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:21.873464 22728 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.880707 22710 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:21.889475 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.896709 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.898677 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.901607 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.904868 22730 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:21.914767 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.915468 14377 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:21:21.918874 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.918874 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.918994 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.921741 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd596811644f8b5ab0c134b279676" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.922420 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.926255 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.929288 14342 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:21.931869 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.932250 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.929744 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.930423 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.932873 22694 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:21.933350 22694 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.933732 22694 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:21.933967 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.932256 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.931159 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.935571 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.931632 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.931516 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.935884 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.932924 14301 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:21:21.938292 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:21.942509 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.945041 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.946123 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.964414 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:21:21.966374 14344 leader_election.cc:336] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:21.966529 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:21.966907 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:21.968158 22700 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:21.968501 22692 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:21.968598 22700 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.969022 22692 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:21.969523 22692 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:21.972977 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:21.969082 22700 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:21:21.982236 14344 leader_election.cc:336] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:21.982755 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:21.983645 14344 leader_election.cc:336] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:21.984144 22702 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:21.984745 22676 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:21.984236 14344 leader_election.cc:336] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:21.988979 14344 leader_election.cc:336] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:21.988387 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:21.991367 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.992604 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.993810 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:21.989532 14344 leader_election.cc:336] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:21.994635 14344 leader_election.cc:336] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:21.996774 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:21.998021 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:22.002425 22691 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.004822 22691 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:22.005818 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:22.006067 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:22.013006 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.015058 14892 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:22.014940 22694 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.018468 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:22.026360 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:22.026949 14297 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:22.032645 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.033368 14896 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 17.
I20260709 13:21:22.033061 22700 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:21.995126 14344 leader_election.cc:336] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.034072 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:22.035051 14344 leader_election.cc:336] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.035465 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.036159 22702 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:22.036844 22702 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:22.037947 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.038331 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.040105 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.041730 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.042327 14897 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:21:22.043511 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.044106 22710 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:22.044631 22710 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.047106 22710 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:22.048194 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:22.048374 22736 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:22.048939 22736 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.049470 22732 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:22.050151 22732 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.051432 22736 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:22.054044 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.059243 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:22.059289 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.064353 14894 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 27.
I20260709 13:21:22.060269 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.043793 22725 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:22.065490 22725 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.067803 22725 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:22.068322 22725 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:22.068826 22725 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.017637 22694 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:22.061306 22732 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:22.061544 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.062667 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:22.063243 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.063596 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.070895 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:22.071589 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:22.071952 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:22.075598 22692 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.072338 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:22.076781 14375 raft_consensus.cc:1240] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: []
I20260709 13:21:22.071146 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:22.072616 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:22.079269 22732 consensus_queue.cc:1059] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:21:22.080287 22732 raft_consensus.cc:3055] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:22.080605 22732 raft_consensus.cc:740] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:22.043681 22711 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:22.082430 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:22.085227 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:22.085969 14378 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 23: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:21:22.079285 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:22.086506 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:22.081470 22732 consensus_queue.cc:260] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.083201 22711 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.088163 22732 raft_consensus.cc:3060] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:22.090690 22700 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:22.083902 22725 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:21:22.090698 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:22.089502 22711 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:22.096975 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:22.108131 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68621.7us
W20260709 13:21:22.108819 14344 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.110234 14344 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.114527 14297 raft_consensus.cc:2468] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 23.
I20260709 13:21:22.115851 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:22.116850 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.118413 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:21:22.116715 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:22.120397 14300 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: []
W20260709 13:21:22.117590 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:22.120261 14342 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:22.122087 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:22.122859 22702 raft_consensus.cc:2804] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:22.123170 22723 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:22.123481 22702 raft_consensus.cc:697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:22.123639 22723 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:22.124116 22723 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:22.124667 22702 consensus_queue.cc:237] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.125965 22721 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:22.127141 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:22.131314 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.133576 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:21:22.135609 22728 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:22.136564 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:22.136734 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 180311us
I20260709 13:21:22.196776 22692 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:22.197639 14865 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.117074 22676 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:22.198161 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:22.203831 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 216099us
I20260709 13:21:22.256759 14893 raft_consensus.cc:2468] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 23.
I20260709 13:21:22.261952 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.262202 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.262782 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:22.278781 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 166711us
I20260709 13:21:22.263885 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.264743 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.265427 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.266134 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:22.263473 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:22.281626 14344 leader_election.cc:336] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.281745 14900 raft_consensus.cc:2393] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 21: Already voted for candidate cebb34ac155340899a38c728707ddc0d in this term.
I20260709 13:21:22.282361 14344 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:22.282795 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 146289us
I20260709 13:21:22.283850 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:22.258872 14270 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111) [suppressed 187 similar messages]
I20260709 13:21:22.288625 22723 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.290021 14865 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.285359 22732 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:22.291175 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:22.292115 14300 raft_consensus.cc:1240] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 17. Current term is 18. Ops: []
W20260709 13:21:22.293524 14344 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:22.294361 14344 leader_election.cc:336] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.294886 14344 leader_election.cc:304] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.295189 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:21:22.257529 22729 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:22.299353 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:22.302456 14865 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.299216 22718 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:22.306584 14898 raft_consensus.cc:2393] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 23: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:22.307890 14865 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.289259 22728 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:22.321877 22687 raft_consensus.cc:2749] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:21:22.322343 14344 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.326596 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.328398 22721 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:21:22.328986 22721 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:22.329449 22721 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:21:22.331135 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.323005 22724 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:22.296759 22735 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:22.305055 22692 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:22.341094 14865 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:22.371603 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 59539.2us
I20260709 13:21:22.372452 14865 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.344996 22712 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:22.345034 22694 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:22.347113 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.347023 22721 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.358497 22736 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:22.341907 14267 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:22.370311 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:22.306205 22729 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:22.374332 14865 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.376721 14341 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.386341 14341 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.387440 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:22.361616 14867 leader_election.cc:336] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.376760 22691 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:22.388026 14867 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.387055 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.385159 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:21:22.398399 14867 leader_election.cc:336] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.398882 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:22.399005 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:22.399840 14867 leader_election.cc:336] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.361521 22723 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:22.400805 14867 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:22.402439 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:22.402408 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.376952 22724 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:22.405439 14867 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.405351 14865 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.411123 14341 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.408483 14867 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.379185 22702 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:22.400262 22698 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:22.399747 22700 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:22.407244 22710 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:22.413205 22700 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:22.414069 22725 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:22.416595 14867 leader_election.cc:336] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.403453 22676 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:22.417192 14867 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.418097 22710 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:22.418757 22710 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:22.419656 22725 consensus_queue.cc:1059] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:22.420887 22710 raft_consensus.cc:3055] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:22.421296 22710 raft_consensus.cc:740] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:22.422184 22710 consensus_queue.cc:260] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.423882 14865 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:22.424609 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44403.9us
I20260709 13:21:22.426281 14378 raft_consensus.cc:1240] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: []
I20260709 13:21:22.407166 22711 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:22.428728 14120 catalog_manager.cc:5697] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 22 to 23, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131). New cstate: current_term: 23 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:22.436439 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:22.438449 14867 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.394342 22729 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:22.437547 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.438997 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:22.440105 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.440605 22725 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:22.393368 22694 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:22.397353 22735 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:22.393918 22692 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:22.397173 22731 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:22.444980 22731 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:22.445925 14867 leader_election.cc:336] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.403584 22732 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:22.446651 14867 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.405038 22718 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:22.448941 14341 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:22.510028 22739 log.cc:927] Time spent T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:21:22.486958 22724 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:22.487912 22700 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.527756 22732 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:22.549919 22700 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:22.551538 22721 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 28 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:22.449669 22692 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:22.530630 14867 leader_election.cc:336] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.555521 14867 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:22.532040 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 255300us
W20260709 13:21:22.559245 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 97846.5us
W20260709 13:21:22.559777 14867 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:22.546547 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 109083us
W20260709 13:21:22.560729 14867 leader_election.cc:336] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.561162 14867 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.442705 22687 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:22.562845 22724 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:22.563647 14867 leader_election.cc:336] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.564067 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:22.564677 22724 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:22.565912 22689 consensus_queue.cc:1059] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:22.567216 22702 raft_consensus.cc:3055] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:22.567582 22702 raft_consensus.cc:740] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:22.568353 22702 consensus_queue.cc:260] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.569761 22702 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:22.577862 22708 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:22.586473 13122 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:22.590031 14867 leader_election.cc:336] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.590794 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:22.591670 22725 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:22.577206 22729 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.592826 14297 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22. Ops: []
W20260709 13:21:22.594235 14866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:22.598824 22729 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:22.559438 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 110799us
I20260709 13:21:22.600469 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:22.603557 14341 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.605542 22689 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:21:22.606312 14867 leader_election.cc:336] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.599675 22692 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:22.606827 14867 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:22.617389 22718 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:22.617885 22724 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:22.619369 14867 leader_election.cc:336] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.619814 14867 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:22.628221 14867 leader_election.cc:336] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.628742 14867 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:22.635143 22736 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:22.636904 22710 raft_consensus.cc:3060] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:22.642838 14267 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:21:22.643788 22723 raft_consensus.cc:2804] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:22.644313 22723 raft_consensus.cc:697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 23 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:22.644774 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.650614 22730 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:22.629365 22718 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:22.652776 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
W20260709 13:21:22.654843 14270 leader_election.cc:336] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.655520 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:22.645205 22723 consensus_queue.cc:237] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.662145 14270 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.665520 22721 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:22.669217 14270 leader_election.cc:336] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.669809 14270 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:22.672288 14270 leader_election.cc:336] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.672744 14270 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:22.674008 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:22.674865 14270 leader_election.cc:336] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.675431 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:22.676677 14270 leader_election.cc:336] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.677248 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:22.678207 22728 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:22.680181 14270 leader_election.cc:336] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.682808 22700 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:22.680627 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.685669 22735 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:22.685871 22700 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:22.686049 14867 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:22.687057 14270 leader_election.cc:336] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.687479 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:22.688166 22700 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:22.689149 14270 leader_election.cc:336] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.689589 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:22.698025 22700 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:22.690647 22712 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:22.707538 14270 leader_election.cc:336] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.708067 14270 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.709033 22729 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:22.709066 14270 leader_election.cc:336] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.712616 14270 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.713711 22730 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:22.716820 14270 leader_election.cc:336] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:22.717320 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:22.718217 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:22.729588 14302 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:22.724336 22735 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:22.751036 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:22.753845 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:22.761253 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.764833 22729 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:21:22.769039 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:22.772436 22700 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:21:22.800457 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 46234.1us
I20260709 13:21:22.821427 22694 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:22.827035 14896 raft_consensus.cc:1275] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:22.836489 14115 maintenance_manager.cc:643] P 2510e400b67647c7923cee16a251d2de: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 1.614s	user 0.118s	sys 0.059s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":28888,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":171008,"dirs.run_cpu_time_us":713,"dirs.run_wall_time_us":6234,"lbm_read_time_us":2159,"lbm_reads_lt_1ms":25,"lbm_write_time_us":1893,"lbm_writes_lt_1ms":12,"peak_mem_usage":309515,"raft.queue_time_us":38997,"raft.run_cpu_time_us":90739,"raft.run_wall_time_us":106817,"reinsert_count":0,"thread_start_us":347506,"threads_started":4,"update_count":303,"wal-append.queue_time_us":124994}
I20260709 13:21:22.840220 14116 maintenance_manager.cc:419] P 2510e400b67647c7923cee16a251d2de: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:21:22.840303 22676 consensus_queue.cc:1048] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:22.855060 14302 raft_consensus.cc:1240] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 28 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 27. Current term is 28. Ops: []
W20260709 13:21:22.857955 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 125711us
I20260709 13:21:22.857529 14115 maintenance_manager.cc:643] P 2510e400b67647c7923cee16a251d2de: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 13:21:22.858626 14121 catalog_manager.cc:5697] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 22 to 23, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 23 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.860918 22702 consensus_queue.cc:1059] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
W20260709 13:21:22.879372 14270 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:22.872766 22751 log.cc:927] Time spent T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:21:22.886765 22688 raft_consensus.cc:3055] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:21:22.887276 22688 raft_consensus.cc:740] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
W20260709 13:21:22.887408 14344 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:22.888134 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:22.818964 22745 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.087s
I20260709 13:21:22.888491 22688 consensus_queue.cc:260] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.890981 22688 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:21:22.899758 22745 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:22.900300 22745 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:22.901232 22745 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:22.907567 22745 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:22.929647 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:22.975562 14867 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:23.032282 14867 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:23.083133 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:23.094848 14344 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:23.119894 14378 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:21:23.134452 22735 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:21:23.146624 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:23.162297 14896 raft_consensus.cc:1275] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:21:23.164467 22723 consensus_queue.cc:1048] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:21:23.219795 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:23.223698 14344 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:23.226480 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:23.300251 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:23.370325 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:23.404628 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:23.488468 14867 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:23.584904 14270 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:23.587503 13122 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:23.640833 14344 consensus_peers.cc:597] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:23.664812 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:23.672170 14270 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:23.705551 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:23.718410 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:23.719022 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:23.750257 22697 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.750943 22697 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:23.754662 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:23.755374 14896 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 17.
I20260709 13:21:23.756937 14341 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:23.758531 22745 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:23.758980 22745 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.759397 22745 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:23.763262 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:23.764026 14295 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:21:23.768584 22697 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:23.792287 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:23.793815 22745 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:23.797155 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:23.797834 14295 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:23.806365 14295 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:21:23.815626 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:23.819075 14901 raft_consensus.cc:3060] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:21:23.830368 14901 raft_consensus.cc:2468] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:21:23.813519 22745 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:23.832487 14342 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
W20260709 13:21:23.833532 14270 consensus_peers.cc:597] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:23.853276 22697 raft_consensus.cc:2804] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:23.853963 22697 raft_consensus.cc:697] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:23.855923 22697 consensus_queue.cc:237] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:23.876257 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:23.942471 22742 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.943130 22742 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:23.946213 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:23.946924 14378 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:21:23.948233 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:23.949084 22735 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:23.949613 22735 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.950031 22735 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:23.948770 22742 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:23.968744 22735 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:23.971299 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:23.972038 14901 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
I20260709 13:21:23.980892 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:23.981611 14377 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:23.981829 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:23.982630 14901 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:23.984279 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:23.984901 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:23.989167 14377 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:21:23.992822 14120 catalog_manager.cc:5697] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:23.994107 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:23.998179 22742 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:23.998885 22742 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:23.999958 22742 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:24.007668 14901 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:21:23.980386 22735 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:24.038671 14867 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:24.078951 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:24.104017 14121 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:24.129631 14270 consensus_peers.cc:597] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:24.134428 22725 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:24.141963 22725 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:24.144230 22725 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:24.146314 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:24.146654 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:24.147047 14377 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:21:24.147611 14302 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 22: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:24.148802 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:24.150342 22725 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:24.150738 22725 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:24.151098 22725 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:24.158020 14270 consensus_peers.cc:597] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:24.169608 22725 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:24.173583 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:24.174275 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:24.175030 14302 raft_consensus.cc:2393] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 22: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
W20260709 13:21:24.175010 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:24.183691 14377 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 22.
I20260709 13:21:24.185199 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:24.188010 22731 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:24.205061 22731 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Leader. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:24.207502 22731 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:24.193939 22725 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:24.245337 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:24.275054 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:24.308537 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 95368.4us
I20260709 13:21:24.313237 22774 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.313236 14297 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:21:24.313862 22774 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:24.316650 22774 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:24.319274 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 43611.7us
I20260709 13:21:24.325150 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:24.331235 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:24.331907 14297 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 28.
I20260709 13:21:24.335644 22731 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:24.336174 22731 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:24.339013 22731 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:24.339291 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:24.340122 14297 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 28: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:24.340375 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:24.341019 14377 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 28.
I20260709 13:21:24.342042 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:24.343103 22731 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:21:24.343484 22731 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:24.344017 22731 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:21:24.362960 22688 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:24.367945 14342 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:21:24.372408 22688 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:21:24.372872 22688 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.373230 22688 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:21:24.390796 14121 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d reported cstate change: term changed from 21 to 22, leader changed from 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131) to cebb34ac155340899a38c728707ddc0d (127.12.208.132). New cstate: current_term: 22 leader_uuid: "cebb34ac155340899a38c728707ddc0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:24.394107 22688 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:24.395529 22731 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:24.404433 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:24.405201 14297 raft_consensus.cc:2393] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 28: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:24.409554 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:24.410205 14896 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:21:24.419404 14896 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 29.
I20260709 13:21:24.422181 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:24.422851 14302 raft_consensus.cc:3060] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:21:24.422960 14341 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:24.424543 22773 raft_consensus.cc:2804] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:21:24.425064 22773 raft_consensus.cc:697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 29 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:24.425909 22773 consensus_queue.cc:237] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:24.436240 22688 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 29 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:24.436926 22731 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 28 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:24.439082 14344 consensus_peers.cc:597] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:24.439590 14302 raft_consensus.cc:2468] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 29.
I20260709 13:21:24.441253 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:24.446485 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:24.448907 14901 raft_consensus.cc:1275] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:21:24.451545 22697 consensus_queue.cc:1048] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:24.452919 22770 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 29 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:21:24.463909 14121 catalog_manager.cc:5697] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.563095 14377 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:21:24.563809 14901 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:21:24.566890 22771 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:24.568748 22771 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:21:24.572682 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:24.588297 13122 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:24.669050 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:24.738019 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 90824.5us
W20260709 13:21:24.759213 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:25.680575 13122 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:25.717720 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 933357us
I20260709 13:21:25.731621 14300 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:21:25.747138 22786 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:25.750036 22792 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.006s
I20260709 13:21:25.748291 22786 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.757640 22786 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:25.765710 22790 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:25.766685 22790 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.771898 22790 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:25.773471 22791 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.774219 22791 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.801925 22791 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:25.819839 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 63980.5us
I20260709 13:21:25.834744 22786 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:25.835860 22786 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.839963 22786 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:25.843142 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:25.858155 22788 raft_consensus.cc:493] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:25.859470 22788 raft_consensus.cc:515] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.869176 22789 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:25.870396 22789 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.873499 22789 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:25.901055 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 58050.5us
I20260709 13:21:25.902081 22788 leader_election.cc:290] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:25.913902 22789 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:25.914740 22789 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.917410 22789 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:25.929940 22796 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:25.930419 22776 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:25.947160 22776 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.956333 22790 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:25.957234 22790 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.966878 22791 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:25.967813 22791 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.969976 22688 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:25.970971 22688 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:25.972343 22776 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:25.973403 22688 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:25.934675 22796 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.974820 22791 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:25.981392 22799 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:25.988341 22799 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:25.982697 22790 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:25.984148 22789 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:21:25.997123 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 46109.4us
I20260709 13:21:25.998479 22790 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:25.999399 22790 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.002964 22790 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.004987 22799 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:26.005774 22789 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:26.008033 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.009900 22702 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:26.011863 22702 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:26.012653 22776 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:26.014071 22773 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:26.014395 22702 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:26.014981 22702 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:26.014710 22773 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:26.009996 22789 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:26.016088 22799 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:26.016851 22799 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.018090 22773 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:26.019268 22697 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:26.020038 22697 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.013259 22776 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:26.021992 22799 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:21:26.023099 22702 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.023802 22776 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:26.025749 22796 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.042119 22796 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:26.043011 22796 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.063092 22806 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:26.063516 22797 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:26.063994 22806 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.064414 22797 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.066223 22793 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:26.067034 22793 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.070052 22793 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:26.073778 22796 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.076246 22797 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.068650 22806 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.085173 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.085675 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.086709 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.087009 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c37f8aa458494687312360eddb12a9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.088250 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.096410 22793 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:26.097172 22793 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.099684 22786 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:26.099864 22702 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.100867 22793 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:26.100466 22786 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.104341 22786 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:26.104810 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.087793 22697 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:26.106077 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 44085.2us
I20260709 13:21:26.111835 14301 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 29 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 13:21:26.111728 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.109315 22796 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:26.114739 22797 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:26.114877 22796 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:26.115527 22797 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.117421 22796 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:26.121750 22797 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.123378 22793 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:26.124205 22793 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.126426 14900 raft_consensus.cc:1275] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 29 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 13:21:26.141636 22793 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:26.142483 14114 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 119908us
I20260709 13:21:26.142979 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:26.151279 14114 catalog_manager.cc:4755] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78b3fe008c45425b8fd1c2bac8020950: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.157090 22793 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:26.157881 22793 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.160447 22791 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:26.161196 22791 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.163719 22791 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.164135 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.166559 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.167317 14375 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:21:26.167399 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.169648 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.170650 22793 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:26.171875 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.172611 14375 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:21:26.174794 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:26.183660 14344 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:26.184330 14344 leader_election.cc:336] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:26.184818 14344 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.186077 22800 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:26.186650 22800 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:26.191747 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.202713 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.203570 14375 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 24.
I20260709 13:21:26.207402 22792 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:26.208386 22792 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:26.214102 14344 leader_election.cc:336] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:26.214709 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:26.207474 22799 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:26.216084 22799 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.223356 22793 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:21:26.227527 14344 leader_election.cc:336] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.225229 22793 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.228322 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:26.228628 14344 leader_election.cc:336] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:26.229318 14344 leader_election.cc:336] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.229471 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.230577 22793 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:26.230225 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:26.223980 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:26.238528 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.240283 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.240955 22799 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:26.241427 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.244115 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.224124 22792 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:26.247488 14867 leader_election.cc:336] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:26.250037 14270 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.257869 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:26.258268 14270 leader_election.cc:336] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:26.258837 14270 leader_election.cc:336] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.254635 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:26.259387 14270 leader_election.cc:336] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.255836 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:26.259945 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:26.257176 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.260844 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.262140 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.243189 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:26.263245 14344 leader_election.cc:336] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:26.262533 14867 leader_election.cc:336] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.264602 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:26.265056 14867 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:26.225314 22800 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:26.267838 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:26.268432 14867 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.269188 14378 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer cebb34ac155340899a38c728707ddc0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:21:26.270972 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:26.271479 14867 leader_election.cc:336] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.271582 14901 raft_consensus.cc:2468] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 23.
W20260709 13:21:26.272053 14867 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.272477 14867 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.273912 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.275297 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.276849 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.277423 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.278162 14895 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 18.
I20260709 13:21:26.280504 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:26.281507 22808 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:26.282008 22808 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:26.282384 22808 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:26.287299 14867 leader_election.cc:336] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.287825 14867 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:26.288559 14867 leader_election.cc:336] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.288987 14867 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.289248 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.287331 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.286664 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.291200 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.286886 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:26.291102 22799 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:26.293305 22786 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:26.291049 22792 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:26.297741 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.301923 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:26.303607 14867 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:26.303823 22702 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:26.304185 14867 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.305400 22792 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:26.306298 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:26.308672 14342 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.309522 22702 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:26.310734 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.314530 22702 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:26.316006 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.318003 22702 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:26.325404 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.327206 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.328444 22702 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:21:26.328753 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf286f2db09c4718a255c14e95c7e781" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.332000 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.333246 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca7fe34f2a4185a741b8aebabd8bfc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.335044 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.336849 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.339749 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.341904 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.344901 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:26.343119 22800 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:26.347695 22791 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:26.348137 22791 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:26.348508 22791 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:26.357316 22791 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.360220 22789 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:26.360743 14267 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:26.366070 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.367918 22789 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:26.368443 22789 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:26.369199 22791 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.371440 14267 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:26.374166 14344 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:26.375346 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:26.372491 22791 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:26.363406 22808 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.382874 14267 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:26.386370 22806 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:26.397076 14867 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:26.399832 22808 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.401713 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.403090 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.404336 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.405579 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:26.383318 22791 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:26.406200 14267 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:26.407240 22799 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:26.410250 22791 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:26.415138 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.416054 22806 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:26.419891 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.420648 22806 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:26.423856 22789 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.425189 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.426890 22806 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:26.428162 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.444048 22806 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:26.448010 14267 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.448796 22806 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:26.449908 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9
I20260709 13:21:26.450630 22806 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:26.450997 22806 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:26.451342 22806 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:26.452996 14344 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:26.459892 22806 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:26.460788 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 51999.6us
I20260709 13:21:26.460829 22800 consensus_queue.cc:1048] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:21:26.462146 22806 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.463981 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.464838 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:26.464989 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:26.465583 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:26.466699 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:26.472860 22800 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:26.460307 22789 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:26.482211 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:26.482867 14378 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:26.483063 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:26.484333 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:26.486666 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:26.490480 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.491654 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.492640 22808 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:21:26.493345 22808 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:26.497491 14341 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.498322 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.520805 22805 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:26.522203 14341 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.522971 22806 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:26.524304 22805 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:26.525498 22786 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.526063 22786 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.528293 22786 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:26.531592 14299 raft_consensus.cc:1240] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 24. Current term is 25. Ops: []
I20260709 13:21:26.532799 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:26.535185 22788 consensus_queue.cc:1059] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:21:26.536191 22793 raft_consensus.cc:3055] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:21:26.536554 22793 raft_consensus.cc:740] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:26.537513 22793 consensus_queue.cc:260] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.539238 22793 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:26.525518 14341 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.547003 22805 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:26.557219 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:26.522995 14378 raft_consensus.cc:2468] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 23.
I20260709 13:21:26.571408 14341 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:26.570861 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 95137.9us
I20260709 13:21:26.579735 14864 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:26.606532 14270 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:26.611739 14864 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.612044 14267 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: cebb34ac155340899a38c728707ddc0d
I20260709 13:21:26.614449 14864 leader_election.cc:304] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:26.608350 22821 log.cc:927] Time spent T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:21:26.589684 22801 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:26.619356 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.627223 14864 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:26.616575 22806 raft_consensus.cc:2804] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:26.637070 14299 raft_consensus.cc:1240] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Rejecting Update request from peer 181bbac22422408c87cd13b7fe3008f9 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:26.615963 22792 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:26.617872 22786 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:26.623656 22788 raft_consensus.cc:2749] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:26.634375 22799 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:26.668038 22800 consensus_queue.cc:1059] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:21:26.672710 22805 raft_consensus.cc:3055] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:26.673126 22805 raft_consensus.cc:740] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:26.673995 22805 consensus_queue.cc:260] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:26.681847 13122 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 14250)
I20260709 13:21:26.644763 22806 raft_consensus.cc:697] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 23 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
W20260709 13:21:26.696098 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 50049.9us
I20260709 13:21:26.696451 22786 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:26.717123 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 90016.3us
I20260709 13:21:26.718137 14864 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:26.717993 22806 consensus_queue.cc:237] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:26.721892 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8280 after lost signal to thread 13125
I20260709 13:21:26.746511 22786 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:26.749194 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08003e38c0 after lost signal to thread 14161
W20260709 13:21:26.752799 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:26.754916 14922 debug-util.cc:398] Leaking SignalData structure 0x7b080028a0a0 after lost signal to thread 14328
W20260709 13:21:26.756317 14922 debug-util.cc:398] Leaking SignalData structure 0x7b0800381780 after lost signal to thread 14402
W20260709 13:21:26.762647 14922 debug-util.cc:398] Leaking SignalData structure 0x7b08001084c0 after lost signal to thread 14925
I20260709 13:21:26.764667 14864 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.770083 22792 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:26.770200 22805 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:26.772136 14864 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:26.776172 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:26.779378 14864 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.782696 22799 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:26.790191 22799 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:26.791244 14300 raft_consensus.cc:1240] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 20. Current term is 21. Ops: []
W20260709 13:21:26.799736 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:26.808022 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:26.833664 14867 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:26.846536 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:26.852336 14297 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 23 LEADER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: []
I20260709 13:21:26.866129 22831 consensus_queue.cc:1059] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:26.867837 22831 raft_consensus.cc:3055] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:26.868310 22831 raft_consensus.cc:740] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:26.869342 22831 consensus_queue.cc:260] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.871809 22831 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:26.879170 14121 catalog_manager.cc:5697] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 22 to 23, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 23 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.881417 22792 consensus_queue.cc:1059] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:21:26.882259 22792 consensus_queue.cc:1243] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [LEADER]: Peer bee4f7fc1b4740dc875537c79309664f log is divergent from this leader: its last log entry 23.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 13:21:26.883162 22830 raft_consensus.cc:3055] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:26.883628 22830 raft_consensus.cc:740] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cebb34ac155340899a38c728707ddc0d, State: Running, Role: LEADER
I20260709 13:21:26.884629 22830 consensus_queue.cc:260] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:26.887030 22830 raft_consensus.cc:3060] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:26.888924 14375 raft_consensus.cc:1240] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Rejecting Update request from peer cebb34ac155340899a38c728707ddc0d for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:21:26.894234 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:26.908821 14867 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:26.911073 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:26.938673 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:26.943682 22828 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:21:26.951618 14344 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:27.062048 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:27.190183 14895 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:21:27.199302 22822 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:21:27.271802 14344 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111) [suppressed 392 similar messages]
W20260709 13:21:27.682440 13122 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 14250)
I20260709 13:21:28.324987 22800 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.327533 22800 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.334233 22800 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.326680 22829 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.344631 22829 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.354687 22829 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.364543 22846 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.365391 22846 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.368825 22846 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.369515 22846 raft_consensus.cc:493] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.370162 22846 raft_consensus.cc:515] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.372586 22846 leader_election.cc:290] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.375538 14297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45306 (request call id 1990) took 1161 ms. Trace:
I20260709 13:21:28.376463 14297 rpcz_store.cc:276] 0709 13:21:27.214094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:27.214536 (+   442us) service_pool.cc:224] Handling call
0709 13:21:27.215554 (+  1018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:28.375055 (+1159501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:28.375107 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:28.375178 (+    71us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:21:28.375234 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:28.375313 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:28.375456 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:28.392375 22844 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.393038 22844 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.396679 22844 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.398957 22826 raft_consensus.cc:493] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.400360 22826 raft_consensus.cc:515] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.404304 22826 leader_election.cc:290] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.419399 22847 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.428817 22847 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.433071 22847 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.434655 22849 raft_consensus.cc:493] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.436537 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.439751 22849 raft_consensus.cc:515] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.439872 22826 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.468425 22826 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:28.455128 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 1.18325e+06us
I20260709 13:21:28.492280 22801 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.495832 22846 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.471323 22826 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.496172 22855 raft_consensus.cc:493] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.500741 22839 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.502625 22839 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:28.500758 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb4e0 after lost signal to thread 13125
I20260709 13:21:28.506378 22839 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.509124 22854 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.499775 22801 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.509915 22854 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.512013 22801 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.512496 22801 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.512956 22801 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.513306 22854 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.490813 22847 raft_consensus.cc:493] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.497859 22844 raft_consensus.cc:493] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.534106 22854 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.534713 22854 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.536970 22801 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.537026 22854 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.539156 22857 raft_consensus.cc:493] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.539763 22857 raft_consensus.cc:515] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.523402 22846 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.542192 22846 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.527005 22847 raft_consensus.cc:515] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.544585 22847 leader_election.cc:290] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.550973 22849 leader_election.cc:290] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.551801 22844 raft_consensus.cc:515] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.537431 22853 raft_consensus.cc:493] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.529089 22812 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.556746 22831 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.516561 22855 raft_consensus.cc:515] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.606930 14373 raft_consensus.cc:1275] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:21:28.567067 22854 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.610433 22854 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.607534 22851 raft_consensus.cc:493] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.593884 22839 raft_consensus.cc:493] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.575145 22801 raft_consensus.cc:493] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.598008 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.599128 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.616106 22776 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.599129 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.618615 22776 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.618992 14374 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 20.
I20260709 13:21:28.602190 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.602699 22844 leader_election.cc:290] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.603251 22857 leader_election.cc:290] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.560081 22853 raft_consensus.cc:515] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.622309 22839 raft_consensus.cc:515] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.623481 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1da5440c0e48a6bc637b43fa41215e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.624289 22853 leader_election.cc:290] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.566494 22812 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.624620 22839 leader_election.cc:290] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.592422 22830 raft_consensus.cc:493] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.615427 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402f68d4d3464bffb55e8bd010ec0133" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.586346 22850 raft_consensus.cc:493] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.616990 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fd6b58648f4a6ca27b84f4fd829df9" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.617481 22801 raft_consensus.cc:515] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:28.633646 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee2a0 after lost signal to thread 14161
I20260709 13:21:28.606921 22855 leader_election.cc:290] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.642794 22862 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.643697 22862 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.646171 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.584997 22831 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.621675 22851 raft_consensus.cc:515] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.651316 22844 raft_consensus.cc:493] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.651739 22822 raft_consensus.cc:493] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.652426 22848 raft_consensus.cc:493] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.653236 22801 leader_election.cc:290] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.654143 22857 raft_consensus.cc:493] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:21:28.654385 14325 debug-util.cc:398] Leaking SignalData structure 0x7b0800339ba0 after lost signal to thread 14328
W20260709 13:21:28.670403 14325 debug-util.cc:398] Leaking SignalData structure 0x7b080022e680 after lost signal to thread 14402
I20260709 13:21:28.656002 22812 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.673097 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:28.631704 22830 raft_consensus.cc:515] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.668717 22848 raft_consensus.cc:515] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.710635 22830 leader_election.cc:290] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:28.683106 13122 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 14250)
I20260709 13:21:28.711673 22848 leader_election.cc:290] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.713264 22862 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.689818 22853 raft_consensus.cc:493] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.719333 22853 raft_consensus.cc:515] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.690460 22846 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.720539 22846 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.722647 22846 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.691046 22849 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.648223 22850 raft_consensus.cc:515] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.723381 22849 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.724738 22850 leader_election.cc:290] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.673636 22857 raft_consensus.cc:515] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.700019 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53e62fb464cccbd45d08ede5b5c4e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.701948 22859 consensus_queue.cc:1048] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:21:28.727293 22857 leader_election.cc:290] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.704182 22854 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.668752 22844 raft_consensus.cc:515] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.705225 22776 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.721710 22853 leader_election.cc:290] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.729617 22844 leader_election.cc:290] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.706138 22851 leader_election.cc:290] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.706960 22831 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.669000 22822 raft_consensus.cc:515] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:28.731981 22822 leader_election.cc:290] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.668074 22865 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.732609 22865 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.734611 22865 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.666213 22839 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.735236 22839 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.737279 22839 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:28.713871 14325 debug-util.cc:398] Leaking SignalData structure 0x7b080041fe00 after lost signal to thread 14925
I20260709 13:21:28.714102 22847 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:21:28.737847 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08002993a0 after lost signal to thread 14926
I20260709 13:21:28.737914 22847 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:28.738336 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8080 after lost signal to thread 22798
I20260709 13:21:28.738373 22847 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:28.738930 14325 debug-util.cc:398] Leaking SignalData structure 0x7b0800274440 after lost signal to thread 22823
W20260709 13:21:28.739236 14325 debug-util.cc:398] Leaking SignalData structure 0x7b080031a2a0 after lost signal to thread 22827
I20260709 13:21:28.742682 22849 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.755821 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d39c5ba6de4fbd8f025024428fbd57" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.765141 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.767063 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808ea406abb545e0aae5a5ddd3964180" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.764987 22847 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.770504 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.771401 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.772464 22866 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.773191 22866 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.772403 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ac8217d9b74cd1a2ee70c8667d998a" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.776891 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24d1f6f6adb4246b65902328e51dfdf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.777678 22866 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.786785 22863 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.787361 22799 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.787492 22863 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.788064 22799 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.791108 22847 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:28.796482 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 148453us
I20260709 13:21:28.791993 22863 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.753611 22839 raft_consensus.cc:493] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.800360 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:28.800376 22839 raft_consensus.cc:515] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.803542 22839 leader_election.cc:290] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.801162 14373 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:21:28.833298 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.808622 22849 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.810362 22822 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.835487 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.813827 22847 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.834295 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2359e4575c5b49208e2395d3f12a7da9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.838816 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.839711 22847 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.827227 22853 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.835480 22866 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.843850 22847 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.849282 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.851030 22864 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.851806 22864 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.854127 22830 raft_consensus.cc:493] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.854857 22830 raft_consensus.cc:515] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.860242 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1479f9f47ee4f9984bc3dae70e66f3a" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.861145 22868 raft_consensus.cc:493] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.860292 22831 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.862432 22831 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.858403 22865 raft_consensus.cc:493] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.865851 22865 raft_consensus.cc:515] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.868664 22865 leader_election.cc:290] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.869891 22868 raft_consensus.cc:515] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.872864 22868 leader_election.cc:290] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.839027 22822 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.874336 22847 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.874892 22847 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.875572 22822 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.876192 14304 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 19.
I20260709 13:21:28.876893 22847 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.878614 22799 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.838214 22849 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.881659 14303 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 in current term 25: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:28.882877 22849 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.883173 22866 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.886121 22861 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.886684 22861 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.887959 22873 raft_consensus.cc:493] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.888505 22873 raft_consensus.cc:515] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.889011 22861 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.850335 22853 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.885520 22866 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.891073 22866 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.891821 22853 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.892117 22830 leader_election.cc:290] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.892558 22863 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.893219 22863 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.889623 22861 raft_consensus.cc:493] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.891840 22866 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.897804 22871 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.907437 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:28.901291 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:28.899161 22799 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.901737 22865 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.925887 22799 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.926163 22865 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.927114 22869 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.924981 14901 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 18.
I20260709 13:21:28.927718 22869 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.928431 22799 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.928566 22865 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.900153 22862 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.929733 22862 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.931311 22863 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.900341 22831 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.932145 22871 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.935111 22871 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.936735 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0694154dd8ad41ad93089be880f2e363" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.938999 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.939086 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03bb64d471f488094a4e3dd7d934b67" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.939678 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddcf0184f1049499e0383b72e34ef74" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.900506 22830 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.942958 22830 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.945142 22830 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.898998 22864 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.901062 22868 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:28.946080 22868 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.948156 22868 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.932235 22862 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:28.949064 14373 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:21:28.950855 22849 raft_consensus.cc:493] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.951521 22849 raft_consensus.cc:515] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.954156 22853 raft_consensus.cc:493] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:28.954356 22849 leader_election.cc:290] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.943185 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.955106 14342 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:28.956454 14895 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 25.
I20260709 13:21:28.959375 22875 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:28.962826 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.963311 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.964176 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.964457 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.964768 14375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.965556 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde6831a789b45549658b2c2146dd650" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.966889 14372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.966979 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.967959 14371 raft_consensus.cc:2393] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 22: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:28.969257 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.954798 22853 raft_consensus.cc:515] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.970938 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.971329 22844 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:28.971817 22844 raft_consensus.cc:493] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.972179 22844 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:28.970981 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98310add35f94d0685fee6cc0aba55a2" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:28.972925 22853 leader_election.cc:290] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.973884 14303 raft_consensus.cc:2368] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22.
I20260709 13:21:28.925133 22861 raft_consensus.cc:515] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.982156 22869 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.984050 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ebdaafff10446f814e66697ebf67ef" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:28.985265 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7157daf9a3647f4af1d12bf4530f984" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:28.935220 22873 leader_election.cc:290] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:28.985682 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e674623b78de49129be2dde67c041ef9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:28.986306 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:28.987166 14897 raft_consensus.cc:2410] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for term 24 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:21:28.987212 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:28.987875 14899 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 21.
W20260709 13:21:28.988219 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 88657.8us
I20260709 13:21:28.988790 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:28.989355 14896 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 22.
I20260709 13:21:28.935110 22866 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:28.991312 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 130526us
W20260709 13:21:28.992340 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:28.996198 14267 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:28.997606 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:28.997598 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.999663 22853 raft_consensus.cc:2804] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:28.999905 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:29.000214 22853 raft_consensus.cc:697] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:29.000690 14374 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 24.
I20260709 13:21:29.001495 22853 consensus_queue.cc:237] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:28.999905 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:29.009379 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 231357us
I20260709 13:21:29.010448 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6f055b9cea4c76a10e5e5ecf91ffc9" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.013618 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:29.013862 14378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40ac1ac2b5420abcc4468ffaf0c1fe" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:29.013231 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:29.008678 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:29.014355 14376 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cebb34ac155340899a38c728707ddc0d in term 24.
I20260709 13:21:29.024315 14376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:29.030105 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:29.030447 14374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f235d077faa24a89832f2f8f181b0ef1" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:29.031513 14377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:29.032744 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.032593 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.030565 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.037881 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2582e91d201c4063b3eff5158b611448" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:28.993196 22861 leader_election.cc:290] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:29.039202 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:29.045472 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.024585 22822 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:29.046881 22822 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.047268 22822 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:29.047361 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.066228 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f44936b303148f4848621766631d925" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.068039 14341 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.068979 22839 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:29.069413 22839 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting leader election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:29.069854 22839 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:29.070993 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:29.072733 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:29.081164 14344 leader_election.cc:336] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.081735 14344 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.087450 14342 leader_election.cc:400] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22.
W20260709 13:21:29.088421 14344 leader_election.cc:336] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.088604 14342 leader_election.cc:403] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:29.089664 22776 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:29.094121 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.095707 14341 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.096693 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:29.102056 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:29.089072 14344 leader_election.cc:304] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.108826 22776 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:21:29.108906 14344 leader_election.cc:336] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.109424 22776 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:29.109560 14344 leader_election.cc:304] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.109870 22776 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:29.069478 22822 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:29.114537 22773 raft_consensus.cc:2749] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:29.115938 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:29.118203 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.120523 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.120951 22773 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127) with higher term. Message: Invalid argument: T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 21. Current term is 22.
I20260709 13:21:29.126075 22805 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.131451 22822 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:28.960117 22875 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:29.139932 22805 raft_consensus.cc:2749] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:29.141114 14344 leader_election.cc:336] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.141597 14344 leader_election.cc:304] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.142376 22805 raft_consensus.cc:2749] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:29.143218 22875 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:29.143347 14344 leader_election.cc:336] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.143959 14344 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.144729 22805 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:29.148624 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:29.105870 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.156001 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 50201us
W20260709 13:21:29.156862 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 43828.4us
I20260709 13:21:29.158553 14864 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
W20260709 13:21:29.119599 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 87182.6us
W20260709 13:21:29.156502 14270 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.160881 14270 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.161720 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b3afc4354948bea829c90a4536aa96" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.165366 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3646e03a744053ae5fd190c43a27e4" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.171696 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.174700 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475079f88bce40fea814453c8c4bfaac" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.174890 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c124265b9c42a5a1adf047554812b4" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.177115 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:29.173370 14270 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:29.178233 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37975f772fc648329a8acae36d33a345" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.178570 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c137013238f4b1dbae260e32cb316dc" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.179178 14303 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 26: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:29.178858 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede0d59e482a4cff952455ca90001863" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.166339 22822 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:29.169809 22875 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:21:29.182542 14270 consensus_peers.cc:597] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:29.184051 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde980445ec54bac8c99f8e77669bffa" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:29.187008 14270 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:29.193598 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8fbf1e78cfb4a15820b9812967ec58c" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:29.202718 14344 leader_election.cc:336] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.206842 14344 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:29.209702 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48413.4us
I20260709 13:21:29.186450 22875 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:29.205720 14270 leader_election.cc:336] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.212847 14344 leader_election.cc:336] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.210948 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:29.223989 14344 leader_election.cc:304] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:29.224000 14270 leader_election.cc:336] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.225504 14270 leader_election.cc:304] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:29.226531 14344 leader_election.cc:336] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.227212 14344 leader_election.cc:304] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.228674 14370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca72c82f0b3e4842b7c74a63118d3360" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:29.224318 14867 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.229465 14867 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:29.234365 14270 leader_election.cc:336] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.234361 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab4884dfe6c4e24a9430e2449523d61" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.227092 22812 raft_consensus.cc:2749] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:29.235265 14270 leader_election.cc:304] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.226697 22875 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:29.239149 14120 catalog_manager.cc:5697] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 20 to 22, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 22 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.226346 22805 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:29.230913 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:29.257488 14867 leader_election.cc:336] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.247066 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:29.231416 22853 raft_consensus.cc:2749] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.234398 22861 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:29.265487 14270 leader_election.cc:336] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.269223 14270 leader_election.cc:304] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:29.271970 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45466.5us
W20260709 13:21:29.259070 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:29.274008 14867 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.272478 14270 leader_election.cc:336] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.275918 14270 leader_election.cc:304] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:29.276736 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:29.255321 22847 raft_consensus.cc:2749] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:29.287814 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.289731 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbf8c75a86f64f6cb1dd8780d0365f85" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.290001 22867 raft_consensus.cc:2749] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:29.274354 22822 raft_consensus.cc:2749] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:29.278643 14867 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.284189 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:29.272540 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:29.298662 14867 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:29.299341 14867 leader_election.cc:336] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.299862 14867 leader_election.cc:304] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.268635 22812 raft_consensus.cc:2749] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:29.296067 14344 consensus_peers.cc:597] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:29.295120 14900 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 21.
W20260709 13:21:29.302526 14344 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.303009 14344 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:29.302022 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 72252.2us
W20260709 13:21:29.308130 14344 leader_election.cc:336] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.308775 14344 leader_election.cc:304] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
W20260709 13:21:29.305850 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:29.263172 22844 raft_consensus.cc:515] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:29.310864 14344 leader_election.cc:336] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.316185 14344 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.301293 22873 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:29.317919 14373 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
I20260709 13:21:29.319124 22844 leader_election.cc:290] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:29.319914 14867 leader_election.cc:336] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.320914 14867 leader_election.cc:304] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.306962 22866 raft_consensus.cc:2749] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:29.310245 22801 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:29.322865 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 88072.5us
W20260709 13:21:29.324527 14867 leader_election.cc:336] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.315510 22826 raft_consensus.cc:2749] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:29.327050 14867 leader_election.cc:336] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.327564 14867 leader_election.cc:336] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.328037 14867 leader_election.cc:336] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.328413 14867 leader_election.cc:304] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.316071 22776 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:29.334327 22776 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:29.338621 14867 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.339162 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.340098 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:29.340703 14301 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:29.340951 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
W20260709 13:21:29.346987 14867 leader_election.cc:336] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.347517 14867 leader_election.cc:336] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.347950 14867 leader_election.cc:336] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.348356 14867 leader_election.cc:336] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.348748 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:29.348811 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:29.349380 14895 raft_consensus.cc:3060] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:21:29.348724 14867 leader_election.cc:304] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.357481 22868 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.358505 22864 raft_consensus.cc:2749] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.360930 22862 raft_consensus.cc:2749] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:29.380003 14895 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:21:29.330438 22873 raft_consensus.cc:2749] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:29.382954 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.385294 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:29.385700 14270 leader_election.cc:336] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.386245 14270 leader_election.cc:304] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:29.387189 14270 leader_election.cc:336] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.345860 22839 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:29.388007 14369 raft_consensus.cc:3060] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:29.389156 22839 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:29.391036 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:29.394939 22847 raft_consensus.cc:2749] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:29.324338 22884 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:29.398770 14341 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d; no voters: 
I20260709 13:21:29.401966 22884 raft_consensus.cc:2804] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:29.402245 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb8ce7d4df824e4e9d0842d3d4d65698" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.402549 22884 raft_consensus.cc:697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Becoming Leader. State: Replica: 181bbac22422408c87cd13b7fe3008f9, State: Running, Role: LEADER
I20260709 13:21:29.387605 14270 leader_election.cc:304] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.403406 22884 consensus_queue.cc:237] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:29.403949 14270 leader_election.cc:336] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.404492 14270 leader_election.cc:336] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.404985 14270 leader_election.cc:336] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.406062 22851 raft_consensus.cc:2749] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:29.405403 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b663177bbd4fbdbe452c58cdba8307" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.409372 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487d8e21fe1a4de4a365bd3c1f91947b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.411386 14369 raft_consensus.cc:2468] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 26.
W20260709 13:21:29.415177 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:29.415493 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:29.418087 14267 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:29.419210 22847 raft_consensus.cc:2804] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:21:29.419735 22847 raft_consensus.cc:697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 26 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:29.420773 22847 consensus_queue.cc:237] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:29.428033 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:29.429320 14899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf37326f616a4b18aaaa6c2c405074bf" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.429639 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93ab0fd97734540911af5bd148751d5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.430271 14896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439318510aaf4073b4ca2996d73b9d8e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.430014 14898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.429941 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:29.431867 14897 raft_consensus.cc:3060] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:29.441731 14301 raft_consensus.cc:2468] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181bbac22422408c87cd13b7fe3008f9 in term 20.
I20260709 13:21:29.432538 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf13dfd8a7f54be7b9ae796572d0961b" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.452864 14894 raft_consensus.cc:2393] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bee4f7fc1b4740dc875537c79309664f in current term 20: Already voted for candidate 181bbac22422408c87cd13b7fe3008f9 in this term.
W20260709 13:21:29.433928 14270 consensus_peers.cc:597] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:29.454161 14270 leader_election.cc:336] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.454690 14270 leader_election.cc:336] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:29.455152 14270 leader_election.cc:336] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.455551 14270 leader_election.cc:304] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.457861 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e025a69a5c42f3be03aeed0ac9a998" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:29.458130 14270 leader_election.cc:336] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.458575 14270 leader_election.cc:304] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.459256 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:29.467063 14867 leader_election.cc:336] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.467279 22867 raft_consensus.cc:2749] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:29.467775 14867 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
W20260709 13:21:29.468461 14270 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:29.468961 14270 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:29.471144 14901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80782a117e14a308698329b8639179e" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.472265 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac406834d504a57b52386e2ae4c5235" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:29.474114 14377 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:21:29.465263 22875 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:29.469684 22822 raft_consensus.cc:2749] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.477895 14897 raft_consensus.cc:2468] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:21:29.477353 14342 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.482715 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:29.470018 22849 raft_consensus.cc:2749] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:29.479883 22864 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:29.491720 14900 raft_consensus.cc:2368] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 25. Current term is 26.
I20260709 13:21:29.493836 22875 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 election: Requested vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:29.494060 22886 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:21:29.498869 22890 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:29.505834 14371 raft_consensus.cc:1240] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Rejecting Update request from peer bee4f7fc1b4740dc875537c79309664f for earlier term 22. Current term is 23. Ops: []
I20260709 13:21:29.507539 22847 consensus_queue.cc:1059] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:29.508800 22867 raft_consensus.cc:3055] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:29.509174 22867 raft_consensus.cc:740] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:29.510402 14373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:29.511193 14373 raft_consensus.cc:2393] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate cebb34ac155340899a38c728707ddc0d in current term 26: Already voted for candidate bee4f7fc1b4740dc875537c79309664f in this term.
I20260709 13:21:29.510063 22867 consensus_queue.cc:260] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:29.513391 22867 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:29.514619 14341 leader_election.cc:400] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 25. Current term is 26.
I20260709 13:21:29.515002 14341 leader_election.cc:403] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:21:29.518070 22801 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137) with higher term. Message: Invalid argument: T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 181bbac22422408c87cd13b7fe3008f9 for earlier term 25. Current term is 26.
I20260709 13:21:29.524174 14865 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.525197 22869 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:29.526328 14121 catalog_manager.cc:5697] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "181bbac22422408c87cd13b7fe3008f9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.525424 14865 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.543047 22831 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.545073 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.548350 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.552242 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.551101 22831 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:29.561231 14865 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.565600 14865 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.559765 22869 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:29.570885 22831 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:29.561487 22873 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:29.583297 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:29.598179 22875 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:29.599970 14865 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.609648 22873 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:29.610852 14865 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.615067 14865 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.615774 22873 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:29.617147 14865 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.618089 22831 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.616703 22875 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:29.631449 14344 consensus_peers.cc:597] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:29.632225 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.633170 22873 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:29.634845 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.635670 22873 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:29.637188 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.638080 22873 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.640672 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.641538 22873 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:29.643692 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.644481 22873 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:29.645845 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.646602 22873 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:29.652616 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1054f387364ae4b11260c5ab742790" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
I20260709 13:21:29.655133 14267 leader_election.cc:304] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.662089 22867 raft_consensus.cc:2749] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:29.712455 13122 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 14250)
I20260709 13:21:29.722419 14267 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.723977 22867 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:29.727093 14267 leader_election.cc:304] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.728299 22867 raft_consensus.cc:2749] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.734459 14267 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.712481 14120 catalog_manager.cc:5697] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 24 to 26, leader changed from cebb34ac155340899a38c728707ddc0d (127.12.208.132) to bee4f7fc1b4740dc875537c79309664f (127.12.208.130). New cstate: current_term: 26 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.735709 22867 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:29.752393 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:29.783635 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:29.816906 14267 leader_election.cc:304] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.817857 22822 raft_consensus.cc:2749] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:29.844376 14900 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:21:29.849957 22826 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:29.851476 14267 leader_election.cc:304] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.857429 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f"
I20260709 13:21:29.871764 22822 raft_consensus.cc:2749] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:29.899803 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:29.902107 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 50710.8us
I20260709 13:21:29.902969 14267 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.903793 22867 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:29.907975 14267 leader_election.cc:304] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.912842 22822 raft_consensus.cc:2749] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:29.914793 14267 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.916994 22822 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:29.918486 14267 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.920487 22822 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.925040 14267 leader_election.cc:304] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.927166 22822 raft_consensus.cc:2749] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:29.940310 14897 raft_consensus.cc:1275] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:21:29.958690 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:29.968861 22873 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:21:29.963477 14267 leader_election.cc:304] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.969764 22822 raft_consensus.cc:2749] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:29.976128 14267 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: 181bbac22422408c87cd13b7fe3008f9, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:29.982455 14301 raft_consensus.cc:1275] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Refusing update from remote peer 181bbac22422408c87cd13b7fe3008f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:21:29.988258 22773 consensus_queue.cc:1048] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:30.007444 22822 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:21:30.022166 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 47747.9us
I20260709 13:21:30.030478 14267 leader_election.cc:304] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:30.037998 22822 raft_consensus.cc:2749] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:30.039651 14267 leader_election.cc:304] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:30.048873 22822 raft_consensus.cc:2749] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:30.051992 22822 consensus_queue.cc:1048] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:30.074414 14369 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:21:30.079087 14894 raft_consensus.cc:1275] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260709 13:21:30.134392 14270 consensus_peers.cc:597] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:30.188678 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:30.193274 22867 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:21:30.217401 22867 consensus_queue.cc:1048] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:21:30.269301 14270 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.296135 14867 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.342422 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:30.410950 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:30.424445 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:30.424942 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:30.535502 14344 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.591701 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:30.662773 14867 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.713006 13122 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:30.716493 14867 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.777107 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:30.784655 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:30.792692 14344 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.912459 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:30.975252 14344 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:30.998646 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.023897 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.120692 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:31.276433 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:31.308892 22822 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.309561 22822 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:31.311666 22822 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:31.322779 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:31.323428 14897 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 22.
I20260709 13:21:31.325801 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
I20260709 13:21:31.326402 14371 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 23.
W20260709 13:21:31.350234 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:31.358705 14867 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:31.344065 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:31.371052 22822 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:31.372941 22822 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.375274 22822 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:31.437446 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 55457.6us
W20260709 13:21:31.445099 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:31.495347 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:31.498412 22822 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:31.504681 14371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9"
I20260709 13:21:31.505358 14371 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:31.523064 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f286c75a82eb4a2284617cd66deff360" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d"
I20260709 13:21:31.523890 14894 raft_consensus.cc:3060] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:21:31.513913 14371 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 24.
I20260709 13:21:31.532775 14894 raft_consensus.cc:2468] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee4f7fc1b4740dc875537c79309664f in term 24.
I20260709 13:21:31.533768 14267 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f; no voters: 
I20260709 13:21:31.539232 22905 raft_consensus.cc:2804] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:31.539799 22905 raft_consensus.cc:697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 24 LEADER]: Becoming Leader. State: Replica: bee4f7fc1b4740dc875537c79309664f, State: Running, Role: LEADER
I20260709 13:21:31.540712 22905 consensus_queue.cc:237] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:31.548372 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:31.534364 22822 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 election: Requested vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:31.536482 14270 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:31.604802 14270 consensus_peers.cc:597] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:31.623864 14120 catalog_manager.cc:5697] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "bee4f7fc1b4740dc875537c79309664f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:31.679561 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.713493 13122 thread.cc:527] Waited for 21000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:31.728927 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:31.729662 14344 consensus_peers.cc:597] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:31.759035 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.781991 14270 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:31.833263 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.903708 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.941354 14270 consensus_peers.cc:597] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:31.970113 14894 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:21:31.971932 22822 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:21:31.976270 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:31.991514 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:31.994481 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:32.064397 14371 raft_consensus.cc:1275] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Refusing update from remote peer bee4f7fc1b4740dc875537c79309664f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:21:32.071761 22905 consensus_queue.cc:1048] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [LEADER]: Connected to new peer: Peer: permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:21:32.240525 14867 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:32.278395 14867 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111) [suppressed 348 similar messages]
W20260709 13:21:32.284583 14270 consensus_peers.cc:597] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:32.294211 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:32.340865 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.429888 14344 consensus_peers.cc:597] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:32.436199 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:32.476348 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:32.568529 14867 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:32.684527 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:32.711050 14270 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:32.714049 13122 thread.cc:527] Waited for 22000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:32.740206 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:32.779911 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:32.889243 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:33.232206 14344 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:33.236675 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:33.233111 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:33.233772 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:33.243422 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:33.358430 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:33.361960 14344 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:33.463006 14867 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:33.492961 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:33.580570 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:33.607825 14867 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:33.714663 13122 thread.cc:527] Waited for 23000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:33.806295 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:33.818109 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:33.865396 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 77980.3us
W20260709 13:21:33.955928 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:34.028409 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:34.034243 14344 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:34.049161 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:34.062820 14270 consensus_peers.cc:597] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:34.065091 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:34.114630 14399 debug-util.cc:398] Leaking SignalData structure 0x7b080015b020 after lost signal to thread 13125
W20260709 13:21:34.116092 14399 debug-util.cc:398] Leaking SignalData structure 0x7b080037d600 after lost signal to thread 14161
W20260709 13:21:34.117718 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08003510c0 after lost signal to thread 14328
W20260709 13:21:34.128691 14399 debug-util.cc:398] Leaking SignalData structure 0x7b080029a600 after lost signal to thread 14402
W20260709 13:21:34.136991 14399 debug-util.cc:398] Leaking SignalData structure 0x7b0800193860 after lost signal to thread 14925
W20260709 13:21:34.141081 14399 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7920 after lost signal to thread 22919
W20260709 13:21:34.155105 14867 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:34.200124 14344 consensus_peers.cc:597] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:34.225625 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:34.227818 14270 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:34.229336 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:34.397045 14114 catalog_manager.cc:4755] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78b3fe008c45425b8fd1c2bac8020950: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:34.439826 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:34.441191 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:34.444135 14270 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:34.499639 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:34.587873 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:34.715158 13122 thread.cc:527] Waited for 24000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:34.719324 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:34.759740 14867 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:34.648623 14270 consensus_peers.cc:597] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:34.766741 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 118179us
W20260709 13:21:34.788226 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:34.795020 14344 consensus_peers.cc:597] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:34.938808 14270 consensus_peers.cc:597] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:34.944854 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:34.957695 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:35.047701 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:35.078953 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:35.155226 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:35.206795 14270 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:35.301651 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:35.354177 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:35.366504 14864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:41203, user_credentials={real_user=slave}} blocked reactor thread for 95382.2us
W20260709 13:21:35.400955 14867 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:35.420538 14341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 45073.4us
W20260709 13:21:35.441354 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:35.449482 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 77905.1us
W20260709 13:21:35.472605 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:35.555553 14344 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:35.717159 13122 thread.cc:527] Waited for 25000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:35.826713 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 117885us
W20260709 13:21:35.817556 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 108940us
W20260709 13:21:36.061807 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:36.064427 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:36.065716 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:36.058951 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:36.081377 14344 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:36.091225 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:36.137310 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:36.198499 14867 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:36.382192 14867 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:36.399066 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:36.510080 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:36.543095 14270 consensus_peers.cc:597] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:36.545397 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:36.556767 14867 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:36.622202 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:36.624233 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:36.691397 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:36.703248 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:36.764556 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:36.788249 14344 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:36.866714 14344 consensus_peers.cc:597] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:36.961424 13122 thread.cc:527] Waited for 26000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:36.980621 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:37.029155 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 48591.4us
W20260709 13:21:37.018888 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:37.094790 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:37.157866 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:37.173130 14270 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:37.245350 14270 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:37.279386 14344 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111) [suppressed 433 similar messages]
W20260709 13:21:37.290009 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:33137, user_credentials={real_user=slave}} blocked reactor thread for 57325.7us
W20260709 13:21:37.283231 14270 consensus_peers.cc:597] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:37.314905 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:37.325498 14344 consensus_peers.cc:597] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:37.417179 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:37.482573 14270 consensus_peers.cc:597] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:37.591033 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:37.693638 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:37.720990 14270 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:37.732725 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:37.796105 14867 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:37.743418 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:37.811594 14344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 68220.6us
W20260709 13:21:37.910979 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:37.927229 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:37.961969 13122 thread.cc:527] Waited for 27000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:37.991578 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:38.090373 14867 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:38.112208 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:38.156497 14344 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:38.335019 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:38.402872 14344 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:38.423293 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:38.551702 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:38.562410 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:38.582901 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:38.680264 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:38.683173 14867 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:38.775866 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:38.851482 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:38.917325 14867 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:38.931659 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:38.957672 14270 consensus_peers.cc:597] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:38.962473 13122 thread.cc:527] Waited for 28000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:38.992272 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:38.993157 14867 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:39.000653 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:39.091663 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:39.119772 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:39.131959 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:39.332650 14344 consensus_peers.cc:597] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:39.387737 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:39.391793 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:39.406453 14344 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:39.964926 13122 thread.cc:527] Waited for 29000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:40.401402 14267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.003s	sys 0.006s
W20260709 13:21:40.402114 14267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.003s	sys 0.006s
W20260709 13:21:40.497576 14270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.008s	sys 0.017s
W20260709 13:21:40.497987 14270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.008s	sys 0.017s
W20260709 13:21:40.604561 14270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 45599.6us
I20260709 13:21:40.670936 22951 raft_consensus.cc:493] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cebb34ac155340899a38c728707ddc0d)
I20260709 13:21:40.671885 22951 raft_consensus.cc:515] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:40.675274 22951 leader_election.cc:290] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
W20260709 13:21:40.681041 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:40.681905 14865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 72996.7us
W20260709 13:21:40.686389 14270 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:40.687062 14270 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:40.685041 14900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18418e3cab2e42b1a301f8068587c987" candidate_uuid: "bee4f7fc1b4740dc875537c79309664f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:40.727708 22962 raft_consensus.cc:493] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
W20260709 13:21:40.728555 14270 leader_election.cc:336] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:40.728447 22962 raft_consensus.cc:515] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:40.729082 14270 leader_election.cc:304] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee4f7fc1b4740dc875537c79309664f; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:40.731498 22962 leader_election.cc:290] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:40.732337 14303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bee4f7fc1b4740dc875537c79309664f" is_pre_election: true
W20260709 13:21:40.744923 14270 consensus_peers.cc:597] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:40.744259 22822 raft_consensus.cc:2749] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:40.758754 14867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:38445, user_credentials={real_user=slave}} blocked reactor thread for 54376.3us
I20260709 13:21:40.791841 14369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3fe008c45425b8fd1c2bac8020950" candidate_uuid: "cebb34ac155340899a38c728707ddc0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "181bbac22422408c87cd13b7fe3008f9" is_pre_election: true
W20260709 13:21:40.793422 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:40.795923 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:40.795848 14864 leader_election.cc:304] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:40.797142 22976 raft_consensus.cc:2749] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:40.800348 14344 consensus_peers.cc:597] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:40.801113 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:40.801684 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:40.803282 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:40.810338 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:40.811658 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:40.811687 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:21:40.814098 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:21:40.826189 14325 debug-util.cc:398] Leaking SignalData structure 0x7b0800423820 after lost signal to thread 13125
W20260709 13:21:40.827446 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08003eae20 after lost signal to thread 14161
W20260709 13:21:40.828823 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa920 after lost signal to thread 14328
W20260709 13:21:40.830018 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08000cf9e0 after lost signal to thread 14402
W20260709 13:21:40.831530 14325 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe660 after lost signal to thread 14925
W20260709 13:21:40.885043 14270 consensus_peers.cc:597] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:40.965764 13122 thread.cc:527] Waited for 30000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:41.005949 14270 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:41.045210 14344 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:41.079138 14867 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:41.089536 14867 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:41.151232 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:41.155411 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:41.374454 14270 consensus_peers.cc:597] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:41.430749 14270 consensus_peers.cc:597] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:41.640599 14344 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:41.695873 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:41.726315 14270 consensus_peers.cc:597] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:41.874807 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:41.902510 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:41.903065 14867 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:41.905011 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:41.914268 14867 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:41.942800 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:41.966311 13122 thread.cc:527] Waited for 31000ms trying to join with diag-logger (tid 14250)
W20260709 13:21:41.997822 14270 consensus_peers.cc:597] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:42.005046 14270 consensus_peers.cc:597] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:42.016352 14270 consensus_peers.cc:597] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:42.088617 14867 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:42.105477 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:42.121249 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:42.140487 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:21:42.245141 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:21:42.256269 14270 consensus_peers.cc:597] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:42.354686 14270 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111) [suppressed 392 similar messages]
W20260709 13:21:42.411875 14344 consensus_peers.cc:597] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:42.542867 14270 consensus_peers.cc:597] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:42.604423 14270 consensus_peers.cc:597] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:42.677608 14344 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:42.687466 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:42.745689 14270 consensus_peers.cc:597] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:42.899405 14344 consensus_peers.cc:597] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:42.919517 14270 consensus_peers.cc:597] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:43.016108 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:43.034865 14270 consensus_peers.cc:597] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:43.066524 14344 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:43.133317 14344 consensus_peers.cc:597] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:43.156864 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:21:43.242563 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:43.298071 14344 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:21:43.335740 13122 tablet_server.cc:196] TabletServer@127.12.208.129:0 shutdown complete.
W20260709 13:21:43.396641 14344 consensus_peers.cc:597] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:43.448128 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:21:43.448925 14344 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:21:43.494717 13122 tablet_server.cc:179] TabletServer@127.12.208.130:0 shutting down...
W20260709 13:21:43.508944 14342 consensus_peers.cc:597] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.516153 14867 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:43.536123 14342 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.561106 14270 consensus_peers.cc:597] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:43.561779 14342 consensus_peers.cc:597] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.562752 14342 consensus_peers.cc:597] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.564941 14270 consensus_peers.cc:597] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:43.567081 14342 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.567294 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:43.568401 13122 tablet_replica.cc:333] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.569394 13122 raft_consensus.cc:2243] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.570178 13122 raft_consensus.cc:2272] T 3e1da5440c0e48a6bc637b43fa41215e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.572925 13122 tablet_replica.cc:333] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.573753 13122 raft_consensus.cc:2243] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.574436 13122 raft_consensus.cc:2272] T 6b3646e03a744053ae5fd190c43a27e4 P bee4f7fc1b4740dc875537c79309664f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.577078 13122 tablet_replica.cc:333] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
W20260709 13:21:43.577101 14342 consensus_peers.cc:597] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.577975 13122 raft_consensus.cc:2243] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.578799 13122 raft_consensus.cc:2272] T 43b3afc4354948bea829c90a4536aa96 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:43.581255 14342 consensus_peers.cc:597] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.581732 13122 tablet_replica.cc:333] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.582490 13122 raft_consensus.cc:2243] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.583289 13122 raft_consensus.cc:2272] T 18418e3cab2e42b1a301f8068587c987 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.585606 13122 tablet_replica.cc:333] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.586470 13122 raft_consensus.cc:2243] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.587162 13122 raft_consensus.cc:2272] T 808ea406abb545e0aae5a5ddd3964180 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.590024 13122 tablet_replica.cc:333] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.590621 13122 raft_consensus.cc:2243] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.591612 13122 raft_consensus.cc:2272] T 76a21260793b426d8f662c772b5b2a03 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.594662 13122 tablet_replica.cc:333] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.595498 13122 raft_consensus.cc:2243] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.596426 13122 raft_consensus.cc:2272] T 487d8e21fe1a4de4a365bd3c1f91947b P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.599203 13122 tablet_replica.cc:333] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.600075 13122 raft_consensus.cc:2243] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.600813 13122 raft_consensus.cc:2272] T eb8ce7d4df824e4e9d0842d3d4d65698 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.602928 13122 tablet_replica.cc:333] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.603621 13122 raft_consensus.cc:2243] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.604130 13122 raft_consensus.cc:2272] T 2ac406834d504a57b52386e2ae4c5235 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.605957 13122 tablet_replica.cc:333] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.606598 13122 raft_consensus.cc:2243] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.607021 13122 raft_consensus.cc:2272] T 25d39c5ba6de4fbd8f025024428fbd57 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.609140 13122 tablet_replica.cc:333] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.609957 13122 raft_consensus.cc:2243] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.610706 13122 raft_consensus.cc:2272] T bbf8c75a86f64f6cb1dd8780d0365f85 P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:43.611361 14342 consensus_peers.cc:597] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.612908 13122 tablet_replica.cc:333] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.613534 13122 raft_consensus.cc:2243] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.614308 13122 raft_consensus.cc:2272] T a4e025a69a5c42f3be03aeed0ac9a998 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.616423 13122 tablet_replica.cc:333] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.617213 13122 raft_consensus.cc:2243] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.618610 13122 raft_consensus.cc:2272] T e531770baa044bc49820df7e47c608eb P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.621140 13122 tablet_replica.cc:333] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.621879 13122 raft_consensus.cc:2243] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.622787 13122 raft_consensus.cc:2272] T 402f68d4d3464bffb55e8bd010ec0133 P bee4f7fc1b4740dc875537c79309664f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.625458 13122 tablet_replica.cc:333] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.626367 13122 raft_consensus.cc:2243] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.627430 13122 raft_consensus.cc:2272] T fa1054f387364ae4b11260c5ab742790 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:43.628357 14270 consensus_peers.cc:597] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:43.630103 13122 tablet_replica.cc:333] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.631011 13122 raft_consensus.cc:2243] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.632181 13122 raft_consensus.cc:2272] T 2359e4575c5b49208e2395d3f12a7da9 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.634836 13122 tablet_replica.cc:333] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.635597 13122 raft_consensus.cc:2243] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.636415 13122 raft_consensus.cc:2272] T cf37326f616a4b18aaaa6c2c405074bf P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.639263 13122 tablet_replica.cc:333] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.640188 13122 raft_consensus.cc:2243] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.641384 13122 raft_consensus.cc:2272] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P bee4f7fc1b4740dc875537c79309664f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.644026 13122 tablet_replica.cc:333] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.644797 13122 raft_consensus.cc:2243] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.646046 13122 raft_consensus.cc:2272] T 2582e91d201c4063b3eff5158b611448 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.648826 13122 tablet_replica.cc:333] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.649587 13122 raft_consensus.cc:2243] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:21:43.650822 14344 consensus_peers.cc:597] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:43.651062 13122 raft_consensus.cc:2272] T 99c124265b9c42a5a1adf047554812b4 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.653913 13122 tablet_replica.cc:333] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.654680 13122 raft_consensus.cc:2243] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.655419 13122 raft_consensus.cc:2272] T 2b16e1f580c44c1f984f63473c6a267d P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.657986 13122 tablet_replica.cc:333] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.658725 13122 raft_consensus.cc:2243] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.659432 13122 raft_consensus.cc:2272] T 46b663177bbd4fbdbe452c58cdba8307 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.662159 13122 tablet_replica.cc:333] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.662978 13122 raft_consensus.cc:2243] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.664232 13122 raft_consensus.cc:2272] T d8db981b8c9a4369a9fa90b9ecf4c80c P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.667454 13122 tablet_replica.cc:333] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.668776 13122 raft_consensus.cc:2243] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.669432 13122 raft_consensus.cc:2272] T f80782a117e14a308698329b8639179e P bee4f7fc1b4740dc875537c79309664f [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:43.670459 14342 consensus_peers.cc:597] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.671983 13122 tablet_replica.cc:333] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
W20260709 13:21:43.672447 14865 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.672834 13122 raft_consensus.cc:2243] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.673898 13122 raft_consensus.cc:2272] T ebe53e62fb464cccbd45d08ede5b5c4e P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.676677 13122 tablet_replica.cc:333] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.677465 13122 raft_consensus.cc:2243] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.678617 13122 raft_consensus.cc:2272] T 42c37f8aa458494687312360eddb12a9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.681541 13122 tablet_replica.cc:333] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.682415 13122 raft_consensus.cc:2243] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.683127 13122 raft_consensus.cc:2272] T c93ab0fd97734540911af5bd148751d5 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:43.683223 14344 consensus_peers.cc:597] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:21:43.685941 13122 tablet_replica.cc:333] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.686710 13122 raft_consensus.cc:2243] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.687815 13122 raft_consensus.cc:2272] T 475079f88bce40fea814453c8c4bfaac P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.690567 13122 tablet_replica.cc:333] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.691408 13122 raft_consensus.cc:2243] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.692049 13122 raft_consensus.cc:2272] T a24d1f6f6adb4246b65902328e51dfdf P bee4f7fc1b4740dc875537c79309664f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.694721 13122 tablet_replica.cc:333] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.695541 13122 raft_consensus.cc:2243] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.696744 13122 raft_consensus.cc:2272] T 8c137013238f4b1dbae260e32cb316dc P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.699498 13122 tablet_replica.cc:333] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.700301 13122 raft_consensus.cc:2243] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.701351 13122 raft_consensus.cc:2272] T e8fbf1e78cfb4a15820b9812967ec58c P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.703951 13122 tablet_replica.cc:333] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.704648 13122 raft_consensus.cc:2243] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.705721 13122 raft_consensus.cc:2272] T 65fa0102e1144f94a57015823294e331 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.708241 13122 tablet_replica.cc:333] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.708984 13122 raft_consensus.cc:2243] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:43.709858 14865 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.709980 13122 raft_consensus.cc:2272] T 439318510aaf4073b4ca2996d73b9d8e P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.712790 13122 tablet_replica.cc:333] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.713591 13122 raft_consensus.cc:2243] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.714368 13122 raft_consensus.cc:2272] T 87ac8217d9b74cd1a2ee70c8667d998a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.716961 13122 tablet_replica.cc:333] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.717725 13122 raft_consensus.cc:2243] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.718297 13122 raft_consensus.cc:2272] T 37975f772fc648329a8acae36d33a345 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.720813 13122 tablet_replica.cc:333] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
W20260709 13:21:43.721506 14342 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.721634 13122 raft_consensus.cc:2243] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.722416 13122 raft_consensus.cc:2272] T cab4884dfe6c4e24a9430e2449523d61 P bee4f7fc1b4740dc875537c79309664f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.724925 13122 tablet_replica.cc:333] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.725642 13122 raft_consensus.cc:2243] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.727541 13122 raft_consensus.cc:2272] T ede0d59e482a4cff952455ca90001863 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.730173 13122 tablet_replica.cc:333] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.730929 13122 raft_consensus.cc:2243] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.731637 13122 raft_consensus.cc:2272] T 08fd6b58648f4a6ca27b84f4fd829df9 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.734226 13122 tablet_replica.cc:333] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.734903 13122 raft_consensus.cc:2243] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.735916 13122 raft_consensus.cc:2272] T c38fd596811644f8b5ab0c134b279676 P bee4f7fc1b4740dc875537c79309664f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.738574 13122 tablet_replica.cc:333] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.739281 13122 raft_consensus.cc:2243] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.740240 13122 raft_consensus.cc:2272] T 78b3fe008c45425b8fd1c2bac8020950 P bee4f7fc1b4740dc875537c79309664f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.742719 13122 tablet_replica.cc:333] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.743425 13122 raft_consensus.cc:2243] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.744673 13122 raft_consensus.cc:2272] T b03bb64d471f488094a4e3dd7d934b67 P bee4f7fc1b4740dc875537c79309664f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.747392 13122 tablet_replica.cc:333] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
W20260709 13:21:43.747954 14342 consensus_peers.cc:597] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.748134 13122 raft_consensus.cc:2243] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.749332 13122 raft_consensus.cc:2272] T a1479f9f47ee4f9984bc3dae70e66f3a P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.752125 13122 tablet_replica.cc:333] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.752799 13122 raft_consensus.cc:2243] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.753930 13122 raft_consensus.cc:2272] T bddcf0184f1049499e0383b72e34ef74 P bee4f7fc1b4740dc875537c79309664f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.756320 13122 tablet_replica.cc:333] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.756958 13122 raft_consensus.cc:2243] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.758318 13122 raft_consensus.cc:2272] T 0694154dd8ad41ad93089be880f2e363 P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.760923 13122 tablet_replica.cc:333] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.761595 13122 raft_consensus.cc:2243] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.762679 13122 raft_consensus.cc:2272] T f286c75a82eb4a2284617cd66deff360 P bee4f7fc1b4740dc875537c79309664f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.765240 13122 tablet_replica.cc:333] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.765952 13122 raft_consensus.cc:2243] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.767241 13122 raft_consensus.cc:2272] T cde980445ec54bac8c99f8e77669bffa P bee4f7fc1b4740dc875537c79309664f [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:43.768165 14342 consensus_peers.cc:597] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.770190 13122 tablet_replica.cc:333] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f: stopping tablet replica
I20260709 13:21:43.770888 13122 raft_consensus.cc:2243] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.771705 13122 raft_consensus.cc:2272] T bf13dfd8a7f54be7b9ae796572d0961b P bee4f7fc1b4740dc875537c79309664f [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:43.789502 14865 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.811102 14342 consensus_peers.cc:597] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.816871 14342 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.838470 14342 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.848634 14342 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.852139 14342 consensus_peers.cc:597] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.862808 14342 consensus_peers.cc:597] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.871146 14867 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:43.879814 14342 consensus_peers.cc:597] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.986294 14865 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.994551 14865 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.000061 14865 consensus_peers.cc:597] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.036535 14342 consensus_peers.cc:597] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.056180 14865 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.061939 14344 consensus_peers.cc:597] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:44.153313 14344 consensus_peers.cc:597] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:21:44.299340 14867 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:21:44.312211 14867 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:21:44.322587 14867 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:44.339190 14867 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:44.407395 14867 consensus_peers.cc:597] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:44.488306 14344 consensus_peers.cc:597] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:21:44.494122 14344 consensus_peers.cc:597] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:44.544415 22974 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.545042 22974 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.550104 22974 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:44.557041 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a21260793b426d8f662c772b5b2a03" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:44.564838 14342 leader_election.cc:336] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.566460 14342 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:44.567744 22974 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:44.602021 14344 consensus_peers.cc:597] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:21:44.607602 13122 tablet_server.cc:196] TabletServer@127.12.208.130:0 shutdown complete.
I20260709 13:21:44.613373 22974 raft_consensus.cc:493] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.614205 22974 raft_consensus.cc:515] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:44.621976 14344 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:44.623476 22974 leader_election.cc:290] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:44.640213 14342 leader_election.cc:336] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.642815 14342 leader_election.cc:304] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.644315 22974 raft_consensus.cc:2749] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:44.651618 14344 consensus_peers.cc:597] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:21:44.717866 22974 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.718636 22974 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.722184 22974 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:44.723040 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f2fbd6ece74e2fa8bbfcc96a1f45b5" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:44.732748 14342 leader_election.cc:336] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.733235 14342 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:44.733651 22974 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:21:44.734139 14344 consensus_peers.cc:597] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:21:44.737532 22974 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.738370 22975 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:44.740537 22974 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:44.742218 14897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db981b8c9a4369a9fa90b9ecf4c80c" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:44.744381 13122 tablet_server.cc:179] TabletServer@127.12.208.131:0 shutting down...
W20260709 13:21:44.752667 14342 leader_election.cc:336] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.753193 14342 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:44.753885 22974 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:44.778398 22974 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.779063 22974 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.782491 22975 raft_consensus.cc:493] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.783088 22975 raft_consensus.cc:515] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:44.784096 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fa0102e1144f94a57015823294e331" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
I20260709 13:21:44.785331 22977 raft_consensus.cc:493] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.785509 22975 leader_election.cc:290] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:44.785972 22977 raft_consensus.cc:515] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:44.792987 14344 leader_election.cc:336] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:44.794803 22993 raft_consensus.cc:493] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.798516 22993 raft_consensus.cc:515] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.799362 22992 raft_consensus.cc:493] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.799937 22992 raft_consensus.cc:515] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.801177 22993 leader_election.cc:290] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:44.797808 14865 leader_election.cc:336] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.802196 22992 leader_election.cc:290] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:44.794553 22977 leader_election.cc:290] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:44.804142 22977 raft_consensus.cc:493] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.807710 22974 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:44.806627 22977 raft_consensus.cc:515] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:44.810747 14342 leader_election.cc:336] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.811599 14341 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: bee4f7fc1b4740dc875537c79309664f, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:44.812397 22975 raft_consensus.cc:493] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.812949 22975 raft_consensus.cc:515] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:44.813405 22977 leader_election.cc:290] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:44.814232 22977 raft_consensus.cc:493] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:21:44.814744 14867 leader_election.cc:336] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:44.815333 14867 leader_election.cc:336] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:44.818720 22991 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:44.819602 14865 leader_election.cc:336] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.820078 14865 leader_election.cc:304] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.822746 22975 leader_election.cc:290] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:44.824388 14867 leader_election.cc:336] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:44.825239 22992 raft_consensus.cc:2749] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:44.826041 22992 raft_consensus.cc:493] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.826520 22992 raft_consensus.cc:515] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.828002 22993 raft_consensus.cc:493] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.828717 22992 leader_election.cc:290] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:44.828573 22993 raft_consensus.cc:515] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:44.829604 14865 leader_election.cc:336] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.830108 14865 leader_election.cc:304] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.831351 22993 leader_election.cc:290] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:44.831960 22993 raft_consensus.cc:2749] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:44.836721 14864 leader_election.cc:336] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:44.837288 14864 leader_election.cc:304] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.814800 22977 raft_consensus.cc:515] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.840161 22993 raft_consensus.cc:2749] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:44.840368 22977 leader_election.cc:290] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:44.840827 22975 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.841409 22975 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.842656 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:44.845065 13122 tablet_replica.cc:333] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.845602 22991 raft_consensus.cc:493] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:21:44.845907 14344 leader_election.cc:336] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:44.846145 22991 raft_consensus.cc:515] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
W20260709 13:21:44.847743 14342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:44127, user_credentials={real_user=slave}} blocked reactor thread for 53381.9us
I20260709 13:21:44.848285 22991 leader_election.cc:290] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
W20260709 13:21:44.848342 14865 leader_election.cc:336] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.848945 14865 leader_election.cc:304] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.850961 22993 raft_consensus.cc:2749] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:44.853688 13122 raft_consensus.cc:2243] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.855530 22975 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), cebb34ac155340899a38c728707ddc0d (127.12.208.132:33137)
I20260709 13:21:44.856210 13122 raft_consensus.cc:2272] T 3e1da5440c0e48a6bc637b43fa41215e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.857070 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e531770baa044bc49820df7e47c608eb" candidate_uuid: "181bbac22422408c87cd13b7fe3008f9" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cebb34ac155340899a38c728707ddc0d" is_pre_election: true
W20260709 13:21:44.857645 14864 leader_election.cc:336] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:44.858955 14344 leader_election.cc:336] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:44.859083 14867 leader_election.cc:336] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:44.859750 14867 leader_election.cc:336] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:44.860394 14865 leader_election.cc:336] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.860863 14865 leader_election.cc:304] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:44.861769 14865 leader_election.cc:336] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.861632 13122 tablet_replica.cc:333] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.863974 22993 raft_consensus.cc:2749] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:44.864686 13122 raft_consensus.cc:2243] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.865870 13122 raft_consensus.cc:2272] T 6b3646e03a744053ae5fd190c43a27e4 P 181bbac22422408c87cd13b7fe3008f9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:44.867811 14344 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:44.862237 14865 leader_election.cc:304] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.868906 13122 tablet_replica.cc:333] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.868914 22993 raft_consensus.cc:2749] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:44.870951 22991 raft_consensus.cc:493] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.871491 22991 raft_consensus.cc:515] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:44.872768 13122 raft_consensus.cc:2243] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:44.873772 13122 raft_consensus.cc:2272] T a7157daf9a3647f4af1d12bf4530f984 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.874400 22991 leader_election.cc:290] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:44.875115 14341 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, cebb34ac155340899a38c728707ddc0d
I20260709 13:21:44.877238 22991 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:44.876322 14865 leader_election.cc:336] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.877800 14865 leader_election.cc:304] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.880844 22993 raft_consensus.cc:493] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
W20260709 13:21:44.876457 14342 leader_election.cc:336] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.881779 22992 raft_consensus.cc:2749] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:44.882007 14342 leader_election.cc:304] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.883021 22993 raft_consensus.cc:515] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } attrs { replace: true } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.884831 22991 raft_consensus.cc:2749] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:44.886063 14344 leader_election.cc:336] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:44.888780 22993 leader_election.cc:290] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:44.880261 13122 tablet_replica.cc:333] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.890110 13122 raft_consensus.cc:2243] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:21:44.891140 14864 consensus_peers.cc:597] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d -> Peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Couldn't send request to peer 181bbac22422408c87cd13b7fe3008f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:44.892153 14342 leader_election.cc:336] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.892609 14342 leader_election.cc:304] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:44.893290 14867 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:44.893771 14865 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.894279 14865 leader_election.cc:304] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
W20260709 13:21:44.894886 14864 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:44.895236 22993 raft_consensus.cc:2749] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:44.896116 13122 raft_consensus.cc:2272] T 43b3afc4354948bea829c90a4536aa96 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.897142 22991 raft_consensus.cc:2749] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:44.897392 14342 leader_election.cc:336] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.897910 14342 leader_election.cc:304] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.899288 22991 raft_consensus.cc:2749] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:44.899849 13122 tablet_replica.cc:333] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.900864 13122 raft_consensus.cc:2243] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:44.901597 13122 raft_consensus.cc:2272] T e674623b78de49129be2dde67c041ef9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:44.904304 14342 leader_election.cc:336] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.904472 13122 tablet_replica.cc:333] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.905464 13122 raft_consensus.cc:2243] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:21:44.905534 14342 leader_election.cc:336] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.906376 14342 leader_election.cc:304] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.906780 13122 raft_consensus.cc:2272] T dd40ac1ac2b5420abcc4468ffaf0c1fe P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.907073 22991 raft_consensus.cc:2749] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:44.911604 13122 tablet_replica.cc:333] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.912578 13122 raft_consensus.cc:2243] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.913651 13122 raft_consensus.cc:2272] T eb8ce7d4df824e4e9d0842d3d4d65698 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.915917 13122 tablet_replica.cc:333] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.916607 13122 raft_consensus.cc:2243] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.917457 13122 raft_consensus.cc:2272] T 808ea406abb545e0aae5a5ddd3964180 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.919539 13122 tablet_replica.cc:333] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.920073 13122 raft_consensus.cc:2243] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:44.920544 13122 raft_consensus.cc:2272] T 76a21260793b426d8f662c772b5b2a03 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.922830 13122 tablet_replica.cc:333] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.923398 13122 raft_consensus.cc:2243] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.924397 13122 raft_consensus.cc:2272] T f235d077faa24a89832f2f8f181b0ef1 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.926689 13122 tablet_replica.cc:333] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.927273 13122 raft_consensus.cc:2243] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.928169 13122 raft_consensus.cc:2272] T 25d39c5ba6de4fbd8f025024428fbd57 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.930359 13122 tablet_replica.cc:333] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.930902 13122 raft_consensus.cc:2243] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:44.931496 13122 raft_consensus.cc:2272] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.932016 22993 raft_consensus.cc:493] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.932600 22993 raft_consensus.cc:515] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.934870 22993 leader_election.cc:290] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:44.935024 13122 tablet_replica.cc:333] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.936106 13122 raft_consensus.cc:2243] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:44.936863 13122 raft_consensus.cc:2272] T f6ebdaafff10446f814e66697ebf67ef P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:44.939443 14867 leader_election.cc:336] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:44.939939 13122 tablet_replica.cc:333] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
W20260709 13:21:44.939970 14865 leader_election.cc:336] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.940649 14865 leader_election.cc:304] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.941072 13122 raft_consensus.cc:2243] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:44.941452 22993 raft_consensus.cc:2749] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:44.941747 13122 raft_consensus.cc:2272] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P 181bbac22422408c87cd13b7fe3008f9 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.944824 13122 tablet_replica.cc:333] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.945672 13122 raft_consensus.cc:2243] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:44.946601 13122 raft_consensus.cc:2272] T e531770baa044bc49820df7e47c608eb P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.946899 22991 raft_consensus.cc:493] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.947384 22991 raft_consensus.cc:515] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } }
I20260709 13:21:44.949337 13122 tablet_replica.cc:333] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.949421 22991 leader_election.cc:290] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:44.950285 13122 raft_consensus.cc:2243] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.952178 13122 raft_consensus.cc:2272] T 402f68d4d3464bffb55e8bd010ec0133 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:44.953291 14344 leader_election.cc:336] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:21:44.954440 14342 leader_election.cc:336] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.954804 14342 leader_election.cc:304] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181bbac22422408c87cd13b7fe3008f9; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.955413 22991 raft_consensus.cc:2749] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:44.955505 22993 raft_consensus.cc:493] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:44.955685 13122 tablet_replica.cc:333] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.956300 22993 raft_consensus.cc:515] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:44.957158 13122 raft_consensus.cc:2243] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.958328 13122 raft_consensus.cc:2272] T cf286f2db09c4718a255c14e95c7e781 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.961318 13122 tablet_replica.cc:333] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.962123 13122 raft_consensus.cc:2243] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:44.962831 13122 raft_consensus.cc:2272] T 2359e4575c5b49208e2395d3f12a7da9 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:44.963845 14867 leader_election.cc:336] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:44.965590 13122 tablet_replica.cc:333] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
W20260709 13:21:44.966305 14865 leader_election.cc:336] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:44.966462 13122 raft_consensus.cc:2243] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.966748 14865 leader_election.cc:304] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: a9b2cf49ceed478480fb0f27ccf55d81, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:44.958220 22993 leader_election.cc:290] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127)
I20260709 13:21:44.967734 13122 raft_consensus.cc:2272] T cf37326f616a4b18aaaa6c2c405074bf P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.967896 22992 raft_consensus.cc:2749] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:44.970589 13122 tablet_replica.cc:333] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.971357 13122 raft_consensus.cc:2243] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.974112 13122 raft_consensus.cc:2272] T fa1054f387364ae4b11260c5ab742790 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.977193 13122 tablet_replica.cc:333] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.977964 13122 raft_consensus.cc:2243] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.979017 13122 raft_consensus.cc:2272] T 46b663177bbd4fbdbe452c58cdba8307 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.981747 13122 tablet_replica.cc:333] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.982574 13122 raft_consensus.cc:2243] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.983714 13122 raft_consensus.cc:2272] T ebe53e62fb464cccbd45d08ede5b5c4e P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.986385 13122 tablet_replica.cc:333] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
W20260709 13:21:44.987149 14867 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:21:44.987156 13122 raft_consensus.cc:2243] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.988651 13122 raft_consensus.cc:2272] T ca72c82f0b3e4842b7c74a63118d3360 P 181bbac22422408c87cd13b7fe3008f9 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.991400 13122 tablet_replica.cc:333] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.992172 13122 raft_consensus.cc:2243] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:44.993248 13122 raft_consensus.cc:2272] T 42c37f8aa458494687312360eddb12a9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:44.996052 13122 tablet_replica.cc:333] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:44.996869 13122 raft_consensus.cc:2243] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:44.998036 13122 raft_consensus.cc:2272] T c93ab0fd97734540911af5bd148751d5 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.000672 13122 tablet_replica.cc:333] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.001499 13122 raft_consensus.cc:2243] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.002800 13122 raft_consensus.cc:2272] T fde6831a789b45549658b2c2146dd650 P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.005812 13122 tablet_replica.cc:333] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.006665 13122 raft_consensus.cc:2243] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.007877 13122 raft_consensus.cc:2272] T bf13dfd8a7f54be7b9ae796572d0961b P 181bbac22422408c87cd13b7fe3008f9 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.007895 14867 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:21:45.010964 13122 tablet_replica.cc:333] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.011828 13122 raft_consensus.cc:2243] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.012985 13122 raft_consensus.cc:2272] T 52ca7fe34f2a4185a741b8aebabd8bfc P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.015980 13122 tablet_replica.cc:333] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.016786 13122 raft_consensus.cc:2243] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.017920 13122 raft_consensus.cc:2272] T 78b3fe008c45425b8fd1c2bac8020950 P 181bbac22422408c87cd13b7fe3008f9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.020659 13122 tablet_replica.cc:333] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.021441 13122 raft_consensus.cc:2243] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.022094 13122 raft_consensus.cc:2272] T c38fd596811644f8b5ab0c134b279676 P 181bbac22422408c87cd13b7fe3008f9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.024852 13122 tablet_replica.cc:333] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.025591 13122 raft_consensus.cc:2243] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.026350 13122 raft_consensus.cc:2272] T 0694154dd8ad41ad93089be880f2e363 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.028437 13122 tablet_replica.cc:333] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.029019 13122 raft_consensus.cc:2243] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.029511 13122 raft_consensus.cc:2272] T 65fa0102e1144f94a57015823294e331 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.031831 13122 tablet_replica.cc:333] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.032503 22992 raft_consensus.cc:493] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:45.032608 13122 raft_consensus.cc:2243] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.033177 22992 raft_consensus.cc:515] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:45.033731 13122 raft_consensus.cc:2272] T 1f44936b303148f4848621766631d925 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.035467 22992 leader_election.cc:290] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:45.036479 14344 consensus_peers.cc:597] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:45.036847 13122 tablet_replica.cc:333] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.037774 13122 raft_consensus.cc:2243] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.038504 13122 raft_consensus.cc:2272] T 98310add35f94d0685fee6cc0aba55a2 P 181bbac22422408c87cd13b7fe3008f9 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.039323 14864 leader_election.cc:336] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:45.041769 13122 tablet_replica.cc:333] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
W20260709 13:21:45.042382 14865 leader_election.cc:336] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:45.042609 13122 raft_consensus.cc:2243] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.042869 14865 leader_election.cc:304] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:45.043653 22992 raft_consensus.cc:2749] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:45.044603 13122 raft_consensus.cc:2272] T 439318510aaf4073b4ca2996d73b9d8e P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.047034 13122 tablet_replica.cc:333] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.047674 13122 raft_consensus.cc:2243] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.048607 13122 raft_consensus.cc:2272] T 87ac8217d9b74cd1a2ee70c8667d998a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.050884 13122 tablet_replica.cc:333] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.051440 13122 raft_consensus.cc:2243] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.052578 13122 raft_consensus.cc:2272] T 37975f772fc648329a8acae36d33a345 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.054699 13122 tablet_replica.cc:333] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.055256 13122 raft_consensus.cc:2243] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.056116 13122 raft_consensus.cc:2272] T cab4884dfe6c4e24a9430e2449523d61 P 181bbac22422408c87cd13b7fe3008f9 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.058426 13122 tablet_replica.cc:333] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.058945 13122 raft_consensus.cc:2243] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.059937 13122 raft_consensus.cc:2272] T 08fd6b58648f4a6ca27b84f4fd829df9 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.062299 13122 tablet_replica.cc:333] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.063030 13122 raft_consensus.cc:2243] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.063614 13122 raft_consensus.cc:2272] T f286c75a82eb4a2284617cd66deff360 P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.066376 13122 tablet_replica.cc:333] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
W20260709 13:21:45.066970 14864 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Couldn't send request to peer 181bbac22422408c87cd13b7fe3008f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:45.067154 13122 raft_consensus.cc:2243] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.067816 13122 raft_consensus.cc:2272] T d8db981b8c9a4369a9fa90b9ecf4c80c P 181bbac22422408c87cd13b7fe3008f9 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.069912 13122 tablet_replica.cc:333] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.070477 13122 raft_consensus.cc:2243] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:45.071424 13122 raft_consensus.cc:2272] T a24d1f6f6adb4246b65902328e51dfdf P 181bbac22422408c87cd13b7fe3008f9 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.073518 13122 tablet_replica.cc:333] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.074136 13122 raft_consensus.cc:2243] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.074654 13122 raft_consensus.cc:2272] T bddcf0184f1049499e0383b72e34ef74 P 181bbac22422408c87cd13b7fe3008f9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.076988 13122 tablet_replica.cc:333] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.077533 13122 raft_consensus.cc:2243] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.078070 13122 raft_consensus.cc:2272] T a1479f9f47ee4f9984bc3dae70e66f3a P 181bbac22422408c87cd13b7fe3008f9 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:45.080176 13122 tablet_replica.cc:333] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9: stopping tablet replica
I20260709 13:21:45.080699 13122 raft_consensus.cc:2243] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:45.081267 13122 raft_consensus.cc:2272] T b03bb64d471f488094a4e3dd7d934b67 P 181bbac22422408c87cd13b7fe3008f9 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:45.102437 14864 consensus_peers.cc:597] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d -> Peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Couldn't send request to peer 181bbac22422408c87cd13b7fe3008f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:45.119910 22993 raft_consensus.cc:493] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:45.120466 22993 raft_consensus.cc:515] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:45.122857 22993 leader_election.cc:290] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:45.130425 14864 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Couldn't send request to peer 181bbac22422408c87cd13b7fe3008f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:45.131134 14864 leader_election.cc:336] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:45.131803 14865 leader_election.cc:336] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:45.132203 14865 leader_election.cc:304] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:45.132925 22993 raft_consensus.cc:2749] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:45.172147 22993 raft_consensus.cc:493] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bee4f7fc1b4740dc875537c79309664f)
I20260709 13:21:45.172705 22993 raft_consensus.cc:515] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:45.179072 22993 leader_election.cc:290] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:45.183174 14865 leader_election.cc:336] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
W20260709 13:21:45.184895 14864 leader_election.cc:336] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
I20260709 13:21:45.185261 14864 leader_election.cc:304] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:45.185904 22993 raft_consensus.cc:2749] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:45.188308 14864 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Couldn't send request to peer 181bbac22422408c87cd13b7fe3008f9. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:45.211156 14864 consensus_peers.cc:597] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d -> Peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Couldn't send request to peer 181bbac22422408c87cd13b7fe3008f9. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:45.701674 14867 consensus_peers.cc:597] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:21:45.702397 14867 consensus_peers.cc:597] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:21:45.759922 14867 consensus_peers.cc:597] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:45.807834 14867 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:21:45.853425 22993 raft_consensus.cc:493] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:45.854017 22993 raft_consensus.cc:515] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:45.856233 22993 leader_election.cc:290] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:45.862084 14864 leader_election.cc:336] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
W20260709 13:21:45.862818 14865 leader_election.cc:336] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:45.863315 14865 leader_election.cc:304] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:45.866168 22993 raft_consensus.cc:2749] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:45.907410 13122 tablet_server.cc:196] TabletServer@127.12.208.131:0 shutdown complete.
I20260709 13:21:45.911319 22993 raft_consensus.cc:493] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:45.911921 22993 raft_consensus.cc:515] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:45.914222 22993 leader_election.cc:290] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:45.919503 14864 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
W20260709 13:21:45.920131 14867 leader_election.cc:336] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:45.920619 14867 leader_election.cc:304] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:45.921525 22993 raft_consensus.cc:2749] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:46.007128 13122 tablet_server.cc:179] TabletServer@127.12.208.132:0 shutting down...
I20260709 13:21:46.059010 22993 raft_consensus.cc:493] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:46.061002 22993 raft_consensus.cc:515] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:46.068037 22993 leader_election.cc:290] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
W20260709 13:21:46.072887 14864 leader_election.cc:336] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
W20260709 13:21:46.073531 14865 leader_election.cc:336] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:46.080791 14865 leader_election.cc:304] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:46.081656 22993 raft_consensus.cc:2749] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:46.108394 22993 raft_consensus.cc:493] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:46.109381 22993 raft_consensus.cc:515] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:46.112437 22993 leader_election.cc:290] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:46.118225 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:21:46.120172 14865 leader_election.cc:336] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
I20260709 13:21:46.122936 13122 tablet_replica.cc:333] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
W20260709 13:21:46.124254 14864 leader_election.cc:336] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
I20260709 13:21:46.126121 14864 leader_election.cc:304] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:46.127454 22992 raft_consensus.cc:2749] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:46.128525 13122 raft_consensus.cc:2243] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.130653 13122 raft_consensus.cc:2272] T e531770baa044bc49820df7e47c608eb P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:46.131429 14865 consensus_peers.cc:597] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.135241 13122 tablet_replica.cc:333] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.137166 13122 raft_consensus.cc:2243] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.138756 13122 raft_consensus.cc:2272] T fa1054f387364ae4b11260c5ab742790 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.143258 13122 tablet_replica.cc:333] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.145501 13122 raft_consensus.cc:2243] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.145320 22992 raft_consensus.cc:493] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:46.146591 22992 raft_consensus.cc:515] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:46.148485 13122 raft_consensus.cc:2272] T 78b3fe008c45425b8fd1c2bac8020950 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.150002 22992 leader_election.cc:290] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:46.154212 13122 tablet_replica.cc:333] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.155535 13122 raft_consensus.cc:2243] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:46.156193 14865 leader_election.cc:336] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
W20260709 13:21:46.156893 14864 leader_election.cc:336] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
I20260709 13:21:46.157474 14864 leader_election.cc:304] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:46.158460 22992 raft_consensus.cc:2749] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:21:46.159313 13122 raft_consensus.cc:2272] T 8c137013238f4b1dbae260e32cb316dc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.163224 13122 tablet_replica.cc:333] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.165132 13122 raft_consensus.cc:2243] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.166311 13122 raft_consensus.cc:2272] T cf37326f616a4b18aaaa6c2c405074bf P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.171113 13122 tablet_replica.cc:333] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.172492 13122 raft_consensus.cc:2243] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.173739 13122 raft_consensus.cc:2272] T c93ab0fd97734540911af5bd148751d5 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.177228 13122 tablet_replica.cc:333] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.178464 13122 raft_consensus.cc:2243] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.180532 13122 raft_consensus.cc:2272] T 18418e3cab2e42b1a301f8068587c987 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.183957 13122 tablet_replica.cc:333] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.185058 13122 raft_consensus.cc:2243] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.186762 13122 raft_consensus.cc:2272] T a7157daf9a3647f4af1d12bf4530f984 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.190250 13122 tablet_replica.cc:333] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.192273 13122 raft_consensus.cc:2243] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.193670 13122 raft_consensus.cc:2272] T f235d077faa24a89832f2f8f181b0ef1 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:46.197203 14867 consensus_peers.cc:597] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d -> Peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Couldn't send request to peer a9b2cf49ceed478480fb0f27ccf55d81. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:21:46.197629 13122 tablet_replica.cc:333] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.198516 13122 raft_consensus.cc:2243] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.200546 13122 raft_consensus.cc:2272] T 0f6f055b9cea4c76a10e5e5ecf91ffc9 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.202325 22993 raft_consensus.cc:493] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:46.203055 22993 raft_consensus.cc:515] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:46.203919 13122 tablet_replica.cc:333] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.204715 13122 raft_consensus.cc:2243] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.205826 13122 raft_consensus.cc:2272] T 80f2fbd6ece74e2fa8bbfcc96a1f45b5 P cebb34ac155340899a38c728707ddc0d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.205911 22993 leader_election.cc:290] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203), a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445)
I20260709 13:21:46.209875 13122 tablet_replica.cc:333] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
W20260709 13:21:46.210681 14864 leader_election.cc:336] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
I20260709 13:21:46.211254 13122 raft_consensus.cc:2243] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:46.211498 14867 leader_election.cc:336] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:46.211995 14867 leader_election.cc:304] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:46.212977 13122 raft_consensus.cc:2272] T eb8ce7d4df824e4e9d0842d3d4d65698 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.212926 22993 raft_consensus.cc:2749] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:46.216539 13122 tablet_replica.cc:333] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.218178 13122 raft_consensus.cc:2243] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.219219 13122 raft_consensus.cc:2272] T 52ca7fe34f2a4185a741b8aebabd8bfc P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.223276 13122 tablet_replica.cc:333] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.224325 13122 raft_consensus.cc:2243] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:46.224584 14865 consensus_peers.cc:597] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.225623 13122 raft_consensus.cc:2272] T 6b3646e03a744053ae5fd190c43a27e4 P cebb34ac155340899a38c728707ddc0d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.229305 13122 tablet_replica.cc:333] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.230145 13122 raft_consensus.cc:2243] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.231158 13122 raft_consensus.cc:2272] T ede0d59e482a4cff952455ca90001863 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.231917 22993 raft_consensus.cc:493] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:46.232777 22993 raft_consensus.cc:515] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "bee4f7fc1b4740dc875537c79309664f" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 44127 } attrs { replace: true } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
W20260709 13:21:46.233925 14865 consensus_peers.cc:597] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.234385 13122 tablet_replica.cc:333] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.235512 13122 raft_consensus.cc:2243] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.236076 22993 leader_election.cc:290] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:46.237366 13122 raft_consensus.cc:2272] T 475079f88bce40fea814453c8c4bfaac P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.241678 13122 tablet_replica.cc:333] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.243276 13122 raft_consensus.cc:2243] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.244678 13122 raft_consensus.cc:2272] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:46.245541 14865 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111)
W20260709 13:21:46.247385 14864 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
I20260709 13:21:46.248123 14864 leader_election.cc:304] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, bee4f7fc1b4740dc875537c79309664f
I20260709 13:21:46.248751 13122 tablet_replica.cc:333] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
W20260709 13:21:46.249063 14867 leader_election.cc:336] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:46.249369 13122 raft_consensus.cc:2243] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:46.250080 14864 raft_consensus.cc:2686] T 439318510aaf4073b4ca2996d73b9d8e P cebb34ac155340899a38c728707ddc0d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:21:46.250751 13122 raft_consensus.cc:2272] T 65fa0102e1144f94a57015823294e331 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.253742 13122 tablet_replica.cc:333] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.254418 13122 raft_consensus.cc:2243] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.255707 13122 raft_consensus.cc:2272] T 98310add35f94d0685fee6cc0aba55a2 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.258038 13122 tablet_replica.cc:333] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.258697 13122 raft_consensus.cc:2243] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.259369 13122 raft_consensus.cc:2272] T e8fbf1e78cfb4a15820b9812967ec58c P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.262287 13122 tablet_replica.cc:333] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.262993 13122 raft_consensus.cc:2243] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.263830 13122 raft_consensus.cc:2272] T fde6831a789b45549658b2c2146dd650 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.267824 13122 tablet_replica.cc:333] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.268909 13122 raft_consensus.cc:2243] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.269778 13122 raft_consensus.cc:2272] T 43b3afc4354948bea829c90a4536aa96 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.273327 13122 tablet_replica.cc:333] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.274327 13122 raft_consensus.cc:2243] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.275144 13122 raft_consensus.cc:2272] T cf286f2db09c4718a255c14e95c7e781 P cebb34ac155340899a38c728707ddc0d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.278155 13122 tablet_replica.cc:333] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.279206 13122 raft_consensus.cc:2243] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.280786 13122 raft_consensus.cc:2272] T bbf8c75a86f64f6cb1dd8780d0365f85 P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:46.283757 14865 consensus_peers.cc:597] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d -> Peer bee4f7fc1b4740dc875537c79309664f (127.12.208.130:44127): Couldn't send request to peer bee4f7fc1b4740dc875537c79309664f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:44127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.284153 13122 tablet_replica.cc:333] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.284898 13122 raft_consensus.cc:2243] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.285835 13122 raft_consensus.cc:2272] T cde980445ec54bac8c99f8e77669bffa P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.288764 13122 tablet_replica.cc:333] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.289490 13122 raft_consensus.cc:2243] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.290433 13122 raft_consensus.cc:2272] T dd40ac1ac2b5420abcc4468ffaf0c1fe P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.293136 13122 tablet_replica.cc:333] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.293946 13122 raft_consensus.cc:2243] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.294651 13122 raft_consensus.cc:2272] T f286c75a82eb4a2284617cd66deff360 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.295503 22993 raft_consensus.cc:493] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 181bbac22422408c87cd13b7fe3008f9)
I20260709 13:21:46.296262 22993 raft_consensus.cc:515] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9b2cf49ceed478480fb0f27ccf55d81" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 38445 } } peers { permanent_uuid: "181bbac22422408c87cd13b7fe3008f9" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 41203 } } peers { permanent_uuid: "cebb34ac155340899a38c728707ddc0d" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 33137 } attrs { promote: false } }
I20260709 13:21:46.297623 13122 tablet_replica.cc:333] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.298704 13122 raft_consensus.cc:2243] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.298797 22993 leader_election.cc:290] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445), 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203)
I20260709 13:21:46.299954 13122 raft_consensus.cc:2272] T 2582e91d201c4063b3eff5158b611448 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.303668 13122 tablet_replica.cc:333] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.304481 13122 raft_consensus.cc:2243] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 27 LEADER]: Raft consensus shutting down.
W20260709 13:21:46.305204 14864 leader_election.cc:336] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
I20260709 13:21:46.306697 13122 raft_consensus.cc:2272] T f6ebdaafff10446f814e66697ebf67ef P cebb34ac155340899a38c728707ddc0d [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:46.306864 14867 leader_election.cc:336] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
I20260709 13:21:46.307379 14867 leader_election.cc:304] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cebb34ac155340899a38c728707ddc0d; no voters: 181bbac22422408c87cd13b7fe3008f9, a9b2cf49ceed478480fb0f27ccf55d81
I20260709 13:21:46.308138 22993 raft_consensus.cc:2749] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:46.310425 13122 tablet_replica.cc:333] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.311257 13122 raft_consensus.cc:2243] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.312672 13122 raft_consensus.cc:2272] T a4e025a69a5c42f3be03aeed0ac9a998 P cebb34ac155340899a38c728707ddc0d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.315405 13122 tablet_replica.cc:333] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.316049 13122 raft_consensus.cc:2243] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.316784 13122 raft_consensus.cc:2272] T d8db981b8c9a4369a9fa90b9ecf4c80c P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.319581 13122 tablet_replica.cc:333] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.320187 13122 raft_consensus.cc:2243] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.323213 13122 raft_consensus.cc:2272] T f80782a117e14a308698329b8639179e P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.326736 13122 tablet_replica.cc:333] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.327507 13122 raft_consensus.cc:2243] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.329324 13122 raft_consensus.cc:2272] T 1f44936b303148f4848621766631d925 P cebb34ac155340899a38c728707ddc0d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.332319 13122 tablet_replica.cc:333] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.332927 13122 raft_consensus.cc:2243] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.333518 13122 raft_consensus.cc:2272] T bf13dfd8a7f54be7b9ae796572d0961b P cebb34ac155340899a38c728707ddc0d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.336349 13122 tablet_replica.cc:333] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.336926 13122 raft_consensus.cc:2243] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.337692 13122 raft_consensus.cc:2272] T 99c124265b9c42a5a1adf047554812b4 P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.340476 13122 tablet_replica.cc:333] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.341076 13122 raft_consensus.cc:2243] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.341643 13122 raft_consensus.cc:2272] T 76a21260793b426d8f662c772b5b2a03 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.344242 13122 tablet_replica.cc:333] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.344928 13122 raft_consensus.cc:2243] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.346117 13122 raft_consensus.cc:2272] T e674623b78de49129be2dde67c041ef9 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.348626 13122 tablet_replica.cc:333] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.349254 13122 raft_consensus.cc:2243] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.350744 13122 raft_consensus.cc:2272] T 37975f772fc648329a8acae36d33a345 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.353396 13122 tablet_replica.cc:333] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.354065 13122 raft_consensus.cc:2243] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.354707 13122 raft_consensus.cc:2272] T cab4884dfe6c4e24a9430e2449523d61 P cebb34ac155340899a38c728707ddc0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.357029 13122 tablet_replica.cc:333] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.357556 13122 raft_consensus.cc:2243] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.359261 13122 raft_consensus.cc:2272] T 2b16e1f580c44c1f984f63473c6a267d P cebb34ac155340899a38c728707ddc0d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.361662 13122 tablet_replica.cc:333] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.362217 13122 raft_consensus.cc:2243] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.362728 13122 raft_consensus.cc:2272] T 46b663177bbd4fbdbe452c58cdba8307 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.365199 13122 tablet_replica.cc:333] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.365717 13122 raft_consensus.cc:2243] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.366681 13122 raft_consensus.cc:2272] T ca72c82f0b3e4842b7c74a63118d3360 P cebb34ac155340899a38c728707ddc0d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.368911 13122 tablet_replica.cc:333] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.369470 13122 raft_consensus.cc:2243] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.370623 13122 raft_consensus.cc:2272] T 2ac406834d504a57b52386e2ae4c5235 P cebb34ac155340899a38c728707ddc0d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.373221 13122 tablet_replica.cc:333] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d: stopping tablet replica
I20260709 13:21:46.373684 13122 raft_consensus.cc:2243] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:46.375188 13122 raft_consensus.cc:2272] T 487d8e21fe1a4de4a365bd3c1f91947b P cebb34ac155340899a38c728707ddc0d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:46.449241 14111 catalog_manager.cc:4755] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): ChangeConfig:REMOVE_PEER RPC failed for tablet 37975f772fc648329a8acae36d33a345: Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
I20260709 13:21:46.924113 13122 tablet_server.cc:196] TabletServer@127.12.208.132:0 shutdown complete.
I20260709 13:21:47.020814 13122 master.cc:562] Master@127.12.208.190:37027 shutting down...
W20260709 13:21:47.060952 14175 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:21:47.061342 14175 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:47.061525 14175 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:50.799772 14114 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111) [suppressed 409 similar messages]
W20260709 13:21:50.803366 14114 catalog_manager.cc:4755] TS a9b2cf49ceed478480fb0f27ccf55d81 (127.12.208.129:38445): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 78b3fe008c45425b8fd1c2bac8020950: Network error: Client connection negotiation failed: client connection to 127.12.208.129:38445: connect: Connection refused (error 111)
W20260709 13:22:04.536067 14158 debug-util.cc:398] Leaking SignalData structure 0x7b0800202560 after lost signal to thread 13125
W20260709 13:22:04.536698 14158 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1da0 after lost signal to thread 14161
W20260709 13:22:42.926309 14158 debug-util.cc:398] Leaking SignalData structure 0x7b0800407ae0 after lost signal to thread 13125
W20260709 13:22:42.926937 14158 debug-util.cc:398] Leaking SignalData structure 0x7b080027df60 after lost signal to thread 14161
W20260709 13:22:46.453763 14111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
W20260709 13:22:46.457547 14111 catalog_manager.cc:4755] TS 181bbac22422408c87cd13b7fe3008f9 (127.12.208.131:41203): ChangeConfig:REMOVE_PEER RPC failed for tablet 37975f772fc648329a8acae36d33a345: Network error: Client connection negotiation failed: client connection to 127.12.208.131:41203: connect: Connection refused (error 111)
I20260709 13:22:48.544863 13122 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:48.545957 13122 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:48.546339 13122 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2510e400b67647c7923cee16a251d2de: stopping tablet replica
I20260709 13:22:48.778379 13122 master.cc:584] Master@127.12.208.190:37027 shutdown complete.
I20260709 13:22:48.837512 13122 test_util.cc:182] -----------------------------------------------
I20260709 13:22:48.837755 13122 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603003722080-13122-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (341861 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:22:48.841694 13122 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.208.190:34953
I20260709 13:22:48.843073 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:48.849273 23009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:48.849411 23010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:48.850955 23012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:48.852353 13122 server_base.cc:1061] running on GCE node
I20260709 13:22:48.856477 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:48.856699 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:48.856830 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603368856819 us; error 0 us; skew 500 ppm
I20260709 13:22:48.857296 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:48.859872 13122 webserver.cc:533] Webserver started at http://127.12.208.190:37007/ using document root <none> and password file <none>
I20260709 13:22:48.860327 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:48.860481 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:48.860698 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:48.862071 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/master-0-root/instance:
uuid: "4dd92c05a57d451dbd11c9187ce49148"
format_stamp: "Formatted at 2026-07-09 13:22:48 on dist-test-slave-ll1f"
I20260709 13:22:48.866566 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:22:48.870046 23017 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:48.870915 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:22:48.871248 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/master-0-root
uuid: "4dd92c05a57d451dbd11c9187ce49148"
format_stamp: "Formatted at 2026-07-09 13:22:48 on dist-test-slave-ll1f"
I20260709 13:22:48.871523 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:48.887738 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:48.889053 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:48.928228 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.190:34953
I20260709 13:22:48.928372 23068 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.190:34953 every 8 connection(s)
I20260709 13:22:48.932514 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:48.944535 23069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148: Bootstrap starting.
I20260709 13:22:48.949540 23069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:48.954146 23069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148: No bootstrap required, opened a new log
I20260709 13:22:48.956430 23069 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dd92c05a57d451dbd11c9187ce49148" member_type: VOTER }
I20260709 13:22:48.956909 23069 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:48.957085 23069 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd92c05a57d451dbd11c9187ce49148, State: Initialized, Role: FOLLOWER
I20260709 13:22:48.957590 23069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dd92c05a57d451dbd11c9187ce49148" member_type: VOTER }
I20260709 13:22:48.958130 23069 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:48.958340 23069 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:48.958556 23069 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:48.963290 23069 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dd92c05a57d451dbd11c9187ce49148" member_type: VOTER }
I20260709 13:22:48.963795 23069 leader_election.cc:304] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4dd92c05a57d451dbd11c9187ce49148; no voters: 
I20260709 13:22:48.964896 23069 leader_election.cc:290] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:48.965348 23072 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:48.966804 23072 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [term 1 LEADER]: Becoming Leader. State: Replica: 4dd92c05a57d451dbd11c9187ce49148, State: Running, Role: LEADER
I20260709 13:22:48.967559 23072 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dd92c05a57d451dbd11c9187ce49148" member_type: VOTER }
I20260709 13:22:48.968065 23069 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:48.974452 23074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4dd92c05a57d451dbd11c9187ce49148. Latest consensus state: current_term: 1 leader_uuid: "4dd92c05a57d451dbd11c9187ce49148" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dd92c05a57d451dbd11c9187ce49148" member_type: VOTER } }
I20260709 13:22:48.974411 23073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4dd92c05a57d451dbd11c9187ce49148" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dd92c05a57d451dbd11c9187ce49148" member_type: VOTER } }
I20260709 13:22:48.975194 23074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:48.975217 23073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:48.979799 23080 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:48.985201 23080 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:48.988407 13122 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:48.996627 23080 catalog_manager.cc:1383] Generated new cluster ID: d1cf1d57c69d4421a8d326724d6a2779
I20260709 13:22:48.996992 23080 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:49.011651 23080 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:49.013001 23080 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:49.026306 23080 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148: Generated new TSK 0
I20260709 13:22:49.026933 23080 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:49.060523 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:49.067122 23090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:49.068496 23091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:49.070078 23093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:49.071359 13122 server_base.cc:1061] running on GCE node
I20260709 13:22:49.074256 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:49.074481 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:49.074659 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603369074640 us; error 0 us; skew 500 ppm
I20260709 13:22:49.075407 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:49.077932 13122 webserver.cc:533] Webserver started at http://127.12.208.129:43773/ using document root <none> and password file <none>
I20260709 13:22:49.078414 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:49.078616 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:49.078891 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:49.080053 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/instance:
uuid: "72629382bd4c46b09b2efeaf08c1460d"
format_stamp: "Formatted at 2026-07-09 13:22:49 on dist-test-slave-ll1f"
I20260709 13:22:49.084985 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:49.088847 23098 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.089651 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:49.090044 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-0-root
uuid: "72629382bd4c46b09b2efeaf08c1460d"
format_stamp: "Formatted at 2026-07-09 13:22:49 on dist-test-slave-ll1f"
I20260709 13:22:49.090405 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:49.101353 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:49.102708 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:49.104239 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:49.106714 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:49.106940 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.107190 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:49.107390 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.149708 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.129:33547
I20260709 13:22:49.149849 23160 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.129:33547 every 8 connection(s)
I20260709 13:22:49.155161 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:49.164307 23165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:49.166327 23166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:49.168468 13122 server_base.cc:1061] running on GCE node
W20260709 13:22:49.169562 23168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:49.171303 23161 heartbeater.cc:344] Connected to a master server at 127.12.208.190:34953
I20260709 13:22:49.171770 23161 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:49.172976 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:49.173347 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:49.173231 23161 heartbeater.cc:507] Master 127.12.208.190:34953 requested a full tablet report, sending...
I20260709 13:22:49.173846 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603369173825 us; error 0 us; skew 500 ppm
I20260709 13:22:49.174759 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:49.176083 23034 ts_manager.cc:194] Registered new tserver with Master: 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:49.177659 13122 webserver.cc:533] Webserver started at http://127.12.208.130:43265/ using document root <none> and password file <none>
I20260709 13:22:49.178313 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:49.178406 23034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44676
I20260709 13:22:49.178576 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:49.178989 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:49.180783 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/instance:
uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
format_stamp: "Formatted at 2026-07-09 13:22:49 on dist-test-slave-ll1f"
I20260709 13:22:49.186244 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:22:49.189662 23173 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.190521 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:22:49.190864 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-1-root
uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
format_stamp: "Formatted at 2026-07-09 13:22:49 on dist-test-slave-ll1f"
I20260709 13:22:49.191159 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:49.210443 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:49.211721 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:49.213364 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:49.215744 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:49.215979 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.216233 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:49.216449 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.260164 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.130:34617
I20260709 13:22:49.260352 23235 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.130:34617 every 8 connection(s)
I20260709 13:22:49.265955 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:49.275377 23240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:49.276968 23239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:49.279387 23236 heartbeater.cc:344] Connected to a master server at 127.12.208.190:34953
W20260709 13:22:49.279865 23242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:49.279881 23236 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:49.281095 23236 heartbeater.cc:507] Master 127.12.208.190:34953 requested a full tablet report, sending...
I20260709 13:22:49.281420 13122 server_base.cc:1061] running on GCE node
I20260709 13:22:49.282516 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:49.282786 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:49.282994 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603369282974 us; error 0 us; skew 500 ppm
I20260709 13:22:49.283571 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:49.283629 23034 ts_manager.cc:194] Registered new tserver with Master: 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:49.285650 23034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44682
I20260709 13:22:49.286991 13122 webserver.cc:533] Webserver started at http://127.12.208.131:36829/ using document root <none> and password file <none>
I20260709 13:22:49.287699 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:49.287959 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:49.288272 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:49.289572 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/instance:
uuid: "b1f5ee52ad2f442bac6959931126746d"
format_stamp: "Formatted at 2026-07-09 13:22:49 on dist-test-slave-ll1f"
I20260709 13:22:49.294428 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:22:49.297706 23247 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.298599 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:22:49.298954 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-2-root
uuid: "b1f5ee52ad2f442bac6959931126746d"
format_stamp: "Formatted at 2026-07-09 13:22:49 on dist-test-slave-ll1f"
I20260709 13:22:49.299247 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:49.311841 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:49.313123 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:49.314715 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:49.316984 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:49.317163 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.317461 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:49.317619 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.359591 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.131:38439
I20260709 13:22:49.359740 23309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.131:38439 every 8 connection(s)
I20260709 13:22:49.365365 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:49.374413 23313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:49.375773 23314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:49.380980 23310 heartbeater.cc:344] Connected to a master server at 127.12.208.190:34953
W20260709 13:22:49.381387 23316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:49.381145 13122 server_base.cc:1061] running on GCE node
I20260709 13:22:49.381639 23310 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:49.382983 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:49.382999 23310 heartbeater.cc:507] Master 127.12.208.190:34953 requested a full tablet report, sending...
W20260709 13:22:49.383503 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:49.383771 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603369383748 us; error 0 us; skew 500 ppm
I20260709 13:22:49.384627 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:49.386077 23034 ts_manager.cc:194] Registered new tserver with Master: b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:49.388000 13122 webserver.cc:533] Webserver started at http://127.12.208.132:40985/ using document root <none> and password file <none>
I20260709 13:22:49.388283 23034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44698
I20260709 13:22:49.388854 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:49.389186 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:49.389549 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:49.391229 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-3-root/instance:
uuid: "28222c0dd7a1411692efad3387118115"
format_stamp: "Formatted at 2026-07-09 13:22:49 on dist-test-slave-ll1f"
I20260709 13:22:49.396430 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:49.400297 23321 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.401239 13122 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:22:49.401603 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-3-root
uuid: "28222c0dd7a1411692efad3387118115"
format_stamp: "Formatted at 2026-07-09 13:22:49 on dist-test-slave-ll1f"
I20260709 13:22:49.401988 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:49.423715 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:49.425169 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:49.426872 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:49.429412 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:49.429625 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.429984 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:49.430166 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:49.478545 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.132:34331
I20260709 13:22:49.478636 23383 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.132:34331 every 8 connection(s)
I20260709 13:22:49.495226 23384 heartbeater.cc:344] Connected to a master server at 127.12.208.190:34953
I20260709 13:22:49.495685 23384 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:49.496510 23384 heartbeater.cc:507] Master 127.12.208.190:34953 requested a full tablet report, sending...
I20260709 13:22:49.498715 23034 ts_manager.cc:194] Registered new tserver with Master: 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:49.499418 13122 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017509734s
I20260709 13:22:49.500661 23034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44710
I20260709 13:22:49.528879 23034 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44714:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:22:49.799722 23348 tablet_service.cc:1511] Processing CreateTablet for tablet 81b244c487d44b40a9f7800f2ae45a24 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:22:49.801344 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b244c487d44b40a9f7800f2ae45a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.801077 23347 tablet_service.cc:1511] Processing CreateTablet for tablet 7d41e7244bf04a4c8c6d02911a829766 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:22:49.815131 23123 tablet_service.cc:1511] Processing CreateTablet for tablet c922bd920ef0444182579d77023af05e (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:22:49.851344 23123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c922bd920ef0444182579d77023af05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.823530 23122 tablet_service.cc:1511] Processing CreateTablet for tablet e0ff21f76a0b4747afdcad23fe926e14 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:22:49.821053 23121 tablet_service.cc:1511] Processing CreateTablet for tablet 31ee84482afc4bd590fa2592f7fa9f44 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:22:49.803025 23346 tablet_service.cc:1511] Processing CreateTablet for tablet e0ff21f76a0b4747afdcad23fe926e14 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:22:49.853874 23346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ff21f76a0b4747afdcad23fe926e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.811013 23126 tablet_service.cc:1511] Processing CreateTablet for tablet 61b02752797c494ea2853b042faf1da6 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:22:49.812942 23125 tablet_service.cc:1511] Processing CreateTablet for tablet afda95fa80ad4b20905e75de45272508 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:22:49.804955 23345 tablet_service.cc:1511] Processing CreateTablet for tablet 31ee84482afc4bd590fa2592f7fa9f44 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:22:49.857211 23345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ee84482afc4bd590fa2592f7fa9f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.858070 23126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b02752797c494ea2853b042faf1da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.858853 23122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ff21f76a0b4747afdcad23fe926e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.859544 23121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ee84482afc4bd590fa2592f7fa9f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.815948 23124 tablet_service.cc:1511] Processing CreateTablet for tablet 81b244c487d44b40a9f7800f2ae45a24 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:22:49.818501 23120 tablet_service.cc:1511] Processing CreateTablet for tablet 28937175e4764f6484d66b61a7e1592a (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:22:49.862462 23124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b244c487d44b40a9f7800f2ae45a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.863431 23120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28937175e4764f6484d66b61a7e1592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.864353 23125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afda95fa80ad4b20905e75de45272508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.825819 23268 tablet_service.cc:1511] Processing CreateTablet for tablet f479db0348074d559c5290d442d0c297 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:22:49.865579 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f479db0348074d559c5290d442d0c297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.827701 23119 tablet_service.cc:1511] Processing CreateTablet for tablet dd7d9a54537545268b3b0ac024d58a93 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:22:49.870462 23119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd7d9a54537545268b3b0ac024d58a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.828516 23344 tablet_service.cc:1511] Processing CreateTablet for tablet d451d4f8dd554041a70fc8d71618d090 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:22:49.829509 23118 tablet_service.cc:1511] Processing CreateTablet for tablet f479db0348074d559c5290d442d0c297 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:22:49.874884 23118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f479db0348074d559c5290d442d0c297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.875023 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d451d4f8dd554041a70fc8d71618d090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.831317 23117 tablet_service.cc:1511] Processing CreateTablet for tablet 24160013ee8743f88e93c264fde917b3 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:22:49.878684 23117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24160013ee8743f88e93c264fde917b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.880128 23404 tablet_bootstrap.cc:492] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:49.833227 23343 tablet_service.cc:1511] Processing CreateTablet for tablet dd7d9a54537545268b3b0ac024d58a93 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:22:49.833849 23201 tablet_service.cc:1511] Processing CreateTablet for tablet afda95fa80ad4b20905e75de45272508 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:22:49.835115 23342 tablet_service.cc:1511] Processing CreateTablet for tablet f479db0348074d559c5290d442d0c297 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:22:49.883107 23201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afda95fa80ad4b20905e75de45272508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.835879 23200 tablet_service.cc:1511] Processing CreateTablet for tablet 81b244c487d44b40a9f7800f2ae45a24 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:22:49.837059 23341 tablet_service.cc:1511] Processing CreateTablet for tablet 9d309f995b354b95a4a462a0f9831a85 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:22:49.837844 23199 tablet_service.cc:1511] Processing CreateTablet for tablet 7d41e7244bf04a4c8c6d02911a829766 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:22:49.886720 23347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d41e7244bf04a4c8c6d02911a829766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.886880 23200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b244c487d44b40a9f7800f2ae45a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.887591 23199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d41e7244bf04a4c8c6d02911a829766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.888011 23343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd7d9a54537545268b3b0ac024d58a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.838940 23340 tablet_service.cc:1511] Processing CreateTablet for tablet 006dd6ad5ee14da39d65b4a6f97b32a4 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:22:49.890722 23340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006dd6ad5ee14da39d65b4a6f97b32a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.839821 23198 tablet_service.cc:1511] Processing CreateTablet for tablet c922bd920ef0444182579d77023af05e (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:22:49.894035 23198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c922bd920ef0444182579d77023af05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.840816 23197 tablet_service.cc:1511] Processing CreateTablet for tablet e0ff21f76a0b4747afdcad23fe926e14 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:22:49.899022 23197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ff21f76a0b4747afdcad23fe926e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.900516 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f479db0348074d559c5290d442d0c297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.841748 23196 tablet_service.cc:1511] Processing CreateTablet for tablet d451d4f8dd554041a70fc8d71618d090 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:22:49.903156 23196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d451d4f8dd554041a70fc8d71618d090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.843628 23195 tablet_service.cc:1511] Processing CreateTablet for tablet 28937175e4764f6484d66b61a7e1592a (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:22:49.844566 23267 tablet_service.cc:1511] Processing CreateTablet for tablet 9d309f995b354b95a4a462a0f9831a85 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:22:49.845544 23194 tablet_service.cc:1511] Processing CreateTablet for tablet dd7d9a54537545268b3b0ac024d58a93 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:22:49.846887 23266 tablet_service.cc:1511] Processing CreateTablet for tablet 24160013ee8743f88e93c264fde917b3 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:22:49.926795 23266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24160013ee8743f88e93c264fde917b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.847322 23192 tablet_service.cc:1511] Processing CreateTablet for tablet 24160013ee8743f88e93c264fde917b3 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:22:49.847419 23193 tablet_service.cc:1511] Processing CreateTablet for tablet 9d309f995b354b95a4a462a0f9831a85 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:22:49.806354 23349 tablet_service.cc:1511] Processing CreateTablet for tablet 61b02752797c494ea2853b042faf1da6 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:22:49.816447 23273 tablet_service.cc:1511] Processing CreateTablet for tablet 7d41e7244bf04a4c8c6d02911a829766 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:22:49.930795 23267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d309f995b354b95a4a462a0f9831a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.931595 23273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d41e7244bf04a4c8c6d02911a829766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.935582 23341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d309f995b354b95a4a462a0f9831a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.822039 23270 tablet_service.cc:1511] Processing CreateTablet for tablet d451d4f8dd554041a70fc8d71618d090 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:22:49.938820 23270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d451d4f8dd554041a70fc8d71618d090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.812747 23275 tablet_service.cc:1511] Processing CreateTablet for tablet 61b02752797c494ea2853b042faf1da6 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:22:49.942845 23275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b02752797c494ea2853b042faf1da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.820181 23271 tablet_service.cc:1511] Processing CreateTablet for tablet 31ee84482afc4bd590fa2592f7fa9f44 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:22:49.946727 23271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ee84482afc4bd590fa2592f7fa9f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.818293 23272 tablet_service.cc:1511] Processing CreateTablet for tablet c922bd920ef0444182579d77023af05e (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:22:49.950848 23272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c922bd920ef0444182579d77023af05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.814627 23274 tablet_service.cc:1511] Processing CreateTablet for tablet afda95fa80ad4b20905e75de45272508 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:22:49.953521 23274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afda95fa80ad4b20905e75de45272508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.823832 23269 tablet_service.cc:1511] Processing CreateTablet for tablet 28937175e4764f6484d66b61a7e1592a (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:22:49.909597 23195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28937175e4764f6484d66b61a7e1592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.958469 23193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d309f995b354b95a4a462a0f9831a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.958770 23269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28937175e4764f6484d66b61a7e1592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.962205 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b02752797c494ea2853b042faf1da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.899802 23346 tablet_service.cc:1511] Processing CreateTablet for tablet 79e7ed81a129474a91e895ef75e45846 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:22:49.966696 23346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e7ed81a129474a91e895ef75e45846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.970233 23194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd7d9a54537545268b3b0ac024d58a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:49.973933 23192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24160013ee8743f88e93c264fde917b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:49.983758 23082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:50.002851 23404 tablet_bootstrap.cc:654] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.037889 23198 tablet_service.cc:1511] Processing CreateTablet for tablet 006dd6ad5ee14da39d65b4a6f97b32a4 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:22:50.039456 23198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006dd6ad5ee14da39d65b4a6f97b32a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.051895 23118 tablet_service.cc:1511] Processing CreateTablet for tablet 79e7ed81a129474a91e895ef75e45846 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:22:50.057025 23405 tablet_bootstrap.cc:492] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:50.054201 23118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e7ed81a129474a91e895ef75e45846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.078557 23117 tablet_service.cc:1511] Processing CreateTablet for tablet 006dd6ad5ee14da39d65b4a6f97b32a4 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:22:50.083398 23197 tablet_service.cc:1511] Processing CreateTablet for tablet 8bac124d4fc6429bbffe49d0090140f9 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:22:50.084960 23197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bac124d4fc6429bbffe49d0090140f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.085729 23120 tablet_service.cc:1511] Processing CreateTablet for tablet 4d36b6bd10764558b6db3eb4e2238a3f (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:22:50.088984 23121 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcda7afa02d4a339af683cf757b6657 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:22:50.090924 23119 tablet_service.cc:1511] Processing CreateTablet for tablet d7c657fadabd4fd1802ed83a975d127f (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:22:50.091322 23348 tablet_service.cc:1511] Processing CreateTablet for tablet 8bac124d4fc6429bbffe49d0090140f9 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:22:50.092633 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bac124d4fc6429bbffe49d0090140f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.102856 23195 tablet_service.cc:1511] Processing CreateTablet for tablet 550e909e22344eeda8dddcbefde935c7 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:22:50.104643 23195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550e909e22344eeda8dddcbefde935c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.093257 23346 tablet_service.cc:1511] Processing CreateTablet for tablet 4d36b6bd10764558b6db3eb4e2238a3f (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:22:50.130017 23126 tablet_service.cc:1511] Processing CreateTablet for tablet 550e909e22344eeda8dddcbefde935c7 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:22:50.107648 23406 tablet_bootstrap.cc:492] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:50.090972 23273 tablet_service.cc:1511] Processing CreateTablet for tablet 79e7ed81a129474a91e895ef75e45846 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:22:50.138993 23273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e7ed81a129474a91e895ef75e45846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.146344 23346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d36b6bd10764558b6db3eb4e2238a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.158100 23194 tablet_service.cc:1511] Processing CreateTablet for tablet 4d36b6bd10764558b6db3eb4e2238a3f (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:22:50.159569 23194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d36b6bd10764558b6db3eb4e2238a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.162761 23349 tablet_service.cc:1511] Processing CreateTablet for tablet 87cb4ccf648b4137bbe92d1a4e9ce542 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:22:50.163172 23201 tablet_service.cc:1511] Processing CreateTablet for tablet d7c657fadabd4fd1802ed83a975d127f (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:22:50.174309 23342 tablet_service.cc:1511] Processing CreateTablet for tablet ad073f97fcad4d19bc9e16ecd3235c2a (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:22:50.164678 23193 tablet_service.cc:1511] Processing CreateTablet for tablet 87cb4ccf648b4137bbe92d1a4e9ce542 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:22:50.175297 23199 tablet_service.cc:1511] Processing CreateTablet for tablet 8192c710d74b4b1c9b4d67b79426ac48 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:22:50.163365 23267 tablet_service.cc:1511] Processing CreateTablet for tablet 550e909e22344eeda8dddcbefde935c7 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:22:50.175609 23275 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcda7afa02d4a339af683cf757b6657 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:22:50.181941 23161 heartbeater.cc:499] Master 127.12.208.190:34953 was elected leader, sending a full tablet report...
I20260709 13:22:50.183545 23347 tablet_service.cc:1511] Processing CreateTablet for tablet 9fac600ebf36450b96343e8ad119b130 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:22:50.097522 23341 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcda7afa02d4a339af683cf757b6657 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:22:50.184199 23200 tablet_service.cc:1511] Processing CreateTablet for tablet db75cc4c217c4476bcc60a4f91750ed3 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:22:50.183560 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad073f97fcad4d19bc9e16ecd3235c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.165146 23343 tablet_service.cc:1511] Processing CreateTablet for tablet 480935b908a045248a3d3c02deab6648 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:22:50.190508 23119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c657fadabd4fd1802ed83a975d127f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.190774 23407 tablet_bootstrap.cc:492] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:50.221114 23275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcda7afa02d4a339af683cf757b6657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.199174 23194 tablet_service.cc:1511] Processing CreateTablet for tablet ad073f97fcad4d19bc9e16ecd3235c2a (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:22:50.221913 23269 tablet_service.cc:1511] Processing CreateTablet for tablet c9a07ed2cfb44ee09a9b0105bf804006 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:22:50.209417 23345 tablet_service.cc:1511] Processing CreateTablet for tablet 053bdd071d8445d1a3e089703a22ab2b (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:22:50.200524 23123 tablet_service.cc:1511] Processing CreateTablet for tablet db75cc4c217c4476bcc60a4f91750ed3 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:22:50.169018 23340 tablet_service.cc:1511] Processing CreateTablet for tablet c9a07ed2cfb44ee09a9b0105bf804006 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:22:50.205431 23192 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5a1889477743c5844083786cef2ef4 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:22:50.174443 23344 tablet_service.cc:1511] Processing CreateTablet for tablet 8192c710d74b4b1c9b4d67b79426ac48 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:22:50.163617 23266 tablet_service.cc:1511] Processing CreateTablet for tablet 8bac124d4fc6429bbffe49d0090140f9 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
W20260709 13:22:50.238602 23019 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 47181.7us
I20260709 13:22:50.204550 23404 tablet_bootstrap.cc:492] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
W20260709 13:22:50.238288 23020 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 54737.9us
I20260709 13:22:50.197937 23193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cb4ccf648b4137bbe92d1a4e9ce542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.253367 23201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c657fadabd4fd1802ed83a975d127f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.205437 23125 tablet_service.cc:1511] Processing CreateTablet for tablet ad073f97fcad4d19bc9e16ecd3235c2a (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:22:50.193358 23124 tablet_service.cc:1511] Processing CreateTablet for tablet 87cb4ccf648b4137bbe92d1a4e9ce542 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:22:50.256788 23199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8192c710d74b4b1c9b4d67b79426ac48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.228734 23274 tablet_service.cc:1511] Processing CreateTablet for tablet db75cc4c217c4476bcc60a4f91750ed3 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:22:50.223228 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 480935b908a045248a3d3c02deab6648 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:22:50.197247 23405 tablet_bootstrap.cc:654] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.194592 23122 tablet_service.cc:1511] Processing CreateTablet for tablet 480935b908a045248a3d3c02deab6648 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:22:50.250283 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cb4ccf648b4137bbe92d1a4e9ce542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.218780 23272 tablet_service.cc:1511] Processing CreateTablet for tablet d7c657fadabd4fd1802ed83a975d127f (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:22:50.206985 23196 tablet_service.cc:1511] Processing CreateTablet for tablet c9a07ed2cfb44ee09a9b0105bf804006 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:22:50.262887 23347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fac600ebf36450b96343e8ad119b130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.215924 23270 tablet_service.cc:1511] Processing CreateTablet for tablet 8192c710d74b4b1c9b4d67b79426ac48 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:22:50.264087 23192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5a1889477743c5844083786cef2ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.265450 23345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053bdd071d8445d1a3e089703a22ab2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.266279 23341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcda7afa02d4a339af683cf757b6657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.266477 23200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db75cc4c217c4476bcc60a4f91750ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.267457 23343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480935b908a045248a3d3c02deab6648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.251837 23404 ts_tablet_manager.cc:1403] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.372s	user 0.010s	sys 0.011s
I20260709 13:22:50.232342 23271 tablet_service.cc:1511] Processing CreateTablet for tablet 9fac600ebf36450b96343e8ad119b130 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:22:50.201758 23198 tablet_service.cc:1511] Processing CreateTablet for tablet 053bdd071d8445d1a3e089703a22ab2b (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:22:50.224714 23406 tablet_bootstrap.cc:654] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.272989 23194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad073f97fcad4d19bc9e16ecd3235c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.248284 23269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a07ed2cfb44ee09a9b0105bf804006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.280830 23267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550e909e22344eeda8dddcbefde935c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.249547 23123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db75cc4c217c4476bcc60a4f91750ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.283236 23120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d36b6bd10764558b6db3eb4e2238a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.287606 23122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480935b908a045248a3d3c02deab6648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.288793 23236 heartbeater.cc:499] Master 127.12.208.190:34953 was elected leader, sending a full tablet report...
I20260709 13:22:50.292564 23274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db75cc4c217c4476bcc60a4f91750ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.294375 23266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bac124d4fc6429bbffe49d0090140f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.297174 23270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8192c710d74b4b1c9b4d67b79426ac48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.313222 23121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcda7afa02d4a339af683cf757b6657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.315519 23340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a07ed2cfb44ee09a9b0105bf804006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.320396 23196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a07ed2cfb44ee09a9b0105bf804006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.342556 23126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550e909e22344eeda8dddcbefde935c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.343158 23118 tablet_service.cc:1511] Processing CreateTablet for tablet 9fac600ebf36450b96343e8ad119b130 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:22:50.344995 23118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fac600ebf36450b96343e8ad119b130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.347528 23117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006dd6ad5ee14da39d65b4a6f97b32a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.350239 23125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad073f97fcad4d19bc9e16ecd3235c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.329054 23272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c657fadabd4fd1802ed83a975d127f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.356319 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8192c710d74b4b1c9b4d67b79426ac48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.371999 23407 tablet_bootstrap.cc:654] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.380139 23346 tablet_service.cc:1511] Processing CreateTablet for tablet 076db0f4793e437cbb23e56b1f75f2d0 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:22:50.382180 23271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fac600ebf36450b96343e8ad119b130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.384830 23197 tablet_service.cc:1511] Processing CreateTablet for tablet c07f8c2c87cd4a47aa2f08e7750ae0ba (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:22:50.390156 23405 tablet_bootstrap.cc:492] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:50.390748 23405 ts_tablet_manager.cc:1403] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.334s	user 0.009s	sys 0.018s
I20260709 13:22:50.391983 23310 heartbeater.cc:499] Master 127.12.208.190:34953 was elected leader, sending a full tablet report...
I20260709 13:22:50.355028 23404 raft_consensus.cc:359] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:50.393105 23404 raft_consensus.cc:385] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.394166 23405 raft_consensus.cc:359] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:50.394953 23405 raft_consensus.cc:385] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.395267 23405 raft_consensus.cc:740] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.395766 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480935b908a045248a3d3c02deab6648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.395136 23404 raft_consensus.cc:740] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.400274 23348 tablet_service.cc:1511] Processing CreateTablet for tablet c07f8c2c87cd4a47aa2f08e7750ae0ba (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:22:50.381696 23346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076db0f4793e437cbb23e56b1f75f2d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.403563 23404 consensus_queue.cc:260] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:50.412735 23122 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5a1889477743c5844083786cef2ef4 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:22:50.417932 23198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053bdd071d8445d1a3e089703a22ab2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.418344 23124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cb4ccf648b4137bbe92d1a4e9ce542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.430526 23197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c07f8c2c87cd4a47aa2f08e7750ae0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.418494 23199 tablet_service.cc:1511] Processing CreateTablet for tablet 17a57dd75f694365ba2ab18b8b2cbe41 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:22:50.441243 23405 consensus_queue.cc:260] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:50.460080 23406 tablet_bootstrap.cc:492] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:50.463120 23406 ts_tablet_manager.cc:1403] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.356s	user 0.030s	sys 0.049s
I20260709 13:22:50.468652 23343 tablet_service.cc:1511] Processing CreateTablet for tablet 17a57dd75f694365ba2ab18b8b2cbe41 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:22:50.473922 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c07f8c2c87cd4a47aa2f08e7750ae0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.476856 23343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a57dd75f694365ba2ab18b8b2cbe41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.460522 23122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5a1889477743c5844083786cef2ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.484216 23273 tablet_service.cc:1511] Processing CreateTablet for tablet 053bdd071d8445d1a3e089703a22ab2b (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:22:50.486464 23406 raft_consensus.cc:359] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:50.487313 23406 raft_consensus.cc:385] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.487679 23406 raft_consensus.cc:740] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.488461 23406 consensus_queue.cc:260] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:50.485684 23273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053bdd071d8445d1a3e089703a22ab2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.507156 23199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a57dd75f694365ba2ab18b8b2cbe41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.518004 23384 heartbeater.cc:499] Master 127.12.208.190:34953 was elected leader, sending a full tablet report...
I20260709 13:22:50.521697 23275 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5a1889477743c5844083786cef2ef4 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:22:50.522512 23404 ts_tablet_manager.cc:1434] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.254s	user 0.006s	sys 0.010s
I20260709 13:22:50.523161 23275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5a1889477743c5844083786cef2ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.522830 23195 tablet_service.cc:1511] Processing CreateTablet for tablet 3e44018374b34e9ab7172698203fddd0 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:22:50.522913 23123 tablet_service.cc:1511] Processing CreateTablet for tablet c07f8c2c87cd4a47aa2f08e7750ae0ba (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:22:50.524214 23195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e44018374b34e9ab7172698203fddd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.524338 23123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c07f8c2c87cd4a47aa2f08e7750ae0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.530637 23349 tablet_service.cc:1511] Processing CreateTablet for tablet 66e092acaa9541649bd04731cf50ea1c (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:22:50.532232 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e092acaa9541649bd04731cf50ea1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.553938 23269 tablet_service.cc:1511] Processing CreateTablet for tablet 17a57dd75f694365ba2ab18b8b2cbe41 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:22:50.559365 23270 tablet_service.cc:1511] Processing CreateTablet for tablet 3e44018374b34e9ab7172698203fddd0 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:22:50.560911 23404 tablet_bootstrap.cc:492] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:50.562951 23124 tablet_service.cc:1511] Processing CreateTablet for tablet 076db0f4793e437cbb23e56b1f75f2d0 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:22:50.583290 23124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076db0f4793e437cbb23e56b1f75f2d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.579908 23200 tablet_service.cc:1511] Processing CreateTablet for tablet 66e092acaa9541649bd04731cf50ea1c (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:22:50.590229 23201 tablet_service.cc:1511] Processing CreateTablet for tablet 2d430d760648423c8b3c2e0861c6bfcf (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:22:50.581414 23269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a57dd75f694365ba2ab18b8b2cbe41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.592751 23270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e44018374b34e9ab7172698203fddd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.599992 23119 tablet_service.cc:1511] Processing CreateTablet for tablet 66e092acaa9541649bd04731cf50ea1c (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:22:50.588699 23404 tablet_bootstrap.cc:654] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.605445 23118 tablet_service.cc:1511] Processing CreateTablet for tablet 3e44018374b34e9ab7172698203fddd0 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:22:50.605917 23124 tablet_service.cc:1511] Processing CreateTablet for tablet d24f89e5242045f2a28a36e335775561 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:22:50.610157 23342 tablet_service.cc:1511] Processing CreateTablet for tablet d24f89e5242045f2a28a36e335775561 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:22:50.615270 23405 ts_tablet_manager.cc:1434] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.224s	user 0.011s	sys 0.004s
I20260709 13:22:50.615607 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24f89e5242045f2a28a36e335775561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.616201 23266 tablet_service.cc:1511] Processing CreateTablet for tablet 076db0f4793e437cbb23e56b1f75f2d0 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:22:50.617295 23200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e092acaa9541649bd04731cf50ea1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.617527 23266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076db0f4793e437cbb23e56b1f75f2d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.621218 23119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e092acaa9541649bd04731cf50ea1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.622805 23272 tablet_service.cc:1511] Processing CreateTablet for tablet d24f89e5242045f2a28a36e335775561 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:22:50.628726 23345 tablet_service.cc:1511] Processing CreateTablet for tablet 2d430d760648423c8b3c2e0861c6bfcf (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:22:50.650674 23345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d430d760648423c8b3c2e0861c6bfcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.632488 23125 tablet_service.cc:1511] Processing CreateTablet for tablet 3a590581b50b42b2ae1ce08dcfe237e7 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:22:50.633765 23201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d430d760648423c8b3c2e0861c6bfcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.652204 23412 raft_consensus.cc:493] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.652756 23412 raft_consensus.cc:515] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:50.654510 23272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24f89e5242045f2a28a36e335775561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.655463 23412 leader_election.cc:290] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:50.634070 23347 tablet_service.cc:1511] Processing CreateTablet for tablet 9632791a4410453a8a5b95e7570c0565 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:22:50.636121 23196 tablet_service.cc:1511] Processing CreateTablet for tablet 3a590581b50b42b2ae1ce08dcfe237e7 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:22:50.643615 23407 tablet_bootstrap.cc:492] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:50.645480 23267 tablet_service.cc:1511] Processing CreateTablet for tablet 2d430d760648423c8b3c2e0861c6bfcf (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:22:50.673965 23162 tablet.cc:2406] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:50.675096 23126 tablet_service.cc:1511] Processing CreateTablet for tablet 9632791a4410453a8a5b95e7570c0565 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:22:50.691634 23405 tablet_bootstrap.cc:492] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:50.692787 23406 ts_tablet_manager.cc:1434] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.229s	user 0.008s	sys 0.007s
I20260709 13:22:50.688342 23273 tablet_service.cc:1511] Processing CreateTablet for tablet 3a590581b50b42b2ae1ce08dcfe237e7 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:22:50.694375 23406 tablet_bootstrap.cc:492] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:50.695227 23267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d430d760648423c8b3c2e0861c6bfcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.695896 23273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a590581b50b42b2ae1ce08dcfe237e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.679512 23407 ts_tablet_manager.cc:1403] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.488s	user 0.010s	sys 0.023s
I20260709 13:22:50.697207 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9c34142ecf4df297b6eff325e4cbd6 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:22:50.698669 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9c34142ecf4df297b6eff325e4cbd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.699602 23407 raft_consensus.cc:359] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:50.700417 23407 raft_consensus.cc:385] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.683984 23196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a590581b50b42b2ae1ce08dcfe237e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.711253 23349 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9c34142ecf4df297b6eff325e4cbd6 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:22:50.724833 23197 tablet_service.cc:1511] Processing CreateTablet for tablet 9632791a4410453a8a5b95e7570c0565 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:22:50.726307 23197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9632791a4410453a8a5b95e7570c0565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.733702 23271 tablet_service.cc:1511] Processing CreateTablet for tablet 2e318744c2b64bd3a410e806761d3648 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:22:50.735128 23271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e318744c2b64bd3a410e806761d3648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.736035 23344 tablet_service.cc:1511] Processing CreateTablet for tablet 2e318744c2b64bd3a410e806761d3648 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:22:50.740208 23121 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9c34142ecf4df297b6eff325e4cbd6 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:22:50.744170 23120 tablet_service.cc:1511] Processing CreateTablet for tablet 03dfec3f3a8c4f79bbac529d3b7691a2 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:22:50.745642 23411 raft_consensus.cc:493] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.746188 23411 raft_consensus.cc:515] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:50.748766 23411 leader_election.cc:290] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:50.700721 23407 raft_consensus.cc:740] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.749384 23194 tablet_service.cc:1511] Processing CreateTablet for tablet 03dfec3f3a8c4f79bbac529d3b7691a2 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:22:50.750154 23407 consensus_queue.cc:260] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:50.750783 23194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03dfec3f3a8c4f79bbac529d3b7691a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.754917 23346 tablet_service.cc:1511] Processing CreateTablet for tablet f6370231c76d43af900444679754d8e6 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:22:50.751498 23118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e44018374b34e9ab7172698203fddd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.771438 23199 tablet_service.cc:1511] Processing CreateTablet for tablet 2e318744c2b64bd3a410e806761d3648 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:22:50.772887 23199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e318744c2b64bd3a410e806761d3648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.772856 23406 tablet_bootstrap.cc:654] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:50.759090 23347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9632791a4410453a8a5b95e7570c0565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.814432 23404 tablet_bootstrap.cc:492] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:50.814962 23404 ts_tablet_manager.cc:1403] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.292s	user 0.014s	sys 0.012s
I20260709 13:22:50.818770 23404 raft_consensus.cc:359] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:50.819556 23404 raft_consensus.cc:385] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:50.827943 23195 tablet_service.cc:1511] Processing CreateTablet for tablet f6370231c76d43af900444679754d8e6 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:22:50.830188 23117 tablet_service.cc:1511] Processing CreateTablet for tablet f6370231c76d43af900444679754d8e6 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:22:50.842895 23270 tablet_service.cc:1511] Processing CreateTablet for tablet 03dfec3f3a8c4f79bbac529d3b7691a2 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:22:50.830231 23348 tablet_service.cc:1511] Processing CreateTablet for tablet 92eec5b6386a41c0b92608938ef9162c (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:22:50.846002 23269 tablet_service.cc:1511] Processing CreateTablet for tablet 92eec5b6386a41c0b92608938ef9162c (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:22:50.848461 23200 tablet_service.cc:1511] Processing CreateTablet for tablet 4535c921be9a4e5686183c491ff5f6ca (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:22:50.848412 23273 tablet_service.cc:1511] Processing CreateTablet for tablet 4535c921be9a4e5686183c491ff5f6ca (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:22:50.848379 23122 tablet_service.cc:1511] Processing CreateTablet for tablet 92eec5b6386a41c0b92608938ef9162c (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:22:50.850152 23125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a590581b50b42b2ae1ce08dcfe237e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.881047 23273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4535c921be9a4e5686183c491ff5f6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.886703 23122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92eec5b6386a41c0b92608938ef9162c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.892010 23270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03dfec3f3a8c4f79bbac529d3b7691a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.894826 23200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4535c921be9a4e5686183c491ff5f6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.898229 23195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6370231c76d43af900444679754d8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.875138 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9c34142ecf4df297b6eff325e4cbd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.851698 23404 raft_consensus.cc:740] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:50.909340 23348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92eec5b6386a41c0b92608938ef9162c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.914685 23272 tablet_service.cc:1511] Processing CreateTablet for tablet fc3b9027733f4b1c9800874f86d1b054 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:22:50.916185 23272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3b9027733f4b1c9800874f86d1b054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.926594 23342 tablet_service.cc:1511] Processing CreateTablet for tablet 4535c921be9a4e5686183c491ff5f6ca (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:22:50.927258 23124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24f89e5242045f2a28a36e335775561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.928227 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4535c921be9a4e5686183c491ff5f6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.929960 23117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6370231c76d43af900444679754d8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.930790 23120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03dfec3f3a8c4f79bbac529d3b7691a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.934698 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479db0348074d559c5290d442d0c297" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:50.937582 23101 leader_election.cc:343] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:50.930670 23123 tablet_service.cc:1511] Processing CreateTablet for tablet fc3b9027733f4b1c9800874f86d1b054 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:22:50.937906 23343 tablet_service.cc:1511] Processing CreateTablet for tablet 797ae11a97f84ad783704a5f0b287330 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:22:50.939006 23123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3b9027733f4b1c9800874f86d1b054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.939251 23343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797ae11a97f84ad783704a5f0b287330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.930810 23269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92eec5b6386a41c0b92608938ef9162c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.961472 23346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6370231c76d43af900444679754d8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.962446 23196 tablet_service.cc:1511] Processing CreateTablet for tablet fc3b9027733f4b1c9800874f86d1b054 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:22:50.963796 23196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3b9027733f4b1c9800874f86d1b054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.964586 23344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e318744c2b64bd3a410e806761d3648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.966071 23126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9632791a4410453a8a5b95e7570c0565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:50.968858 23404 consensus_queue.cc:260] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:50.970003 23411 raft_consensus.cc:493] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.970289 23414 raft_consensus.cc:493] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:50.970543 23411 raft_consensus.cc:515] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:50.970815 23414 raft_consensus.cc:515] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:50.983280 23411 leader_election.cc:290] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:50.984030 23406 tablet_bootstrap.cc:492] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:50.991402 23414 leader_election.cc:290] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:50.991444 23407 ts_tablet_manager.cc:1434] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.295s	user 0.029s	sys 0.026s
I20260709 13:22:50.989271 23121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9c34142ecf4df297b6eff325e4cbd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.008318 23406 ts_tablet_manager.cc:1403] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.314s	user 0.010s	sys 0.024s
I20260709 13:22:51.027523 23407 tablet_bootstrap.cc:492] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:51.028167 23345 tablet_service.cc:1511] Processing CreateTablet for tablet 514b8e2595b64695ae570184026e6b10 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:22:51.029603 23345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 514b8e2595b64695ae570184026e6b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.031602 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff21f76a0b4747afdcad23fe926e14" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:51.033231 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b244c487d44b40a9f7800f2ae45a24" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:51.028167 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 514b8e2595b64695ae570184026e6b10 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:22:51.038630 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 514b8e2595b64695ae570184026e6b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.058174 23423 raft_consensus.cc:493] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.059010 23423 raft_consensus.cc:515] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.064172 23119 tablet_service.cc:1511] Processing CreateTablet for tablet 797ae11a97f84ad783704a5f0b287330 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:22:51.065627 23119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797ae11a97f84ad783704a5f0b287330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.076627 23407 tablet_bootstrap.cc:654] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:51.077891 23082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:51.088754 23406 raft_consensus.cc:359] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.092785 23405 tablet_bootstrap.cc:654] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.094523 23423 leader_election.cc:290] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:51.089571 23406 raft_consensus.cc:385] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:51.112483 23323 leader_election.cc:343] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.111503 23406 raft_consensus.cc:740] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.162237 23404 ts_tablet_manager.cc:1434] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.347s	user 0.002s	sys 0.014s
I20260709 13:22:51.162418 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479db0348074d559c5290d442d0c297" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:51.164026 23404 tablet_bootstrap.cc:492] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
W20260709 13:22:51.149354 23323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 54004.4us
W20260709 13:22:51.166556 23323 leader_election.cc:343] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:51.169693 23099 leader_election.cc:343] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.170260 23099 leader_election.cc:304] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:51.118377 23122 tablet_service.cc:1511] Processing CreateTablet for tablet 514b8e2595b64695ae570184026e6b10 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:22:51.182649 23122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 514b8e2595b64695ae570184026e6b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.210876 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff21f76a0b4747afdcad23fe926e14" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:51.213356 23406 consensus_queue.cc:260] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.215993 23406 ts_tablet_manager.cc:1434] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.192s	user 0.006s	sys 0.001s
I20260709 13:22:51.217482 23406 tablet_bootstrap.cc:492] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:51.228578 23406 tablet_bootstrap.cc:654] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.230855 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b244c487d44b40a9f7800f2ae45a24" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
W20260709 13:22:51.233333 23323 leader_election.cc:343] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.233923 23323 leader_election.cc:304] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:51.234309 23414 raft_consensus.cc:493] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.234122 23269 tablet_service.cc:1511] Processing CreateTablet for tablet 7e74c84af241495bb52d0ecfd1cce7ff (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:22:51.235014 23414 raft_consensus.cc:515] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.235723 23269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e74c84af241495bb52d0ecfd1cce7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.237278 23414 leader_election.cc:290] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:51.239465 23411 raft_consensus.cc:2749] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:51.240533 23323 leader_election.cc:343] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.244194 23346 tablet_service.cc:1511] Processing CreateTablet for tablet 7e74c84af241495bb52d0ecfd1cce7ff (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:22:51.245605 23346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e74c84af241495bb52d0ecfd1cce7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.249745 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28937175e4764f6484d66b61a7e1592a" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:51.241057 23323 leader_election.cc:304] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:51.254155 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c922bd920ef0444182579d77023af05e" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:51.257743 23404 tablet_bootstrap.cc:654] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:51.258050 23175 leader_election.cc:343] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.258430 23195 tablet_service.cc:1511] Processing CreateTablet for tablet 797ae11a97f84ad783704a5f0b287330 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:22:51.258770 23175 leader_election.cc:343] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.259899 23195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797ae11a97f84ad783704a5f0b287330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.260398 23196 tablet_service.cc:1511] Processing CreateTablet for tablet 7e74c84af241495bb52d0ecfd1cce7ff (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:22:51.262176 23196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e74c84af241495bb52d0ecfd1cce7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.263068 23125 tablet_service.cc:1511] Processing CreateTablet for tablet 74b4ab214feb430ca8ca7034b0903fd2 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:22:51.264420 23125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b4ab214feb430ca8ca7034b0903fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.270030 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28937175e4764f6484d66b61a7e1592a" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:51.271551 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d309f995b354b95a4a462a0f9831a85" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:51.271588 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c922bd920ef0444182579d77023af05e" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
W20260709 13:22:51.273200 23174 leader_election.cc:343] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:51.273439 23249 leader_election.cc:343] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.273700 23174 leader_election.cc:304] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:51.273939 23200 tablet_service.cc:1511] Processing CreateTablet for tablet 74b4ab214feb430ca8ca7034b0903fd2 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:22:51.270042 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 74b4ab214feb430ca8ca7034b0903fd2 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:22:51.275485 23200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b4ab214feb430ca8ca7034b0903fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.275599 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b4ab214feb430ca8ca7034b0903fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.276592 23343 tablet_service.cc:1511] Processing CreateTablet for tablet 987cdec3ef244fddafb031e68024c1dc (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:22:51.278002 23414 raft_consensus.cc:2749] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:51.279824 23174 leader_election.cc:343] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.277997 23343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987cdec3ef244fddafb031e68024c1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.273428 23407 tablet_bootstrap.cc:492] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:51.284621 23407 ts_tablet_manager.cc:1403] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.257s	user 0.010s	sys 0.037s
W20260709 13:22:51.285841 23099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 91016.3us
W20260709 13:22:51.290791 23323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:34617, user_credentials={real_user=slave}} blocked reactor thread for 50292us
I20260709 13:22:51.291527 23121 tablet_service.cc:1511] Processing CreateTablet for tablet 987cdec3ef244fddafb031e68024c1dc (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:22:51.288496 23411 raft_consensus.cc:2749] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:51.293156 23121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987cdec3ef244fddafb031e68024c1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.296111 23405 tablet_bootstrap.cc:492] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:51.296666 23405 ts_tablet_manager.cc:1403] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.605s	user 0.025s	sys 0.016s
I20260709 13:22:51.297104 23407 raft_consensus.cc:359] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.297935 23407 raft_consensus.cc:385] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.299914 23405 raft_consensus.cc:359] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.303239 23405 raft_consensus.cc:385] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.303671 23405 raft_consensus.cc:740] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.304554 23405 consensus_queue.cc:260] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.280280 23174 leader_election.cc:304] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:51.301165 23433 raft_consensus.cc:2749] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:51.302290 23269 tablet_service.cc:1511] Processing CreateTablet for tablet e6fd3cdd94174b018ebe04f44a1cc4fb (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:22:51.305757 23407 raft_consensus.cc:740] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.305574 23347 tablet_service.cc:1511] Processing CreateTablet for tablet e6fd3cdd94174b018ebe04f44a1cc4fb (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:22:51.308596 23407 consensus_queue.cc:260] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.309082 23347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fd3cdd94174b018ebe04f44a1cc4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.311826 23414 raft_consensus.cc:2749] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:51.319519 23406 tablet_bootstrap.cc:492] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:51.320165 23406 ts_tablet_manager.cc:1403] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.103s	user 0.009s	sys 0.009s
I20260709 13:22:51.324349 23406 raft_consensus.cc:359] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:51.325399 23406 raft_consensus.cc:385] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.325855 23406 raft_consensus.cc:740] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.326495 23269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fd3cdd94174b018ebe04f44a1cc4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.326753 23272 tablet_service.cc:1511] Processing CreateTablet for tablet 4689f05e6159426c8b5073075c502f3c (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:22:51.326869 23406 consensus_queue.cc:260] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:51.328022 23272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4689f05e6159426c8b5073075c502f3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.330147 23406 ts_tablet_manager.cc:1434] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:22:51.332859 23121 tablet_service.cc:1511] Processing CreateTablet for tablet e6fd3cdd94174b018ebe04f44a1cc4fb (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:22:51.334240 23121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fd3cdd94174b018ebe04f44a1cc4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.334957 23199 tablet_service.cc:1511] Processing CreateTablet for tablet 987cdec3ef244fddafb031e68024c1dc (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:22:51.345000 23195 tablet_service.cc:1511] Processing CreateTablet for tablet 4689f05e6159426c8b5073075c502f3c (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:22:51.348878 23342 tablet_service.cc:1511] Processing CreateTablet for tablet 4689f05e6159426c8b5073075c502f3c (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:22:51.350229 23122 tablet_service.cc:1511] Processing CreateTablet for tablet 17cabb464d6148dab5eba6d8ba9d13e5 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:22:51.350922 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4689f05e6159426c8b5073075c502f3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.351493 23407 ts_tablet_manager.cc:1434] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.062s	user 0.003s	sys 0.003s
I20260709 13:22:51.352588 23407 tablet_bootstrap.cc:492] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:51.355319 23194 tablet_service.cc:1511] Processing CreateTablet for tablet 17cabb464d6148dab5eba6d8ba9d13e5 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:22:51.359225 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d309f995b354b95a4a462a0f9831a85" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:51.361264 23250 leader_election.cc:343] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.361756 23250 leader_election.cc:304] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115
I20260709 13:22:51.362627 23423 raft_consensus.cc:2749] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:51.351548 23122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17cabb464d6148dab5eba6d8ba9d13e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.367067 23199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987cdec3ef244fddafb031e68024c1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.370990 23349 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd01caec9d94514a02b3e251a1ea509 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:22:51.371280 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 17cabb464d6148dab5eba6d8ba9d13e5 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:22:51.371574 23194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17cabb464d6148dab5eba6d8ba9d13e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.372399 23349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd01caec9d94514a02b3e251a1ea509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.372553 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17cabb464d6148dab5eba6d8ba9d13e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.378603 23195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4689f05e6159426c8b5073075c502f3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.397943 23121 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd01caec9d94514a02b3e251a1ea509 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:22:51.399441 23121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd01caec9d94514a02b3e251a1ea509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.361935 23406 tablet_bootstrap.cc:492] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:51.408349 23346 tablet_service.cc:1511] Processing CreateTablet for tablet 92f3d3eace634645af1d9239ca7bd856 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:22:51.409111 23414 raft_consensus.cc:493] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.409880 23346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f3d3eace634645af1d9239ca7bd856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.409673 23414 raft_consensus.cc:515] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:51.403723 23272 tablet_service.cc:1511] Processing CreateTablet for tablet 92f3d3eace634645af1d9239ca7bd856 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:22:51.411475 23272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f3d3eace634645af1d9239ca7bd856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.412328 23414 leader_election.cc:290] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:51.414702 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff21f76a0b4747afdcad23fe926e14" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:51.415730 23407 tablet_bootstrap.cc:654] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:51.416676 23175 leader_election.cc:343] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.428303 23407 tablet_bootstrap.cc:492] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:51.428898 23407 ts_tablet_manager.cc:1403] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.000s
I20260709 13:22:51.432328 23407 raft_consensus.cc:359] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.433146 23407 raft_consensus.cc:385] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.433447 23407 raft_consensus.cc:740] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.434347 23407 consensus_queue.cc:260] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.436841 23407 ts_tablet_manager.cc:1434] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:22:51.445238 23273 tablet_service.cc:1511] Processing CreateTablet for tablet b5a4328b7c8048a58b8f49269156e606 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:22:51.447649 23273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a4328b7c8048a58b8f49269156e606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.447768 23406 tablet_bootstrap.cc:654] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.451866 23200 tablet_service.cc:1511] Processing CreateTablet for tablet b5a4328b7c8048a58b8f49269156e606 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:22:51.452658 23196 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd01caec9d94514a02b3e251a1ea509 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:22:51.453255 23200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a4328b7c8048a58b8f49269156e606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.453989 23196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd01caec9d94514a02b3e251a1ea509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.456732 23433 raft_consensus.cc:493] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.457247 23433 raft_consensus.cc:515] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.461508 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff21f76a0b4747afdcad23fe926e14" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:51.462296 23359 raft_consensus.cc:2468] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:51.463234 23433 leader_election.cc:290] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:51.463641 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24160013ee8743f88e93c264fde917b3" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:51.465087 23176 leader_election.cc:304] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:51.466639 23414 raft_consensus.cc:2804] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:51.467120 23414 raft_consensus.cc:493] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:51.467521 23414 raft_consensus.cc:3060] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:51.470672 23099 leader_election.cc:343] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.447474 23118 tablet_service.cc:1511] Processing CreateTablet for tablet 92f3d3eace634645af1d9239ca7bd856 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:22:51.472069 23118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f3d3eace634645af1d9239ca7bd856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.475615 23122 tablet_service.cc:1511] Processing CreateTablet for tablet 16a37225566b46a499f90759aadbf267 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:22:51.476960 23122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a37225566b46a499f90759aadbf267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.477409 23201 tablet_service.cc:1511] Processing CreateTablet for tablet 16a37225566b46a499f90759aadbf267 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:22:51.478726 23201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a37225566b46a499f90759aadbf267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.494912 23407 tablet_bootstrap.cc:492] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:51.502705 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 16a37225566b46a499f90759aadbf267 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:22:51.503484 23407 tablet_bootstrap.cc:654] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.504199 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a37225566b46a499f90759aadbf267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.511826 23414 raft_consensus.cc:515] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:51.515919 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff21f76a0b4747afdcad23fe926e14" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:51.516042 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff21f76a0b4747afdcad23fe926e14" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:51.516587 23359 raft_consensus.cc:3060] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:51.517585 23175 leader_election.cc:343] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.473361 23343 tablet_service.cc:1511] Processing CreateTablet for tablet b5a4328b7c8048a58b8f49269156e606 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:22:51.519188 23343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a4328b7c8048a58b8f49269156e606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.520166 23404 tablet_bootstrap.cc:492] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:51.520704 23404 ts_tablet_manager.cc:1403] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.357s	user 0.032s	sys 0.006s
I20260709 13:22:51.523566 23405 ts_tablet_manager.cc:1434] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.227s	user 0.029s	sys 0.048s
I20260709 13:22:51.524814 23405 tablet_bootstrap.cc:492] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:51.524528 23404 raft_consensus.cc:359] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:51.534271 23404 raft_consensus.cc:385] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.530107 23359 raft_consensus.cc:2468] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:51.534636 23404 raft_consensus.cc:740] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.535820 23176 leader_election.cc:304] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:51.535643 23404 consensus_queue.cc:260] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:51.540158 23404 ts_tablet_manager.cc:1434] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 13:22:51.541280 23404 tablet_bootstrap.cc:492] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:51.546759 23406 tablet_bootstrap.cc:492] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:51.547351 23406 ts_tablet_manager.cc:1403] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.186s	user 0.024s	sys 0.003s
I20260709 13:22:51.547972 23346 tablet_service.cc:1511] Processing CreateTablet for tablet 283ea57ae7df4e8aab22865b9922ad56 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:22:51.549364 23346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 283ea57ae7df4e8aab22865b9922ad56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.522282 23414 leader_election.cc:290] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:51.562326 23414 raft_consensus.cc:2804] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:51.562965 23414 raft_consensus.cc:697] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:51.564086 23414 consensus_queue.cc:237] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:51.567405 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24160013ee8743f88e93c264fde917b3" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:51.550923 23125 tablet_service.cc:1511] Processing CreateTablet for tablet 283ea57ae7df4e8aab22865b9922ad56 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 13:22:51.569298 23100 leader_election.cc:343] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.570003 23100 leader_election.cc:304] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:51.570578 23125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 283ea57ae7df4e8aab22865b9922ad56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.571461 23438 raft_consensus.cc:2749] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:51.571269 23201 tablet_service.cc:1511] Processing CreateTablet for tablet 283ea57ae7df4e8aab22865b9922ad56 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:22:51.572778 23201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 283ea57ae7df4e8aab22865b9922ad56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.556860 23405 tablet_bootstrap.cc:654] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.550693 23406 raft_consensus.cc:359] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.573971 23406 raft_consensus.cc:385] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.574395 23406 raft_consensus.cc:740] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.575357 23406 consensus_queue.cc:260] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
W20260709 13:22:51.589417 23176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 53693.2us
I20260709 13:22:51.590281 23268 tablet_service.cc:1511] Processing CreateTablet for tablet a537c251284f4165af8ff6b08343c427 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:22:51.592061 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a537c251284f4165af8ff6b08343c427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.596999 23033 catalog_manager.cc:5697] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:51.603101 23342 tablet_service.cc:1511] Processing CreateTablet for tablet a537c251284f4165af8ff6b08343c427 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:22:51.605379 23342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a537c251284f4165af8ff6b08343c427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.603541 23414 raft_consensus.cc:493] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.609963 23414 raft_consensus.cc:515] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.609112 23407 tablet_bootstrap.cc:492] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:51.611222 23407 ts_tablet_manager.cc:1403] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.014s
I20260709 13:22:51.612341 23122 tablet_service.cc:1511] Processing CreateTablet for tablet a537c251284f4165af8ff6b08343c427 (DEFAULT_TABLE table=test-workload [id=efa6a03769964f1f8581471ea6d8b8ed]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:22:51.613862 23122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a537c251284f4165af8ff6b08343c427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:51.614606 23407 raft_consensus.cc:359] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.615386 23407 raft_consensus.cc:385] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.615674 23407 raft_consensus.cc:740] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.617684 23407 consensus_queue.cc:260] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.620020 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda95fa80ad4b20905e75de45272508" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:51.621990 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda95fa80ad4b20905e75de45272508" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
W20260709 13:22:51.624610 23175 leader_election.cc:343] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:51.626005 23174 leader_election.cc:343] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.626153 23407 ts_tablet_manager.cc:1434] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:22:51.626533 23174 leader_election.cc:304] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:51.623239 23414 leader_election.cc:290] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:51.632404 23414 raft_consensus.cc:2749] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:51.612311 23404 tablet_bootstrap.cc:654] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.635036 23406 ts_tablet_manager.cc:1434] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.018s
I20260709 13:22:51.635686 23407 tablet_bootstrap.cc:492] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:51.643693 23406 tablet_bootstrap.cc:492] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:51.644611 23405 tablet_bootstrap.cc:492] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:51.645200 23405 ts_tablet_manager.cc:1403] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.121s	user 0.011s	sys 0.008s
I20260709 13:22:51.648612 23405 raft_consensus.cc:359] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.649375 23405 raft_consensus.cc:385] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.649669 23405 raft_consensus.cc:740] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.655520 23405 consensus_queue.cc:260] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.659008 23407 tablet_bootstrap.cc:654] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.660029 23405 ts_tablet_manager.cc:1434] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:22:51.660779 23406 tablet_bootstrap.cc:654] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.667798 23404 tablet_bootstrap.cc:492] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:51.668356 23404 ts_tablet_manager.cc:1403] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.127s	user 0.014s	sys 0.002s
I20260709 13:22:51.672132 23404 raft_consensus.cc:359] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.674196 23404 raft_consensus.cc:385] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.674507 23404 raft_consensus.cc:740] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.675380 23404 consensus_queue.cc:260] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.680413 23404 ts_tablet_manager.cc:1434] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:22:51.680684 23405 tablet_bootstrap.cc:492] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:51.681579 23404 tablet_bootstrap.cc:492] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:51.702135 23407 tablet_bootstrap.cc:492] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:51.703033 23407 ts_tablet_manager.cc:1403] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.008s
I20260709 13:22:51.703729 23406 tablet_bootstrap.cc:492] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:51.703940 23405 tablet_bootstrap.cc:654] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.704289 23406 ts_tablet_manager.cc:1403] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.010s
I20260709 13:22:51.709393 23423 raft_consensus.cc:493] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.710239 23423 raft_consensus.cc:515] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.712690 23423 leader_election.cc:290] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:51.714154 23407 raft_consensus.cc:359] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.715035 23407 raft_consensus.cc:385] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.715384 23407 raft_consensus.cc:740] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.716352 23407 consensus_queue.cc:260] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.717046 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24160013ee8743f88e93c264fde917b3" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:51.719311 23407 ts_tablet_manager.cc:1434] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:22:51.713565 23406 raft_consensus.cc:359] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.720199 23406 raft_consensus.cc:385] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.720536 23406 raft_consensus.cc:740] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.721243 23423 raft_consensus.cc:493] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.721347 23406 consensus_queue.cc:260] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.721987 23423 raft_consensus.cc:515] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
W20260709 13:22:51.722489 23249 leader_election.cc:343] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.723840 23406 ts_tablet_manager.cc:1434] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:22:51.724949 23406 tablet_bootstrap.cc:492] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:51.725317 23423 leader_election.cc:290] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:51.725533 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b02752797c494ea2853b042faf1da6" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:51.717046 23405 tablet_bootstrap.cc:492] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:51.726332 23405 ts_tablet_manager.cc:1403] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.009s
W20260709 13:22:51.726928 23250 leader_election.cc:343] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.726495 23407 tablet_bootstrap.cc:492] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:51.729554 23405 raft_consensus.cc:359] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:51.730346 23405 raft_consensus.cc:385] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.730655 23405 raft_consensus.cc:740] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.731452 23405 consensus_queue.cc:260] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:51.732153 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24160013ee8743f88e93c264fde917b3" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:51.732887 23136 raft_consensus.cc:2468] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:51.733961 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b02752797c494ea2853b042faf1da6" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:51.734709 23135 raft_consensus.cc:2468] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:51.731509 23404 tablet_bootstrap.cc:654] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.737187 23438 raft_consensus.cc:493] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.737802 23438 raft_consensus.cc:515] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:51.738962 23249 leader_election.cc:304] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0
I20260709 13:22:51.740068 23406 tablet_bootstrap.cc:654] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.740161 23438 leader_election.cc:290] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:51.740413 23249 leader_election.cc:304] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:51.742153 23423 raft_consensus.cc:2804] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:51.742650 23423 raft_consensus.cc:493] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:51.743067 23405 ts_tablet_manager.cc:1434] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:51.743320 23423 raft_consensus.cc:3060] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:51.744009 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9a54537545268b3b0ac024d58a93" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:51.744570 23405 tablet_bootstrap.cc:492] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:51.742918 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9a54537545268b3b0ac024d58a93" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:51.748927 23100 leader_election.cc:343] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.751788 23407 tablet_bootstrap.cc:654] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:51.753895 23101 leader_election.cc:343] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.757438 23405 tablet_bootstrap.cc:654] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.757692 23456 raft_consensus.cc:2804] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:51.758167 23456 raft_consensus.cc:493] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:51.758528 23456 raft_consensus.cc:3060] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:51.758561 23101 leader_election.cc:304] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115
I20260709 13:22:51.760655 23438 raft_consensus.cc:2749] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:51.766429 23423 raft_consensus.cc:515] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.768680 23404 tablet_bootstrap.cc:492] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:51.769104 23423 leader_election.cc:290] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:51.770331 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24160013ee8743f88e93c264fde917b3" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:51.772682 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24160013ee8743f88e93c264fde917b3" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:51.773372 23135 raft_consensus.cc:3060] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:51.776926 23407 tablet_bootstrap.cc:492] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:51.777551 23407 ts_tablet_manager.cc:1403] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.012s
I20260709 13:22:51.780508 23406 tablet_bootstrap.cc:492] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:51.781262 23406 ts_tablet_manager.cc:1403] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.002s
I20260709 13:22:51.780988 23407 raft_consensus.cc:359] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
W20260709 13:22:51.781453 23249 leader_election.cc:343] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.782064 23407 raft_consensus.cc:385] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.782649 23407 raft_consensus.cc:740] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.783589 23407 consensus_queue.cc:260] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:51.784161 23135 raft_consensus.cc:2468] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:51.785691 23249 leader_election.cc:304] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0
I20260709 13:22:51.786691 23423 raft_consensus.cc:2804] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:51.785955 23404 ts_tablet_manager.cc:1403] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.002s
I20260709 13:22:51.789094 23405 tablet_bootstrap.cc:492] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:51.789707 23405 ts_tablet_manager.cc:1403] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.014s
I20260709 13:22:51.791225 23406 raft_consensus.cc:359] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:51.791998 23406 raft_consensus.cc:385] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.792302 23406 raft_consensus.cc:740] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.790621 23404 raft_consensus.cc:359] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.793419 23404 raft_consensus.cc:385] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.794735 23404 raft_consensus.cc:740] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.794766 23423 raft_consensus.cc:697] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:51.793628 23406 consensus_queue.cc:260] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:51.794000 23405 raft_consensus.cc:359] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:51.795374 23461 raft_consensus.cc:493] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.796005 23423 consensus_queue.cc:237] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.796028 23456 raft_consensus.cc:515] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.795933 23404 consensus_queue.cc:260] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.796339 23405 raft_consensus.cc:385] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.797093 23461 raft_consensus.cc:515] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.805471 23406 ts_tablet_manager.cc:1434] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 13:22:51.799934 23456 leader_election.cc:290] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:51.806609 23406 tablet_bootstrap.cc:492] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:51.800644 23405 raft_consensus.cc:740] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.804632 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b02752797c494ea2853b042faf1da6" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:51.808502 23405 consensus_queue.cc:260] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
W20260709 13:22:51.809218 23250 leader_election.cc:343] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.811208 23405 ts_tablet_manager.cc:1434] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:22:51.811203 23404 ts_tablet_manager.cc:1434] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.005s
I20260709 13:22:51.813205 23405 tablet_bootstrap.cc:492] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:51.806654 23407 ts_tablet_manager.cc:1434] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:22:51.815471 23407 tablet_bootstrap.cc:492] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:51.816346 23456 raft_consensus.cc:493] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.818524 23456 raft_consensus.cc:515] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:51.819389 23406 tablet_bootstrap.cc:654] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.821341 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d41e7244bf04a4c8c6d02911a829766" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:51.817682 23461 leader_election.cc:290] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:51.822988 23404 tablet_bootstrap.cc:492] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
W20260709 13:22:51.827723 23250 leader_election.cc:343] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.828739 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479db0348074d559c5290d442d0c297" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:51.829312 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b02752797c494ea2853b042faf1da6" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:51.829974 23135 raft_consensus.cc:3060] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:51.830353 23250 leader_election.cc:343] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.825462 23456 leader_election.cc:290] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:51.833295 23411 raft_consensus.cc:493] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.834031 23411 raft_consensus.cc:515] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.837706 23411 leader_election.cc:290] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:51.838995 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d309f995b354b95a4a462a0f9831a85" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
W20260709 13:22:51.844110 23323 leader_election.cc:343] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.851133 23135 raft_consensus.cc:2468] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:51.861569 23407 tablet_bootstrap.cc:654] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.863557 23405 tablet_bootstrap.cc:654] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.864593 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d41e7244bf04a4c8c6d02911a829766" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:51.865564 23211 raft_consensus.cc:2468] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:51.869326 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479db0348074d559c5290d442d0c297" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:51.868721 23033 catalog_manager.cc:5697] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:51.870313 23135 raft_consensus.cc:2468] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:51.868036 23411 raft_consensus.cc:493] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.872159 23411 raft_consensus.cc:515] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.875193 23411 leader_election.cc:290] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:51.877627 23404 tablet_bootstrap.cc:654] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.879530 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d451d4f8dd554041a70fc8d71618d090" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
W20260709 13:22:51.884244 23323 leader_election.cc:343] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.886847 23249 leader_election.cc:304] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:51.887884 23423 raft_consensus.cc:2804] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:51.888293 23423 raft_consensus.cc:493] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:51.888760 23423 raft_consensus.cc:3060] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:51.888190 23249 leader_election.cc:304] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:51.894989 23407 tablet_bootstrap.cc:492] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:51.895406 23462 raft_consensus.cc:2804] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:51.895642 23407 ts_tablet_manager.cc:1403] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.016s
I20260709 13:22:51.896034 23462 raft_consensus.cc:697] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:51.896974 23423 raft_consensus.cc:515] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.897038 23462 consensus_queue.cc:237] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.899516 23423 leader_election.cc:290] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:51.900959 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d41e7244bf04a4c8c6d02911a829766" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
W20260709 13:22:51.902889 23250 leader_election.cc:343] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.902990 23249 leader_election.cc:304] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:51.902634 23407 raft_consensus.cc:359] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.904750 23407 raft_consensus.cc:385] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.905447 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d41e7244bf04a4c8c6d02911a829766" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:51.906189 23211 raft_consensus.cc:3060] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:51.905733 23407 raft_consensus.cc:740] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.907590 23407 consensus_queue.cc:260] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.909463 23407 ts_tablet_manager.cc:1434] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:22:51.911033 23407 tablet_bootstrap.cc:492] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:51.913061 23034 catalog_manager.cc:5697] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:51.915601 23211 raft_consensus.cc:2468] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:51.917001 23249 leader_election.cc:304] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:51.906597 23462 raft_consensus.cc:2804] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:51.918669 23462 raft_consensus.cc:493] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:51.919087 23462 raft_consensus.cc:3060] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:51.919593 23407 tablet_bootstrap.cc:654] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.920583 23406 tablet_bootstrap.cc:492] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:51.921106 23406 ts_tablet_manager.cc:1403] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.019s
I20260709 13:22:51.922050 23423 raft_consensus.cc:2804] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:51.922817 23423 raft_consensus.cc:697] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:51.924052 23423 consensus_queue.cc:237] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.924414 23406 raft_consensus.cc:359] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.925316 23406 raft_consensus.cc:385] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.925680 23406 raft_consensus.cc:740] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.926501 23406 consensus_queue.cc:260] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.929309 23406 ts_tablet_manager.cc:1434] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:22:51.930459 23406 tablet_bootstrap.cc:492] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:51.932268 23456 raft_consensus.cc:493] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.932801 23456 raft_consensus.cc:515] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.933537 23405 tablet_bootstrap.cc:492] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:51.934093 23405 ts_tablet_manager.cc:1403] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.121s	user 0.023s	sys 0.019s
I20260709 13:22:51.936331 23404 tablet_bootstrap.cc:492] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:51.936964 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d451d4f8dd554041a70fc8d71618d090" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:51.937553 23405 raft_consensus.cc:359] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.938452 23405 raft_consensus.cc:385] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.938768 23405 raft_consensus.cc:740] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.938556 23359 raft_consensus.cc:2468] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:51.939679 23405 consensus_queue.cc:260] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:51.940740 23250 leader_election.cc:304] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:51.942277 23405 ts_tablet_manager.cc:1434] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:22:51.944542 23461 raft_consensus.cc:2804] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:51.944960 23461 raft_consensus.cc:493] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:51.937521 23456 leader_election.cc:290] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:51.945339 23461 raft_consensus.cc:3060] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:51.946573 23404 ts_tablet_manager.cc:1403] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.005s
I20260709 13:22:51.951262 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d309f995b354b95a4a462a0f9831a85" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:51.951368 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d451d4f8dd554041a70fc8d71618d090" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:51.952235 23284 raft_consensus.cc:2468] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 0.
I20260709 13:22:51.953837 23322 leader_election.cc:304] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0
I20260709 13:22:51.954758 23411 raft_consensus.cc:2804] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:51.955179 23411 raft_consensus.cc:493] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:51.955520 23411 raft_consensus.cc:3060] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:51.955963 23405 tablet_bootstrap.cc:492] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:51.962380 23461 raft_consensus.cc:515] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.963624 23285 raft_consensus.cc:2393] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28222c0dd7a1411692efad3387118115 in current term 1: Already voted for candidate b1f5ee52ad2f442bac6959931126746d in this term.
I20260709 13:22:51.958983 23404 raft_consensus.cc:359] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:51.964300 23404 raft_consensus.cc:385] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:51.964742 23404 raft_consensus.cc:740] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:51.966037 23404 consensus_queue.cc:260] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:51.967808 23322 leader_election.cc:304] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:51.968824 23473 raft_consensus.cc:493] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:51.969396 23473 raft_consensus.cc:515] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:51.969538 23411 raft_consensus.cc:515] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:51.971581 23473 leader_election.cc:290] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:51.972534 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d309f995b354b95a4a462a0f9831a85" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:51.972673 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:51.973167 23211 raft_consensus.cc:3060] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:51.973068 23475 raft_consensus.cc:3060] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:51.974529 23323 leader_election.cc:343] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:51.975255 23462 raft_consensus.cc:515] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:51.976177 23411 leader_election.cc:290] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:51.977380 23462 leader_election.cc:290] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:51.978590 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479db0348074d559c5290d442d0c297" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:51.978910 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d309f995b354b95a4a462a0f9831a85" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:51.979422 23359 raft_consensus.cc:3060] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:51.979547 23284 raft_consensus.cc:3060] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:51.983374 23406 tablet_bootstrap.cc:654] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.986212 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:51.970526 23032 catalog_manager.cc:5697] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:51.996095 23405 tablet_bootstrap.cc:654] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:51.996220 23404 ts_tablet_manager.cc:1434] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.049s	user 0.011s	sys 0.003s
I20260709 13:22:51.997279 23404 tablet_bootstrap.cc:492] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:52.000141 23211 raft_consensus.cc:2468] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:22:52.001654 23407 tablet_bootstrap.cc:492] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:52.002399 23407 ts_tablet_manager.cc:1403] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.092s	user 0.038s	sys 0.019s
I20260709 13:22:52.005553 23407 raft_consensus.cc:359] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.005964 23359 raft_consensus.cc:2468] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:52.006392 23407 raft_consensus.cc:385] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.006728 23407 raft_consensus.cc:740] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.007468 23407 consensus_queue.cc:260] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.010385 23405 tablet_bootstrap.cc:492] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:52.010932 23405 ts_tablet_manager.cc:1403] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.002s
I20260709 13:22:52.013239 23250 leader_election.cc:304] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:52.014300 23405 raft_consensus.cc:359] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.015084 23405 raft_consensus.cc:385] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.015403 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d451d4f8dd554041a70fc8d71618d090" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:52.015872 23423 raft_consensus.cc:2804] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:52.016440 23423 raft_consensus.cc:697] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:52.017144 23407 ts_tablet_manager.cc:1434] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:22:52.017310 23423 consensus_queue.cc:237] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.018239 23407 tablet_bootstrap.cc:492] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:52.018827 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f479db0348074d559c5290d442d0c297" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:52.015405 23405 raft_consensus.cc:740] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.019932 23135 raft_consensus.cc:3060] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.020466 23405 consensus_queue.cc:260] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
W20260709 13:22:52.022760 23322 leader_election.cc:343] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.023245 23322 leader_election.cc:304] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:52.023730 23405 ts_tablet_manager.cc:1434] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:22:52.024364 23473 raft_consensus.cc:2749] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:52.027179 23405 tablet_bootstrap.cc:492] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:52.027988 23135 raft_consensus.cc:2468] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:52.028059 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d451d4f8dd554041a70fc8d71618d090" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:52.029839 23323 leader_election.cc:304] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:22:52.030715 23473 raft_consensus.cc:2804] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:52.030835 23475 raft_consensus.cc:2749] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:52.031239 23473 raft_consensus.cc:697] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:22:52.032163 23473 consensus_queue.cc:237] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.034638 23404 tablet_bootstrap.cc:654] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.038295 23405 tablet_bootstrap.cc:654] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:52.038484 23249 leader_election.cc:343] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.053403 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d451d4f8dd554041a70fc8d71618d090" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:52.042943 23461 leader_election.cc:290] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:51.997665 23284 raft_consensus.cc:2468] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
W20260709 13:22:52.058441 23249 leader_election.cc:343] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.065757 23359 raft_consensus.cc:2468] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:52.075806 23250 leader_election.cc:304] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0
I20260709 13:22:52.075330 23033 catalog_manager.cc:5697] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 1 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:52.077744 23423 raft_consensus.cc:2804] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:52.078349 23423 raft_consensus.cc:697] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:52.079082 23406 tablet_bootstrap.cc:492] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:52.079730 23406 ts_tablet_manager.cc:1403] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.149s	user 0.012s	sys 0.030s
I20260709 13:22:52.079206 23423 consensus_queue.cc:237] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
W20260709 13:22:52.082273 23082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:52.082778 23406 raft_consensus.cc:359] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.083552 23406 raft_consensus.cc:385] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.083847 23406 raft_consensus.cc:740] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.084601 23407 tablet_bootstrap.cc:654] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.084551 23406 consensus_queue.cc:260] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.087096 23406 ts_tablet_manager.cc:1434] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:52.081604 23405 tablet_bootstrap.cc:492] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:52.085031 23404 tablet_bootstrap.cc:492] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:52.087744 23405 ts_tablet_manager.cc:1403] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.004s
I20260709 13:22:52.087926 23404 ts_tablet_manager.cc:1403] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.091s	user 0.006s	sys 0.029s
I20260709 13:22:52.090706 23405 raft_consensus.cc:359] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.091450 23405 raft_consensus.cc:385] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.091747 23405 raft_consensus.cc:740] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.092440 23405 consensus_queue.cc:260] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.094674 23405 ts_tablet_manager.cc:1434] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:22:52.094257 23438 raft_consensus.cc:493] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.110126 23031 catalog_manager.cc:5697] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:52.093269 23406 tablet_bootstrap.cc:492] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:52.115141 23405 tablet_bootstrap.cc:492] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:52.114799 23438 raft_consensus.cc:515] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.123109 23135 raft_consensus.cc:3060] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.131075 23405 tablet_bootstrap.cc:654] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.138281 23445 consensus_queue.cc:1048] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:52.142328 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff21f76a0b4747afdcad23fe926e14" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:52.148546 23438 leader_election.cc:290] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:52.149138 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ff21f76a0b4747afdcad23fe926e14" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:52.151437 23100 leader_election.cc:304] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115
I20260709 13:22:52.153076 23438 raft_consensus.cc:2749] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:52.091986 23404 raft_consensus.cc:359] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.154742 23404 raft_consensus.cc:385] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.155200 23404 raft_consensus.cc:740] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.156203 23407 tablet_bootstrap.cc:492] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:52.156888 23407 ts_tablet_manager.cc:1403] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.139s	user 0.008s	sys 0.026s
I20260709 13:22:52.156535 23033 catalog_manager.cc:5697] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:52.160707 23407 raft_consensus.cc:359] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.161655 23407 raft_consensus.cc:385] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.162030 23407 raft_consensus.cc:740] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.162882 23407 consensus_queue.cc:260] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.164444 23461 raft_consensus.cc:493] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.164903 23461 raft_consensus.cc:515] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.165498 23407 ts_tablet_manager.cc:1434] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:22:52.166517 23407 tablet_bootstrap.cc:492] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:52.167030 23461 leader_election.cc:290] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:52.169438 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c922bd920ef0444182579d77023af05e" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:52.171028 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c922bd920ef0444182579d77023af05e" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:52.171856 23211 raft_consensus.cc:2468] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:52.173424 23407 tablet_bootstrap.cc:654] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:52.173570 23249 leader_election.cc:343] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.174396 23249 leader_election.cc:304] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:52.175999 23423 raft_consensus.cc:2804] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:52.176473 23423 raft_consensus.cc:493] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:52.176800 23423 raft_consensus.cc:3060] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.185422 23423 raft_consensus.cc:515] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.189052 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c922bd920ef0444182579d77023af05e" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:52.190397 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c922bd920ef0444182579d77023af05e" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
W20260709 13:22:52.190578 23249 leader_election.cc:343] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.189536 23404 consensus_queue.cc:260] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.191020 23211 raft_consensus.cc:3060] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.194075 23406 tablet_bootstrap.cc:654] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.195868 23487 raft_consensus.cc:493] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.196468 23487 raft_consensus.cc:515] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.200642 23405 tablet_bootstrap.cc:492] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:52.204524 23405 ts_tablet_manager.cc:1403] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.008s
I20260709 13:22:52.206246 23404 ts_tablet_manager.cc:1434] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.118s	user 0.005s	sys 0.004s
I20260709 13:22:52.207540 23404 tablet_bootstrap.cc:492] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:52.208425 23405 raft_consensus.cc:359] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.209501 23405 raft_consensus.cc:385] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.209924 23438 raft_consensus.cc:493] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.210872 23438 raft_consensus.cc:515] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.214393 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28937175e4764f6484d66b61a7e1592a" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:52.209898 23423 leader_election.cc:290] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:52.215095 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28937175e4764f6484d66b61a7e1592a" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:52.215134 23210 raft_consensus.cc:2468] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:52.215771 23284 raft_consensus.cc:2468] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:52.217258 23099 leader_election.cc:304] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:52.218724 23484 raft_consensus.cc:2804] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:52.219274 23484 raft_consensus.cc:493] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:52.219681 23484 raft_consensus.cc:3060] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.221112 23494 raft_consensus.cc:493] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.221683 23494 raft_consensus.cc:515] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.230991 23484 raft_consensus.cc:515] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.232481 23490 consensus_queue.cc:1048] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:52.233136 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9a54537545268b3b0ac024d58a93" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:52.241860 23407 tablet_bootstrap.cc:492] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:52.242272 23359 raft_consensus.cc:2468] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:52.233902 23211 raft_consensus.cc:2468] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:52.234529 23438 leader_election.cc:290] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:52.234920 23494 leader_election.cc:290] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:52.235632 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9a54537545268b3b0ac024d58a93" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:52.224038 23406 tablet_bootstrap.cc:492] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:52.243728 23135 raft_consensus.cc:2468] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:52.244096 23406 ts_tablet_manager.cc:1403] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.151s	user 0.010s	sys 0.005s
I20260709 13:22:52.244503 23249 leader_election.cc:304] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:52.244956 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28937175e4764f6484d66b61a7e1592a" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:52.237103 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d451d4f8dd554041a70fc8d71618d090" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:52.237962 23487 leader_election.cc:290] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:52.239282 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d451d4f8dd554041a70fc8d71618d090" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:52.243732 23176 leader_election.cc:304] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:22:52.246913 23423 raft_consensus.cc:2804] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:52.236624 23404 tablet_bootstrap.cc:654] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.246477 23358 raft_consensus.cc:2393] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f0dc6416e1e43ee863a6af614ece6c0 in current term 1: Already voted for candidate b1f5ee52ad2f442bac6959931126746d in this term.
I20260709 13:22:52.242432 23407 ts_tablet_manager.cc:1403] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.036s
I20260709 13:22:52.245615 23210 raft_consensus.cc:3060] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.249617 23423 raft_consensus.cc:697] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:52.251053 23423 consensus_queue.cc:237] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.251484 23407 raft_consensus.cc:359] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.252167 23407 raft_consensus.cc:385] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.252452 23407 raft_consensus.cc:740] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.253093 23407 consensus_queue.cc:260] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.255370 23407 ts_tablet_manager.cc:1434] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:52.256562 23407 tablet_bootstrap.cc:492] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:52.256605 23406 raft_consensus.cc:359] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.257635 23406 raft_consensus.cc:385] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.257994 23406 raft_consensus.cc:740] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.243794 23438 raft_consensus.cc:493] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.258517 23488 raft_consensus.cc:2804] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:52.258620 23438 raft_consensus.cc:515] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.258924 23176 leader_election.cc:304] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:52.258878 23406 consensus_queue.cc:260] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.260402 23494 raft_consensus.cc:3060] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.261531 23406 ts_tablet_manager.cc:1434] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:22:52.261574 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ee84482afc4bd590fa2592f7fa9f44" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:52.262465 23284 raft_consensus.cc:2468] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:52.262696 23406 tablet_bootstrap.cc:492] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:52.263792 23099 leader_election.cc:304] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:52.267098 23210 raft_consensus.cc:2468] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:52.268617 23100 leader_election.cc:304] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:52.259092 23488 raft_consensus.cc:493] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:52.270355 23488 raft_consensus.cc:3060] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.270723 23494 raft_consensus.cc:2749] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:52.273972 23406 tablet_bootstrap.cc:654] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.280519 23406 tablet_bootstrap.cc:492] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:52.281520 23406 ts_tablet_manager.cc:1403] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:22:52.285545 23406 raft_consensus.cc:359] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.286572 23461 consensus_queue.cc:1048] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:52.289748 23406 raft_consensus.cc:385] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.290371 23406 raft_consensus.cc:740] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.291606 23406 consensus_queue.cc:260] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.209775 23405 raft_consensus.cc:740] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.297212 23405 consensus_queue.cc:260] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.300137 23406 ts_tablet_manager.cc:1434] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 13:22:52.301920 23406 tablet_bootstrap.cc:492] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:52.308163 23484 leader_election.cc:290] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:52.309830 23484 raft_consensus.cc:2804] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:52.310316 23484 raft_consensus.cc:493] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:52.310511 23406 tablet_bootstrap.cc:654] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.314420 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ee84482afc4bd590fa2592f7fa9f44" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:52.316223 23101 leader_election.cc:343] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.316896 23438 leader_election.cc:290] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:52.317492 23438 raft_consensus.cc:2804] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:52.317998 23438 raft_consensus.cc:697] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:52.318908 23438 consensus_queue.cc:237] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.321120 23488 raft_consensus.cc:515] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.323757 23406 tablet_bootstrap.cc:492] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:52.324555 23406 ts_tablet_manager.cc:1403] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:22:52.324575 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9a54537545268b3b0ac024d58a93" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:52.325433 23358 raft_consensus.cc:3060] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.326056 23407 tablet_bootstrap.cc:654] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.326826 23134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7d9a54537545268b3b0ac024d58a93" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:52.327497 23134 raft_consensus.cc:3060] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.324791 23488 leader_election.cc:290] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:52.328557 23406 raft_consensus.cc:359] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.329862 23406 raft_consensus.cc:385] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.330260 23406 raft_consensus.cc:740] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.331341 23406 consensus_queue.cc:260] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.334131 23406 ts_tablet_manager.cc:1434] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.009s	user 0.012s	sys 0.000s
I20260709 13:22:52.335706 23406 tablet_bootstrap.cc:492] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:52.342636 23358 raft_consensus.cc:2468] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
W20260709 13:22:52.343086 23250 consensus_peers.cc:597] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:52.348959 23250 consensus_peers.cc:597] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:52.353777 23099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 90058us
I20260709 13:22:52.366616 23406 tablet_bootstrap.cc:654] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.369098 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28937175e4764f6484d66b61a7e1592a" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:52.369889 23488 raft_consensus.cc:493] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:52.354048 23100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:34617, user_credentials={real_user=slave}} blocked reactor thread for 85533.3us
I20260709 13:22:52.370601 23488 raft_consensus.cc:515] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.345238 23134 raft_consensus.cc:2468] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:52.373070 23488 leader_election.cc:290] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:52.373014 23175 leader_election.cc:304] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:52.375272 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b244c487d44b40a9f7800f2ae45a24" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:52.376027 23133 raft_consensus.cc:2468] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:52.377235 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b244c487d44b40a9f7800f2ae45a24" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:52.377938 23359 raft_consensus.cc:2468] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:52.310729 23484 raft_consensus.cc:3060] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.379825 23176 leader_election.cc:304] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:22:52.380726 23494 raft_consensus.cc:2804] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:52.381215 23494 raft_consensus.cc:697] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:52.381346 23487 raft_consensus.cc:2804] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:52.381867 23487 raft_consensus.cc:493] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:52.357627 23405 ts_tablet_manager.cc:1434] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.153s	user 0.008s	sys 0.000s
I20260709 13:22:52.382261 23487 raft_consensus.cc:3060] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.382170 23494 consensus_queue.cc:237] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.384289 23406 tablet_bootstrap.cc:492] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:52.384789 23406 ts_tablet_manager.cc:1403] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.009s
I20260709 13:22:52.385731 23405 tablet_bootstrap.cc:492] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:52.369959 23284 raft_consensus.cc:3060] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.387742 23406 raft_consensus.cc:359] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.388402 23406 raft_consensus.cc:385] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.390703 23487 raft_consensus.cc:515] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.393110 23487 leader_election.cc:290] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:52.394358 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b244c487d44b40a9f7800f2ae45a24" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:52.395247 23133 raft_consensus.cc:3060] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.396322 23033 catalog_manager.cc:5697] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:52.407256 23210 raft_consensus.cc:3060] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.408718 23284 raft_consensus.cc:2468] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:52.388651 23406 raft_consensus.cc:740] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.394395 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b244c487d44b40a9f7800f2ae45a24" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:52.424903 23133 raft_consensus.cc:2468] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:52.420432 23406 consensus_queue.cc:260] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.419147 23358 raft_consensus.cc:3060] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.431645 23406 ts_tablet_manager.cc:1434] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:22:52.432159 23423 consensus_queue.cc:1048] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:52.432844 23406 tablet_bootstrap.cc:492] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:52.438063 23175 leader_election.cc:304] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:52.439486 23488 raft_consensus.cc:2804] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:52.440294 23488 raft_consensus.cc:697] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:52.441110 23488 consensus_queue.cc:237] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.444914 23405 tablet_bootstrap.cc:654] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.451800 23406 tablet_bootstrap.cc:654] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.468384 23456 raft_consensus.cc:493] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.468976 23456 raft_consensus.cc:515] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.470242 23407 tablet_bootstrap.cc:492] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:52.470973 23407 ts_tablet_manager.cc:1403] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.215s	user 0.025s	sys 0.029s
I20260709 13:22:52.471216 23456 leader_election.cc:290] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:52.472380 23404 tablet_bootstrap.cc:492] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:52.473032 23404 ts_tablet_manager.cc:1403] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.266s	user 0.048s	sys 0.096s
I20260709 13:22:52.476253 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda95fa80ad4b20905e75de45272508" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:52.476629 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda95fa80ad4b20905e75de45272508" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:52.480314 23249 leader_election.cc:343] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.482973 23404 raft_consensus.cc:359] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.484094 23461 consensus_queue.cc:1048] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:52.489881 23407 raft_consensus.cc:359] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.490777 23407 raft_consensus.cc:385] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.491115 23407 raft_consensus.cc:740] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.492089 23407 consensus_queue.cc:260] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.486018 23404 raft_consensus.cc:385] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.485476 23456 consensus_queue.cc:1048] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:52.493176 23210 raft_consensus.cc:2468] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:52.496198 23404 raft_consensus.cc:740] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.498517 23404 consensus_queue.cc:260] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.496212 23407 ts_tablet_manager.cc:1434] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:22:52.523766 23404 ts_tablet_manager.cc:1434] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:22:52.525234 23407 tablet_bootstrap.cc:492] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:52.526925 23404 tablet_bootstrap.cc:492] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:52.485183 23484 raft_consensus.cc:515] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.545302 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ee84482afc4bd590fa2592f7fa9f44" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:52.525890 23358 raft_consensus.cc:2468] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:52.546833 23484 leader_election.cc:290] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:52.560393 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ee84482afc4bd590fa2592f7fa9f44" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
W20260709 13:22:52.562024 23101 leader_election.cc:343] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.552161 23494 raft_consensus.cc:493] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.554955 23284 raft_consensus.cc:3060] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.567878 23404 tablet_bootstrap.cc:654] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.557725 23406 tablet_bootstrap.cc:492] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:52.568588 23406 ts_tablet_manager.cc:1403] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.014s
I20260709 13:22:52.553375 23249 leader_election.cc:304] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:52.563719 23494 raft_consensus.cc:515] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.572201 23406 raft_consensus.cc:359] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.572444 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24160013ee8743f88e93c264fde917b3" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:52.572961 23406 raft_consensus.cc:385] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.573266 23406 raft_consensus.cc:740] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.573820 23494 leader_election.cc:290] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:52.574203 23406 consensus_queue.cc:260] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.566949 23032 catalog_manager.cc:5697] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:52.575421 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24160013ee8743f88e93c264fde917b3" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:52.577807 23175 leader_election.cc:304] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:52.580473 23033 catalog_manager.cc:5697] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:52.583207 23488 raft_consensus.cc:2749] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:52.584733 23406 ts_tablet_manager.cc:1434] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.006s
I20260709 13:22:52.585835 23406 tablet_bootstrap.cc:492] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:52.590001 23423 raft_consensus.cc:2804] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:52.594183 23423 raft_consensus.cc:493] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:52.594539 23423 raft_consensus.cc:3060] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.597100 23473 raft_consensus.cc:493] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.597625 23473 raft_consensus.cc:515] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.599821 23473 leader_election.cc:290] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:52.606845 23405 tablet_bootstrap.cc:492] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:52.607394 23405 ts_tablet_manager.cc:1403] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.222s	user 0.015s	sys 0.026s
I20260709 13:22:52.607555 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b02752797c494ea2853b042faf1da6" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:52.609560 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b02752797c494ea2853b042faf1da6" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:52.610248 23405 raft_consensus.cc:359] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.610941 23405 raft_consensus.cc:385] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.611188 23405 raft_consensus.cc:740] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.611961 23405 consensus_queue.cc:260] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.613181 23322 leader_election.cc:304] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:52.614133 23405 ts_tablet_manager.cc:1434] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:22:52.613929 23461 consensus_queue.cc:1048] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:52.614569 23462 consensus_queue.cc:1048] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:52.615301 23518 consensus_queue.cc:1048] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:52.615859 23284 raft_consensus.cc:2468] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:52.617312 23099 leader_election.cc:304] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:52.618532 23484 raft_consensus.cc:2804] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:52.619138 23484 raft_consensus.cc:697] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:52.625763 23405 tablet_bootstrap.cc:492] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:52.629082 23438 raft_consensus.cc:493] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.629844 23438 raft_consensus.cc:515] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.634162 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c922bd920ef0444182579d77023af05e" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:52.634191 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c922bd920ef0444182579d77023af05e" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:52.635277 23209 raft_consensus.cc:2393] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72629382bd4c46b09b2efeaf08c1460d in current term 1: Already voted for candidate b1f5ee52ad2f442bac6959931126746d in this term.
I20260709 13:22:52.640110 23438 leader_election.cc:290] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:52.641100 23100 leader_election.cc:304] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:52.642021 23438 raft_consensus.cc:3060] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.636279 23484 consensus_queue.cc:237] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.643911 23423 raft_consensus.cc:515] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.626786 23473 raft_consensus.cc:2749] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:52.645149 23473 consensus_queue.cc:1048] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:52.651517 23407 tablet_bootstrap.cc:654] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.669601 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda95fa80ad4b20905e75de45272508" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:52.681632 23438 raft_consensus.cc:2749] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:52.681941 23136 raft_consensus.cc:3060] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.682480 23405 tablet_bootstrap.cc:654] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.683655 23406 tablet_bootstrap.cc:654] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:52.685695 23322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 71235.6us
I20260709 13:22:52.672295 23423 leader_election.cc:290] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:52.680994 23404 tablet_bootstrap.cc:492] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:52.674948 23522 consensus_queue.cc:1048] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:22:52.690946 23404 ts_tablet_manager.cc:1403] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.166s	user 0.027s	sys 0.035s
I20260709 13:22:52.676473 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda95fa80ad4b20905e75de45272508" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:52.702327 23488 raft_consensus.cc:493] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.703121 23488 raft_consensus.cc:515] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.696550 23208 raft_consensus.cc:3060] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.706012 23423 consensus_queue.cc:1048] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:52.712124 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d36b6bd10764558b6db3eb4e2238a3f" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:52.723721 23176 leader_election.cc:343] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.732862 23518 raft_consensus.cc:493] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.733443 23518 raft_consensus.cc:515] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.735742 23518 leader_election.cc:290] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:52.738243 23134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d36b6bd10764558b6db3eb4e2238a3f" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:52.739959 23175 leader_election.cc:343] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.740552 23175 leader_election.cc:304] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:52.741498 23494 raft_consensus.cc:2749] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:52.727854 23488 leader_election.cc:290] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:52.741775 23134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:52.744534 23249 leader_election.cc:343] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.751431 23404 raft_consensus.cc:359] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.754007 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:52.754738 23358 raft_consensus.cc:2468] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:52.752553 23033 catalog_manager.cc:5697] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:52.752557 23404 raft_consensus.cc:385] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.760692 23404 raft_consensus.cc:740] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.761868 23404 consensus_queue.cc:260] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.772377 23404 ts_tablet_manager.cc:1434] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.000s
I20260709 13:22:52.775781 23404 tablet_bootstrap.cc:492] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:52.784303 23405 tablet_bootstrap.cc:492] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:52.785126 23405 ts_tablet_manager.cc:1403] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.165s	user 0.017s	sys 0.045s
I20260709 13:22:52.783773 23250 leader_election.cc:304] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:52.787489 23208 raft_consensus.cc:2468] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:52.787762 23461 raft_consensus.cc:2804] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:52.788165 23461 raft_consensus.cc:493] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:52.788522 23461 raft_consensus.cc:3060] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.778339 23518 consensus_queue.cc:1048] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:22:52.789644 23249 leader_election.cc:304] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:52.793242 23423 raft_consensus.cc:2804] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:52.793769 23423 raft_consensus.cc:697] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:52.798539 23406 tablet_bootstrap.cc:492] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:52.799075 23406 ts_tablet_manager.cc:1403] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.213s	user 0.040s	sys 0.046s
I20260709 13:22:52.798858 23423 consensus_queue.cc:237] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:52.803587 23406 raft_consensus.cc:359] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.805210 23406 raft_consensus.cc:385] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.805774 23406 raft_consensus.cc:740] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.804641 23358 raft_consensus.cc:3060] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.797009 23136 raft_consensus.cc:2468] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:52.808496 23488 raft_consensus.cc:493] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.809031 23488 raft_consensus.cc:515] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.816669 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006dd6ad5ee14da39d65b4a6f97b32a4" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:52.817394 23359 raft_consensus.cc:2468] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:52.796108 23405 raft_consensus.cc:359] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.818585 23405 raft_consensus.cc:385] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.819018 23405 raft_consensus.cc:740] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.820669 23405 consensus_queue.cc:260] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.824116 23176 leader_election.cc:304] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:22:52.825397 23487 raft_consensus.cc:2804] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:22:52.818221 23520 log.cc:927] Time spent T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:22:52.826228 23406 consensus_queue.cc:260] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.828163 23405 ts_tablet_manager.cc:1434] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.004s
I20260709 13:22:52.828922 23405 tablet_bootstrap.cc:492] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:52.826047 23487 raft_consensus.cc:493] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:52.830008 23487 raft_consensus.cc:3060] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.831843 23406 ts_tablet_manager.cc:1434] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:22:52.832851 23406 tablet_bootstrap.cc:492] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:52.835925 23488 leader_election.cc:290] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:52.841293 23406 tablet_bootstrap.cc:654] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.843286 23461 raft_consensus.cc:515] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.843809 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006dd6ad5ee14da39d65b4a6f97b32a4" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:52.845427 23175 leader_election.cc:343] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.848889 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:52.849586 23357 raft_consensus.cc:3060] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.865566 23484 raft_consensus.cc:493] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:52.872277 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:52.868515 23484 raft_consensus.cc:515] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.874349 23423 consensus_queue.cc:1048] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:52.879590 23404 tablet_bootstrap.cc:654] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.878847 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:52.882586 23136 raft_consensus.cc:3060] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:52.883267 23407 tablet_bootstrap.cc:492] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:52.883981 23407 ts_tablet_manager.cc:1403] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.361s	user 0.028s	sys 0.022s
I20260709 13:22:52.886309 23494 consensus_queue.cc:1048] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:52.887661 23407 raft_consensus.cc:359] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.888523 23407 raft_consensus.cc:385] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.888855 23407 raft_consensus.cc:740] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.892323 23407 consensus_queue.cc:260] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:52.880149 23461 leader_election.cc:290] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:52.893980 23484 leader_election.cc:290] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:52.894460 23284 raft_consensus.cc:2393] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72629382bd4c46b09b2efeaf08c1460d in current term 1: Already voted for candidate b1f5ee52ad2f442bac6959931126746d in this term.
I20260709 13:22:52.894572 23484 consensus_queue.cc:1048] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:52.900650 23487 raft_consensus.cc:515] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:52.903132 23487 leader_election.cc:290] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:52.900571 23357 raft_consensus.cc:2468] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:52.910369 23405 tablet_bootstrap.cc:654] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:52.918287 23407 ts_tablet_manager.cc:1434] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:22:52.918499 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:52.919361 23407 tablet_bootstrap.cc:492] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:52.919412 23355 raft_consensus.cc:2393] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72629382bd4c46b09b2efeaf08c1460d in current term 1: Already voted for candidate b1f5ee52ad2f442bac6959931126746d in this term.
I20260709 13:22:52.920979 23101 leader_election.cc:304] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:52.923898 23033 catalog_manager.cc:5697] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:52.930032 23487 consensus_queue.cc:1048] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:22:52.931598 23484 consensus_queue.cc:1048] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:22:52.923275 23250 leader_election.cc:304] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:52.934605 23461 raft_consensus.cc:2804] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:52.935148 23461 raft_consensus.cc:697] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:52.937712 23136 raft_consensus.cc:2468] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:52.945425 23406 tablet_bootstrap.cc:492] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:52.946249 23406 ts_tablet_manager.cc:1403] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.114s	user 0.028s	sys 0.015s
I20260709 13:22:52.938427 23438 raft_consensus.cc:2749] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:52.955993 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006dd6ad5ee14da39d65b4a6f97b32a4" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:52.936019 23461 consensus_queue.cc:237] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.992100 23405 tablet_bootstrap.cc:492] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:52.992834 23405 ts_tablet_manager.cc:1403] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.164s	user 0.015s	sys 0.011s
W20260709 13:22:52.996563 23175 leader_election.cc:343] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:52.996492 23405 raft_consensus.cc:359] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:52.998329 23405 raft_consensus.cc:385] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:52.998634 23405 raft_consensus.cc:740] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:52.986439 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006dd6ad5ee14da39d65b4a6f97b32a4" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:52.999377 23405 consensus_queue.cc:260] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.005882 23357 raft_consensus.cc:3060] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.007283 23405 ts_tablet_manager.cc:1434] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:22:53.008404 23405 tablet_bootstrap.cc:492] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:53.004994 23032 catalog_manager.cc:5697] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:53.013890 23488 consensus_queue.cc:1048] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:53.021039 23407 tablet_bootstrap.cc:654] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.021365 23494 consensus_queue.cc:1048] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:53.004685 23406 raft_consensus.cc:359] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.029157 23406 raft_consensus.cc:385] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.032169 23406 raft_consensus.cc:740] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.034739 23404 tablet_bootstrap.cc:492] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:53.035349 23404 ts_tablet_manager.cc:1403] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.260s	user 0.025s	sys 0.021s
I20260709 13:22:53.040520 23407 tablet_bootstrap.cc:492] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:53.041764 23407 ts_tablet_manager.cc:1403] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.123s	user 0.018s	sys 0.001s
I20260709 13:22:53.042297 23405 tablet_bootstrap.cc:654] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.044587 23407 raft_consensus.cc:359] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.045303 23407 raft_consensus.cc:385] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.045548 23407 raft_consensus.cc:740] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.050416 23407 consensus_queue.cc:260] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.041008 23404 raft_consensus.cc:359] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.052716 23404 raft_consensus.cc:385] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.053009 23404 raft_consensus.cc:740] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.054009 23494 raft_consensus.cc:493] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.053766 23404 consensus_queue.cc:260] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.054518 23494 raft_consensus.cc:515] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.055922 23404 ts_tablet_manager.cc:1434] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:22:53.056761 23494 leader_election.cc:290] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:53.056910 23404 tablet_bootstrap.cc:492] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:53.053766 23407 ts_tablet_manager.cc:1434] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 13:22:53.059221 23407 tablet_bootstrap.cc:492] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:53.058653 23406 consensus_queue.cc:260] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.061547 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bac124d4fc6429bbffe49d0090140f9" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.065129 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bac124d4fc6429bbffe49d0090140f9" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:53.063505 23284 raft_consensus.cc:2468] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:53.069644 23174 leader_election.cc:304] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:53.070111 23407 tablet_bootstrap.cc:654] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.074839 23406 ts_tablet_manager.cc:1434] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.001s
I20260709 13:22:53.078064 23494 raft_consensus.cc:2804] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:53.078476 23494 raft_consensus.cc:493] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:53.078768 23494 raft_consensus.cc:3060] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.079023 23404 tablet_bootstrap.cc:654] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:53.075806 23176 leader_election.cc:343] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.089615 23406 tablet_bootstrap.cc:492] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:53.096846 23494 raft_consensus.cc:515] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.089031 23357 raft_consensus.cc:2468] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:53.102671 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bac124d4fc6429bbffe49d0090140f9" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:53.103407 23176 leader_election.cc:304] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:53.104494 23487 raft_consensus.cc:2804] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:53.105018 23487 raft_consensus.cc:697] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
W20260709 13:22:53.105072 23176 leader_election.cc:343] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.109524 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bac124d4fc6429bbffe49d0090140f9" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:53.110442 23284 raft_consensus.cc:3060] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.105988 23487 consensus_queue.cc:237] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
W20260709 13:22:53.116173 23082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:53.115480 23032 catalog_manager.cc:5697] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:53.107479 23494 leader_election.cc:290] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:53.122480 23405 tablet_bootstrap.cc:492] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:53.123026 23405 ts_tablet_manager.cc:1403] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.026s
I20260709 13:22:53.125674 23405 raft_consensus.cc:359] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.126382 23405 raft_consensus.cc:385] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.126660 23405 raft_consensus.cc:740] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.127357 23405 consensus_queue.cc:260] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.129415 23405 ts_tablet_manager.cc:1434] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:53.130364 23405 tablet_bootstrap.cc:492] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:53.136240 23494 raft_consensus.cc:493] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.137450 23405 tablet_bootstrap.cc:654] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.137470 23494 raft_consensus.cc:515] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.140455 23406 tablet_bootstrap.cc:654] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.142330 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:53.143908 23175 leader_election.cc:343] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.146131 23438 consensus_queue.cc:1048] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:53.148272 23494 leader_election.cc:290] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:53.149454 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.184851 23033 catalog_manager.cc:5697] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:53.138180 23284 raft_consensus.cc:2468] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
W20260709 13:22:53.186728 23174 leader_election.cc:343] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.188331 23174 leader_election.cc:304] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:53.157147 23405 tablet_bootstrap.cc:492] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:53.191776 23405 ts_tablet_manager.cc:1403] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.004s
I20260709 13:22:53.194805 23405 raft_consensus.cc:359] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.195457 23405 raft_consensus.cc:385] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.195540 23404 tablet_bootstrap.cc:492] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:53.195770 23405 raft_consensus.cc:740] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.196133 23404 ts_tablet_manager.cc:1403] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.139s	user 0.026s	sys 0.031s
I20260709 13:22:53.163748 23406 tablet_bootstrap.cc:492] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:53.197430 23406 ts_tablet_manager.cc:1403] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.001s
I20260709 13:22:53.199051 23404 raft_consensus.cc:359] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.199528 23174 leader_election.cc:304] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:53.199803 23404 raft_consensus.cc:385] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.200248 23404 raft_consensus.cc:740] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.199712 23405 consensus_queue.cc:260] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.201020 23404 consensus_queue.cc:260] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.202556 23494 raft_consensus.cc:2749] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.202461 23406 raft_consensus.cc:359] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.204648 23406 raft_consensus.cc:385] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.204881 23494 raft_consensus.cc:2804] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:53.204133 23405 ts_tablet_manager.cc:1434] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:22:53.205586 23494 raft_consensus.cc:697] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:53.206276 23405 tablet_bootstrap.cc:492] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:53.206646 23494 consensus_queue.cc:237] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.213192 23405 tablet_bootstrap.cc:654] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.213755 23359 raft_consensus.cc:3060] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.204975 23406 raft_consensus.cc:740] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.216389 23406 consensus_queue.cc:260] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.218565 23406 ts_tablet_manager.cc:1434] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:22:53.219486 23406 tablet_bootstrap.cc:492] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:53.203104 23404 ts_tablet_manager.cc:1434] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:22:53.222569 23404 tablet_bootstrap.cc:492] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:53.228623 23404 tablet_bootstrap.cc:654] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.234478 23406 tablet_bootstrap.cc:654] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.237550 23438 consensus_queue.cc:1048] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:53.243516 23405 tablet_bootstrap.cc:492] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:53.244066 23405 ts_tablet_manager.cc:1403] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.001s
I20260709 13:22:53.257069 23405 raft_consensus.cc:359] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.257716 23407 tablet_bootstrap.cc:492] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:53.257967 23405 raft_consensus.cc:385] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.258292 23407 ts_tablet_manager.cc:1403] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.199s	user 0.019s	sys 0.016s
I20260709 13:22:53.258380 23405 raft_consensus.cc:740] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.259420 23405 consensus_queue.cc:260] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.261278 23407 raft_consensus.cc:359] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.261967 23407 raft_consensus.cc:385] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.262235 23407 raft_consensus.cc:740] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.264000 23462 raft_consensus.cc:493] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.264518 23462 raft_consensus.cc:515] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.266127 23438 raft_consensus.cc:493] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.265934 23405 ts_tablet_manager.cc:1434] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:22:53.267899 23405 tablet_bootstrap.cc:492] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:53.266623 23438 raft_consensus.cc:515] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.269116 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcda7afa02d4a339af683cf757b6657" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:53.269855 23438 leader_election.cc:290] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:53.266629 23462 leader_election.cc:290] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
W20260709 13:22:53.270664 23250 leader_election.cc:343] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.271432 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcda7afa02d4a339af683cf757b6657" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:53.271989 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480935b908a045248a3d3c02deab6648" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.263072 23407 consensus_queue.cc:260] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
W20260709 13:22:53.273722 23249 leader_election.cc:343] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.273916 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480935b908a045248a3d3c02deab6648" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:53.274235 23249 leader_election.cc:304] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:53.274580 23407 ts_tablet_manager.cc:1434] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:22:53.275825 23407 tablet_bootstrap.cc:492] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
W20260709 13:22:53.275522 23099 leader_election.cc:343] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.275628 23462 raft_consensus.cc:2749] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.278249 23033 catalog_manager.cc:5697] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:53.280757 23101 leader_election.cc:343] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.281467 23101 leader_election.cc:304] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:53.284066 23438 raft_consensus.cc:2749] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.295523 23407 tablet_bootstrap.cc:654] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.296536 23404 tablet_bootstrap.cc:492] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:53.297029 23405 tablet_bootstrap.cc:654] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.297133 23404 ts_tablet_manager.cc:1403] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.009s
I20260709 13:22:53.302057 23404 raft_consensus.cc:359] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.303143 23404 raft_consensus.cc:385] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.303751 23404 raft_consensus.cc:740] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.309028 23406 tablet_bootstrap.cc:492] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:53.309871 23406 ts_tablet_manager.cc:1403] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.014s
I20260709 13:22:53.314429 23494 raft_consensus.cc:493] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.315256 23494 raft_consensus.cc:515] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.314103 23406 raft_consensus.cc:359] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.317499 23406 raft_consensus.cc:385] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.317864 23406 raft_consensus.cc:740] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.317884 23405 tablet_bootstrap.cc:492] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:53.305918 23404 consensus_queue.cc:260] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.318091 23407 tablet_bootstrap.cc:492] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:53.318794 23406 consensus_queue.cc:260] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.319577 23407 ts_tablet_manager.cc:1403] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.014s
I20260709 13:22:53.320194 23404 ts_tablet_manager.cc:1434] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:22:53.321161 23404 tablet_bootstrap.cc:492] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:53.322546 23407 raft_consensus.cc:359] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.322902 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8192c710d74b4b1c9b4d67b79426ac48" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.323302 23407 raft_consensus.cc:385] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.323598 23407 raft_consensus.cc:740] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.324463 23406 ts_tablet_manager.cc:1434] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:22:53.324311 23407 consensus_queue.cc:260] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.318755 23405 ts_tablet_manager.cc:1403] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.015s
I20260709 13:22:53.325565 23406 tablet_bootstrap.cc:492] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:53.328136 23405 raft_consensus.cc:359] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.328831 23405 raft_consensus.cc:385] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.329111 23405 raft_consensus.cc:740] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.329968 23405 consensus_queue.cc:260] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.331195 23285 raft_consensus.cc:2468] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:53.331641 23404 tablet_bootstrap.cc:654] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.332337 23405 ts_tablet_manager.cc:1434] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:53.334312 23405 tablet_bootstrap.cc:492] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:53.336512 23174 leader_election.cc:304] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:53.337525 23552 raft_consensus.cc:2804] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:53.338057 23552 raft_consensus.cc:493] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:53.338429 23552 raft_consensus.cc:3060] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.348227 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8192c710d74b4b1c9b4d67b79426ac48" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:53.347023 23494 leader_election.cc:290] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
W20260709 13:22:53.353930 23176 leader_election.cc:343] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.354461 23473 raft_consensus.cc:493] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.355033 23473 raft_consensus.cc:515] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.355851 23405 tablet_bootstrap.cc:654] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.356696 23407 ts_tablet_manager.cc:1434] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 13:22:53.357762 23407 tablet_bootstrap.cc:492] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:53.359498 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d41e7244bf04a4c8c6d02911a829766" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:53.361320 23423 consensus_queue.cc:1048] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:53.363056 23552 raft_consensus.cc:515] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.370189 23406 tablet_bootstrap.cc:654] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.373613 23407 tablet_bootstrap.cc:654] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.373929 23405 tablet_bootstrap.cc:492] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:53.374449 23405 ts_tablet_manager.cc:1403] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.012s
I20260709 13:22:53.376309 23359 raft_consensus.cc:3060] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.377671 23405 raft_consensus.cc:359] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.378715 23405 raft_consensus.cc:385] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.379031 23405 raft_consensus.cc:740] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.379858 23405 consensus_queue.cc:260] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.382323 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d41e7244bf04a4c8c6d02911a829766" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.382859 23405 ts_tablet_manager.cc:1434] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:53.384136 23405 tablet_bootstrap.cc:492] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:53.375689 23404 tablet_bootstrap.cc:492] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:53.385104 23404 ts_tablet_manager.cc:1403] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.022s
I20260709 13:22:53.387845 23404 raft_consensus.cc:359] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.388482 23404 raft_consensus.cc:385] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.388767 23404 raft_consensus.cc:740] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.390959 23552 leader_election.cc:290] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:53.389778 23404 consensus_queue.cc:260] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.391876 23473 leader_election.cc:290] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:53.395732 23423 consensus_queue.cc:1048] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:53.404055 23405 tablet_bootstrap.cc:654] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.396363 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8192c710d74b4b1c9b4d67b79426ac48" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
W20260709 13:22:53.406666 23176 leader_election.cc:343] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.396759 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8192c710d74b4b1c9b4d67b79426ac48" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:53.396404 23462 consensus_queue.cc:1048] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:22:53.409303 23285 raft_consensus.cc:3060] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.413179 23406 tablet_bootstrap.cc:492] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:53.413748 23406 ts_tablet_manager.cc:1403] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.014s
I20260709 13:22:53.416342 23322 leader_election.cc:304] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:53.417177 23406 raft_consensus.cc:359] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.418025 23406 raft_consensus.cc:385] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.418334 23406 raft_consensus.cc:740] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.419258 23406 consensus_queue.cc:260] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.423107 23407 tablet_bootstrap.cc:492] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:53.423810 23407 ts_tablet_manager.cc:1403] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.014s
I20260709 13:22:53.425760 23406 ts_tablet_manager.cc:1434] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:22:53.432832 23406 tablet_bootstrap.cc:492] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:53.436643 23285 raft_consensus.cc:2468] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:53.434578 23462 raft_consensus.cc:493] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.442914 23462 raft_consensus.cc:515] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.445659 23462 leader_election.cc:290] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:53.447611 23407 raft_consensus.cc:359] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.448429 23407 raft_consensus.cc:385] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.448730 23407 raft_consensus.cc:740] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.449434 23407 consensus_queue.cc:260] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.453364 23405 tablet_bootstrap.cc:492] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:53.453923 23405 ts_tablet_manager.cc:1403] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.012s
I20260709 13:22:53.454429 23406 tablet_bootstrap.cc:654] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.456100 23407 ts_tablet_manager.cc:1434] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.002s
I20260709 13:22:53.456676 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a07ed2cfb44ee09a9b0105bf804006" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:53.457459 23407 tablet_bootstrap.cc:492] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:53.456302 23518 consensus_queue.cc:1048] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:22:53.458627 23174 leader_election.cc:304] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:53.459632 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a07ed2cfb44ee09a9b0105bf804006" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:53.456480 23484 raft_consensus.cc:493] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.460760 23484 raft_consensus.cc:515] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.461176 23494 raft_consensus.cc:2804] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:53.461686 23494 raft_consensus.cc:697] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:53.463201 23484 leader_election.cc:290] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:53.463548 23494 consensus_queue.cc:237] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.466320 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:53.467037 23249 leader_election.cc:343] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.467419 23405 raft_consensus.cc:359] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
W20260709 13:22:53.467998 23101 leader_election.cc:343] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.468271 23405 raft_consensus.cc:385] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.468441 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:53.468698 23405 raft_consensus.cc:740] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
W20260709 13:22:53.469413 23250 leader_election.cc:343] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.469920 23250 leader_election.cc:304] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115
I20260709 13:22:53.469614 23405 consensus_queue.cc:260] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.470947 23406 tablet_bootstrap.cc:492] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:53.471432 23406 ts_tablet_manager.cc:1403] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.007s
W20260709 13:22:53.471469 23100 leader_election.cc:343] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.471815 23405 ts_tablet_manager.cc:1434] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:22:53.472414 23423 raft_consensus.cc:2749] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.473213 23405 tablet_bootstrap.cc:492] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:53.465334 23407 tablet_bootstrap.cc:654] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.472010 23100 leader_election.cc:304] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115
I20260709 13:22:53.478667 23484 raft_consensus.cc:2749] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.483246 23405 tablet_bootstrap.cc:654] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.487612 23404 ts_tablet_manager.cc:1434] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.004s
I20260709 13:22:53.490757 23404 tablet_bootstrap.cc:492] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:53.494581 23488 raft_consensus.cc:493] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.495173 23488 raft_consensus.cc:515] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.497891 23405 tablet_bootstrap.cc:492] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:53.498526 23405 ts_tablet_manager.cc:1403] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.003s
I20260709 13:22:53.499624 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.497584 23488 leader_election.cc:290] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
W20260709 13:22:53.502185 23174 leader_election.cc:343] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.505110 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:53.506506 23175 leader_election.cc:343] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.506723 23473 raft_consensus.cc:2749] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.507014 23175 leader_election.cc:304] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:53.508759 23488 raft_consensus.cc:2749] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.477013 23406 raft_consensus.cc:359] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.509593 23406 raft_consensus.cc:385] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.509927 23406 raft_consensus.cc:740] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.510640 23406 consensus_queue.cc:260] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.512640 23406 ts_tablet_manager.cc:1434] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 13:22:53.512881 23404 tablet_bootstrap.cc:654] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.513585 23406 tablet_bootstrap.cc:492] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:53.520670 23405 raft_consensus.cc:359] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.521562 23405 raft_consensus.cc:385] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.521868 23405 raft_consensus.cc:740] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.519862 23407 tablet_bootstrap.cc:492] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:53.523563 23407 ts_tablet_manager.cc:1403] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.011s
I20260709 13:22:53.522624 23405 consensus_queue.cc:260] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.531239 23407 raft_consensus.cc:359] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.532226 23405 ts_tablet_manager.cc:1434] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:22:53.532287 23407 raft_consensus.cc:385] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.533017 23407 raft_consensus.cc:740] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.534029 23405 tablet_bootstrap.cc:492] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:53.536495 23438 raft_consensus.cc:493] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.537006 23438 raft_consensus.cc:515] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.535552 23407 consensus_queue.cc:260] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.537753 23484 raft_consensus.cc:493] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.539288 23438 leader_election.cc:290] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:53.530273 23032 catalog_manager.cc:5697] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:53.539927 23406 tablet_bootstrap.cc:654] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.541010 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.539085 23484 raft_consensus.cc:515] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.542536 23407 ts_tablet_manager.cc:1434] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:22:53.545454 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:53.545838 23407 tablet_bootstrap.cc:492] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:53.542433 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:53.546727 23100 leader_election.cc:343] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:53.543632 23099 leader_election.cc:343] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:53.548033 23101 leader_election.cc:343] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.548470 23101 leader_election.cc:304] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:53.549585 23438 raft_consensus.cc:2749] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.557256 23405 tablet_bootstrap.cc:654] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:53.558812 23175 consensus_peers.cc:597] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:53.565548 23438 raft_consensus.cc:493] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.566282 23438 raft_consensus.cc:515] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.567883 23407 tablet_bootstrap.cc:654] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.570453 23404 tablet_bootstrap.cc:492] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:53.570636 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fac600ebf36450b96343e8ad119b130" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.571120 23404 ts_tablet_manager.cc:1403] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.007s
I20260709 13:22:53.571578 23438 leader_election.cc:290] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:53.572217 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.572911 23284 raft_consensus.cc:2468] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:53.573092 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fac600ebf36450b96343e8ad119b130" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:53.574036 23099 leader_election.cc:343] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:53.574620 23101 leader_election.cc:343] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.575062 23101 leader_election.cc:304] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:53.575295 23099 leader_election.cc:304] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0
I20260709 13:22:53.575862 23438 raft_consensus.cc:2749] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.576189 23495 raft_consensus.cc:2804] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:53.576567 23495 raft_consensus.cc:493] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:53.576905 23495 raft_consensus.cc:3060] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.577719 23404 raft_consensus.cc:359] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.579636 23404 raft_consensus.cc:385] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.581030 23404 raft_consensus.cc:740] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.583854 23404 consensus_queue.cc:260] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.591847 23407 tablet_bootstrap.cc:492] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:53.596670 23407 ts_tablet_manager.cc:1403] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.000s
I20260709 13:22:53.602051 23438 raft_consensus.cc:493] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.595566 23404 ts_tablet_manager.cc:1434] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.005s
I20260709 13:22:53.602809 23438 raft_consensus.cc:515] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.604768 23404 tablet_bootstrap.cc:492] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:53.608228 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb4ccf648b4137bbe92d1a4e9ce542" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:53.610044 23101 leader_election.cc:343] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.601190 23407 raft_consensus.cc:359] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.611272 23407 raft_consensus.cc:385] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.612058 23407 raft_consensus.cc:740] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.613391 23438 leader_election.cc:290] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:53.614581 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb4ccf648b4137bbe92d1a4e9ce542" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:53.615368 23210 raft_consensus.cc:2468] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:53.613288 23407 consensus_queue.cc:260] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.618955 23100 leader_election.cc:304] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:53.619987 23438 raft_consensus.cc:2804] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:53.620368 23438 raft_consensus.cc:493] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:53.620726 23438 raft_consensus.cc:3060] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.611635 23484 leader_election.cc:290] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:53.622049 23407 ts_tablet_manager.cc:1434] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:22:53.623823 23404 tablet_bootstrap.cc:654] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.627691 23495 raft_consensus.cc:515] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.625213 23407 tablet_bootstrap.cc:492] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:53.631853 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
W20260709 13:22:53.634451 23100 leader_election.cc:343] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.636439 23473 raft_consensus.cc:493] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.637004 23473 raft_consensus.cc:515] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.639422 23473 leader_election.cc:290] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:53.640697 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480935b908a045248a3d3c02deab6648" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:53.641144 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480935b908a045248a3d3c02deab6648" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.641445 23136 raft_consensus.cc:2468] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 0.
W20260709 13:22:53.642701 23322 leader_election.cc:343] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.642946 23407 tablet_bootstrap.cc:654] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.643791 23404 tablet_bootstrap.cc:492] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:53.644361 23404 ts_tablet_manager.cc:1403] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.003s
I20260709 13:22:53.644734 23323 leader_election.cc:304] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:53.646323 23473 raft_consensus.cc:2804] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:53.646692 23473 raft_consensus.cc:493] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:53.647014 23473 raft_consensus.cc:3060] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.648018 23461 raft_consensus.cc:493] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.648677 23461 raft_consensus.cc:515] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.655047 23407 tablet_bootstrap.cc:492] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:53.655871 23518 raft_consensus.cc:493] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.655767 23473 raft_consensus.cc:515] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.656469 23518 raft_consensus.cc:515] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.658736 23518 leader_election.cc:290] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:53.659128 23461 leader_election.cc:290] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:53.660825 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fac600ebf36450b96343e8ad119b130" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:53.661439 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480935b908a045248a3d3c02deab6648" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:53.662097 23407 ts_tablet_manager.cc:1403] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.001s
I20260709 13:22:53.662259 23135 raft_consensus.cc:3060] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.662372 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c657fadabd4fd1802ed83a975d127f" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:53.663148 23133 raft_consensus.cc:2468] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:53.664464 23249 leader_election.cc:304] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:53.665307 23461 raft_consensus.cc:2804] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:53.665658 23461 raft_consensus.cc:493] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:53.666015 23461 raft_consensus.cc:3060] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.666427 23575 raft_consensus.cc:493] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.666596 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480935b908a045248a3d3c02deab6648" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:53.666980 23575 raft_consensus.cc:515] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.661504 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c657fadabd4fd1802ed83a975d127f" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:53.668612 23210 raft_consensus.cc:2468] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:53.661501 23136 raft_consensus.cc:2468] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:53.670893 23249 leader_election.cc:304] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:53.671829 23518 raft_consensus.cc:2804] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:53.672188 23518 raft_consensus.cc:493] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:53.672508 23518 raft_consensus.cc:3060] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.673892 23461 raft_consensus.cc:515] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.674139 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fac600ebf36450b96343e8ad119b130" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:53.674671 23495 leader_election.cc:290] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:53.674959 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d36b6bd10764558b6db3eb4e2238a3f" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:53.669526 23407 raft_consensus.cc:359] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
W20260709 13:22:53.675554 23322 leader_election.cc:343] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.675808 23407 raft_consensus.cc:385] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.676143 23407 raft_consensus.cc:740] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.676849 23407 consensus_queue.cc:260] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
W20260709 13:22:53.677248 23323 leader_election.cc:343] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.678128 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:53.678737 23284 raft_consensus.cc:3060] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.679369 23407 ts_tablet_manager.cc:1434] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:22:53.680384 23407 tablet_bootstrap.cc:492] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
W20260709 13:22:53.681177 23250 leader_election.cc:343] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.682732 23518 raft_consensus.cc:515] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.683482 23575 leader_election.cc:290] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:53.684212 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c657fadabd4fd1802ed83a975d127f" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:53.684988 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d36b6bd10764558b6db3eb4e2238a3f" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:53.688982 23438 raft_consensus.cc:515] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.687013 23473 leader_election.cc:290] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:53.690572 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c657fadabd4fd1802ed83a975d127f" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:53.691622 23494 raft_consensus.cc:493] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.698024 23494 raft_consensus.cc:515] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.700246 23494 leader_election.cc:290] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:53.701647 23209 raft_consensus.cc:3060] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.701933 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053bdd071d8445d1a3e089703a22ab2b" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:53.702227 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053bdd071d8445d1a3e089703a22ab2b" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
W20260709 13:22:53.703650 23176 leader_election.cc:343] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.704984 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fac600ebf36450b96343e8ad119b130" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:53.696271 23136 raft_consensus.cc:3060] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:53.706302 23250 leader_election.cc:343] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:53.707789 23174 leader_election.cc:343] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.708294 23174 leader_election.cc:304] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:53.708554 23406 tablet_bootstrap.cc:492] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:53.709112 23406 ts_tablet_manager.cc:1403] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.196s	user 0.026s	sys 0.009s
I20260709 13:22:53.696532 23210 raft_consensus.cc:2468] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 0.
I20260709 13:22:53.709873 23494 raft_consensus.cc:2749] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.711009 23323 leader_election.cc:304] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:53.711828 23575 raft_consensus.cc:2804] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:53.711926 23406 raft_consensus.cc:359] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.712250 23575 raft_consensus.cc:493] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:53.712514 23406 raft_consensus.cc:385] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.712745 23406 raft_consensus.cc:740] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.686448 23461 leader_election.cc:290] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:53.712641 23575 raft_consensus.cc:3060] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.693418 23135 raft_consensus.cc:2468] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:22:53.713512 23406 consensus_queue.cc:260] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.716313 23404 raft_consensus.cc:359] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.716941 23404 raft_consensus.cc:385] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.717208 23404 raft_consensus.cc:740] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.718868 23406 ts_tablet_manager.cc:1434] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:53.720458 23406 tablet_bootstrap.cc:492] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:53.721590 23284 raft_consensus.cc:2468] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:53.715973 23518 leader_election.cc:290] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:53.723407 23323 leader_election.cc:304] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:53.718839 23209 raft_consensus.cc:2468] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:53.724359 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fac600ebf36450b96343e8ad119b130" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:53.727273 23473 raft_consensus.cc:493] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.728579 23099 leader_election.cc:304] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0
I20260709 13:22:53.734398 23473 raft_consensus.cc:515] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.735447 23495 raft_consensus.cc:2804] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:53.735991 23495 raft_consensus.cc:697] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:53.736467 23438 leader_election.cc:290] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:53.736845 23495 consensus_queue.cc:237] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.737665 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bac124d4fc6429bbffe49d0090140f9" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.738164 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb4ccf648b4137bbe92d1a4e9ce542" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:53.738950 23473 leader_election.cc:290] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:53.739130 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bac124d4fc6429bbffe49d0090140f9" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:53.720490 23404 consensus_queue.cc:260] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.739506 23249 leader_election.cc:304] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:53.739866 23284 raft_consensus.cc:2393] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28222c0dd7a1411692efad3387118115 in current term 1: Already voted for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in this term.
I20260709 13:22:53.729720 23571 raft_consensus.cc:2804] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:53.733990 23135 raft_consensus.cc:3060] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.745607 23405 tablet_bootstrap.cc:492] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:53.746598 23405 ts_tablet_manager.cc:1403] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.213s	user 0.019s	sys 0.017s
I20260709 13:22:53.745985 23518 raft_consensus.cc:2804] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:53.747334 23407 tablet_bootstrap.cc:654] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.748366 23518 raft_consensus.cc:697] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:53.749006 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb4ccf648b4137bbe92d1a4e9ce542" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:53.749255 23518 consensus_queue.cc:237] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.743474 23359 raft_consensus.cc:3060] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.749630 23209 raft_consensus.cc:3060] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.749600 23404 ts_tablet_manager.cc:1434] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.002s
I20260709 13:22:53.754043 23404 tablet_bootstrap.cc:492] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:53.757256 23136 raft_consensus.cc:2468] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:53.759099 23494 consensus_queue.cc:1048] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:53.747587 23571 raft_consensus.cc:697] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:22:53.761232 23571 consensus_queue.cc:237] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.762341 23322 leader_election.cc:304] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:53.763934 23569 raft_consensus.cc:3060] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.773023 23569 raft_consensus.cc:2749] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:53.752607 23575 raft_consensus.cc:515] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.781351 23488 consensus_queue.cc:1048] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:22:53.789474 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d36b6bd10764558b6db3eb4e2238a3f" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:53.790117 23210 raft_consensus.cc:3060] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.790926 23405 raft_consensus.cc:359] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.793628 23405 raft_consensus.cc:385] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.793969 23405 raft_consensus.cc:740] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.791404 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d36b6bd10764558b6db3eb4e2238a3f" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:53.793256 23406 tablet_bootstrap.cc:654] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.792147 23359 raft_consensus.cc:2468] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:53.783143 23404 tablet_bootstrap.cc:654] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.795302 23405 consensus_queue.cc:260] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.795203 23033 catalog_manager.cc:5697] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:53.796869 23575 leader_election.cc:290] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:53.811355 23405 ts_tablet_manager.cc:1434] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:22:53.814349 23405 tablet_bootstrap.cc:492] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:22:53.809865 23323 leader_election.cc:343] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:53.823664 23209 raft_consensus.cc:2468] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:53.825140 23100 leader_election.cc:304] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:53.825768 23135 raft_consensus.cc:2468] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:53.832031 23249 leader_election.cc:304] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:53.835062 23518 raft_consensus.cc:2804] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:53.835137 23552 consensus_queue.cc:1048] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:53.835705 23518 raft_consensus.cc:697] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:53.836581 23518 consensus_queue.cc:237] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.828959 23587 raft_consensus.cc:2804] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:53.842509 23587 raft_consensus.cc:697] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:53.843546 23587 consensus_queue.cc:237] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.828140 23210 raft_consensus.cc:2468] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:22:53.846719 23323 leader_election.cc:304] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:53.848131 23575 raft_consensus.cc:2804] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:53.848634 23575 raft_consensus.cc:697] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:22:53.849462 23575 consensus_queue.cc:237] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.860342 23407 tablet_bootstrap.cc:492] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:53.861096 23488 consensus_queue.cc:1048] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:53.861183 23407 ts_tablet_manager.cc:1403] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.181s	user 0.015s	sys 0.006s
I20260709 13:22:53.865161 23407 raft_consensus.cc:359] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.865960 23407 raft_consensus.cc:385] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.866294 23407 raft_consensus.cc:740] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.868660 23406 tablet_bootstrap.cc:492] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:53.869355 23406 ts_tablet_manager.cc:1403] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.149s	user 0.010s	sys 0.003s
I20260709 13:22:53.873487 23028 catalog_manager.cc:5697] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:53.875694 23406 raft_consensus.cc:359] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.876444 23406 raft_consensus.cc:385] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.876726 23406 raft_consensus.cc:740] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.877404 23406 consensus_queue.cc:260] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.879823 23406 ts_tablet_manager.cc:1434] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:53.880832 23406 tablet_bootstrap.cc:492] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:53.890077 23406 tablet_bootstrap.cc:654] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.899720 23407 consensus_queue.cc:260] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
W20260709 13:22:53.904816 23176 consensus_peers.cc:597] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:53.904865 23407 ts_tablet_manager.cc:1434] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 13:22:53.908835 23407 tablet_bootstrap.cc:492] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:53.923259 23407 tablet_bootstrap.cc:654] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.924881 23404 tablet_bootstrap.cc:492] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:53.932538 23405 tablet_bootstrap.cc:654] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.933354 23406 tablet_bootstrap.cc:492] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:53.933946 23406 ts_tablet_manager.cc:1403] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.053s	user 0.004s	sys 0.026s
I20260709 13:22:53.925195 23028 catalog_manager.cc:5697] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:53.936998 23405 tablet_bootstrap.cc:492] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:53.936787 23406 raft_consensus.cc:359] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.937518 23405 ts_tablet_manager.cc:1403] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.000s
I20260709 13:22:53.937579 23406 raft_consensus.cc:385] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.938057 23406 raft_consensus.cc:740] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.938885 23406 consensus_queue.cc:260] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.940454 23405 raft_consensus.cc:359] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.940934 23406 ts_tablet_manager.cc:1434] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:53.941151 23405 raft_consensus.cc:385] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.941486 23405 raft_consensus.cc:740] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.942281 23406 tablet_bootstrap.cc:492] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:53.942270 23405 consensus_queue.cc:260] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.946306 23404 ts_tablet_manager.cc:1403] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.193s	user 0.039s	sys 0.017s
I20260709 13:22:53.947222 23405 ts_tablet_manager.cc:1434] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:22:53.948328 23405 tablet_bootstrap.cc:492] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:53.948606 23406 tablet_bootstrap.cc:654] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.947688 23027 catalog_manager.cc:5697] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 1 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:53.949194 23404 raft_consensus.cc:359] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.949958 23404 raft_consensus.cc:385] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.950374 23404 raft_consensus.cc:740] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.949990 23027 catalog_manager.cc:5697] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 1 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:53.951082 23404 consensus_queue.cc:260] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:53.964927 23406 tablet_bootstrap.cc:492] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:53.965596 23406 ts_tablet_manager.cc:1403] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 13:22:53.967298 23404 ts_tablet_manager.cc:1434] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:22:53.967967 23587 raft_consensus.cc:493] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.968411 23404 tablet_bootstrap.cc:492] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:53.968525 23587 raft_consensus.cc:515] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:53.971581 23587 leader_election.cc:290] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:53.972640 23495 raft_consensus.cc:493] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:53.973376 23495 raft_consensus.cc:515] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.973603 23030 catalog_manager.cc:5697] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:53.976182 23495 leader_election.cc:290] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:53.974503 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:53.977329 23284 raft_consensus.cc:2468] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:53.978621 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d36b6bd10764558b6db3eb4e2238a3f" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:53.979475 23404 tablet_bootstrap.cc:654] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:53.983798 23099 leader_election.cc:304] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:53.984794 23587 raft_consensus.cc:2804] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:53.985097 23407 tablet_bootstrap.cc:492] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:53.985244 23587 raft_consensus.cc:493] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:53.985610 23407 ts_tablet_manager.cc:1403] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.002s
I20260709 13:22:53.985743 23587 raft_consensus.cc:3060] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:53.988487 23407 raft_consensus.cc:359] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.989163 23407 raft_consensus.cc:385] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.989437 23407 raft_consensus.cc:740] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.991609 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d36b6bd10764558b6db3eb4e2238a3f" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:53.992100 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:53.992453 23208 raft_consensus.cc:2393] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72629382bd4c46b09b2efeaf08c1460d in current term 1: Already voted for candidate 28222c0dd7a1411692efad3387118115 in this term.
I20260709 13:22:53.992733 23209 raft_consensus.cc:2468] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:53.990259 23407 consensus_queue.cc:260] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:53.983841 23406 raft_consensus.cc:359] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:53.994482 23406 raft_consensus.cc:385] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:53.994783 23406 raft_consensus.cc:740] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:53.997889 23406 consensus_queue.cc:260] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.000555 23100 leader_election.cc:304] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115
I20260709 13:22:54.001871 23495 raft_consensus.cc:3060] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.015625 23495 raft_consensus.cc:2749] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:54.017192 23405 tablet_bootstrap.cc:654] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.018831 23552 raft_consensus.cc:493] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.019330 23406 ts_tablet_manager.cc:1434] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:22:54.019412 23552 raft_consensus.cc:515] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.004645 23587 raft_consensus.cc:515] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.020531 23406 tablet_bootstrap.cc:492] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:54.022663 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:54.023367 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:54.023496 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:54.024029 23284 raft_consensus.cc:3060] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:54.024200 23176 leader_election.cc:343] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.024268 23135 raft_consensus.cc:2468] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:54.025097 23488 raft_consensus.cc:493] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.025563 23488 raft_consensus.cc:515] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.025844 23175 leader_election.cc:304] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:54.026757 23494 raft_consensus.cc:2804] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.027113 23494 raft_consensus.cc:493] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.027428 23494 raft_consensus.cc:3060] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.027768 23488 leader_election.cc:290] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:54.030036 23587 leader_election.cc:290] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:54.030405 23284 raft_consensus.cc:2468] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:54.031221 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:54.032476 23099 leader_election.cc:304] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:54.033049 23405 tablet_bootstrap.cc:492] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:54.033365 23587 raft_consensus.cc:2804] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:54.033538 23405 ts_tablet_manager.cc:1403] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.001s
I20260709 13:22:54.033660 23406 tablet_bootstrap.cc:654] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.033901 23587 raft_consensus.cc:697] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:54.034459 23552 leader_election.cc:290] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:54.035045 23587 consensus_queue.cc:237] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.036155 23405 raft_consensus.cc:359] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.037236 23407 ts_tablet_manager.cc:1434] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:22:54.041464 23407 tablet_bootstrap.cc:492] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:54.045120 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:54.045692 23405 raft_consensus.cc:385] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.048048 23405 raft_consensus.cc:740] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.045902 23494 raft_consensus.cc:515] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.045771 23209 raft_consensus.cc:3060] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.049639 23405 consensus_queue.cc:260] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.053752 23405 ts_tablet_manager.cc:1434] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:22:54.056522 23405 tablet_bootstrap.cc:492] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:54.060518 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:54.061610 23284 raft_consensus.cc:2393] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f0dc6416e1e43ee863a6af614ece6c0 in current term 1: Already voted for candidate 72629382bd4c46b09b2efeaf08c1460d in this term.
I20260709 13:22:54.063199 23174 leader_election.cc:304] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:54.065327 23552 raft_consensus.cc:3060] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.066462 23209 raft_consensus.cc:2468] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:54.051564 23407 tablet_bootstrap.cc:654] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.068696 23494 leader_election.cc:290] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:54.068931 23404 tablet_bootstrap.cc:492] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:54.069520 23404 ts_tablet_manager.cc:1403] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.006s
I20260709 13:22:54.070479 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:54.071146 23133 raft_consensus.cc:3060] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.073163 23405 tablet_bootstrap.cc:654] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.072912 23404 raft_consensus.cc:359] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:54.073724 23404 raft_consensus.cc:385] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.074103 23404 raft_consensus.cc:740] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.083393 23406 tablet_bootstrap.cc:492] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:54.083997 23406 ts_tablet_manager.cc:1403] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.020s
I20260709 13:22:54.075012 23404 consensus_queue.cc:260] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:54.085148 23133 raft_consensus.cc:2468] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:54.088570 23552 raft_consensus.cc:2749] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:54.089309 23518 raft_consensus.cc:493] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.089872 23518 raft_consensus.cc:515] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.091391 23032 catalog_manager.cc:5697] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:54.092620 23518 leader_election.cc:290] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:54.094204 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053bdd071d8445d1a3e089703a22ab2b" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:54.095964 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:54.098145 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053bdd071d8445d1a3e089703a22ab2b" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:54.098739 23209 raft_consensus.cc:2468] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:54.099784 23249 leader_election.cc:304] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:54.101356 23175 leader_election.cc:304] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
W20260709 13:22:54.101716 23250 leader_election.cc:343] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.102144 23518 raft_consensus.cc:2804] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.102711 23518 raft_consensus.cc:493] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.103173 23518 raft_consensus.cc:3060] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:54.110244 23176 leader_election.cc:343] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.116190 23404 ts_tablet_manager.cc:1434] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:22:54.121023 23404 tablet_bootstrap.cc:492] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:54.124083 23571 raft_consensus.cc:493] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.124868 23571 raft_consensus.cc:515] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:54.127847 23571 leader_election.cc:290] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:54.129815 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcda7afa02d4a339af683cf757b6657" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:54.130849 23133 raft_consensus.cc:2468] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 0.
I20260709 13:22:54.133502 23323 leader_election.cc:304] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:54.135087 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcda7afa02d4a339af683cf757b6657" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:54.136083 23575 raft_consensus.cc:2804] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.136703 23575 raft_consensus.cc:493] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.137144 23575 raft_consensus.cc:3060] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.136126 23284 raft_consensus.cc:2468] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 0.
W20260709 13:22:54.151345 23175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 50068.5us
W20260709 13:22:54.155898 23176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 44586.4us
I20260709 13:22:54.158735 23494 raft_consensus.cc:493] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.159461 23494 raft_consensus.cc:515] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.163673 23494 leader_election.cc:290] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:54.164950 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07f8c2c87cd4a47aa2f08e7750ae0ba" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:54.167047 23175 leader_election.cc:343] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.168629 23404 tablet_bootstrap.cc:654] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.169596 23406 raft_consensus.cc:359] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.170816 23406 raft_consensus.cc:385] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.171288 23406 raft_consensus.cc:740] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.153244 23575 raft_consensus.cc:515] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:54.176270 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07f8c2c87cd4a47aa2f08e7750ae0ba" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:54.176440 23571 consensus_queue.cc:1048] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:54.176270 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcda7afa02d4a339af683cf757b6657" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:54.177585 23575 leader_election.cc:290] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:54.177871 23284 raft_consensus.cc:3060] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.179551 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcda7afa02d4a339af683cf757b6657" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:54.180186 23135 raft_consensus.cc:3060] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.180539 23406 consensus_queue.cc:260] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.183374 23406 ts_tablet_manager.cc:1434] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.000s
I20260709 13:22:54.190198 23405 tablet_bootstrap.cc:492] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:54.191548 23405 ts_tablet_manager.cc:1403] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.135s	user 0.056s	sys 0.044s
I20260709 13:22:54.190431 23284 raft_consensus.cc:2468] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:22:54.196372 23322 leader_election.cc:304] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:54.197345 23575 raft_consensus.cc:2804] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:54.197888 23575 raft_consensus.cc:697] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:22:54.198712 23575 consensus_queue.cc:237] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:54.153043 23611 raft_consensus.cc:2804] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:22:54.179010 23176 leader_election.cc:343] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.201423 23406 tablet_bootstrap.cc:492] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:54.206496 23611 raft_consensus.cc:697] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:54.206573 23587 consensus_queue.cc:1048] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:54.211886 23135 raft_consensus.cc:2468] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:22:54.207738 23611 consensus_queue.cc:237] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.205199 23176 leader_election.cc:304] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:54.216542 23405 raft_consensus.cc:359] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.217648 23405 raft_consensus.cc:385] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.217988 23405 raft_consensus.cc:740] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.218698 23405 consensus_queue.cc:260] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.219004 23552 raft_consensus.cc:2749] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:54.221472 23405 ts_tablet_manager.cc:1434] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:22:54.222397 23405 tablet_bootstrap.cc:492] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:54.225809 23406 tablet_bootstrap.cc:654] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.229017 23405 tablet_bootstrap.cc:654] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.212684 23518 raft_consensus.cc:515] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.236464 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053bdd071d8445d1a3e089703a22ab2b" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:54.237591 23209 raft_consensus.cc:3060] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.237630 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053bdd071d8445d1a3e089703a22ab2b" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:54.236361 23518 leader_election.cc:290] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:54.241446 23407 tablet_bootstrap.cc:492] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:54.242420 23407 ts_tablet_manager.cc:1403] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.201s	user 0.040s	sys 0.053s
W20260709 13:22:54.247123 23250 leader_election.cc:343] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.252954 23404 tablet_bootstrap.cc:492] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:54.253551 23404 ts_tablet_manager.cc:1403] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.133s	user 0.012s	sys 0.006s
I20260709 13:22:54.255260 23495 consensus_queue.cc:1048] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:54.256523 23404 raft_consensus.cc:359] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.257441 23404 raft_consensus.cc:385] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.262764 23423 raft_consensus.cc:493] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.263345 23407 raft_consensus.cc:359] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.264659 23407 raft_consensus.cc:385] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.264964 23407 raft_consensus.cc:740] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.265810 23407 consensus_queue.cc:260] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.267511 23032 catalog_manager.cc:5697] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 1 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:54.263377 23423 raft_consensus.cc:515] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:54.275051 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480935b908a045248a3d3c02deab6648" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:54.278009 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480935b908a045248a3d3c02deab6648" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:54.279609 23209 raft_consensus.cc:2468] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:54.281878 23249 leader_election.cc:304] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:54.283447 23461 raft_consensus.cc:493] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.283851 23462 raft_consensus.cc:2749] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:54.284003 23461 raft_consensus.cc:515] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.286263 23249 leader_election.cc:304] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:54.288118 23405 tablet_bootstrap.cc:492] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:54.288627 23462 raft_consensus.cc:2804] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:54.289186 23406 tablet_bootstrap.cc:492] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:54.289683 23406 ts_tablet_manager.cc:1403] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.089s	user 0.020s	sys 0.011s
I20260709 13:22:54.270663 23404 raft_consensus.cc:740] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.290904 23404 consensus_queue.cc:260] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.288447 23033 catalog_manager.cc:5697] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:54.291857 23462 raft_consensus.cc:697] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:54.294802 23407 ts_tablet_manager.cc:1434] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:22:54.296120 23407 tablet_bootstrap.cc:492] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:54.298161 23518 consensus_queue.cc:1048] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:54.300872 23461 leader_election.cc:290] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:54.303236 23407 tablet_bootstrap.cc:654] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.273643 23423 leader_election.cc:290] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:54.309911 23284 raft_consensus.cc:3060] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:54.313896 23250 consensus_peers.cc:597] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:54.292925 23462 consensus_queue.cc:237] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.318202 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e44018374b34e9ab7172698203fddd0" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:54.325246 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e44018374b34e9ab7172698203fddd0" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:54.327428 23473 consensus_queue.cc:1048] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:54.288771 23405 ts_tablet_manager.cc:1403] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.008s
I20260709 13:22:54.341564 23404 ts_tablet_manager.cc:1434] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:22:54.343132 23404 tablet_bootstrap.cc:492] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:54.359961 23406 raft_consensus.cc:359] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.361114 23406 raft_consensus.cc:385] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.361483 23406 raft_consensus.cc:740] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
W20260709 13:22:54.348346 23249 leader_election.cc:343] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.387929 23405 raft_consensus.cc:359] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.388705 23405 raft_consensus.cc:385] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.388983 23405 raft_consensus.cc:740] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.390194 23405 consensus_queue.cc:260] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.391944 23473 consensus_queue.cc:1048] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:22:54.395103 23405 ts_tablet_manager.cc:1434] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:22:54.403208 23405 tablet_bootstrap.cc:492] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:22:54.396246 23249 leader_election.cc:343] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.407271 23552 raft_consensus.cc:493] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.407840 23552 raft_consensus.cc:515] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.413991 23552 leader_election.cc:290] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:54.420554 23473 raft_consensus.cc:493] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.421085 23473 raft_consensus.cc:515] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.423765 23473 leader_election.cc:290] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:54.419910 23249 leader_election.cc:304] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:54.417466 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:54.434357 23407 tablet_bootstrap.cc:492] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:54.434890 23407 ts_tablet_manager.cc:1403] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.139s	user 0.015s	sys 0.014s
I20260709 13:22:54.428534 23461 raft_consensus.cc:2749] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:54.439368 23176 leader_election.cc:343] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.440094 23611 raft_consensus.cc:493] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.440842 23404 tablet_bootstrap.cc:654] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.440621 23611 raft_consensus.cc:515] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.441836 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a07ed2cfb44ee09a9b0105bf804006" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:54.442536 23285 raft_consensus.cc:2468] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 0.
I20260709 13:22:54.443131 23495 consensus_queue.cc:1048] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:54.443396 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a07ed2cfb44ee09a9b0105bf804006" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:54.444036 23209 raft_consensus.cc:2468] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 0.
I20260709 13:22:54.445605 23323 leader_election.cc:304] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:22:54.447448 23611 leader_election.cc:290] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:54.445928 23495 raft_consensus.cc:493] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.448355 23495 raft_consensus.cc:515] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.449728 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a07ed2cfb44ee09a9b0105bf804006" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:54.448647 23473 raft_consensus.cc:2804] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.450852 23495 leader_election.cc:290] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:54.451193 23473 raft_consensus.cc:493] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.451601 23473 raft_consensus.cc:3060] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.452414 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006dd6ad5ee14da39d65b4a6f97b32a4" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:54.454461 23587 consensus_queue.cc:1048] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:54.454895 23423 consensus_queue.cc:1048] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:54.453542 23438 consensus_queue.cc:1048] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:22:54.460901 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:54.462357 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006dd6ad5ee14da39d65b4a6f97b32a4" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:54.462925 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a07ed2cfb44ee09a9b0105bf804006" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:54.463891 23285 raft_consensus.cc:2468] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:54.463938 23438 raft_consensus.cc:493] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.447486 23406 consensus_queue.cc:260] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.470841 23100 leader_election.cc:304] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115
I20260709 13:22:54.471505 23033 catalog_manager.cc:5697] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:54.478085 23495 raft_consensus.cc:2749] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:54.480787 23423 consensus_queue.cc:1048] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:54.468658 23438 raft_consensus.cc:515] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.499023 23174 leader_election.cc:304] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:54.500051 23488 raft_consensus.cc:2804] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:22:54.500366 23174 leader_election.cc:343] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.500597 23488 raft_consensus.cc:493] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.500936 23174 leader_election.cc:304] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:54.501140 23488 raft_consensus.cc:3060] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.503116 23406 ts_tablet_manager.cc:1434] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.213s	user 0.012s	sys 0.000s
I20260709 13:22:54.507507 23406 tablet_bootstrap.cc:492] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
W20260709 13:22:54.495041 23082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:54.513192 23494 raft_consensus.cc:2749] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:54.535043 23407 raft_consensus.cc:359] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.536214 23407 raft_consensus.cc:385] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.536584 23407 raft_consensus.cc:740] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.542891 23407 consensus_queue.cc:260] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.529470 23473 raft_consensus.cc:515] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.558526 23405 tablet_bootstrap.cc:654] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.560022 23407 ts_tablet_manager.cc:1434] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.000s
I20260709 13:22:54.561170 23407 tablet_bootstrap.cc:492] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:54.562940 23438 leader_election.cc:290] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:54.564273 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
W20260709 13:22:54.565824 23099 leader_election.cc:343] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.573190 23407 tablet_bootstrap.cc:654] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:54.581959 23627 log.cc:927] Time spent T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: Append to log took a long time: real 0.084s	user 0.004s	sys 0.000s
I20260709 13:22:54.610337 23357 raft_consensus.cc:2393] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f0dc6416e1e43ee863a6af614ece6c0 in current term 1: Already voted for candidate 28222c0dd7a1411692efad3387118115 in this term.
I20260709 13:22:54.609213 23571 consensus_queue.cc:1048] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:22:54.617724 23473 leader_election.cc:290] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:54.622412 23205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a07ed2cfb44ee09a9b0105bf804006" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:54.622820 23211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:54.622934 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a07ed2cfb44ee09a9b0105bf804006" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:54.623726 23211 raft_consensus.cc:2468] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:54.624172 23283 raft_consensus.cc:3060] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.629439 23406 tablet_bootstrap.cc:654] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.631278 23100 leader_election.cc:304] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:54.632845 23495 raft_consensus.cc:2804] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.633282 23495 raft_consensus.cc:493] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:54.640184 23495 raft_consensus.cc:3060] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.699911 23283 raft_consensus.cc:2468] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:22:54.700103 23571 raft_consensus.cc:493] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.702333 23571 raft_consensus.cc:515] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.704304 23587 raft_consensus.cc:493] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.704679 23571 leader_election.cc:290] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:54.704926 23587 raft_consensus.cc:515] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.710809 23135 raft_consensus.cc:3060] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.712695 23407 tablet_bootstrap.cc:492] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:54.713268 23407 ts_tablet_manager.cc:1403] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.152s	user 0.024s	sys 0.032s
I20260709 13:22:54.707350 23587 leader_election.cc:290] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:54.714522 23204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:54.723305 23495 raft_consensus.cc:515] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.724006 23322 leader_election.cc:304] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:54.726668 23488 raft_consensus.cc:515] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.739621 23407 raft_consensus.cc:359] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:54.740789 23407 raft_consensus.cc:385] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.745287 23462 raft_consensus.cc:493] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.741207 23407 raft_consensus.cc:740] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.756349 23407 consensus_queue.cc:260] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:54.770715 23359 raft_consensus.cc:3060] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.780545 23404 tablet_bootstrap.cc:492] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:54.781143 23404 ts_tablet_manager.cc:1403] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.438s	user 0.044s	sys 0.038s
I20260709 13:22:54.777781 23134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:54.785771 23495 leader_election.cc:290] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:54.791407 23407 ts_tablet_manager.cc:1434] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.002s
I20260709 13:22:54.792323 23407 tablet_bootstrap.cc:492] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:54.788942 23134 raft_consensus.cc:2393] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28222c0dd7a1411692efad3387118115 in current term 1: Already voted for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in this term.
I20260709 13:22:54.798101 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a07ed2cfb44ee09a9b0105bf804006" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:54.798884 23488 leader_election.cc:290] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:54.799435 23357 raft_consensus.cc:2393] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f0dc6416e1e43ee863a6af614ece6c0 in current term 1: Already voted for candidate 28222c0dd7a1411692efad3387118115 in this term.
I20260709 13:22:54.800904 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:54.789999 23205 raft_consensus.cc:2393] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 28222c0dd7a1411692efad3387118115 in current term 1: Already voted for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in this term.
I20260709 13:22:54.798175 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07f8c2c87cd4a47aa2f08e7750ae0ba" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:54.764001 23462 raft_consensus.cc:515] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:54.793717 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07f8c2c87cd4a47aa2f08e7750ae0ba" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:54.808511 23210 raft_consensus.cc:2468] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:54.809628 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:54.810218 23210 raft_consensus.cc:3060] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:54.810266 23323 leader_election.cc:304] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:54.819191 23636 consensus_queue.cc:1048] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:54.820878 23405 tablet_bootstrap.cc:492] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:54.821475 23405 ts_tablet_manager.cc:1403] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.418s	user 0.021s	sys 0.019s
I20260709 13:22:54.830248 23575 raft_consensus.cc:2804] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:54.830958 23575 raft_consensus.cc:697] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:22:54.839845 23210 raft_consensus.cc:2468] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:54.825227 23462 leader_election.cc:290] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:54.838243 23405 raft_consensus.cc:359] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.843044 23405 raft_consensus.cc:385] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.843329 23405 raft_consensus.cc:740] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.840250 23552 consensus_queue.cc:1048] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:22:54.845995 23405 consensus_queue.cc:260] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.832031 23575 consensus_queue.cc:237] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
W20260709 13:22:54.841563 23322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 114665us
I20260709 13:22:54.864867 23406 tablet_bootstrap.cc:492] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:54.866048 23406 ts_tablet_manager.cc:1403] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.359s	user 0.016s	sys 0.015s
I20260709 13:22:54.871532 23352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:54.876974 23406 raft_consensus.cc:359] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
W20260709 13:22:54.877600 23101 leader_election.cc:343] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.878060 23406 raft_consensus.cc:385] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.849267 23438 consensus_queue.cc:1048] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:22:54.865975 23405 ts_tablet_manager.cc:1434] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.006s
I20260709 13:22:54.884042 23405 tablet_bootstrap.cc:492] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:22:54.856176 23099 leader_election.cc:343] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.881595 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:54.895445 23407 tablet_bootstrap.cc:654] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.888794 23404 raft_consensus.cc:359] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:54.896988 23404 raft_consensus.cc:385] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:54.897401 23404 raft_consensus.cc:740] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.889916 23406 raft_consensus.cc:740] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:54.907002 23404 consensus_queue.cc:260] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
W20260709 13:22:54.898628 23099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 43861.9us
I20260709 13:22:54.910451 23406 consensus_queue.cc:260] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.927371 23406 ts_tablet_manager.cc:1434] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:22:54.909130 23210 raft_consensus.cc:2468] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
W20260709 13:22:54.931844 23323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 79646.5us
I20260709 13:22:54.948530 23650 consensus_queue.cc:1048] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:54.954643 23404 ts_tablet_manager.cc:1434] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.173s	user 0.016s	sys 0.018s
I20260709 13:22:54.956120 23404 tablet_bootstrap.cc:492] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:54.971104 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a07ed2cfb44ee09a9b0105bf804006" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:54.972059 23284 raft_consensus.cc:2393] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f0dc6416e1e43ee863a6af614ece6c0 in current term 1: Already voted for candidate 28222c0dd7a1411692efad3387118115 in this term.
W20260709 13:22:54.973126 23250 leader_election.cc:343] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:54.976332 23636 raft_consensus.cc:493] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:54.976908 23636 raft_consensus.cc:515] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:54.980391 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e092acaa9541649bd04731cf50ea1c" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:54.984437 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e092acaa9541649bd04731cf50ea1c" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:54.984498 23133 raft_consensus.cc:2468] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:54.987392 23406 tablet_bootstrap.cc:492] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:54.995455 23175 leader_election.cc:304] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:54.991385 23100 leader_election.cc:304] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:54.996912 23405 tablet_bootstrap.cc:654] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:54.998068 23100 leader_election.cc:304] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:55.008221 23587 raft_consensus.cc:2804] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.008882 23587 raft_consensus.cc:697] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:55.014819 23587 consensus_queue.cc:237] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:54.979233 23636 leader_election.cc:290] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:55.030300 23651 raft_consensus.cc:493] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.030905 23651 raft_consensus.cc:515] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
W20260709 13:22:55.031101 23176 leader_election.cc:343] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.033689 23249 leader_election.cc:304] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:55.035477 23461 raft_consensus.cc:2804] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:55.035864 23461 raft_consensus.cc:493] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:55.036193 23461 raft_consensus.cc:3060] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.005486 23552 raft_consensus.cc:2804] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:55.009747 23495 raft_consensus.cc:2804] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:54.977738 23174 leader_election.cc:304] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
W20260709 13:22:55.048956 23174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 71313.8us
I20260709 13:22:55.037148 23651 leader_election.cc:290] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:55.046664 23552 raft_consensus.cc:493] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:55.051070 23552 raft_consensus.cc:3060] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.061376 23406 tablet_bootstrap.cc:654] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.046550 23495 raft_consensus.cc:493] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:55.064393 23644 raft_consensus.cc:2749] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:55.068174 23407 tablet_bootstrap.cc:492] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:55.068825 23407 ts_tablet_manager.cc:1403] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.277s	user 0.012s	sys 0.016s
I20260709 13:22:55.054067 23611 raft_consensus.cc:2749] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:55.071800 23495 raft_consensus.cc:3060] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.071820 23407 raft_consensus.cc:359] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.073091 23407 raft_consensus.cc:385] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.073450 23407 raft_consensus.cc:740] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.074344 23407 consensus_queue.cc:260] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.085580 23407 ts_tablet_manager.cc:1434] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:22:55.092132 23407 tablet_bootstrap.cc:492] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:55.120962 23407 tablet_bootstrap.cc:654] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.137588 23552 raft_consensus.cc:515] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
W20260709 13:22:55.139854 23662 log.cc:927] Time spent T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:22:55.140384 23552 leader_election.cc:290] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:55.144115 23404 tablet_bootstrap.cc:654] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.144613 23359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e092acaa9541649bd04731cf50ea1c" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
W20260709 13:22:55.146556 23176 leader_election.cc:343] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.149250 23495 raft_consensus.cc:515] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:55.129099 23587 raft_consensus.cc:493] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.152483 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07f8c2c87cd4a47aa2f08e7750ae0ba" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:55.153237 23587 raft_consensus.cc:515] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
W20260709 13:22:55.154036 23101 leader_election.cc:343] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.157052 23495 leader_election.cc:290] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:55.157279 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:55.160373 23587 leader_election.cc:290] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:55.162582 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:55.163551 23283 raft_consensus.cc:2468] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
W20260709 13:22:55.166839 23250 consensus_peers.cc:597] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:55.167395 23660 consensus_queue.cc:1048] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:55.167825 23250 leader_election.cc:343] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.168715 23644 raft_consensus.cc:493] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.169420 23644 raft_consensus.cc:515] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.172307 23644 leader_election.cc:290] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:55.171825 23461 raft_consensus.cc:515] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.175549 23099 leader_election.cc:304] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:55.177726 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fac600ebf36450b96343e8ad119b130" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:55.178056 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:55.178259 23282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fac600ebf36450b96343e8ad119b130" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:55.180372 23461 leader_election.cc:290] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
W20260709 13:22:55.184969 23249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 148298us
I20260709 13:22:55.181406 23587 raft_consensus.cc:2804] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:22:55.181260 23174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 127422us
I20260709 13:22:55.193653 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:55.194830 23322 leader_election.cc:304] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:55.198663 23587 raft_consensus.cc:493] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:55.216922 23587 raft_consensus.cc:3060] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.218401 23646 raft_consensus.cc:2749] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:55.222561 23101 leader_election.cc:343] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.200686 23130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:55.226298 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07f8c2c87cd4a47aa2f08e7750ae0ba" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:55.227010 23209 raft_consensus.cc:3060] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:55.208791 23250 leader_election.cc:343] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.234488 23462 consensus_queue.cc:1048] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:55.238376 23205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:55.239267 23205 raft_consensus.cc:3060] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.245221 23030 catalog_manager.cc:5697] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 1 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:55.256728 23587 raft_consensus.cc:515] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.258176 23130 raft_consensus.cc:2393] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5ee52ad2f442bac6959931126746d in current term 1: Already voted for candidate 72629382bd4c46b09b2efeaf08c1460d in this term.
I20260709 13:22:55.262153 23355 raft_consensus.cc:3060] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.264726 23249 leader_election.cc:304] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:55.265918 23462 raft_consensus.cc:3060] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.269923 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:55.270349 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
W20260709 13:22:55.271582 23101 leader_election.cc:343] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.273208 23587 leader_election.cc:290] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
W20260709 13:22:55.185624 23175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 82855us
I20260709 13:22:55.283077 23462 raft_consensus.cc:2749] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:55.293390 23406 tablet_bootstrap.cc:492] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:55.295409 23406 ts_tablet_manager.cc:1403] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.308s	user 0.020s	sys 0.005s
I20260709 13:22:55.297873 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e092acaa9541649bd04731cf50ea1c" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:55.298184 23209 raft_consensus.cc:2468] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:55.298586 23133 raft_consensus.cc:3060] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.300467 23283 raft_consensus.cc:2468] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:55.303088 23205 raft_consensus.cc:2468] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:55.307286 23099 leader_election.cc:304] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:55.309067 23587 raft_consensus.cc:2804] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.309716 23587 raft_consensus.cc:697] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:55.310868 23587 consensus_queue.cc:237] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.341436 23404 tablet_bootstrap.cc:492] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:55.342098 23404 ts_tablet_manager.cc:1403] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.386s	user 0.030s	sys 0.040s
I20260709 13:22:55.342175 23407 tablet_bootstrap.cc:492] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:55.342898 23407 ts_tablet_manager.cc:1403] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.255s	user 0.037s	sys 0.038s
I20260709 13:22:55.344923 23404 raft_consensus.cc:359] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.345705 23404 raft_consensus.cc:385] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.348066 23404 raft_consensus.cc:740] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.348889 23404 consensus_queue.cc:260] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.351298 23404 ts_tablet_manager.cc:1434] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:22:55.346644 23407 raft_consensus.cc:359] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.353405 23407 raft_consensus.cc:385] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.353849 23407 raft_consensus.cc:740] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.354987 23407 consensus_queue.cc:260] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.361176 23670 raft_consensus.cc:493] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.361866 23670 raft_consensus.cc:515] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.364380 23670 leader_election.cc:290] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:55.366300 23407 ts_tablet_manager.cc:1434] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:22:55.366799 23404 tablet_bootstrap.cc:492] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:55.322994 23406 raft_consensus.cc:359] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:55.367719 23406 raft_consensus.cc:385] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.368031 23406 raft_consensus.cc:740] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.371320 23405 tablet_bootstrap.cc:492] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:55.371937 23405 ts_tablet_manager.cc:1403] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.488s	user 0.031s	sys 0.026s
I20260709 13:22:55.373204 23100 leader_election.cc:304] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:55.373843 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e44018374b34e9ab7172698203fddd0" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:55.374327 23642 raft_consensus.cc:2804] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.374554 23283 raft_consensus.cc:2468] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:55.374655 23249 leader_election.cc:304] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:55.374845 23642 raft_consensus.cc:697] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:55.376610 23404 tablet_bootstrap.cc:654] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.376068 23642 consensus_queue.cc:237] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:55.378329 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e44018374b34e9ab7172698203fddd0" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:55.381196 23133 raft_consensus.cc:2468] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:55.376147 23462 raft_consensus.cc:2804] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.382467 23462 raft_consensus.cc:697] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:55.383188 23644 consensus_queue.cc:1048] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.384464 23405 raft_consensus.cc:359] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.385452 23405 raft_consensus.cc:385] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.385880 23405 raft_consensus.cc:740] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.383332 23462 consensus_queue.cc:237] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.386869 23405 consensus_queue.cc:260] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.383102 23174 leader_election.cc:304] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:55.389109 23407 tablet_bootstrap.cc:492] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:55.389737 23405 ts_tablet_manager.cc:1434] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:22:55.390605 23405 tablet_bootstrap.cc:492] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:55.368692 23406 consensus_queue.cc:260] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
W20260709 13:22:55.394510 23175 leader_election.cc:343] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.400488 23494 raft_consensus.cc:2804] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:55.400977 23494 raft_consensus.cc:493] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:55.401298 23494 raft_consensus.cc:3060] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.406363 23405 tablet_bootstrap.cc:654] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.418084 23406 ts_tablet_manager.cc:1434] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.000s
I20260709 13:22:55.421859 23406 tablet_bootstrap.cc:492] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:55.415392 23175 leader_election.cc:304] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:55.435437 23462 raft_consensus.cc:493] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.436558 23462 raft_consensus.cc:515] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.438764 23407 tablet_bootstrap.cc:654] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.440306 23670 raft_consensus.cc:2804] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.440853 23670 raft_consensus.cc:697] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:55.441754 23670 consensus_queue.cc:237] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:55.440867 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a590581b50b42b2ae1ce08dcfe237e7" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:55.433622 23587 raft_consensus.cc:493] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.444077 23355 raft_consensus.cc:3060] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.444471 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a590581b50b42b2ae1ce08dcfe237e7" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:55.444121 23587 raft_consensus.cc:515] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.461993 23406 tablet_bootstrap.cc:654] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:55.458459 23249 leader_election.cc:343] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:55.463848 23249 leader_election.cc:343] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.464319 23249 leader_election.cc:304] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:55.465561 23404 tablet_bootstrap.cc:492] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:55.466701 23404 ts_tablet_manager.cc:1403] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.007s
I20260709 13:22:55.445839 23462 leader_election.cc:290] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:55.470892 23643 raft_consensus.cc:2749] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:55.472401 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3b9027733f4b1c9800874f86d1b054" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:55.472182 23587 leader_election.cc:290] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:55.474694 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3b9027733f4b1c9800874f86d1b054" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:55.474922 23644 consensus_queue.cc:1048] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:55.475880 23405 tablet_bootstrap.cc:492] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:55.476485 23405 ts_tablet_manager.cc:1403] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.009s
W20260709 13:22:55.477085 23099 leader_election.cc:343] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:55.485306 23100 leader_election.cc:343] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.498013 23405 raft_consensus.cc:359] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.499030 23405 raft_consensus.cc:385] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.499375 23405 raft_consensus.cc:740] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.501256 23405 consensus_queue.cc:260] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.457747 23494 raft_consensus.cc:515] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.486042 23100 leader_election.cc:304] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:55.505085 23495 raft_consensus.cc:2749] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:55.533164 23405 ts_tablet_manager.cc:1434] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.001s
I20260709 13:22:55.536754 23405 tablet_bootstrap.cc:492] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:55.537364 23404 raft_consensus.cc:359] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.538570 23404 raft_consensus.cc:385] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.538872 23404 raft_consensus.cc:740] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.535005 23587 consensus_queue.cc:1048] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:22:55.539825 23404 consensus_queue.cc:260] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.546092 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e44018374b34e9ab7172698203fddd0" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:55.547374 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e44018374b34e9ab7172698203fddd0" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:55.548033 23284 raft_consensus.cc:3060] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.542223 23494 leader_election.cc:290] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:55.568528 23404 ts_tablet_manager.cc:1434] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.000s
I20260709 13:22:55.570643 23404 tablet_bootstrap.cc:492] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
W20260709 13:22:55.564924 23175 leader_election.cc:343] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.573447 23407 tablet_bootstrap.cc:492] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:55.574132 23407 ts_tablet_manager.cc:1403] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.207s	user 0.021s	sys 0.009s
I20260709 13:22:55.577031 23407 raft_consensus.cc:359] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.577744 23407 raft_consensus.cc:385] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.578274 23494 raft_consensus.cc:493] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.579506 23494 raft_consensus.cc:515] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:55.582860 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:55.584427 23284 raft_consensus.cc:2468] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
W20260709 13:22:55.584422 23176 leader_election.cc:343] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.585718 23174 leader_election.cc:304] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:55.587266 23494 leader_election.cc:290] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:55.587421 23670 raft_consensus.cc:2804] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.588014 23670 raft_consensus.cc:697] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:55.578442 23407 raft_consensus.cc:740] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.589208 23670 consensus_queue.cc:237] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.591301 23407 consensus_queue.cc:260] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.595438 23407 ts_tablet_manager.cc:1434] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 13:22:55.596477 23407 tablet_bootstrap.cc:492] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
W20260709 13:22:55.598184 23099 consensus_peers.cc:597] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:55.601446 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:55.604230 23407 tablet_bootstrap.cc:654] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:55.604372 23175 leader_election.cc:343] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.604957 23175 leader_election.cc:304] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:55.605743 23494 raft_consensus.cc:2749] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:55.606652 23406 tablet_bootstrap.cc:492] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:55.607184 23406 ts_tablet_manager.cc:1403] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.188s	user 0.006s	sys 0.025s
I20260709 13:22:55.617596 23033 catalog_manager.cc:5697] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:55.630275 23406 raft_consensus.cc:359] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.630882 23405 tablet_bootstrap.cc:654] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.635074 23404 tablet_bootstrap.cc:654] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.637900 23406 raft_consensus.cc:385] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.638309 23406 raft_consensus.cc:740] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.639333 23406 consensus_queue.cc:260] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.642037 23406 ts_tablet_manager.cc:1434] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:22:55.643649 23404 tablet_bootstrap.cc:492] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:55.644351 23404 ts_tablet_manager.cc:1403] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.000s
I20260709 13:22:55.647830 23406 tablet_bootstrap.cc:492] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:55.649407 23407 tablet_bootstrap.cc:492] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:55.649974 23407 ts_tablet_manager.cc:1403] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.009s
I20260709 13:22:55.653395 23407 raft_consensus.cc:359] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.654147 23407 raft_consensus.cc:385] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.654389 23407 raft_consensus.cc:740] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.654846 23406 tablet_bootstrap.cc:654] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.655143 23407 consensus_queue.cc:260] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.659538 23407 ts_tablet_manager.cc:1434] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:22:55.660543 23407 tablet_bootstrap.cc:492] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:55.666661 23587 raft_consensus.cc:493] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.667302 23407 tablet_bootstrap.cc:654] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.667273 23587 raft_consensus.cc:515] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.669920 23462 raft_consensus.cc:493] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.670558 23462 raft_consensus.cc:515] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.671507 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:55.673103 23462 leader_election.cc:290] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
W20260709 13:22:55.673810 23101 leader_election.cc:343] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.674213 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:55.674762 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:55.675987 23587 leader_election.cc:290] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:55.679080 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:55.677157 23249 leader_election.cc:304] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
W20260709 13:22:55.676534 23082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:55.680963 23462 raft_consensus.cc:2749] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:55.681579 23099 leader_election.cc:343] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.682276 23099 leader_election.cc:304] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:55.683135 23587 raft_consensus.cc:2749] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:55.684296 23407 tablet_bootstrap.cc:492] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:55.685035 23407 ts_tablet_manager.cc:1403] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.007s
I20260709 13:22:55.684247 23030 catalog_manager.cc:5697] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:55.686126 23406 tablet_bootstrap.cc:492] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:55.686945 23404 raft_consensus.cc:359] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.689664 23405 tablet_bootstrap.cc:492] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:55.691573 23406 ts_tablet_manager.cc:1403] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.009s
I20260709 13:22:55.691967 23407 raft_consensus.cc:359] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.692813 23404 raft_consensus.cc:385] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.694000 23407 raft_consensus.cc:385] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.694131 23404 raft_consensus.cc:740] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.692508 23405 ts_tablet_manager.cc:1403] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.002s
I20260709 13:22:55.694523 23407 raft_consensus.cc:740] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.696058 23404 consensus_queue.cc:260] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.698539 23405 raft_consensus.cc:359] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.699486 23405 raft_consensus.cc:385] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.699826 23405 raft_consensus.cc:740] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.699647 23407 consensus_queue.cc:260] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.701083 23404 ts_tablet_manager.cc:1434] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:22:55.700857 23405 consensus_queue.cc:260] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.702872 23404 tablet_bootstrap.cc:492] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:55.703636 23407 ts_tablet_manager.cc:1434] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:22:55.704756 23407 tablet_bootstrap.cc:492] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:55.697932 23406 raft_consensus.cc:359] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.706965 23406 raft_consensus.cc:385] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.707278 23406 raft_consensus.cc:740] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.710439 23404 tablet_bootstrap.cc:654] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.711748 23407 tablet_bootstrap.cc:654] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.708108 23406 consensus_queue.cc:260] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.715987 23405 ts_tablet_manager.cc:1434] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:22:55.717558 23405 tablet_bootstrap.cc:492] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:55.724196 23406 ts_tablet_manager.cc:1434] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 13:22:55.723117 23033 catalog_manager.cc:5697] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:55.733299 23033 catalog_manager.cc:5697] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:55.741943 23587 consensus_queue.cc:1048] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.742882 23406 tablet_bootstrap.cc:492] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:55.747694 23423 raft_consensus.cc:493] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.748306 23423 raft_consensus.cc:515] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.749548 23356 raft_consensus.cc:3060] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.756817 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f89e5242045f2a28a36e335775561" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:55.758440 23250 leader_election.cc:343] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.763523 23423 leader_election.cc:290] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:55.764305 23587 consensus_queue.cc:1048] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:55.765470 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f89e5242045f2a28a36e335775561" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:55.766465 23135 raft_consensus.cc:2468] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:55.767762 23249 leader_election.cc:304] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:55.768702 23423 raft_consensus.cc:2804] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:55.769134 23423 raft_consensus.cc:493] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:55.769570 23423 raft_consensus.cc:3060] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.784006 23423 raft_consensus.cc:515] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.785948 23405 tablet_bootstrap.cc:654] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.794996 23423 leader_election.cc:290] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:55.795398 23406 tablet_bootstrap.cc:654] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.796343 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f89e5242045f2a28a36e335775561" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:55.797001 23135 raft_consensus.cc:3060] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.799361 23644 raft_consensus.cc:493] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.800050 23644 raft_consensus.cc:515] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.801896 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f89e5242045f2a28a36e335775561" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
W20260709 13:22:55.803447 23250 leader_election.cc:343] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.804102 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:55.805270 23210 raft_consensus.cc:2393] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28222c0dd7a1411692efad3387118115 in current term 1: Already voted for candidate b1f5ee52ad2f442bac6959931126746d in this term.
I20260709 13:22:55.806861 23644 leader_election.cc:290] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:55.808028 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:55.810495 23322 leader_election.cc:304] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:55.812108 23644 raft_consensus.cc:3060] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.827525 23135 raft_consensus.cc:2468] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:55.830201 23407 tablet_bootstrap.cc:492] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:55.830399 23644 raft_consensus.cc:2749] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:55.830837 23407 ts_tablet_manager.cc:1403] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.126s	user 0.019s	sys 0.020s
I20260709 13:22:55.834589 23407 raft_consensus.cc:359] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.835229 23407 raft_consensus.cc:385] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.835515 23407 raft_consensus.cc:740] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.836346 23407 consensus_queue.cc:260] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.839389 23407 ts_tablet_manager.cc:1434] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:55.841015 23407 tablet_bootstrap.cc:492] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:55.843032 23406 tablet_bootstrap.cc:492] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:55.843581 23406 ts_tablet_manager.cc:1403] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.008s
I20260709 13:22:55.841619 23249 leader_election.cc:304] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:55.847533 23462 raft_consensus.cc:2804] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.848048 23462 raft_consensus.cc:697] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:55.848865 23462 consensus_queue.cc:237] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:55.852057 23030 catalog_manager.cc:5697] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:55.854321 23030 catalog_manager.cc:5697] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:55.855129 23670 consensus_queue.cc:1048] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:55.877698 23407 tablet_bootstrap.cc:654] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.894145 23518 consensus_queue.cc:1048] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:22:55.895781 23101 consensus_peers.cc:597] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:55.894861 23406 raft_consensus.cc:359] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.908048 23406 raft_consensus.cc:385] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.908506 23406 raft_consensus.cc:740] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.915781 23406 consensus_queue.cc:260] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.922084 23405 tablet_bootstrap.cc:492] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:55.922679 23405 ts_tablet_manager.cc:1403] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.205s	user 0.017s	sys 0.012s
I20260709 13:22:55.924968 23030 catalog_manager.cc:5697] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:55.916590 23462 raft_consensus.cc:493] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.926875 23462 raft_consensus.cc:515] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.929072 23462 leader_election.cc:290] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:55.930866 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d430d760648423c8b3c2e0861c6bfcf" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:55.925631 23405 raft_consensus.cc:359] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:55.931492 23405 raft_consensus.cc:385] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.931770 23405 raft_consensus.cc:740] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
W20260709 13:22:55.932550 23250 leader_election.cc:343] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.932474 23405 consensus_queue.cc:260] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:55.933276 23404 tablet_bootstrap.cc:492] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:55.933845 23404 ts_tablet_manager.cc:1403] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.231s	user 0.050s	sys 0.080s
I20260709 13:22:55.934679 23405 ts_tablet_manager.cc:1434] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:55.935708 23405 tablet_bootstrap.cc:492] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:55.941340 23407 tablet_bootstrap.cc:492] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:55.941947 23407 ts_tablet_manager.cc:1403] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.003s
I20260709 13:22:55.945037 23407 raft_consensus.cc:359] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.945842 23407 raft_consensus.cc:385] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.946130 23407 raft_consensus.cc:740] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.946817 23407 consensus_queue.cc:260] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:55.949072 23407 ts_tablet_manager.cc:1434] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:55.940418 23404 raft_consensus.cc:359] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.949507 23404 raft_consensus.cc:385] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.949772 23404 raft_consensus.cc:740] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.950577 23404 consensus_queue.cc:260] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.952230 23407 tablet_bootstrap.cc:492] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:55.953270 23406 ts_tablet_manager.cc:1434] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.001s
I20260709 13:22:55.954301 23406 tablet_bootstrap.cc:492] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:55.960800 23404 ts_tablet_manager.cc:1434] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:22:55.957928 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d430d760648423c8b3c2e0861c6bfcf" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
W20260709 13:22:55.969513 23706 log.cc:927] Time spent T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
I20260709 13:22:55.972508 23404 tablet_bootstrap.cc:492] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:55.985072 23406 tablet_bootstrap.cc:654] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.987474 23284 raft_consensus.cc:3060] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.988060 23636 raft_consensus.cc:493] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:55.988607 23636 raft_consensus.cc:515] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:55.980342 23208 raft_consensus.cc:2468] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:55.994014 23249 leader_election.cc:304] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:55.994483 23636 leader_election.cc:290] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
W20260709 13:22:55.995384 23175 consensus_peers.cc:597] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:55.996934 23462 raft_consensus.cc:2804] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:55.997150 23282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e318744c2b64bd3a410e806761d3648" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:55.997479 23462 raft_consensus.cc:493] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:22:56.027072 23176 consensus_peers.cc:597] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:56.028788 23405 tablet_bootstrap.cc:654] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.013073 23671 consensus_queue.cc:1048] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:22:56.005178 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e318744c2b64bd3a410e806761d3648" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:56.011735 23495 consensus_queue.cc:1048] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:22:56.001683 23518 raft_consensus.cc:493] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:56.035418 23518 raft_consensus.cc:515] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.025367 23462 raft_consensus.cc:3060] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.037484 23518 leader_election.cc:290] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
W20260709 13:22:56.045750 23176 leader_election.cc:343] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:55.997912 23282 raft_consensus.cc:2468] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:56.047389 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dfec3f3a8c4f79bbac529d3b7691a2" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:56.049590 23174 leader_election.cc:304] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
W20260709 13:22:56.057217 23249 leader_election.cc:343] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:56.060947 23636 raft_consensus.cc:2804] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:56.071081 23407 tablet_bootstrap.cc:654] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.061658 23636 raft_consensus.cc:493] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:56.076443 23636 raft_consensus.cc:3060] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.072058 23206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dfec3f3a8c4f79bbac529d3b7691a2" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
W20260709 13:22:56.083495 23249 leader_election.cc:343] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:56.084107 23249 leader_election.cc:304] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:56.084949 23671 raft_consensus.cc:493] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:56.085158 23518 raft_consensus.cc:2749] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:56.085513 23671 raft_consensus.cc:515] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:56.088567 23404 tablet_bootstrap.cc:654] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.093226 23671 leader_election.cc:290] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:56.122536 23670 raft_consensus.cc:493] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:56.123353 23670 raft_consensus.cc:515] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.127478 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a590581b50b42b2ae1ce08dcfe237e7" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:56.129814 23175 leader_election.cc:343] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:56.131767 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9c34142ecf4df297b6eff325e4cbd6" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:56.134183 23249 leader_election.cc:343] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:56.142324 23669 consensus_queue.cc:1048] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:56.148990 23670 leader_election.cc:290] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:56.154211 23282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a590581b50b42b2ae1ce08dcfe237e7" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:56.155017 23282 raft_consensus.cc:2468] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:56.156363 23174 leader_election.cc:304] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:56.157990 23494 raft_consensus.cc:2804] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:56.158372 23494 raft_consensus.cc:493] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:56.158705 23494 raft_consensus.cc:3060] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.154726 23462 raft_consensus.cc:515] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:56.183599 23406 tablet_bootstrap.cc:492] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:56.184434 23406 ts_tablet_manager.cc:1403] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.230s	user 0.027s	sys 0.031s
I20260709 13:22:56.203197 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d430d760648423c8b3c2e0861c6bfcf" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:56.203905 23208 raft_consensus.cc:3060] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.204491 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9c34142ecf4df297b6eff325e4cbd6" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:56.205618 23462 leader_election.cc:290] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:56.206873 23406 raft_consensus.cc:359] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.210521 23406 raft_consensus.cc:385] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.210821 23406 raft_consensus.cc:740] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.207377 23636 raft_consensus.cc:515] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:56.211774 23406 consensus_queue.cc:260] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.222528 23406 ts_tablet_manager.cc:1434] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.005s
I20260709 13:22:56.224083 23405 tablet_bootstrap.cc:492] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:56.224812 23405 ts_tablet_manager.cc:1403] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.289s	user 0.026s	sys 0.035s
I20260709 13:22:56.211305 23494 raft_consensus.cc:515] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.248405 23494 leader_election.cc:290] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:56.253540 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a590581b50b42b2ae1ce08dcfe237e7" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:56.231575 23495 raft_consensus.cc:493] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:56.260869 23175 leader_election.cc:343] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:56.274403 23636 leader_election.cc:290] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:56.275233 23495 raft_consensus.cc:515] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:56.285022 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6370231c76d43af900444679754d8e6" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:56.286392 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d430d760648423c8b3c2e0861c6bfcf" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
W20260709 13:22:56.294263 23250 leader_election.cc:343] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:56.294987 23250 leader_election.cc:304] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:56.297971 23423 raft_consensus.cc:2749] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:56.302711 23494 raft_consensus.cc:493] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:56.303305 23494 raft_consensus.cc:515] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.303802 23282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a590581b50b42b2ae1ce08dcfe237e7" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:56.304551 23282 raft_consensus.cc:3060] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.304760 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e318744c2b64bd3a410e806761d3648" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:56.305389 23283 raft_consensus.cc:3060] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.306735 23134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dfec3f3a8c4f79bbac529d3b7691a2" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:56.308435 23494 leader_election.cc:290] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:56.312382 23282 raft_consensus.cc:2468] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:56.313407 23406 tablet_bootstrap.cc:492] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:56.323942 23174 leader_election.cc:304] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:56.325696 23715 raft_consensus.cc:2804] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:56.326622 23715 raft_consensus.cc:697] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:56.328814 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e318744c2b64bd3a410e806761d3648" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
W20260709 13:22:56.330235 23713 log.cc:927] Time spent T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:22:56.272727 23405 raft_consensus.cc:359] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.332825 23405 raft_consensus.cc:385] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.333169 23405 raft_consensus.cc:740] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.336623 23405 consensus_queue.cc:260] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.318436 23495 leader_election.cc:290] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:56.329636 23283 raft_consensus.cc:2468] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:56.363083 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6370231c76d43af900444679754d8e6" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:56.355145 23134 raft_consensus.cc:2468] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
W20260709 13:22:56.364241 23176 leader_election.cc:343] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:56.380357 23405 ts_tablet_manager.cc:1434] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.155s	user 0.010s	sys 0.014s
I20260709 13:22:56.381335 23405 tablet_bootstrap.cc:492] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:56.362146 23282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dfec3f3a8c4f79bbac529d3b7691a2" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:56.383774 23715 consensus_queue.cc:237] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
W20260709 13:22:56.379951 23250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 83612.8us
W20260709 13:22:56.443259 23250 leader_election.cc:343] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:56.387835 23407 tablet_bootstrap.cc:492] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
W20260709 13:22:56.439575 23101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 111479us
I20260709 13:22:56.462528 23407 ts_tablet_manager.cc:1403] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.510s	user 0.012s	sys 0.019s
I20260709 13:22:56.388779 23404 tablet_bootstrap.cc:492] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:56.390494 23405 tablet_bootstrap.cc:654] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.393301 23406 tablet_bootstrap.cc:654] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:56.437845 23099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 77112.3us
I20260709 13:22:56.472736 23407 raft_consensus.cc:359] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.487226 23407 raft_consensus.cc:385] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.493526 23717 raft_consensus.cc:493] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:56.494997 23717 raft_consensus.cc:515] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
W20260709 13:22:56.439544 23100 leader_election.cc:343] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:56.499019 23100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:34617, user_credentials={real_user=slave}} blocked reactor thread for 59856us
I20260709 13:22:56.499372 23404 ts_tablet_manager.cc:1403] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.527s	user 0.038s	sys 0.046s
I20260709 13:22:56.457826 23174 leader_election.cc:304] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:56.488867 23407 raft_consensus.cc:740] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.518499 23494 raft_consensus.cc:2804] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:22:56.519539 23174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 63656.3us
I20260709 13:22:56.520228 23494 raft_consensus.cc:697] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
W20260709 13:22:56.509236 23101 leader_election.cc:343] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:56.385562 23282 raft_consensus.cc:2468] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:56.532469 23404 raft_consensus.cc:359] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:56.534010 23404 raft_consensus.cc:385] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.534379 23404 raft_consensus.cc:740] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.535293 23404 consensus_queue.cc:260] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:56.537724 23206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8192c710d74b4b1c9b4d67b79426ac48" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:56.539403 23494 consensus_queue.cc:237] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:56.546636 23404 ts_tablet_manager.cc:1434] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.005s
I20260709 13:22:56.548866 23404 tablet_bootstrap.cc:492] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:56.562613 23358 raft_consensus.cc:3060] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.567226 23404 tablet_bootstrap.cc:654] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.568545 23208 raft_consensus.cc:2468] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:56.545320 23174 leader_election.cc:304] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
W20260709 13:22:56.592687 23174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 47511.9us
I20260709 13:22:56.604591 23636 raft_consensus.cc:2804] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:56.605219 23636 raft_consensus.cc:493] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:56.605693 23636 raft_consensus.cc:3060] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.594929 23407 consensus_queue.cc:260] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.590795 23101 leader_election.cc:304] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115
I20260709 13:22:56.624270 23717 leader_election.cc:290] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
W20260709 13:22:56.625571 23101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 135549us
I20260709 13:22:56.637446 23724 raft_consensus.cc:2749] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:56.641535 23407 ts_tablet_manager.cc:1434] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.175s	user 0.007s	sys 0.006s
I20260709 13:22:56.650367 23249 leader_election.cc:304] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:56.652696 23643 raft_consensus.cc:2804] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:56.653479 23643 raft_consensus.cc:697] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:56.654764 23643 consensus_queue.cc:237] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
W20260709 13:22:56.662982 23250 consensus_peers.cc:597] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:56.665098 23357 raft_consensus.cc:3060] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.692698 23407 tablet_bootstrap.cc:492] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:56.667517 23282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8192c710d74b4b1c9b4d67b79426ac48" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:56.712968 23407 tablet_bootstrap.cc:654] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:56.717927 23249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.130:34617, user_credentials={real_user=slave}} blocked reactor thread for 67874.1us
I20260709 13:22:56.720026 23404 tablet_bootstrap.cc:492] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:56.722635 23404 ts_tablet_manager.cc:1403] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.174s	user 0.026s	sys 0.009s
I20260709 13:22:56.732246 23405 tablet_bootstrap.cc:492] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:56.732965 23405 ts_tablet_manager.cc:1403] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.352s	user 0.012s	sys 0.016s
I20260709 13:22:56.734826 23406 tablet_bootstrap.cc:492] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:56.735667 23406 ts_tablet_manager.cc:1403] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.422s	user 0.017s	sys 0.003s
I20260709 13:22:56.736905 23462 consensus_queue.cc:1048] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:56.737031 23405 raft_consensus.cc:359] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.738058 23405 raft_consensus.cc:385] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.738389 23405 raft_consensus.cc:740] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.739359 23405 consensus_queue.cc:260] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.741676 23405 ts_tablet_manager.cc:1434] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:22:56.744921 23322 leader_election.cc:304] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:56.750406 23405 tablet_bootstrap.cc:492] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:56.743844 23404 raft_consensus.cc:359] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:56.758474 23404 raft_consensus.cc:385] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.758776 23404 raft_consensus.cc:740] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.759574 23404 consensus_queue.cc:260] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:56.739616 23406 raft_consensus.cc:359] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.766073 23406 raft_consensus.cc:385] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.766530 23406 raft_consensus.cc:740] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.767550 23406 consensus_queue.cc:260] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.768028 23636 raft_consensus.cc:515] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.772828 23406 ts_tablet_manager.cc:1434] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.005s
I20260709 13:22:56.785121 23404 ts_tablet_manager.cc:1434] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.003s
I20260709 13:22:56.797299 23404 tablet_bootstrap.cc:492] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:56.808990 23407 tablet_bootstrap.cc:492] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:56.809594 23407 ts_tablet_manager.cc:1403] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.012s
I20260709 13:22:56.817679 23404 tablet_bootstrap.cc:654] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.818032 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dfec3f3a8c4f79bbac529d3b7691a2" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:56.818787 23135 raft_consensus.cc:3060] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.822717 23405 tablet_bootstrap.cc:654] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.813373 23407 raft_consensus.cc:359] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:56.832904 23636 leader_election.cc:290] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:56.824932 23407 raft_consensus.cc:385] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.835302 23644 raft_consensus.cc:2749] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:56.838227 23135 raft_consensus.cc:2468] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:56.840269 23175 leader_election.cc:304] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:56.841439 23715 raft_consensus.cc:493] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:56.842031 23715 raft_consensus.cc:515] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.842739 23670 raft_consensus.cc:2804] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:56.843305 23670 raft_consensus.cc:697] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:56.844601 23715 leader_election.cc:290] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:56.845410 23406 tablet_bootstrap.cc:492] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:56.848563 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3b9027733f4b1c9800874f86d1b054" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:56.844336 23670 consensus_queue.cc:237] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.849505 23131 raft_consensus.cc:2468] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:56.855379 23175 leader_election.cc:304] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:56.856379 23669 consensus_queue.cc:1048] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:56.856982 23494 raft_consensus.cc:2804] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:56.857395 23494 raft_consensus.cc:493] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:56.857713 23494 raft_consensus.cc:3060] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.858256 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03dfec3f3a8c4f79bbac529d3b7691a2" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:56.859037 23285 raft_consensus.cc:3060] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:56.847779 23027 catalog_manager.cc:5697] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:56.863905 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3b9027733f4b1c9800874f86d1b054" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:56.864704 23283 raft_consensus.cc:2468] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:56.834734 23407 raft_consensus.cc:740] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.877517 23406 tablet_bootstrap.cc:654] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.898415 23407 consensus_queue.cc:260] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:56.903455 23404 tablet_bootstrap.cc:492] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:56.904124 23404 ts_tablet_manager.cc:1403] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.107s	user 0.043s	sys 0.034s
I20260709 13:22:56.907642 23404 raft_consensus.cc:359] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:56.908358 23404 raft_consensus.cc:385] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.908619 23404 raft_consensus.cc:740] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.909356 23404 consensus_queue.cc:260] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:56.911818 23724 raft_consensus.cc:493] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:56.912388 23724 raft_consensus.cc:515] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:56.913507 23404 ts_tablet_manager.cc:1434] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:56.914897 23404 tablet_bootstrap.cc:492] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:56.914086 23027 catalog_manager.cc:5697] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:56.916572 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a590581b50b42b2ae1ce08dcfe237e7" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:56.918982 23724 leader_election.cc:290] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:56.921650 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a590581b50b42b2ae1ce08dcfe237e7" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:56.922303 23404 tablet_bootstrap.cc:654] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.923615 23100 leader_election.cc:304] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:56.928642 23724 raft_consensus.cc:2749] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:56.957516 23740 log.cc:927] Time spent T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:22:56.982409 23405 tablet_bootstrap.cc:492] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:56.983034 23405 ts_tablet_manager.cc:1403] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.233s	user 0.026s	sys 0.000s
I20260709 13:22:57.002667 23404 tablet_bootstrap.cc:492] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:57.003322 23404 ts_tablet_manager.cc:1403] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.089s	user 0.034s	sys 0.027s
I20260709 13:22:57.007262 23404 raft_consensus.cc:359] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:57.008081 23404 raft_consensus.cc:385] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.008419 23404 raft_consensus.cc:740] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.009258 23404 consensus_queue.cc:260] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:57.015707 23407 ts_tablet_manager.cc:1434] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.206s	user 0.008s	sys 0.003s
I20260709 13:22:57.019878 23404 ts_tablet_manager.cc:1434] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:22:57.029342 23494 raft_consensus.cc:515] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:57.033056 23406 tablet_bootstrap.cc:492] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:57.033746 23406 ts_tablet_manager.cc:1403] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.209s	user 0.020s	sys 0.020s
I20260709 13:22:57.022855 23644 raft_consensus.cc:493] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.047338 23494 leader_election.cc:290] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:57.023314 23669 consensus_queue.cc:1048] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:22:57.076275 23407 tablet_bootstrap.cc:492] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:57.042053 23644 raft_consensus.cc:515] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:57.081526 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d430d760648423c8b3c2e0861c6bfcf" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:57.082456 23210 raft_consensus.cc:2393] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28222c0dd7a1411692efad3387118115 in current term 1: Already voted for candidate b1f5ee52ad2f442bac6959931126746d in this term.
I20260709 13:22:57.092738 23405 raft_consensus.cc:359] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.093591 23405 raft_consensus.cc:385] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.093932 23405 raft_consensus.cc:740] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.094597 23405 consensus_queue.cc:260] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.096324 23405 ts_tablet_manager.cc:1434] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.000s
I20260709 13:22:57.101491 23406 raft_consensus.cc:359] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:57.102679 23406 raft_consensus.cc:385] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.103034 23406 raft_consensus.cc:740] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.104110 23406 consensus_queue.cc:260] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:57.122920 23285 raft_consensus.cc:2468] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:57.126188 23406 ts_tablet_manager.cc:1434] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.001s
I20260709 13:22:57.127553 23406 tablet_bootstrap.cc:492] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:57.131765 23407 tablet_bootstrap.cc:654] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.131353 23029 catalog_manager.cc:5697] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:57.135589 23406 tablet_bootstrap.cc:654] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.142714 23404 tablet_bootstrap.cc:492] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:57.272677 23644 leader_election.cc:290] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:57.281570 23134 raft_consensus.cc:3060] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.282733 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3b9027733f4b1c9800874f86d1b054" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:57.283444 23135 raft_consensus.cc:3060] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.299309 23135 raft_consensus.cc:2468] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:57.299569 23406 tablet_bootstrap.cc:492] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:57.300380 23406 ts_tablet_manager.cc:1403] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.173s	user 0.011s	sys 0.008s
I20260709 13:22:57.303764 23406 raft_consensus.cc:359] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.304569 23406 raft_consensus.cc:385] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.304843 23406 raft_consensus.cc:740] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.305657 23406 consensus_queue.cc:260] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.319952 23406 ts_tablet_manager.cc:1434] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:22:57.321854 23406 tablet_bootstrap.cc:492] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:57.331660 23754 consensus_queue.cc:1048] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:57.341125 23406 tablet_bootstrap.cc:654] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.344609 23175 leader_election.cc:304] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:57.346354 23753 raft_consensus.cc:2804] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:57.348920 23756 consensus_queue.cc:1048] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:57.373368 23756 raft_consensus.cc:493] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.374006 23756 raft_consensus.cc:515] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:57.386929 23756 leader_election.cc:290] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:57.393929 23404 tablet_bootstrap.cc:654] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.412503 23753 raft_consensus.cc:697] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:57.415205 23753 consensus_queue.cc:237] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:57.417886 23756 raft_consensus.cc:493] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.420470 23756 raft_consensus.cc:515] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.430370 23644 raft_consensus.cc:493] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.430737 23761 raft_consensus.cc:493] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.431015 23644 raft_consensus.cc:515] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.431229 23761 raft_consensus.cc:515] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.433236 23644 leader_election.cc:290] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:57.440488 23760 raft_consensus.cc:493] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.441183 23760 raft_consensus.cc:515] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.443548 23760 leader_election.cc:290] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:57.444350 23358 raft_consensus.cc:3060] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.447566 23756 leader_election.cc:290] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:57.453545 23406 tablet_bootstrap.cc:492] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:57.454352 23406 ts_tablet_manager.cc:1403] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.133s	user 0.024s	sys 0.022s
I20260709 13:22:57.455389 23462 consensus_queue.cc:1048] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:57.433239 23761 leader_election.cc:290] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:57.460580 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:57.466823 23175 leader_election.cc:343] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:57.469909 23082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:57.457736 23406 raft_consensus.cc:359] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.473659 23406 raft_consensus.cc:385] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.474121 23406 raft_consensus.cc:740] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.455363 23404 tablet_bootstrap.cc:492] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:57.475397 23404 ts_tablet_manager.cc:1403] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.404s	user 0.014s	sys 0.010s
I20260709 13:22:57.480741 23406 consensus_queue.cc:260] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.500476 23406 ts_tablet_manager.cc:1434] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:22:57.503340 23135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514b8e2595b64695ae570184026e6b10" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:57.516085 23100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:34617, user_credentials={real_user=slave}} blocked reactor thread for 55826.8us
W20260709 13:22:57.531363 23249 leader_election.cc:343] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.549058 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4535c921be9a4e5686183c491ff5f6ca" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
W20260709 13:22:57.567868 23174 leader_election.cc:343] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.568804 23406 tablet_bootstrap.cc:492] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
W20260709 13:22:57.580718 23176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.029s	sys 0.023s
W20260709 13:22:57.581213 23176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.029s	sys 0.023s
I20260709 13:22:57.583038 23406 tablet_bootstrap.cc:654] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.594172 23404 raft_consensus.cc:359] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.595827 23404 raft_consensus.cc:385] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.596199 23404 raft_consensus.cc:740] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.597131 23404 consensus_queue.cc:260] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.610963 23353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:57.615566 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4535c921be9a4e5686183c491ff5f6ca" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:57.616572 23353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:57.618589 23101 leader_election.cc:343] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.617095 23404 ts_tablet_manager.cc:1434] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.001s
I20260709 13:22:57.622292 23404 tablet_bootstrap.cc:492] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:57.626837 23636 raft_consensus.cc:493] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.628993 23636 raft_consensus.cc:515] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.632073 23636 leader_election.cc:290] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
W20260709 13:22:57.635192 23176 leader_election.cc:343] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.637065 23176 leader_election.cc:304] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:57.638137 23494 consensus_queue.cc:1048] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:57.645498 23407 tablet_bootstrap.cc:492] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:57.646132 23407 ts_tablet_manager.cc:1403] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.608s	user 0.017s	sys 0.021s
I20260709 13:22:57.648761 23636 raft_consensus.cc:2749] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:57.649042 23407 raft_consensus.cc:359] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.649778 23407 raft_consensus.cc:385] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.651762 23407 raft_consensus.cc:740] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.654220 23405 tablet_bootstrap.cc:492] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:57.653978 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6370231c76d43af900444679754d8e6" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:57.653218 23407 consensus_queue.cc:260] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.655186 23131 raft_consensus.cc:2468] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:57.664757 23407 ts_tablet_manager.cc:1434] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:22:57.671331 23405 tablet_bootstrap.cc:654] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:57.650332 23176 leader_election.cc:343] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.674739 23176 leader_election.cc:304] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:57.676635 23636 raft_consensus.cc:2749] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:57.682014 23278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:57.682857 23278 raft_consensus.cc:2468] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:57.686376 23406 tablet_bootstrap.cc:492] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:57.686916 23406 ts_tablet_manager.cc:1403] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.140s	user 0.015s	sys 0.000s
W20260709 13:22:57.688031 23176 consensus_peers.cc:597] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.691588 23352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6370231c76d43af900444679754d8e6" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:57.690217 23406 raft_consensus.cc:359] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:57.693046 23406 raft_consensus.cc:385] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:57.693435 23176 leader_election.cc:343] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.693454 23406 raft_consensus.cc:740] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.695073 23406 consensus_queue.cc:260] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:57.697510 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f89e5242045f2a28a36e335775561" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:57.698114 23406 ts_tablet_manager.cc:1434] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:22:57.699412 23406 tablet_bootstrap.cc:492] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:57.707170 23099 leader_election.cc:304] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:57.713075 23724 raft_consensus.cc:2804] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.713704 23724 raft_consensus.cc:493] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.714170 23724 raft_consensus.cc:3060] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.721719 23355 raft_consensus.cc:3060] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.730634 23352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514b8e2595b64695ae570184026e6b10" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:57.731455 23352 raft_consensus.cc:2468] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:57.735667 23353 raft_consensus.cc:3060] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.742563 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3b9027733f4b1c9800874f86d1b054" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:57.743323 23285 raft_consensus.cc:3060] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.764678 23407 tablet_bootstrap.cc:492] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:57.764717 23404 tablet_bootstrap.cc:654] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.768682 23724 raft_consensus.cc:515] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.794940 23407 tablet_bootstrap.cc:654] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.814841 23746 raft_consensus.cc:493] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.815552 23746 raft_consensus.cc:515] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:57.818462 23746 leader_election.cc:290] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:57.818681 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:57.821127 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
W20260709 13:22:57.824491 23174 leader_election.cc:343] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.842078 23175 leader_election.cc:304] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:57.843134 23670 raft_consensus.cc:2804] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:22:57.843587 23175 leader_election.cc:343] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.843816 23670 raft_consensus.cc:493] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.844218 23175 leader_election.cc:304] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:57.844468 23670 raft_consensus.cc:3060] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.845137 23405 tablet_bootstrap.cc:492] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:57.845713 23405 ts_tablet_manager.cc:1403] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.192s	user 0.046s	sys 0.042s
I20260709 13:22:57.846037 23753 raft_consensus.cc:2749] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:57.851922 23757 raft_consensus.cc:493] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.852530 23757 raft_consensus.cc:515] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.853240 23406 tablet_bootstrap.cc:654] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.856145 23757 leader_election.cc:290] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:57.856205 23206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797ae11a97f84ad783704a5f0b287330" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:57.857106 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797ae11a97f84ad783704a5f0b287330" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:57.857307 23206 raft_consensus.cc:2468] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
W20260709 13:22:57.858453 23101 leader_election.cc:343] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.859454 23100 leader_election.cc:304] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:57.859354 23405 raft_consensus.cc:359] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.860162 23405 raft_consensus.cc:385] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.860442 23405 raft_consensus.cc:740] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.860703 23757 raft_consensus.cc:2804] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.861460 23757 raft_consensus.cc:493] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.862147 23757 raft_consensus.cc:3060] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.873600 23724 leader_election.cc:290] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:57.874496 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:57.875203 23280 raft_consensus.cc:3060] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.881734 23250 leader_election.cc:304] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:57.883093 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d430d760648423c8b3c2e0861c6bfcf" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:57.883766 23643 raft_consensus.cc:2804] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.884255 23643 raft_consensus.cc:493] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.884594 23643 raft_consensus.cc:3060] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.881582 23278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f89e5242045f2a28a36e335775561" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:57.887571 23657 raft_consensus.cc:493] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:22:57.888329 23657 raft_consensus.cc:515] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.888609 23731 consensus_queue.cc:1048] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:57.889430 23322 leader_election.cc:304] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:57.890542 23352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:57.890950 23644 raft_consensus.cc:2749] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:57.893237 23101 leader_election.cc:343] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.896826 23132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb4ccf648b4137bbe92d1a4e9ce542" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:57.901002 23206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb4ccf648b4137bbe92d1a4e9ce542" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:57.901525 23657 leader_election.cc:290] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:57.903623 23323 leader_election.cc:304] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:57.861159 23405 consensus_queue.cc:260] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.908151 23285 raft_consensus.cc:2468] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:57.909008 23657 raft_consensus.cc:2749] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:57.910983 23280 raft_consensus.cc:2468] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:57.934974 23034 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44710 (request call id 52) took 1054 ms. Trace:
I20260709 13:22:57.935515 23034 rpcz_store.cc:276] 0709 13:22:56.880978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:22:56.881219 (+   241us) service_pool.cc:224] Handling call
0709 13:22:56.904430 (+ 23211us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b54002fca10. stack: 00007f8de9f6d343 00007f8de9f6d240 00007f8de98fc1d4 00007f8df363a304 00007f8df363a299 00007f8de9e27db1 00007f8de9f67b71 00007f8de9f680b2 00007f8df2ee1a89 00007f8df2e79da6 00007f8df2e4b088 00007f8df2f4937e 00007f8df140a2a4 00007f8df140a232 00007f8df140a161 00007f8df140a0dc
0709 13:22:57.934783 (+1030353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81821,"reported_tablets":3,"spinlock_wait_cycles":18121472}
I20260709 13:22:57.943507 23404 tablet_bootstrap.cc:492] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:57.944329 23404 ts_tablet_manager.cc:1403] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.322s	user 0.029s	sys 0.060s
I20260709 13:22:57.948395 23404 raft_consensus.cc:359] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.949483 23404 raft_consensus.cc:385] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.954249 23404 raft_consensus.cc:740] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.958653 23405 ts_tablet_manager.cc:1434] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.112s	user 0.008s	sys 0.000s
I20260709 13:22:57.948530 23757 raft_consensus.cc:515] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:57.958917 23404 consensus_queue.cc:260] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.963692 23404 ts_tablet_manager.cc:1434] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.007s
I20260709 13:22:57.964634 23766 raft_consensus.cc:493] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.967496 23766 raft_consensus.cc:515] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.968034 23404 tablet_bootstrap.cc:492] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:57.966668 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797ae11a97f84ad783704a5f0b287330" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
W20260709 13:22:57.972249 23101 leader_election.cc:343] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.973256 23766 leader_election.cc:290] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:57.974762 23404 tablet_bootstrap.cc:654] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.978370 23757 leader_election.cc:290] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
W20260709 13:22:57.953905 23322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 64558.5us
I20260709 13:22:57.991722 23206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797ae11a97f84ad783704a5f0b287330" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:57.997118 23099 leader_election.cc:304] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:58.001899 23724 raft_consensus.cc:2804] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.002553 23724 raft_consensus.cc:697] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:58.003475 23724 consensus_queue.cc:237] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.006431 23132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9c34142ecf4df297b6eff325e4cbd6" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:57.999097 23206 raft_consensus.cc:3060] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.020119 23406 tablet_bootstrap.cc:492] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:58.020711 23406 ts_tablet_manager.cc:1403] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.322s	user 0.019s	sys 0.007s
I20260709 13:22:58.021946 23643 raft_consensus.cc:515] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:57.999897 23670 raft_consensus.cc:515] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.024575 23405 tablet_bootstrap.cc:492] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:22:58.023306 23249 leader_election.cc:343] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.026990 23406 raft_consensus.cc:359] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.028374 23406 raft_consensus.cc:385] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.028695 23406 raft_consensus.cc:740] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.033311 23643 leader_election.cc:290] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:58.012600 23322 leader_election.cc:304] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:58.035117 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514b8e2595b64695ae570184026e6b10" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:58.036584 23670 leader_election.cc:290] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:58.039657 23657 raft_consensus.cc:2749] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.032981 23029 catalog_manager.cc:5697] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } }
I20260709 13:22:58.040297 23353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6370231c76d43af900444679754d8e6" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
W20260709 13:22:58.038580 23249 leader_election.cc:343] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.041442 23406 consensus_queue.cc:260] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.064917 23206 raft_consensus.cc:2468] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:58.065747 23406 ts_tablet_manager.cc:1434] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:22:58.066965 23406 tablet_bootstrap.cc:492] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:58.038025 23786 raft_consensus.cc:493] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:58.042857 23176 leader_election.cc:343] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.051509 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9c34142ecf4df297b6eff325e4cbd6" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:58.070544 23786 raft_consensus.cc:515] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.052579 23405 tablet_bootstrap.cc:654] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.049835 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6370231c76d43af900444679754d8e6" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:58.054039 23746 consensus_queue.cc:1048] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.075153 23100 leader_election.cc:304] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:58.075539 23715 consensus_queue.cc:1048] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.056638 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514b8e2595b64695ae570184026e6b10" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:58.076531 23358 raft_consensus.cc:3060] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.078164 23724 raft_consensus.cc:2804] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.078917 23724 raft_consensus.cc:697] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:58.080080 23724 consensus_queue.cc:237] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.083777 23131 raft_consensus.cc:3060] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:58.084004 23250 leader_election.cc:343] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.084543 23250 leader_election.cc:304] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:58.085376 23766 raft_consensus.cc:2749] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.085887 23786 leader_election.cc:290] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:58.087034 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:58.088003 23280 raft_consensus.cc:2393] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28222c0dd7a1411692efad3387118115 in current term 1: Already voted for candidate 72629382bd4c46b09b2efeaf08c1460d in this term.
W20260709 13:22:58.089654 23249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 51097.1us
I20260709 13:22:58.059083 23407 tablet_bootstrap.cc:492] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:58.060721 23404 tablet_bootstrap.cc:492] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:58.073884 23132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:58.092083 23407 ts_tablet_manager.cc:1403] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.328s	user 0.031s	sys 0.048s
I20260709 13:22:58.092162 23404 ts_tablet_manager.cc:1403] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.026s
I20260709 13:22:58.095031 23404 raft_consensus.cc:359] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.095706 23404 raft_consensus.cc:385] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.095963 23404 raft_consensus.cc:740] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.096742 23404 consensus_queue.cc:260] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.099097 23404 ts_tablet_manager.cc:1434] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:22:58.100143 23404 tablet_bootstrap.cc:492] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:58.100878 23358 raft_consensus.cc:2468] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:58.092111 23131 raft_consensus.cc:2468] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:58.106917 23033 catalog_manager.cc:5697] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.114033 23407 raft_consensus.cc:359] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.114764 23407 raft_consensus.cc:385] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.115490 23404 tablet_bootstrap.cc:654] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.115199 23407 raft_consensus.cc:740] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.118398 23757 raft_consensus.cc:493] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.118927 23757 raft_consensus.cc:515] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.121022 23757 leader_election.cc:290] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:58.122097 23175 leader_election.cc:304] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:58.123041 23670 raft_consensus.cc:2804] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.123668 23670 raft_consensus.cc:697] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:58.123831 23405 tablet_bootstrap.cc:492] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:58.124439 23405 ts_tablet_manager.cc:1403] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.133s	user 0.009s	sys 0.003s
I20260709 13:22:58.124644 23670 consensus_queue.cc:237] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.126045 23406 tablet_bootstrap.cc:654] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.127470 23405 raft_consensus.cc:359] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.128193 23405 raft_consensus.cc:385] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.128463 23405 raft_consensus.cc:740] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.129140 23405 consensus_queue.cc:260] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.131385 23405 ts_tablet_manager.cc:1434] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:58.134312 23206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:58.135025 23206 raft_consensus.cc:2468] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:58.135526 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:58.137517 23101 leader_election.cc:343] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.137035 23407 consensus_queue.cc:260] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.140760 23100 leader_election.cc:304] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:58.141831 23724 raft_consensus.cc:2804] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.144644 23724 raft_consensus.cc:493] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.142860 23407 ts_tablet_manager.cc:1434] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:22:58.113451 23322 leader_election.cc:304] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:58.147689 23657 raft_consensus.cc:3060] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.145341 23724 raft_consensus.cc:3060] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.160627 23405 tablet_bootstrap.cc:492] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:58.161443 23407 tablet_bootstrap.cc:492] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:58.171131 23029 catalog_manager.cc:5697] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:58.162273 23322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 48986.1us
I20260709 13:22:58.175118 23250 leader_election.cc:304] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:58.179361 23657 raft_consensus.cc:2749] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.182655 23406 tablet_bootstrap.cc:492] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:58.183194 23406 ts_tablet_manager.cc:1403] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.016s
I20260709 13:22:58.186028 23406 raft_consensus.cc:359] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.186501 23766 raft_consensus.cc:2804] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.186753 23406 raft_consensus.cc:385] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.187187 23766 raft_consensus.cc:697] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:58.187147 23406 raft_consensus.cc:740] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.188416 23766 consensus_queue.cc:237] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.189416 23406 consensus_queue.cc:260] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.190359 23405 tablet_bootstrap.cc:654] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.191022 23404 tablet_bootstrap.cc:492] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:58.191563 23404 ts_tablet_manager.cc:1403] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.000s
I20260709 13:22:58.193003 23407 tablet_bootstrap.cc:654] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.193452 23406 ts_tablet_manager.cc:1434] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:58.194626 23406 tablet_bootstrap.cc:492] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:58.195078 23724 raft_consensus.cc:515] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.198669 23353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
W20260709 13:22:58.199364 23157 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7220 after lost signal to thread 13125
I20260709 13:22:58.199563 23724 leader_election.cc:290] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
W20260709 13:22:58.200709 23157 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7900 after lost signal to thread 23068
W20260709 13:22:58.202409 23157 debug-util.cc:398] Leaking SignalData structure 0x7b0800344da0 after lost signal to thread 23160
W20260709 13:22:58.204629 23157 debug-util.cc:398] Leaking SignalData structure 0x7b08000f74e0 after lost signal to thread 23235
I20260709 13:22:58.204423 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:58.205165 23210 raft_consensus.cc:3060] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:58.205866 23101 leader_election.cc:343] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:58.206453 23157 debug-util.cc:398] Leaking SignalData structure 0x7b08001af780 after lost signal to thread 23309
W20260709 13:22:58.208003 23157 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3aa0 after lost signal to thread 23383
I20260709 13:22:58.205164 23358 raft_consensus.cc:3060] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.215909 23406 tablet_bootstrap.cc:654] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.223480 23407 tablet_bootstrap.cc:492] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:58.223737 23404 raft_consensus.cc:359] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.224493 23404 raft_consensus.cc:385] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.224761 23404 raft_consensus.cc:740] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.225518 23404 consensus_queue.cc:260] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.173246 23029 catalog_manager.cc:5697] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:58.230480 23407 ts_tablet_manager.cc:1403] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.007s
I20260709 13:22:58.237393 23405 tablet_bootstrap.cc:492] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:58.238459 23405 ts_tablet_manager.cc:1403] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.000s
I20260709 13:22:58.233521 23407 raft_consensus.cc:359] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.240732 23407 raft_consensus.cc:385] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.241011 23407 raft_consensus.cc:740] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.243489 23405 raft_consensus.cc:359] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.244277 23405 raft_consensus.cc:385] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.244585 23405 raft_consensus.cc:740] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.245103 23210 raft_consensus.cc:2468] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:58.245455 23407 consensus_queue.cc:260] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.246464 23100 leader_election.cc:304] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:58.247637 23724 raft_consensus.cc:2804] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.248096 23724 raft_consensus.cc:697] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:58.248961 23724 consensus_queue.cc:237] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.249095 23405 consensus_queue.cc:260] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.251484 23405 ts_tablet_manager.cc:1434] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:22:58.252475 23405 tablet_bootstrap.cc:492] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:58.258473 23404 ts_tablet_manager.cc:1434] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:22:58.258800 23405 tablet_bootstrap.cc:654] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.259661 23404 tablet_bootstrap.cc:492] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:58.247977 23407 ts_tablet_manager.cc:1434] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:22:58.262116 23407 tablet_bootstrap.cc:492] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:58.268326 23407 tablet_bootstrap.cc:654] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.271755 23406 tablet_bootstrap.cc:492] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:58.272272 23406 ts_tablet_manager.cc:1403] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.019s
I20260709 13:22:58.274998 23406 raft_consensus.cc:359] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.278735 23033 catalog_manager.cc:5697] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.275730 23406 raft_consensus.cc:385] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.284699 23406 raft_consensus.cc:740] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.285480 23406 consensus_queue.cc:260] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.296322 23406 ts_tablet_manager.cc:1434] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:22:58.296149 23027 catalog_manager.cc:5697] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:58.297534 23406 tablet_bootstrap.cc:492] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:58.304589 23406 tablet_bootstrap.cc:654] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.319357 23405 tablet_bootstrap.cc:492] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:58.319846 23405 ts_tablet_manager.cc:1403] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.068s	user 0.029s	sys 0.021s
I20260709 13:22:58.322571 23405 raft_consensus.cc:359] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.323266 23405 raft_consensus.cc:385] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.323525 23405 raft_consensus.cc:740] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.330927 23405 consensus_queue.cc:260] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.331903 23406 tablet_bootstrap.cc:492] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:58.332480 23406 ts_tablet_manager.cc:1403] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.003s
I20260709 13:22:58.332578 23405 ts_tablet_manager.cc:1434] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:22:58.333657 23405 tablet_bootstrap.cc:492] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:58.334679 23034 catalog_manager.cc:5697] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.338447 23407 tablet_bootstrap.cc:492] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:58.338979 23407 ts_tablet_manager.cc:1403] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.002s
I20260709 13:22:58.339761 23405 tablet_bootstrap.cc:654] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.344874 23406 raft_consensus.cc:359] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.345584 23406 raft_consensus.cc:385] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.345893 23406 raft_consensus.cc:740] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.342396 23407 raft_consensus.cc:359] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.346822 23407 raft_consensus.cc:385] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.347105 23407 raft_consensus.cc:740] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.347947 23407 consensus_queue.cc:260] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.350167 23407 ts_tablet_manager.cc:1434] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:22:58.351127 23407 tablet_bootstrap.cc:492] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:58.351472 23406 consensus_queue.cc:260] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.353605 23405 tablet_bootstrap.cc:492] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:58.354172 23405 ts_tablet_manager.cc:1403] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:22:58.357589 23405 raft_consensus.cc:359] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.359982 23405 raft_consensus.cc:385] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.360320 23405 raft_consensus.cc:740] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.361106 23405 consensus_queue.cc:260] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.362836 23407 tablet_bootstrap.cc:654] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.363502 23405 ts_tablet_manager.cc:1434] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:22:58.368620 23406 ts_tablet_manager.cc:1434] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:22:58.369148 23407 tablet_bootstrap.cc:492] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:58.369693 23406 tablet_bootstrap.cc:492] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:58.369737 23407 ts_tablet_manager.cc:1403] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.001s
I20260709 13:22:58.373703 23404 tablet_bootstrap.cc:654] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.375815 23670 raft_consensus.cc:493] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.376245 23758 raft_consensus.cc:493] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.376353 23670 raft_consensus.cc:515] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.376874 23758 raft_consensus.cc:515] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.378883 23670 leader_election.cc:290] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:58.379197 23758 leader_election.cc:290] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:58.380030 23406 tablet_bootstrap.cc:654] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.380672 23132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a37225566b46a499f90759aadbf267" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:58.381013 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e74c84af241495bb52d0ecfd1cce7ff" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:58.382553 23176 leader_election.cc:343] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:58.383507 23175 leader_election.cc:343] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.384495 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e74c84af241495bb52d0ecfd1cce7ff" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:58.385372 23280 raft_consensus.cc:2468] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:58.388196 23174 leader_election.cc:304] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:58.403558 23746 raft_consensus.cc:2804] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.405066 23746 raft_consensus.cc:493] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.405411 23746 raft_consensus.cc:3060] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.407788 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a37225566b46a499f90759aadbf267" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:58.408465 23405 tablet_bootstrap.cc:492] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:58.415004 23746 raft_consensus.cc:515] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
W20260709 13:22:58.416723 23174 leader_election.cc:343] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.417233 23174 leader_election.cc:304] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:58.418090 23746 leader_election.cc:290] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:58.418550 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e74c84af241495bb52d0ecfd1cce7ff" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:58.418708 23746 raft_consensus.cc:2749] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:58.421916 23176 leader_election.cc:343] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.427048 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e74c84af241495bb52d0ecfd1cce7ff" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:58.427910 23280 raft_consensus.cc:3060] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.439287 23405 tablet_bootstrap.cc:654] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.439648 23407 raft_consensus.cc:359] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.440466 23777 raft_consensus.cc:493] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.440681 23407 raft_consensus.cc:385] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.441169 23407 raft_consensus.cc:740] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.441088 23777 raft_consensus.cc:515] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.442167 23407 consensus_queue.cc:260] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.443389 23777 leader_election.cc:290] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:58.444437 23407 ts_tablet_manager.cc:1434] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.001s
I20260709 13:22:58.445688 23132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:22:58.447321 23249 leader_election.cc:343] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.451289 23724 consensus_queue.cc:1048] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.458509 23406 tablet_bootstrap.cc:492] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:58.458604 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:58.459213 23406 ts_tablet_manager.cc:1403] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.015s
I20260709 13:22:58.459478 23210 raft_consensus.cc:2468] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:58.462596 23406 raft_consensus.cc:359] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.463553 23406 raft_consensus.cc:385] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.463974 23406 raft_consensus.cc:740] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.464825 23406 consensus_queue.cc:260] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.467326 23406 ts_tablet_manager.cc:1434] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:22:58.467696 23249 leader_election.cc:304] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:58.473999 23766 raft_consensus.cc:493] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.448158 23280 raft_consensus.cc:2468] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:22:58.476305 23766 raft_consensus.cc:515] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.477056 23407 tablet_bootstrap.cc:492] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:58.477242 23772 raft_consensus.cc:2804] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.477756 23772 raft_consensus.cc:493] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.478149 23772 raft_consensus.cc:3060] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.480269 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4689f05e6159426c8b5073075c502f3c" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:58.482043 23250 leader_election.cc:343] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.483587 23724 raft_consensus.cc:493] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.484282 23724 raft_consensus.cc:515] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.488199 23772 raft_consensus.cc:515] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.475526 23404 tablet_bootstrap.cc:492] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:58.489333 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4689f05e6159426c8b5073075c502f3c" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:58.504783 23404 ts_tablet_manager.cc:1403] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.245s	user 0.012s	sys 0.022s
I20260709 13:22:58.505309 23746 raft_consensus.cc:493] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.505860 23746 raft_consensus.cc:515] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.494890 23406 tablet_bootstrap.cc:492] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:58.489624 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514b8e2595b64695ae570184026e6b10" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:58.509568 23358 raft_consensus.cc:2393] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72629382bd4c46b09b2efeaf08c1460d in current term 1: Already voted for candidate b1f5ee52ad2f442bac6959931126746d in this term.
I20260709 13:22:58.497089 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "514b8e2595b64695ae570184026e6b10" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:58.503741 23174 leader_election.cc:304] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:58.499534 23763 consensus_queue.cc:1048] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:22:58.504808 23210 raft_consensus.cc:2468] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:58.499375 23766 leader_election.cc:290] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:58.507894 23746 leader_election.cc:290] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:58.500398 23657 raft_consensus.cc:493] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.513348 23657 raft_consensus.cc:515] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.488574 23724 leader_election.cc:290] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:58.515791 23657 leader_election.cc:290] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:58.518047 23746 raft_consensus.cc:2804] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.518394 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6370231c76d43af900444679754d8e6" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:58.518663 23746 raft_consensus.cc:697] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:22:58.519503 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cabb464d6148dab5eba6d8ba9d13e5" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:58.519868 23746 consensus_queue.cc:237] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.524474 23132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6370231c76d43af900444679754d8e6" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:58.526821 23757 consensus_queue.cc:1048] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.533246 23249 leader_election.cc:304] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
W20260709 13:22:58.533813 23175 leader_election.cc:343] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.534461 23643 raft_consensus.cc:2804] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.534946 23643 raft_consensus.cc:493] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.535300 23643 raft_consensus.cc:3060] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.536732 23101 leader_election.cc:304] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:58.539192 23724 raft_consensus.cc:493] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.539646 23724 raft_consensus.cc:515] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.541062 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cabb464d6148dab5eba6d8ba9d13e5" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:58.542260 23772 leader_election.cc:290] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:58.542428 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9c34142ecf4df297b6eff325e4cbd6" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:58.542685 23763 raft_consensus.cc:493] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.546178 23206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:58.543649 23132 raft_consensus.cc:2393] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28222c0dd7a1411692efad3387118115 in current term 1: Already voted for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in this term.
I20260709 13:22:58.491760 23407 tablet_bootstrap.cc:654] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.555420 23323 leader_election.cc:304] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
W20260709 13:22:58.553750 23082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:58.543923 23724 leader_election.cc:290] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:58.550287 23283 raft_consensus.cc:2468] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:58.563026 23404 raft_consensus.cc:359] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.570399 23404 raft_consensus.cc:385] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:58.553197 23174 leader_election.cc:343] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.572491 23174 leader_election.cc:304] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:58.545598 23757 raft_consensus.cc:3060] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.563226 23206 raft_consensus.cc:3060] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.574450 23715 raft_consensus.cc:2749] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.576018 23099 leader_election.cc:304] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:58.563527 23657 raft_consensus.cc:3060] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.570670 23404 raft_consensus.cc:740] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.587229 23404 consensus_queue.cc:260] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.606180 23404 ts_tablet_manager.cc:1434] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.001s
I20260709 13:22:58.550696 23763 raft_consensus.cc:515] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
W20260709 13:22:58.617770 23101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 61126.2us
I20260709 13:22:58.626781 23724 raft_consensus.cc:2804] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.638475 23132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:58.649312 23724 raft_consensus.cc:493] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.658494 23353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9c34142ecf4df297b6eff325e4cbd6" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:58.697438 23643 raft_consensus.cc:515] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.672173 23724 raft_consensus.cc:3060] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:58.699525 23101 consensus_peers.cc:597] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:58.667898 23100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:34617, user_credentials={real_user=slave}} blocked reactor thread for 62692.4us
I20260709 13:22:58.706617 23643 leader_election.cc:290] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:58.709678 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4689f05e6159426c8b5073075c502f3c" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:58.710649 23210 raft_consensus.cc:3060] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.716388 23763 leader_election.cc:290] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
W20260709 13:22:58.718425 23101 leader_election.cc:343] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.724875 23134 raft_consensus.cc:3060] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.731254 23404 tablet_bootstrap.cc:492] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:58.732810 23406 tablet_bootstrap.cc:654] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:58.738634 23249 leader_election.cc:343] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.737105 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4689f05e6159426c8b5073075c502f3c" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:58.736732 23206 raft_consensus.cc:2468] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:58.751899 23033 catalog_manager.cc:5697] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.752683 23643 raft_consensus.cc:493] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.754982 23643 raft_consensus.cc:515] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.755952 23405 tablet_bootstrap.cc:492] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:58.756474 23405 ts_tablet_manager.cc:1403] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.352s	user 0.039s	sys 0.050s
I20260709 13:22:58.757021 23643 leader_election.cc:290] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:58.758700 23407 tablet_bootstrap.cc:492] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:58.759349 23407 ts_tablet_manager.cc:1403] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.283s	user 0.011s	sys 0.035s
I20260709 13:22:58.770663 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e44018374b34e9ab7172698203fddd0" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:58.771126 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e44018374b34e9ab7172698203fddd0" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
W20260709 13:22:58.786734 23250 leader_election.cc:343] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.788530 23777 consensus_queue.cc:1048] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.792274 23099 leader_election.cc:304] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:58.800698 23249 leader_election.cc:304] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:58.804647 23407 raft_consensus.cc:359] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.807207 23407 raft_consensus.cc:385] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.807723 23407 raft_consensus.cc:740] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.810384 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4535c921be9a4e5686183c491ff5f6ca" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:58.817114 23208 raft_consensus.cc:2468] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:58.818096 23819 raft_consensus.cc:493] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.818542 23825 consensus_queue.cc:1048] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.818626 23819 raft_consensus.cc:515] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.820919 23819 leader_election.cc:290] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:58.824733 23757 raft_consensus.cc:2749] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.813117 23407 consensus_queue.cc:260] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.812317 23405 raft_consensus.cc:359] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.830778 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987cdec3ef244fddafb031e68024c1dc" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:58.831627 23209 raft_consensus.cc:2468] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:22:58.807250 23777 raft_consensus.cc:2804] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.830089 23405 raft_consensus.cc:385] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.838227 23249 leader_election.cc:304] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:58.841219 23643 raft_consensus.cc:2804] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.841761 23643 raft_consensus.cc:493] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.842182 23643 raft_consensus.cc:3060] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.834160 23405 raft_consensus.cc:740] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.847517 23405 consensus_queue.cc:260] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:58.856390 23404 tablet_bootstrap.cc:654] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.860771 23831 raft_consensus.cc:493] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.815296 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4535c921be9a4e5686183c491ff5f6ca" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:58.861356 23831 raft_consensus.cc:515] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:58.867919 23407 ts_tablet_manager.cc:1434] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.108s	user 0.011s	sys 0.000s
I20260709 13:22:58.876127 23407 tablet_bootstrap.cc:492] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:58.870580 23100 leader_election.cc:304] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:58.892880 23405 ts_tablet_manager.cc:1434] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.136s	user 0.010s	sys 0.001s
I20260709 13:22:58.899156 23657 raft_consensus.cc:2749] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.900678 23831 leader_election.cc:290] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
W20260709 13:22:58.903266 23250 leader_election.cc:343] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.906391 23826 raft_consensus.cc:493] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.909989 23210 raft_consensus.cc:2468] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:58.910698 23406 tablet_bootstrap.cc:492] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:58.911203 23406 ts_tablet_manager.cc:1403] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.417s	user 0.023s	sys 0.019s
W20260709 13:22:58.920789 23249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 56745.7us
I20260709 13:22:58.925150 23777 raft_consensus.cc:697] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:58.926448 23777 consensus_queue.cc:237] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:58.900693 23763 raft_consensus.cc:2804] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.930179 23763 raft_consensus.cc:493] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.930712 23763 raft_consensus.cc:3060] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.935349 23746 consensus_queue.cc:1048] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.941478 23406 raft_consensus.cc:359] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.942318 23406 raft_consensus.cc:385] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.942587 23406 raft_consensus.cc:740] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.947213 23405 tablet_bootstrap.cc:492] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:58.947528 23406 consensus_queue.cc:260] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.951035 23407 tablet_bootstrap.cc:654] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.962524 23815 raft_consensus.cc:2749] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.969854 23352 raft_consensus.cc:3060] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.972584 23249 leader_election.cc:304] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:58.974476 23772 raft_consensus.cc:2804] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.974994 23772 raft_consensus.cc:697] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:58.975858 23772 consensus_queue.cc:237] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:58.981345 23132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:58.984211 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987cdec3ef244fddafb031e68024c1dc" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:58.910310 23826 raft_consensus.cc:515] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:59.001921 23766 consensus_queue.cc:1048] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.003391 23826 leader_election.cc:290] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:58.965585 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:59.005254 23134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3cdd94174b018ebe04f44a1cc4fb" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:59.006002 23134 raft_consensus.cc:2468] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:59.006186 23353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3cdd94174b018ebe04f44a1cc4fb" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:59.012182 23250 leader_election.cc:343] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.015434 23323 leader_election.cc:304] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:59.016718 23830 raft_consensus.cc:2749] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.019354 23724 raft_consensus.cc:515] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:59.021320 23404 tablet_bootstrap.cc:492] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:59.021961 23724 leader_election.cc:290] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:59.022099 23404 ts_tablet_manager.cc:1403] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.319s	user 0.019s	sys 0.000s
I20260709 13:22:59.031144 23249 leader_election.cc:304] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:59.050419 23406 ts_tablet_manager.cc:1434] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.139s	user 0.009s	sys 0.000s
I20260709 13:22:59.054813 23643 raft_consensus.cc:515] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:59.057076 23643 leader_election.cc:290] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
W20260709 13:22:59.039531 23175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 106335us
I20260709 13:22:59.059347 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4535c921be9a4e5686183c491ff5f6ca" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:59.062229 23404 raft_consensus.cc:359] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
W20260709 13:22:59.062919 23250 leader_election.cc:343] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.066721 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9c34142ecf4df297b6eff325e4cbd6" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:22:59.067404 23285 raft_consensus.cc:3060] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.051880 23406 tablet_bootstrap.cc:492] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
I20260709 13:22:59.063001 23404 raft_consensus.cc:385] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.074918 23404 raft_consensus.cc:740] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.077744 23404 consensus_queue.cc:260] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:59.087579 23404 ts_tablet_manager.cc:1434] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:22:59.049584 23763 raft_consensus.cc:515] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.097155 23405 tablet_bootstrap.cc:654] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.098348 23819 consensus_queue.cc:1048] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.124007 23404 tablet_bootstrap.cc:492] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:59.108206 23821 raft_consensus.cc:2804] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.126814 23763 leader_election.cc:290] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
W20260709 13:22:59.131006 23101 leader_election.cc:343] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.132510 23832 consensus_queue.cc:1048] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.135591 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9c34142ecf4df297b6eff325e4cbd6" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:59.146549 23821 raft_consensus.cc:493] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.152848 23821 raft_consensus.cc:3060] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.151531 23357 raft_consensus.cc:3060] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:59.138607 23176 consensus_peers.cc:597] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:59.140628 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987cdec3ef244fddafb031e68024c1dc" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:59.158406 23209 raft_consensus.cc:3060] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.170953 23209 raft_consensus.cc:2468] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:59.201241 23100 leader_election.cc:304] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:59.202456 23763 raft_consensus.cc:2804] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.203212 23763 raft_consensus.cc:697] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:59.218942 23352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987cdec3ef244fddafb031e68024c1dc" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:22:59.219799 23357 raft_consensus.cc:2468] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:59.223466 23406 tablet_bootstrap.cc:654] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.256420 23746 raft_consensus.cc:493] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:59.258174 23249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:34617, user_credentials={real_user=slave}} blocked reactor thread for 214376us
I20260709 13:22:59.257308 23746 raft_consensus.cc:515] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:59.266542 23715 consensus_queue.cc:1048] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:22:59.274849 23746 leader_election.cc:290] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:22:59.264119 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4535c921be9a4e5686183c491ff5f6ca" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:22:59.275842 23209 raft_consensus.cc:3060] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.291536 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a4328b7c8048a58b8f49269156e606" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
W20260709 13:22:59.293517 23174 leader_election.cc:343] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:59.305264 23175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 73406.1us
I20260709 13:22:59.204571 23763 consensus_queue.cc:237] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.257673 23404 tablet_bootstrap.cc:654] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.318517 23209 raft_consensus.cc:2468] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:59.320036 23249 leader_election.cc:304] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:59.307379 23285 raft_consensus.cc:2468] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:22:59.362700 23407 tablet_bootstrap.cc:492] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:59.363281 23407 ts_tablet_manager.cc:1403] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.487s	user 0.064s	sys 0.083s
I20260709 13:22:59.350255 23777 raft_consensus.cc:2804] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.375782 23407 raft_consensus.cc:359] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:59.380766 23407 raft_consensus.cc:385] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.381194 23407 raft_consensus.cc:740] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
W20260709 13:22:59.387293 23101 leader_election.cc:343] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.388554 23101 leader_election.cc:304] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:59.394479 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a4328b7c8048a58b8f49269156e606" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:59.395083 23404 tablet_bootstrap.cc:492] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:59.395747 23404 ts_tablet_manager.cc:1403] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.272s	user 0.019s	sys 0.011s
I20260709 13:22:59.398450 23760 raft_consensus.cc:2804] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.399554 23760 raft_consensus.cc:697] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:22:59.399825 23405 tablet_bootstrap.cc:492] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:59.400359 23405 ts_tablet_manager.cc:1403] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.478s	user 0.014s	sys 0.016s
I20260709 13:22:59.400399 23760 consensus_queue.cc:237] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:59.401504 23406 tablet_bootstrap.cc:492] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:59.402036 23406 ts_tablet_manager.cc:1403] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.351s	user 0.014s	sys 0.004s
I20260709 13:22:59.382067 23407 consensus_queue.cc:260] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:59.376875 23777 raft_consensus.cc:697] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:22:59.413357 23404 raft_consensus.cc:359] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.414075 23404 raft_consensus.cc:385] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.414382 23404 raft_consensus.cc:740] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.420871 23404 consensus_queue.cc:260] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.436604 23407 ts_tablet_manager.cc:1434] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.003s
I20260709 13:22:59.441695 23404 ts_tablet_manager.cc:1434] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:22:59.446215 23407 tablet_bootstrap.cc:492] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:59.454257 23405 raft_consensus.cc:359] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:59.454819 23405 raft_consensus.cc:385] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.454988 23405 raft_consensus.cc:740] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.456221 23404 tablet_bootstrap.cc:492] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:59.455436 23405 consensus_queue.cc:260] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
W20260709 13:22:59.463413 23176 leader_election.cc:343] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.464003 23176 leader_election.cc:304] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:59.465632 23670 raft_consensus.cc:2749] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.469646 23405 ts_tablet_manager.cc:1434] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.002s
I20260709 13:22:59.442595 23821 raft_consensus.cc:515] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:59.486699 23404 tablet_bootstrap.cc:654] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.489665 23821 leader_election.cc:290] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:59.452234 23777 consensus_queue.cc:237] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:59.512856 23033 catalog_manager.cc:5697] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:59.519323 23033 catalog_manager.cc:5697] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.529618 23405 tablet_bootstrap.cc:492] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:59.531706 23406 raft_consensus.cc:359] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.532655 23406 raft_consensus.cc:385] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.532979 23406 raft_consensus.cc:740] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.537454 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3cdd94174b018ebe04f44a1cc4fb" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:59.538321 23136 raft_consensus.cc:3060] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.528797 23836 consensus_queue.cc:1048] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:22:59.548873 23406 consensus_queue.cc:260] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.557140 23406 ts_tablet_manager.cc:1434] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.155s	user 0.007s	sys 0.001s
I20260709 13:22:59.570514 23355 raft_consensus.cc:3060] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.551666 23836 consensus_queue.cc:1048] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:22:59.584004 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3cdd94174b018ebe04f44a1cc4fb" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
W20260709 13:22:59.588938 23250 consensus_peers.cc:597] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:59.589622 23250 leader_election.cc:343] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.600792 23407 tablet_bootstrap.cc:654] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.618165 23406 tablet_bootstrap.cc:492] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0: Bootstrap starting.
W20260709 13:22:59.624037 23082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:59.690827 23405 tablet_bootstrap.cc:654] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.693142 23136 raft_consensus.cc:2468] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:22:59.696144 23249 leader_election.cc:304] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:22:59.697372 23837 raft_consensus.cc:2804] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.698010 23837 raft_consensus.cc:697] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
W20260709 13:22:59.698760 23174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 78258.4us
I20260709 13:22:59.698885 23837 consensus_queue.cc:237] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:59.700553 23404 tablet_bootstrap.cc:492] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:59.701089 23404 ts_tablet_manager.cc:1403] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.250s	user 0.010s	sys 0.034s
W20260709 13:22:59.703488 23176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 72270.3us
I20260709 13:22:59.704356 23404 raft_consensus.cc:359] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:59.705094 23404 raft_consensus.cc:385] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.705354 23404 raft_consensus.cc:740] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.706077 23404 consensus_queue.cc:260] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:59.708214 23404 ts_tablet_manager.cc:1434] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:59.709259 23404 tablet_bootstrap.cc:492] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
W20260709 13:22:59.715013 23249 consensus_peers.cc:597] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:59.718240 23406 tablet_bootstrap.cc:654] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.730849 23407 tablet_bootstrap.cc:492] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:59.731407 23407 ts_tablet_manager.cc:1403] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.285s	user 0.010s	sys 0.009s
I20260709 13:22:59.735853 23407 raft_consensus.cc:359] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:59.742063 23407 raft_consensus.cc:385] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.742378 23407 raft_consensus.cc:740] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.752806 23407 consensus_queue.cc:260] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:59.761965 23407 ts_tablet_manager.cc:1434] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:22:59.763526 23404 tablet_bootstrap.cc:654] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.763784 23407 tablet_bootstrap.cc:492] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:22:59.772910 23405 tablet_bootstrap.cc:492] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:59.773502 23405 ts_tablet_manager.cc:1403] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.295s	user 0.020s	sys 0.007s
I20260709 13:22:59.776638 23405 raft_consensus.cc:359] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.777398 23405 raft_consensus.cc:385] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.777667 23405 raft_consensus.cc:740] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.778303 23405 consensus_queue.cc:260] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.780550 23405 ts_tablet_manager.cc:1434] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:59.781667 23405 tablet_bootstrap.cc:492] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:59.787660 23405 tablet_bootstrap.cc:654] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.789291 23836 raft_consensus.cc:493] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.789929 23836 raft_consensus.cc:515] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:59.798943 23836 leader_election.cc:290] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:22:59.806371 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cabb464d6148dab5eba6d8ba9d13e5" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:59.807303 23210 raft_consensus.cc:2468] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:59.808809 23404 tablet_bootstrap.cc:492] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:22:59.809384 23404 ts_tablet_manager.cc:1403] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.001s
I20260709 13:22:59.810612 23831 raft_consensus.cc:493] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.811156 23831 raft_consensus.cc:515] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:59.813438 23831 leader_election.cc:290] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:22:59.815188 23132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cabb464d6148dab5eba6d8ba9d13e5" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:59.815955 23132 raft_consensus.cc:2468] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:22:59.816497 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4535c921be9a4e5686183c491ff5f6ca" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:22:59.821583 23407 tablet_bootstrap.cc:654] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.833706 23832 raft_consensus.cc:493] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.834414 23832 raft_consensus.cc:515] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.835958 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4535c921be9a4e5686183c491ff5f6ca" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:22:59.836581 23832 leader_election.cc:290] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:59.836848 23209 raft_consensus.cc:2393] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28222c0dd7a1411692efad3387118115 in current term 1: Already voted for candidate b1f5ee52ad2f442bac6959931126746d in this term.
I20260709 13:22:59.839196 23323 leader_election.cc:304] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:22:59.826313 23249 leader_election.cc:304] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:22:59.840106 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01caec9d94514a02b3e251a1ea509" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:59.841089 23831 raft_consensus.cc:3060] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.841566 23131 raft_consensus.cc:2468] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:22:59.842562 23777 raft_consensus.cc:2804] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.842971 23777 raft_consensus.cc:493] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.843448 23777 raft_consensus.cc:3060] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.840307 23836 raft_consensus.cc:493] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.848688 23836 raft_consensus.cc:515] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:22:59.851580 23724 consensus_queue.cc:1048] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.851852 23352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f3d3eace634645af1d9239ca7bd856" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:22:59.854141 23250 leader_election.cc:343] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.855218 23175 leader_election.cc:304] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:22:59.860713 23404 raft_consensus.cc:359] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:59.861460 23404 raft_consensus.cc:385] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.861701 23404 raft_consensus.cc:740] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.851649 23034 catalog_manager.cc:5697] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.878750 23404 consensus_queue.cc:260] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:59.855520 23831 raft_consensus.cc:2749] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.885001 23034 catalog_manager.cc:5697] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:59.872018 23836 leader_election.cc:290] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:59.884037 23832 raft_consensus.cc:2804] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.894451 23352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01caec9d94514a02b3e251a1ea509" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:22:59.902680 23404 ts_tablet_manager.cc:1434] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 13:22:59.904474 23837 consensus_queue.cc:1048] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.891100 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f3d3eace634645af1d9239ca7bd856" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:22:59.916062 23406 tablet_bootstrap.cc:492] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0: No bootstrap required, opened a new log
I20260709 13:22:59.916602 23406 ts_tablet_manager.cc:1403] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent bootstrapping tablet: real 0.353s	user 0.014s	sys 0.042s
W20260709 13:22:59.918298 23249 leader_election.cc:343] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.918792 23249 leader_election.cc:304] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:22:59.922401 23404 tablet_bootstrap.cc:492] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:22:59.906561 23832 raft_consensus.cc:493] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.926343 23405 tablet_bootstrap.cc:492] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:22:59.926892 23405 ts_tablet_manager.cc:1403] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.145s	user 0.027s	sys 0.018s
I20260709 13:22:59.929282 23405 raft_consensus.cc:359] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:59.930505 23405 raft_consensus.cc:385] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.930787 23405 raft_consensus.cc:740] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.931790 23405 consensus_queue.cc:260] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:22:59.920913 23836 raft_consensus.cc:2749] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.930104 23832 raft_consensus.cc:3060] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:59.937992 23176 leader_election.cc:343] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:59.941711 23101 consensus_peers.cc:597] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d -> Peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Couldn't send request to peer 28222c0dd7a1411692efad3387118115. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:59.945001 23724 consensus_queue.cc:1048] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.950541 23405 ts_tablet_manager.cc:1434] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:22:59.951615 23406 raft_consensus.cc:359] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.953564 23406 raft_consensus.cc:385] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.958256 23825 consensus_queue.cc:1048] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.959973 23832 raft_consensus.cc:515] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.954563 23405 tablet_bootstrap.cc:492] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:22:59.953866 23406 raft_consensus.cc:740] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.967034 23406 consensus_queue.cc:260] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:22:59.976547 23407 tablet_bootstrap.cc:492] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:22:59.977188 23407 ts_tablet_manager.cc:1403] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.214s	user 0.023s	sys 0.008s
I20260709 13:22:59.991595 23832 leader_election.cc:290] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:22:59.994748 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01caec9d94514a02b3e251a1ea509" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:22:59.995438 23136 raft_consensus.cc:3060] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.996644 23404 tablet_bootstrap.cc:654] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.986125 23407 raft_consensus.cc:359] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:22:59.998512 23407 raft_consensus.cc:385] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.998198 23405 tablet_bootstrap.cc:654] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.998788 23407 raft_consensus.cc:740] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.991875 23777 raft_consensus.cc:515] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:00.002018 23825 raft_consensus.cc:493] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.002575 23825 raft_consensus.cc:515] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:00.004756 23825 leader_election.cc:290] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:00.006835 23407 consensus_queue.cc:260] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:00.007736 23406 ts_tablet_manager.cc:1434] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.002s
I20260709 13:23:00.013859 23837 consensus_queue.cc:1048] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:23:00.016101 23777 leader_election.cc:290] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:00.016781 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:00.018452 23206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cabb464d6148dab5eba6d8ba9d13e5" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:00.020421 23407 ts_tablet_manager.cc:1434] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 13:23:00.018664 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:00.023517 23206 raft_consensus.cc:3060] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.027640 23100 leader_election.cc:304] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:23:00.029392 23760 raft_consensus.cc:2749] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.030025 23131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cabb464d6148dab5eba6d8ba9d13e5" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:23:00.030768 23131 raft_consensus.cc:3060] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.032855 23136 raft_consensus.cc:2468] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:23:00.030078 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01caec9d94514a02b3e251a1ea509" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:00.034432 23175 leader_election.cc:304] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:00.034569 23206 raft_consensus.cc:2468] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:23:00.035682 23832 raft_consensus.cc:2804] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.036229 23832 raft_consensus.cc:697] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:00.037076 23249 leader_election.cc:304] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:00.037082 23832 consensus_queue.cc:237] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.037978 23837 raft_consensus.cc:2804] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.038473 23837 raft_consensus.cc:697] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:00.039266 23837 consensus_queue.cc:237] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:00.042238 23407 tablet_bootstrap.cc:492] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:23:00.045423 23131 raft_consensus.cc:2468] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
W20260709 13:23:00.046765 23176 leader_election.cc:343] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.054680 23407 tablet_bootstrap.cc:654] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.079736 23404 tablet_bootstrap.cc:492] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:23:00.081413 23404 ts_tablet_manager.cc:1403] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.160s	user 0.016s	sys 0.004s
I20260709 13:23:00.110476 23407 tablet_bootstrap.cc:492] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:23:00.111037 23407 ts_tablet_manager.cc:1403] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.012s
I20260709 13:23:00.117594 23407 raft_consensus.cc:359] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:00.118572 23657 raft_consensus.cc:493] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.119118 23657 raft_consensus.cc:515] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:00.121233 23657 leader_election.cc:290] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:00.125571 23206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e74c84af241495bb52d0ecfd1cce7ff" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:00.127801 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e74c84af241495bb52d0ecfd1cce7ff" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:00.129710 23322 leader_election.cc:304] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:23:00.132040 23657 raft_consensus.cc:2749] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.118363 23407 raft_consensus.cc:385] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.133275 23407 raft_consensus.cc:740] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.134052 23407 consensus_queue.cc:260] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:00.136323 23407 ts_tablet_manager.cc:1434] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:23:00.149852 23405 tablet_bootstrap.cc:492] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:23:00.150553 23405 ts_tablet_manager.cc:1403] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.196s	user 0.014s	sys 0.028s
I20260709 13:23:00.151808 23034 catalog_manager.cc:5697] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.153631 23407 tablet_bootstrap.cc:492] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d: Bootstrap starting.
I20260709 13:23:00.160252 23860 raft_consensus.cc:493] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.160847 23860 raft_consensus.cc:515] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:00.163111 23860 leader_election.cc:290] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:00.162979 23404 raft_consensus.cc:359] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.163734 23404 raft_consensus.cc:385] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.164038 23404 raft_consensus.cc:740] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.164882 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a37225566b46a499f90759aadbf267" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:23:00.165459 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a37225566b46a499f90759aadbf267" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:00.166131 23280 raft_consensus.cc:2468] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 0.
I20260709 13:23:00.165812 23404 consensus_queue.cc:260] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.167752 23174 leader_election.cc:304] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:00.167387 23034 catalog_manager.cc:5697] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.168809 23404 ts_tablet_manager.cc:1434] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.000s
I20260709 13:23:00.169636 23860 raft_consensus.cc:2804] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.170138 23404 tablet_bootstrap.cc:492] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:23:00.170073 23860 raft_consensus.cc:493] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.170644 23860 raft_consensus.cc:3060] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.185305 23404 tablet_bootstrap.cc:654] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:00.190835 23175 leader_election.cc:343] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.194972 23860 raft_consensus.cc:515] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:00.197220 23860 leader_election.cc:290] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:00.198566 23407 tablet_bootstrap.cc:654] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.211619 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a37225566b46a499f90759aadbf267" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:00.212045 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a37225566b46a499f90759aadbf267" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:23:00.212287 23280 raft_consensus.cc:3060] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:00.213565 23175 leader_election.cc:343] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.223608 23405 raft_consensus.cc:359] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:00.224491 23405 raft_consensus.cc:385] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.224781 23405 raft_consensus.cc:740] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.225509 23027 catalog_manager.cc:5697] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:00.228432 23405 consensus_queue.cc:260] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:00.230412 23136 raft_consensus.cc:3060] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.243142 23280 raft_consensus.cc:2468] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:23:00.245751 23174 leader_election.cc:304] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:00.250031 23860 raft_consensus.cc:2804] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.250165 23405 ts_tablet_manager.cc:1434] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.003s
I20260709 13:23:00.250620 23860 raft_consensus.cc:697] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:00.251293 23405 tablet_bootstrap.cc:492] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:00.251544 23860 consensus_queue.cc:237] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:00.252918 23404 tablet_bootstrap.cc:492] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:23:00.254081 23404 ts_tablet_manager.cc:1403] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.084s	user 0.023s	sys 0.006s
I20260709 13:23:00.257913 23355 raft_consensus.cc:3060] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.258574 23405 tablet_bootstrap.cc:654] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.257620 23404 raft_consensus.cc:359] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.262077 23404 raft_consensus.cc:385] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.262406 23404 raft_consensus.cc:740] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.262791 23034 catalog_manager.cc:5697] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:00.264158 23404 consensus_queue.cc:260] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.266712 23404 ts_tablet_manager.cc:1434] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:23:00.267871 23404 tablet_bootstrap.cc:492] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:23:00.294872 23836 consensus_queue.cc:1048] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:00.300508 23358 raft_consensus.cc:3060] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.315994 23033 catalog_manager.cc:5697] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.323441 23404 tablet_bootstrap.cc:654] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.344458 23404 tablet_bootstrap.cc:492] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:23:00.344987 23404 ts_tablet_manager.cc:1403] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.005s
I20260709 13:23:00.347388 23404 raft_consensus.cc:359] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.348079 23404 raft_consensus.cc:385] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.348379 23404 raft_consensus.cc:740] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.348981 23404 consensus_queue.cc:260] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.353128 23407 tablet_bootstrap.cc:492] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d: No bootstrap required, opened a new log
I20260709 13:23:00.353300 23404 ts_tablet_manager.cc:1434] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:23:00.353693 23407 ts_tablet_manager.cc:1403] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d: Time spent bootstrapping tablet: real 0.200s	user 0.018s	sys 0.004s
I20260709 13:23:00.354344 23404 tablet_bootstrap.cc:492] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:23:00.356509 23407 raft_consensus.cc:359] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.357107 23407 raft_consensus.cc:385] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.357355 23407 raft_consensus.cc:740] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.358182 23758 raft_consensus.cc:493] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.358075 23407 consensus_queue.cc:260] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.340734 23836 consensus_queue.cc:1048] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:23:00.358876 23758 raft_consensus.cc:515] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.370163 23407 ts_tablet_manager.cc:1434] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:23:00.375195 23766 raft_consensus.cc:493] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.375833 23766 raft_consensus.cc:515] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:00.379132 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a4328b7c8048a58b8f49269156e606" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:00.379866 23209 raft_consensus.cc:2468] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 0.
I20260709 13:23:00.392618 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:23:00.394083 23352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:23:00.395531 23175 leader_election.cc:343] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.391325 23404 tablet_bootstrap.cc:654] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:00.397202 23176 leader_election.cc:343] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.391516 23758 leader_election.cc:290] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:00.397707 23176 leader_election.cc:304] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:00.400287 23405 tablet_bootstrap.cc:492] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:23:00.404206 23405 ts_tablet_manager.cc:1403] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.153s	user 0.011s	sys 0.014s
I20260709 13:23:00.400517 23832 raft_consensus.cc:2749] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.428253 23766 leader_election.cc:290] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:23:00.429373 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a4328b7c8048a58b8f49269156e606" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:00.429627 23249 leader_election.cc:304] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
W20260709 13:23:00.431105 23250 leader_election.cc:343] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.431509 23766 raft_consensus.cc:2804] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.431991 23766 raft_consensus.cc:493] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.432370 23355 raft_consensus.cc:3060] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.436249 23405 raft_consensus.cc:359] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.436992 23405 raft_consensus.cc:385] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.437260 23405 raft_consensus.cc:740] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.432350 23766 raft_consensus.cc:3060] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.439457 23836 raft_consensus.cc:493] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.442195 23836 raft_consensus.cc:515] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.444427 23836 leader_election.cc:290] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:00.447314 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537c251284f4165af8ff6b08343c427" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
W20260709 13:23:00.448779 23250 leader_election.cc:343] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.438681 23405 consensus_queue.cc:260] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.449637 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537c251284f4165af8ff6b08343c427" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:23:00.451679 23405 ts_tablet_manager.cc:1434] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.001s
W20260709 13:23:00.452658 23249 leader_election.cc:343] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.453603 23249 leader_election.cc:304] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:00.454471 23840 raft_consensus.cc:2749] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.456882 23404 tablet_bootstrap.cc:492] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:23:00.457513 23404 ts_tablet_manager.cc:1403] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.013s
I20260709 13:23:00.460983 23404 raft_consensus.cc:359] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.462206 23404 raft_consensus.cc:385] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.462553 23404 raft_consensus.cc:740] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.463384 23404 consensus_queue.cc:260] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.466735 23405 tablet_bootstrap.cc:492] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:00.474895 23831 raft_consensus.cc:493] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.475510 23831 raft_consensus.cc:515] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.485111 23831 leader_election.cc:290] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:00.489650 23766 raft_consensus.cc:515] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:00.519182 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a4328b7c8048a58b8f49269156e606" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:00.492687 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01caec9d94514a02b3e251a1ea509" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:00.491786 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01caec9d94514a02b3e251a1ea509" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
W20260709 13:23:00.521442 23250 leader_election.cc:343] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.496469 23758 consensus_queue.cc:1048] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:23:00.523782 23206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a4328b7c8048a58b8f49269156e606" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:00.524487 23206 raft_consensus.cc:3060] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.527592 23133 raft_consensus.cc:2468] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:23:00.499023 23404 ts_tablet_manager.cc:1434] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:23:00.534439 23404 tablet_bootstrap.cc:492] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:23:00.539307 23206 raft_consensus.cc:2468] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:23:00.546403 23323 leader_election.cc:304] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:00.547961 23825 raft_consensus.cc:493] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.548631 23825 raft_consensus.cc:515] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:00.551643 23825 leader_election.cc:290] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:00.558136 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a37225566b46a499f90759aadbf267" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:00.559094 23284 raft_consensus.cc:2393] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72629382bd4c46b09b2efeaf08c1460d in current term 1: Already voted for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in this term.
I20260709 13:23:00.560333 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a37225566b46a499f90759aadbf267" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:00.561149 23405 tablet_bootstrap.cc:654] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.566330 23404 tablet_bootstrap.cc:654] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.566784 23766 leader_election.cc:290] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:23:00.578649 23100 leader_election.cc:304] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:23:00.582219 23404 tablet_bootstrap.cc:492] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:23:00.582847 23404 ts_tablet_manager.cc:1403] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.011s
I20260709 13:23:00.582911 23405 tablet_bootstrap.cc:492] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:23:00.584851 23405 ts_tablet_manager.cc:1403] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.118s	user 0.007s	sys 0.005s
I20260709 13:23:00.586005 23404 raft_consensus.cc:359] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:00.586862 23404 raft_consensus.cc:385] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.587204 23404 raft_consensus.cc:740] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.588003 23404 consensus_queue.cc:260] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:00.590348 23763 raft_consensus.cc:3060] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.590325 23405 raft_consensus.cc:359] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.590890 23404 ts_tablet_manager.cc:1434] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:23:00.592422 23404 tablet_bootstrap.cc:492] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:23:00.565390 23249 leader_election.cc:304] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115
I20260709 13:23:00.591212 23405 raft_consensus.cc:385] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.597327 23405 raft_consensus.cc:740] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.597534 23766 raft_consensus.cc:2804] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.598217 23766 raft_consensus.cc:697] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:00.598474 23405 consensus_queue.cc:260] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.599294 23766 consensus_queue.cc:237] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:00.606742 23405 ts_tablet_manager.cc:1434] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:23:00.600786 23404 tablet_bootstrap.cc:654] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.612655 23405 tablet_bootstrap.cc:492] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:00.626848 23405 tablet_bootstrap.cc:654] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.627362 23830 raft_consensus.cc:493] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.629040 23830 raft_consensus.cc:515] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.631162 23830 leader_election.cc:290] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:00.637902 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987cdec3ef244fddafb031e68024c1dc" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:00.643087 23405 tablet_bootstrap.cc:492] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d: No bootstrap required, opened a new log
I20260709 13:23:00.643783 23405 ts_tablet_manager.cc:1403] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:23:00.648401 23404 tablet_bootstrap.cc:492] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:23:00.648902 23404 ts_tablet_manager.cc:1403] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.002s
I20260709 13:23:00.651674 23405 raft_consensus.cc:359] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.652400 23405 raft_consensus.cc:385] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.652642 23405 raft_consensus.cc:740] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.654791 23404 raft_consensus.cc:359] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.655532 23404 raft_consensus.cc:385] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.655795 23404 raft_consensus.cc:740] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.656553 23404 consensus_queue.cc:260] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.659303 23404 ts_tablet_manager.cc:1434] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:23:00.653338 23405 consensus_queue.cc:260] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.666813 23405 ts_tablet_manager.cc:1434] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:23:00.667627 23404 tablet_bootstrap.cc:492] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:23:00.669203 23033 catalog_manager.cc:5697] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 1 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.646315 23136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987cdec3ef244fddafb031e68024c1dc" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:23:00.674321 23404 tablet_bootstrap.cc:654] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.686298 23404 tablet_bootstrap.cc:492] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:23:00.687036 23404 ts_tablet_manager.cc:1403] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:23:00.689852 23404 raft_consensus.cc:359] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:00.690626 23404 raft_consensus.cc:385] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.690917 23404 raft_consensus.cc:740] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.699626 23404 consensus_queue.cc:260] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:00.703380 23404 ts_tablet_manager.cc:1434] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:23:00.704408 23404 tablet_bootstrap.cc:492] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115: Bootstrap starting.
I20260709 13:23:00.710400 23404 tablet_bootstrap.cc:654] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.722599 23404 tablet_bootstrap.cc:492] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115: No bootstrap required, opened a new log
I20260709 13:23:00.723126 23404 ts_tablet_manager.cc:1403] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:23:00.726225 23404 raft_consensus.cc:359] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.726953 23404 raft_consensus.cc:385] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.727246 23404 raft_consensus.cc:740] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28222c0dd7a1411692efad3387118115, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.727437 23825 raft_consensus.cc:493] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.728164 23825 raft_consensus.cc:515] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.728327 23404 consensus_queue.cc:260] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.730770 23724 raft_consensus.cc:493] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.731345 23724 raft_consensus.cc:515] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.733579 23724 leader_election.cc:290] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:00.735510 23825 leader_election.cc:290] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:23:00.736631 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f3d3eace634645af1d9239ca7bd856" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:00.737505 23284 raft_consensus.cc:2468] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:23:00.739200 23099 leader_election.cc:304] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:00.739971 23830 raft_consensus.cc:493] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.740541 23830 raft_consensus.cc:515] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:00.742789 23830 leader_election.cc:290] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:00.739528 23404 ts_tablet_manager.cc:1434] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:23:00.745217 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a4328b7c8048a58b8f49269156e606" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:00.747969 23724 raft_consensus.cc:2804] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.748425 23724 raft_consensus.cc:493] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.748777 23724 raft_consensus.cc:3060] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.749459 23831 raft_consensus.cc:493] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.750069 23831 raft_consensus.cc:515] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.755057 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537c251284f4165af8ff6b08343c427" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:00.755924 23285 raft_consensus.cc:2468] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 0.
I20260709 13:23:00.757232 23322 leader_election.cc:304] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:00.758415 23830 raft_consensus.cc:2804] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.758184 23724 raft_consensus.cc:515] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.758989 23830 raft_consensus.cc:493] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.759560 23830 raft_consensus.cc:3060] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.761034 23724 leader_election.cc:290] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:23:00.767277 23280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f3d3eace634645af1d9239ca7bd856" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:00.767855 23831 leader_election.cc:290] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:00.768786 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537c251284f4165af8ff6b08343c427" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d" is_pre_election: true
I20260709 13:23:00.781111 23133 raft_consensus.cc:2468] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 0.
I20260709 13:23:00.771785 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a4328b7c8048a58b8f49269156e606" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:00.790234 23209 raft_consensus.cc:2393] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28222c0dd7a1411692efad3387118115 in current term 1: Already voted for candidate b1f5ee52ad2f442bac6959931126746d in this term.
I20260709 13:23:00.771431 23763 raft_consensus.cc:2749] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.767976 23280 raft_consensus.cc:3060] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.776880 23206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:00.795397 23206 raft_consensus.cc:2468] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:23:00.777727 23657 raft_consensus.cc:2804] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:00.778162 23323 leader_election.cc:304] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:00.801422 23831 raft_consensus.cc:2749] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.801517 23657 raft_consensus.cc:493] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f0dc6416e1e43ee863a6af614ece6c0)
I20260709 13:23:00.803145 23657 raft_consensus.cc:3060] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:00.804375 23832 consensus_queue.cc:1048] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:00.806712 23832 consensus_queue.cc:1048] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:00.809340 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f3d3eace634645af1d9239ca7bd856" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:00.810091 23356 raft_consensus.cc:2468] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:23:00.811394 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f3d3eace634645af1d9239ca7bd856" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:00.800122 23323 leader_election.cc:304] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:23:00.811939 23356 raft_consensus.cc:3060] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.813524 23358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:00.814566 23100 leader_election.cc:304] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:00.816253 23825 raft_consensus.cc:2804] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.816696 23825 raft_consensus.cc:493] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.817348 23825 raft_consensus.cc:3060] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.814185 23358 raft_consensus.cc:2468] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 0.
I20260709 13:23:00.836238 23831 raft_consensus.cc:3060] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.838078 23358 raft_consensus.cc:3060] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.855173 23657 raft_consensus.cc:515] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.858458 23657 leader_election.cc:290] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:00.858878 23842 consensus_queue.cc:1048] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:23:00.861855 23830 raft_consensus.cc:515] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:00.874799 23836 consensus_queue.cc:1048] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:23:00.891811 23777 consensus_queue.cc:1048] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:23:00.898612 23174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 46429.5us
I20260709 13:23:00.909253 23830 leader_election.cc:290] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:00.909971 23830 raft_consensus.cc:493] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.910413 23830 raft_consensus.cc:515] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:00.912442 23830 leader_election.cc:290] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:00.915007 23284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537c251284f4165af8ff6b08343c427" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:00.915670 23284 raft_consensus.cc:3060] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.918151 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4689f05e6159426c8b5073075c502f3c" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:00.918642 23356 raft_consensus.cc:2468] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:23:00.857555 23825 raft_consensus.cc:515] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:00.922686 23101 leader_election.cc:304] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:00.923532 23903 raft_consensus.cc:2804] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.923949 23825 leader_election.cc:290] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:00.924052 23903 raft_consensus.cc:697] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:00.925064 23903 consensus_queue.cc:237] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
W20260709 13:23:00.900817 23323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:34617, user_credentials={real_user=slave}} blocked reactor thread for 70607.3us
I20260709 13:23:01.006487 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:01.024994 23355 raft_consensus.cc:3060] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.005678 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:01.030269 23208 raft_consensus.cc:3060] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.039073 23831 raft_consensus.cc:2749] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:01.046643 23284 raft_consensus.cc:2468] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:23:01.065192 23280 raft_consensus.cc:2468] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:23:01.071993 23322 leader_election.cc:304] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:01.100003 23909 raft_consensus.cc:2804] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:01.146147 23208 raft_consensus.cc:2468] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
I20260709 13:23:01.116436 23132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537c251284f4165af8ff6b08343c427" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:23:01.147234 23132 raft_consensus.cc:3060] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:01.154424 23082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:01.150887 23909 raft_consensus.cc:697] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
W20260709 13:23:01.235082 23249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 334409us
I20260709 13:23:01.235543 23356 raft_consensus.cc:3060] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.251821 23909 consensus_queue.cc:237] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:01.260887 23913 consensus_queue.cc:1048] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:23:01.303339 23132 raft_consensus.cc:2468] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:23:01.308094 23355 raft_consensus.cc:2468] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 1.
W20260709 13:23:01.357272 23912 log.cc:927] Time spent T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
I20260709 13:23:01.360394 23353 raft_consensus.cc:1240] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Rejecting Update request from peer 0f0dc6416e1e43ee863a6af614ece6c0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:23:01.364310 23101 leader_election.cc:304] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:01.365346 23924 raft_consensus.cc:2804] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:01.376067 23758 consensus_queue.cc:1059] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:01.376765 23133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01caec9d94514a02b3e251a1ea509" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
I20260709 13:23:01.377075 23758 raft_consensus.cc:3055] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:01.377712 23758 raft_consensus.cc:740] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:01.378700 23758 consensus_queue.cc:260] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:01.374684 23924 raft_consensus.cc:697] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:01.409583 23924 consensus_queue.cc:237] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:01.393201 23925 consensus_queue.cc:1048] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:23:01.416927 23034 catalog_manager.cc:5697] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:01.390836 23758 raft_consensus.cc:3060] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.440711 23840 consensus_queue.cc:1048] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.456040 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd01caec9d94514a02b3e251a1ea509" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:01.441499 23825 consensus_queue.cc:1048] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:23:01.465659 23029 catalog_manager.cc:5697] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 1 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:01.481952 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4689f05e6159426c8b5073075c502f3c" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:01.510861 23323 leader_election.cc:304] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d
I20260709 13:23:01.512725 23909 raft_consensus.cc:2749] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:01.552389 23209 raft_consensus.cc:2468] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:01.579190 23323 leader_election.cc:304] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:01.581220 23831 raft_consensus.cc:2804] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:01.581951 23831 raft_consensus.cc:697] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:23:01.582967 23831 consensus_queue.cc:237] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:01.733501 23034 catalog_manager.cc:5697] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 1 to 2, leader changed from 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130) to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 2 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:01.757843 23033 catalog_manager.cc:5697] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 0 to 1, leader changed from <none> to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 1 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:01.801594 23825 consensus_queue.cc:1048] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.828210 23909 consensus_queue.cc:1048] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:01.857419 23909 consensus_queue.cc:1048] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.876201 23920 consensus_queue.cc:1048] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.132565 23209 raft_consensus.cc:1275] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:02.134150 23953 consensus_queue.cc:1048] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:02.149178 23131 raft_consensus.cc:3060] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.156940 23131 raft_consensus.cc:1275] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:02.159090 23923 consensus_queue.cc:1048] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:02.231140 13122 tablet_server.cc:179] TabletServer@127.12.208.129:0 shutting down...
W20260709 13:23:02.238584 23249 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:23:02.254993 23175 consensus_peers.cc:597] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.259701 23249 consensus_peers.cc:597] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.293310 23175 consensus_peers.cc:597] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.297878 23323 consensus_peers.cc:597] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.301563 23175 consensus_peers.cc:597] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.303085 23249 consensus_peers.cc:597] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.321859 23249 consensus_peers.cc:597] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.329191 23175 consensus_peers.cc:597] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.330998 23323 consensus_peers.cc:597] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:02.336968 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:02.338009 13122 tablet_replica.cc:333] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.338881 13122 raft_consensus.cc:2243] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.339392 13122 raft_consensus.cc:2272] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.341944 13122 tablet_replica.cc:333] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.342643 13122 raft_consensus.cc:2243] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.343060 13122 raft_consensus.cc:2272] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.344959 13122 tablet_replica.cc:333] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.345494 13122 raft_consensus.cc:2243] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.345940 13122 raft_consensus.cc:2272] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.347829 13122 tablet_replica.cc:333] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.348637 13122 raft_consensus.cc:2243] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.349614 13122 raft_consensus.cc:2272] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.352144 13122 tablet_replica.cc:333] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.352993 13122 raft_consensus.cc:2243] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.353961 13122 raft_consensus.cc:2272] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:02.355921 23249 consensus_peers.cc:597] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:02.356420 13122 tablet_replica.cc:333] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.357288 13122 raft_consensus.cc:2243] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.357726 13122 raft_consensus.cc:2272] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.359647 13122 tablet_replica.cc:333] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.360302 13122 raft_consensus.cc:2243] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.361029 13122 raft_consensus.cc:2272] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.362993 13122 tablet_replica.cc:333] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.363787 13122 raft_consensus.cc:2243] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.364290 13122 raft_consensus.cc:2272] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.366912 13122 tablet_replica.cc:333] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.367551 13122 raft_consensus.cc:2243] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.368047 13122 raft_consensus.cc:2272] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.370178 13122 tablet_replica.cc:333] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.370990 13122 raft_consensus.cc:2243] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.371464 13122 raft_consensus.cc:2272] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.373872 13122 tablet_replica.cc:333] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.374709 13122 raft_consensus.cc:2243] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.375622 13122 raft_consensus.cc:2272] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.379470 13122 tablet_replica.cc:333] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
W20260709 13:23:02.380313 23249 consensus_peers.cc:597] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:02.380414 13122 raft_consensus.cc:2243] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.381606 13122 raft_consensus.cc:2272] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.384817 13122 tablet_replica.cc:333] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
W20260709 13:23:02.385543 23175 consensus_peers.cc:597] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:02.385815 13122 raft_consensus.cc:2243] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.386554 13122 raft_consensus.cc:2272] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.391141 13122 tablet_replica.cc:333] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.391999 13122 raft_consensus.cc:2243] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.392973 13122 raft_consensus.cc:2272] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.395542 13122 tablet_replica.cc:333] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.396301 13122 raft_consensus.cc:2243] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.396770 13122 raft_consensus.cc:2272] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.398939 13122 tablet_replica.cc:333] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.399765 13122 raft_consensus.cc:2243] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.400831 13122 raft_consensus.cc:2272] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.403541 13122 tablet_replica.cc:333] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.404335 13122 raft_consensus.cc:2243] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.404862 13122 raft_consensus.cc:2272] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.407191 13122 tablet_replica.cc:333] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.407775 13122 raft_consensus.cc:2243] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.408571 13122 raft_consensus.cc:2272] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.410677 13122 tablet_replica.cc:333] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.411252 13122 raft_consensus.cc:2243] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.411689 13122 raft_consensus.cc:2272] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.414077 13122 tablet_replica.cc:333] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.414855 13122 raft_consensus.cc:2243] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.415926 13122 raft_consensus.cc:2272] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:02.418223 23249 consensus_peers.cc:597] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:02.418684 13122 tablet_replica.cc:333] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.419404 13122 raft_consensus.cc:2243] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.419940 13122 raft_consensus.cc:2272] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.422642 13122 tablet_replica.cc:333] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.423388 13122 raft_consensus.cc:2243] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.424433 13122 raft_consensus.cc:2272] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.426898 13122 tablet_replica.cc:333] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.427711 13122 raft_consensus.cc:2243] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.428195 13122 raft_consensus.cc:2272] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.430492 13122 tablet_replica.cc:333] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.431218 13122 raft_consensus.cc:2243] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.431740 13122 raft_consensus.cc:2272] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.434168 13122 tablet_replica.cc:333] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.434998 13122 raft_consensus.cc:2243] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.435524 13122 raft_consensus.cc:2272] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.438103 13122 tablet_replica.cc:333] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.438854 13122 raft_consensus.cc:2243] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.439404 13122 raft_consensus.cc:2272] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.442090 13122 tablet_replica.cc:333] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.442847 13122 raft_consensus.cc:2243] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.443859 13122 raft_consensus.cc:2272] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.446403 13122 tablet_replica.cc:333] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.447197 13122 raft_consensus.cc:2243] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.448205 13122 raft_consensus.cc:2272] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.450860 13122 tablet_replica.cc:333] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.451596 13122 raft_consensus.cc:2243] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.452104 13122 raft_consensus.cc:2272] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.454731 13122 tablet_replica.cc:333] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
W20260709 13:23:02.455400 23175 consensus_peers.cc:597] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:02.455541 13122 raft_consensus.cc:2243] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.456257 13122 raft_consensus.cc:2272] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.459206 13122 tablet_replica.cc:333] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.460002 13122 raft_consensus.cc:2243] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.460539 13122 raft_consensus.cc:2272] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.462877 13122 tablet_replica.cc:333] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.463595 13122 raft_consensus.cc:2243] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.464143 13122 raft_consensus.cc:2272] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.467037 13122 tablet_replica.cc:333] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.467772 13122 raft_consensus.cc:2243] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.468318 13122 raft_consensus.cc:2272] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:02.468247 23323 consensus_peers.cc:597] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:02.471508 13122 tablet_replica.cc:333] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.472241 13122 raft_consensus.cc:2243] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.473222 13122 raft_consensus.cc:2272] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.475589 13122 tablet_replica.cc:333] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.476188 13122 raft_consensus.cc:2243] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.476686 13122 raft_consensus.cc:2272] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.479351 13122 tablet_replica.cc:333] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.480161 13122 raft_consensus.cc:2243] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.481202 13122 raft_consensus.cc:2272] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:02.481122 23175 consensus_peers.cc:597] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:02.484179 13122 tablet_replica.cc:333] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.485034 13122 raft_consensus.cc:2243] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.485598 13122 raft_consensus.cc:2272] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:02.487170 23175 consensus_peers.cc:597] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:02.488649 13122 tablet_replica.cc:333] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.489320 13122 raft_consensus.cc:2243] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.490293 13122 raft_consensus.cc:2272] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.492400 13122 tablet_replica.cc:333] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.492965 13122 raft_consensus.cc:2243] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.493422 13122 raft_consensus.cc:2272] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.496591 13122 tablet_replica.cc:333] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.497335 13122 raft_consensus.cc:2243] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.497912 13122 raft_consensus.cc:2272] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:02.500321 23249 consensus_peers.cc:597] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:02.501142 13122 tablet_replica.cc:333] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.501907 13122 raft_consensus.cc:2243] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.502468 13122 raft_consensus.cc:2272] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.505021 13122 tablet_replica.cc:333] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.505600 13122 raft_consensus.cc:2243] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.506110 13122 raft_consensus.cc:2272] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.508417 13122 tablet_replica.cc:333] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.508944 13122 raft_consensus.cc:2243] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:02.509934 13122 raft_consensus.cc:2272] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.512104 13122 tablet_replica.cc:333] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.512705 13122 raft_consensus.cc:2243] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.513237 13122 raft_consensus.cc:2272] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:02.515933 13122 tablet_replica.cc:333] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d: stopping tablet replica
I20260709 13:23:02.516484 13122 raft_consensus.cc:2243] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:02.517043 13122 raft_consensus.cc:2272] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:02.547717 23175 consensus_peers.cc:597] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.548599 23175 consensus_peers.cc:597] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.549484 23249 consensus_peers.cc:597] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.574247 23249 consensus_peers.cc:597] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.582446 23175 consensus_peers.cc:597] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.594015 23249 consensus_peers.cc:597] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.619401 23323 consensus_peers.cc:597] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.624708 23175 consensus_peers.cc:597] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.667881 23249 consensus_peers.cc:597] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.668520 23323 consensus_peers.cc:597] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.767324 23249 consensus_peers.cc:597] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:02.772598 23249 consensus_peers.cc:597] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:03.287389 23909 raft_consensus.cc:493] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.288049 23909 raft_consensus.cc:515] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.290369 23909 leader_election.cc:290] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:03.292011 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
W20260709 13:23:03.294735 23323 leader_election.cc:336] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.295228 23323 leader_election.cc:304] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.296139 23923 raft_consensus.cc:2749] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:03.366173 23923 raft_consensus.cc:493] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.366714 23923 raft_consensus.cc:515] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.371009 23923 leader_election.cc:290] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:03.371398 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
W20260709 13:23:03.376574 23323 leader_election.cc:336] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.377067 23323 leader_election.cc:304] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.378700 23923 raft_consensus.cc:2749] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:03.381711 23923 raft_consensus.cc:493] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.382671 23923 raft_consensus.cc:515] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.387403 23923 leader_election.cc:290] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.387501 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
W20260709 13:23:03.391860 23323 leader_election.cc:336] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.392249 23323 leader_election.cc:304] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:23:03.392869 23923 raft_consensus.cc:2749] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:03.435314 23840 raft_consensus.cc:493] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.436030 23840 raft_consensus.cc:515] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:03.438234 23840 leader_election.cc:290] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:03.442027 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
W20260709 13:23:03.448051 23249 leader_election.cc:336] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.448525 23249 leader_election.cc:304] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.449121 23840 raft_consensus.cc:2749] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:03.452057 23840 raft_consensus.cc:493] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.452625 23840 raft_consensus.cc:515] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.455826 23840 leader_election.cc:290] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.456403 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ee84482afc4bd590fa2592f7fa9f44" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:03.457552 23965 raft_consensus.cc:493] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.458227 23965 raft_consensus.cc:515] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
W20260709 13:23:03.460238 23249 leader_election.cc:336] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.461045 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07f8c2c87cd4a47aa2f08e7750ae0ba" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:03.461622 23249 leader_election.cc:304] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.461076 23965 leader_election.cc:290] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.462845 23840 raft_consensus.cc:2749] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:23:03.464969 23175 leader_election.cc:336] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.465365 23175 leader_election.cc:304] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.465939 23965 raft_consensus.cc:2749] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:03.472769 23923 raft_consensus.cc:493] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.473304 23923 raft_consensus.cc:515] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.475075 23923 leader_election.cc:290] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:03.476824 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987cdec3ef244fddafb031e68024c1dc" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:03.478966 23923 raft_consensus.cc:493] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
W20260709 13:23:03.479578 23323 leader_election.cc:336] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.480299 23323 leader_election.cc:304] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.479565 23923 raft_consensus.cc:515] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.481133 23909 raft_consensus.cc:2749] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:03.482388 23923 leader_election.cc:290] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:03.485083 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07f8c2c87cd4a47aa2f08e7750ae0ba" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:03.485846 23208 raft_consensus.cc:2468] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:23:03.486899 23933 raft_consensus.cc:493] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
W20260709 13:23:03.486937 23323 leader_election.cc:336] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.487604 23933 raft_consensus.cc:515] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.489143 23323 leader_election.cc:304] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.490496 23909 raft_consensus.cc:2804] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.490617 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987cdec3ef244fddafb031e68024c1dc" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:03.491097 23909 raft_consensus.cc:493] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.491367 23355 raft_consensus.cc:2468] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:23:03.491513 23909 raft_consensus.cc:3060] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.492650 23176 leader_election.cc:304] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:23:03.495317 23962 raft_consensus.cc:2804] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.495721 23962 raft_consensus.cc:493] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.490408 23933 leader_election.cc:290] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.496145 23962 raft_consensus.cc:3060] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.500888 23909 raft_consensus.cc:515] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.503484 23909 leader_election.cc:290] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:03.506963 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07f8c2c87cd4a47aa2f08e7750ae0ba" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:03.520157 23209 raft_consensus.cc:3060] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:03.508049 23175 leader_election.cc:336] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.509186 23962 raft_consensus.cc:515] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.527071 23962 leader_election.cc:290] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.527576 23965 raft_consensus.cc:493] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.528168 23965 raft_consensus.cc:515] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:03.528645 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987cdec3ef244fddafb031e68024c1dc" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:03.529337 23355 raft_consensus.cc:3060] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.527588 23209 raft_consensus.cc:2468] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
W20260709 13:23:03.511013 23323 leader_election.cc:336] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.531404 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:03.532122 23281 raft_consensus.cc:2468] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:23:03.533594 23174 leader_election.cc:304] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.534852 23965 leader_election.cc:290] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:03.534973 23962 raft_consensus.cc:2804] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.535501 23962 raft_consensus.cc:493] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.536228 23962 raft_consensus.cc:3060] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.545123 23962 raft_consensus.cc:515] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:03.546728 23967 raft_consensus.cc:493] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.547318 23967 raft_consensus.cc:515] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.549495 23967 leader_election.cc:290] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.549682 23962 leader_election.cc:290] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:03.550160 23355 raft_consensus.cc:2468] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 2.
I20260709 13:23:03.550765 23285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f3d3eace634645af1d9239ca7bd856" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:03.555626 23323 leader_election.cc:304] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.556453 23909 raft_consensus.cc:2804] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.556954 23909 raft_consensus.cc:697] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:23:03.554518 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:03.557829 23281 raft_consensus.cc:3060] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:03.551146 23175 leader_election.cc:336] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:03.558584 23175 leader_election.cc:336] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.559540 23909 consensus_queue.cc:237] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.560504 23176 leader_election.cc:304] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.564474 23962 raft_consensus.cc:2804] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.565023 23962 raft_consensus.cc:697] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:03.565932 23962 consensus_queue.cc:237] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.566248 23281 raft_consensus.cc:2468] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 2.
W20260709 13:23:03.569229 23175 leader_election.cc:336] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.572105 23174 leader_election.cc:304] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.572826 23968 raft_consensus.cc:2804] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.573310 23968 raft_consensus.cc:697] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:03.574434 23968 consensus_queue.cc:237] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:03.590786 23033 catalog_manager.cc:5697] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:03.586582 23029 catalog_manager.cc:5697] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 2 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.594957 23909 raft_consensus.cc:493] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.596272 23909 raft_consensus.cc:515] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.598232 23922 raft_consensus.cc:493] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.599313 23922 raft_consensus.cc:515] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.603642 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f3d3eace634645af1d9239ca7bd856" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:03.604256 23355 raft_consensus.cc:2468] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:23:03.605685 23250 leader_election.cc:304] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.606961 23922 leader_election.cc:290] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.606982 23840 raft_consensus.cc:2804] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.607614 23840 raft_consensus.cc:493] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.608050 23840 raft_consensus.cc:3060] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:03.608740 13122 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23157)
I20260709 13:23:03.610000 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ee84482afc4bd590fa2592f7fa9f44" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:03.610700 23281 raft_consensus.cc:2468] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:23:03.611526 23909 leader_election.cc:290] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
W20260709 13:23:03.612301 23249 leader_election.cc:336] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.612877 23322 leader_election.cc:304] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.613647 23909 raft_consensus.cc:2804] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.614249 23909 raft_consensus.cc:493] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.614812 23909 raft_consensus.cc:3060] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:03.617920 23323 leader_election.cc:336] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.618445 23323 leader_election.cc:304] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:23:03.620108 23840 raft_consensus.cc:515] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.624884 23909 raft_consensus.cc:515] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.626180 23923 raft_consensus.cc:2749] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:03.626958 23923 raft_consensus.cc:493] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.627471 23923 raft_consensus.cc:515] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.628464 23909 leader_election.cc:290] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.629170 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ee84482afc4bd590fa2592f7fa9f44" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:03.629606 23923 leader_election.cc:290] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:03.629864 23281 raft_consensus.cc:3060] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.637735 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f3d3eace634645af1d9239ca7bd856" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:03.638477 23355 raft_consensus.cc:3060] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.649339 23355 raft_consensus.cc:2468] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 2.
I20260709 13:23:03.650521 23250 leader_election.cc:304] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.651460 23966 raft_consensus.cc:2804] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.651963 23966 raft_consensus.cc:697] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:03.652856 23966 consensus_queue.cc:237] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.660096 23962 raft_consensus.cc:493] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.660658 23962 raft_consensus.cc:515] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.661092 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb4ccf648b4137bbe92d1a4e9ce542" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:03.662744 23962 leader_election.cc:290] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.663057 23840 leader_election.cc:290] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
W20260709 13:23:03.671211 23323 leader_election.cc:336] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:03.672127 23323 leader_election.cc:336] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:03.672590 23323 leader_election.cc:336] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.672950 23323 leader_election.cc:304] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.676847 23923 raft_consensus.cc:2749] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:23:03.680346 23175 leader_election.cc:336] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:03.681286 23249 leader_election.cc:336] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.683828 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:03.685708 23355 raft_consensus.cc:2468] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:23:03.686834 23176 leader_election.cc:304] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.687170 23968 raft_consensus.cc:493] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.687636 23933 raft_consensus.cc:2804] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.688112 23933 raft_consensus.cc:493] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.687881 23968 raft_consensus.cc:515] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.690332 23968 leader_election.cc:290] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.688501 23933 raft_consensus.cc:3060] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.693380 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb4ccf648b4137bbe92d1a4e9ce542" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:03.699795 23933 raft_consensus.cc:515] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.701289 23968 raft_consensus.cc:493] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.701961 23968 raft_consensus.cc:515] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.704358 23968 leader_election.cc:290] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.705885 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797ae11a97f84ad783704a5f0b287330" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:03.710060 23933 leader_election.cc:290] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.711567 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9632791a4410453a8a5b95e7570c0565" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:03.713280 23356 raft_consensus.cc:3060] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:03.714004 23175 leader_election.cc:336] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.711730 23281 raft_consensus.cc:2468] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:03.719535 23322 leader_election.cc:304] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.720654 23923 raft_consensus.cc:2804] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.721112 23923 raft_consensus.cc:697] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:23:03.722250 23923 consensus_queue.cc:237] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.723049 23356 raft_consensus.cc:2468] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 2.
I20260709 13:23:03.724700 23968 raft_consensus.cc:493] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.725262 23968 raft_consensus.cc:515] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:03.725996 23840 raft_consensus.cc:493] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.726516 23840 raft_consensus.cc:515] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.728714 23840 leader_election.cc:290] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.729096 23176 leader_election.cc:304] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:23:03.729969 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:03.730183 23968 leader_election.cc:290] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:03.730019 23962 raft_consensus.cc:2804] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.730667 23283 raft_consensus.cc:2468] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:23:03.731221 23962 raft_consensus.cc:697] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:03.731825 23174 leader_election.cc:304] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.732210 23962 consensus_queue.cc:237] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.734786 23968 raft_consensus.cc:2804] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.735165 23968 raft_consensus.cc:493] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.735520 23968 raft_consensus.cc:3060] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.743804 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9c34142ecf4df297b6eff325e4cbd6" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:03.744025 23967 raft_consensus.cc:493] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.744638 23967 raft_consensus.cc:515] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.746752 23967 leader_election.cc:290] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:03.748819 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797ae11a97f84ad783704a5f0b287330" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:03.749504 23208 raft_consensus.cc:2468] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:23:03.752723 23323 leader_election.cc:304] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:23:03.754083 23968 raft_consensus.cc:515] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:03.756115 23909 raft_consensus.cc:2804] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.756439 23967 raft_consensus.cc:493] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.757256 23967 raft_consensus.cc:515] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.756584 23909 raft_consensus.cc:493] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.758680 23909 raft_consensus.cc:3060] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.760455 23967 leader_election.cc:290] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.760309 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9c34142ecf4df297b6eff325e4cbd6" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
W20260709 13:23:03.761283 23323 leader_election.cc:336] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.761454 23283 raft_consensus.cc:2468] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 1.
I20260709 13:23:03.763119 23322 leader_election.cc:304] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.758606 23953 raft_consensus.cc:493] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.764667 23953 raft_consensus.cc:515] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.767112 23953 leader_election.cc:290] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.767632 23953 raft_consensus.cc:2804] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.767871 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:03.767966 23953 raft_consensus.cc:493] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.771351 23953 raft_consensus.cc:3060] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:03.771770 23323 leader_election.cc:336] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:03.773829 23249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 56106us
I20260709 13:23:03.775684 23357 raft_consensus.cc:2468] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:23:03.776974 23176 leader_election.cc:304] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.778307 23962 raft_consensus.cc:2804] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.778743 23962 raft_consensus.cc:493] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.779153 23962 raft_consensus.cc:3060] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.792670 23962 raft_consensus.cc:515] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
W20260709 13:23:03.793447 23323 leader_election.cc:336] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.797537 23323 leader_election.cc:304] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:23:03.798274 23909 raft_consensus.cc:515] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
W20260709 13:23:03.796962 23175 leader_election.cc:336] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.803201 23175 leader_election.cc:304] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.804095 23909 leader_election.cc:290] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:03.800755 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:03.805162 23840 raft_consensus.cc:493] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.805510 23283 raft_consensus.cc:3060] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.797694 23953 raft_consensus.cc:515] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.805857 23840 raft_consensus.cc:515] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.805917 23962 leader_election.cc:290] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.807868 23953 leader_election.cc:290] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.808460 23840 leader_election.cc:290] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.811158 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:03.811892 23355 raft_consensus.cc:2468] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:23:03.813277 23250 leader_election.cc:304] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.799954 23968 leader_election.cc:290] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:03.814255 23966 raft_consensus.cc:2804] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.814431 23283 raft_consensus.cc:2468] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 2.
I20260709 13:23:03.814810 23966 raft_consensus.cc:493] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.815285 23966 raft_consensus.cc:3060] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.802698 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87cb4ccf648b4137bbe92d1a4e9ce542" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:03.815985 23174 leader_election.cc:304] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.816229 23357 raft_consensus.cc:3060] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.815025 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9c34142ecf4df297b6eff325e4cbd6" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:03.817013 23281 raft_consensus.cc:3060] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.822690 23933 raft_consensus.cc:2749] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:03.824891 23281 raft_consensus.cc:2468] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:03.840209 23322 leader_election.cc:304] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.841212 23953 raft_consensus.cc:2804] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.841742 23953 raft_consensus.cc:697] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:23:03.828002 23034 catalog_manager.cc:5697] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 2 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.833026 23840 raft_consensus.cc:493] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
W20260709 13:23:03.846529 23323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:33547, user_credentials={real_user=slave}} blocked reactor thread for 53108.4us
I20260709 13:23:03.846380 23923 raft_consensus.cc:2749] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:03.828061 23968 raft_consensus.cc:2804] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.842914 23953 consensus_queue.cc:237] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.851564 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797ae11a97f84ad783704a5f0b287330" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:03.852181 23208 raft_consensus.cc:3060] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:03.855134 23249 leader_election.cc:336] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.855856 23249 leader_election.cc:304] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5ee52ad2f442bac6959931126746d; no voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:03.824788 23966 raft_consensus.cc:515] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
W20260709 13:23:03.864188 23175 leader_election.cc:336] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:03.865756 23175 leader_election.cc:336] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.862353 23777 raft_consensus.cc:2749] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:03.860420 23962 raft_consensus.cc:493] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.859727 23968 raft_consensus.cc:697] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:03.853858 23840 raft_consensus.cc:515] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.882575 23208 raft_consensus.cc:2468] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:03.870450 23965 raft_consensus.cc:493] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.884887 23323 leader_election.cc:304] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:23:03.886225 23965 raft_consensus.cc:515] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:03.888831 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:03.889873 23355 raft_consensus.cc:2468] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:23:03.891217 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:03.891256 23250 leader_election.cc:304] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.891906 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
I20260709 13:23:03.892331 23356 raft_consensus.cc:3060] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.892614 23777 raft_consensus.cc:2804] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.893271 23777 raft_consensus.cc:493] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.893834 23777 raft_consensus.cc:3060] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.894168 23965 leader_election.cc:290] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:03.881937 23962 raft_consensus.cc:515] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:03.892604 23281 raft_consensus.cc:2468] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
W20260709 13:23:03.893343 23323 leader_election.cc:336] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.898543 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28937175e4764f6484d66b61a7e1592a" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d" is_pre_election: true
W20260709 13:23:03.899027 23323 leader_election.cc:336] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.899634 23174 leader_election.cc:304] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.900499 23953 raft_consensus.cc:2804] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.901201 23965 raft_consensus.cc:2804] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.901641 23965 raft_consensus.cc:493] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.902029 23965 raft_consensus.cc:3060] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.904692 23777 raft_consensus.cc:515] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:03.906111 23356 raft_consensus.cc:2468] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 2.
I20260709 13:23:03.906231 23953 raft_consensus.cc:697] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:23:03.906832 23357 raft_consensus.cc:2468] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 2.
I20260709 13:23:03.907542 23250 leader_election.cc:304] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:03.908111 23176 leader_election.cc:304] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
W20260709 13:23:03.909447 23175 leader_election.cc:336] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.911937 23777 leader_election.cc:290] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.912645 23777 raft_consensus.cc:493] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:03.913255 23777 raft_consensus.cc:515] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:03.903600 23962 leader_election.cc:290] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:03.912197 23933 raft_consensus.cc:2804] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.921262 23777 leader_election.cc:290] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:03.921932 23777 raft_consensus.cc:2804] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.922384 23777 raft_consensus.cc:697] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:03.923118 23777 consensus_queue.cc:237] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
W20260709 13:23:03.932443 23175 leader_election.cc:336] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:03.935361 23953 consensus_queue.cc:237] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.942519 23840 leader_election.cc:290] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:03.950977 23933 raft_consensus.cc:697] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:03.935863 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:03.919708 23968 consensus_queue.cc:237] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:03.955278 23357 raft_consensus.cc:3060] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.952109 23933 consensus_queue.cc:237] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:03.986773 23965 raft_consensus.cc:515] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:04.005823 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28937175e4764f6484d66b61a7e1592a" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" is_pre_election: true
I20260709 13:23:04.006584 23208 raft_consensus.cc:2468] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 1.
I20260709 13:23:04.007380 23962 raft_consensus.cc:493] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:04.007923 23962 raft_consensus.cc:515] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:04.009961 23962 leader_election.cc:290] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
W20260709 13:23:04.004666 23175 leader_election.cc:336] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:04.014652 23249 leader_election.cc:304] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
W20260709 13:23:04.015470 23175 leader_election.cc:336] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:04.016028 23175 leader_election.cc:304] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:23:04.046583 23965 leader_election.cc:290] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:04.020062 23984 raft_consensus.cc:2804] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:04.047518 23984 raft_consensus.cc:493] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:04.047921 23984 raft_consensus.cc:3060] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.022363 23986 raft_consensus.cc:2749] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:04.053432 23357 raft_consensus.cc:2468] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 2.
I20260709 13:23:04.054358 23966 leader_election.cc:290] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:04.059465 23250 leader_election.cc:304] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:04.060652 23966 raft_consensus.cc:2804] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:04.061151 23966 raft_consensus.cc:697] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:04.065222 23208 raft_consensus.cc:1275] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.067106 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:04.065485 23966 consensus_queue.cc:237] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:04.067950 23281 raft_consensus.cc:3060] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:04.070117 23175 leader_election.cc:336] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:04.070999 23175 leader_election.cc:336] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:04.079676 23967 consensus_queue.cc:1048] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:04.081324 23283 raft_consensus.cc:1275] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 0f0dc6416e1e43ee863a6af614ece6c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.081471 23357 raft_consensus.cc:1275] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Refusing update from remote peer b1f5ee52ad2f442bac6959931126746d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.083467 23840 consensus_queue.cc:1048] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:04.079226 23176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 75375.2us
W20260709 13:23:04.080052 23249 leader_election.cc:336] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:04.088037 23355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115" is_pre_election: true
I20260709 13:23:04.088622 23355 raft_consensus.cc:2468] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 1.
I20260709 13:23:04.092175 23356 raft_consensus.cc:1275] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Refusing update from remote peer 0f0dc6416e1e43ee863a6af614ece6c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.096112 23984 raft_consensus.cc:515] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:04.100914 23176 leader_election.cc:304] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:04.106166 23988 raft_consensus.cc:2804] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:04.106590 23988 raft_consensus.cc:493] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:04.106945 23988 raft_consensus.cc:3060] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.107631 23990 consensus_queue.cc:1048] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:04.111088 23249 leader_election.cc:336] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:04.111949 23249 leader_election.cc:336] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:04.120975 23249 leader_election.cc:336] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:04.121690 23249 leader_election.cc:336] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:04.110410 23962 consensus_queue.cc:1048] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 13:23:04.134720 23175 consensus_peers.cc:597] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:04.134877 23988 raft_consensus.cc:515] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:04.152302 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56" candidate_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:04.153018 23356 raft_consensus.cc:3060] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.158483 23984 leader_election.cc:290] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: Requested vote from peers 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
W20260709 13:23:04.162286 23323 consensus_peers.cc:597] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:04.161832 23356 raft_consensus.cc:2468] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 2.
I20260709 13:23:04.167692 23176 leader_election.cc:304] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:23:04.176894 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28937175e4764f6484d66b61a7e1592a" candidate_uuid: "b1f5ee52ad2f442bac6959931126746d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:04.177873 23208 raft_consensus.cc:3060] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.193249 23208 raft_consensus.cc:2468] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5ee52ad2f442bac6959931126746d in term 2.
I20260709 13:23:04.200070 23029 catalog_manager.cc:5697] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 2 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.200877 23356 raft_consensus.cc:1275] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Refusing update from remote peer 0f0dc6416e1e43ee863a6af614ece6c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.201699 23029 catalog_manager.cc:5697] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 2 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.204627 23965 consensus_queue.cc:1048] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.189245 23968 raft_consensus.cc:2804] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:04.209184 23029 catalog_manager.cc:5697] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 2 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.206532 23968 raft_consensus.cc:697] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:04.211931 23281 raft_consensus.cc:2468] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0dc6416e1e43ee863a6af614ece6c0 in term 2.
I20260709 13:23:04.178349 23988 leader_election.cc:290] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:04.212587 23033 catalog_manager.cc:5697] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.223938 23033 catalog_manager.cc:5697] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.226248 23033 catalog_manager.cc:5697] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:04.216589 23968 consensus_queue.cc:237] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:04.239966 23249 leader_election.cc:304] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:04.242720 23174 leader_election.cc:304] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, b1f5ee52ad2f442bac6959931126746d; no voters: 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:04.243733 23840 raft_consensus.cc:2804] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:04.244331 23840 raft_consensus.cc:697] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Becoming Leader. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:04.237608 23033 catalog_manager.cc:5697] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } }
W20260709 13:23:04.248416 23175 leader_election.cc:336] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
I20260709 13:23:04.264699 23840 consensus_queue.cc:237] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:04.263999 23988 raft_consensus.cc:2804] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:23:04.286439 23175 consensus_peers.cc:597] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:04.286968 23175 consensus_peers.cc:597] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:04.292186 23988 raft_consensus.cc:697] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Becoming Leader. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:04.301292 23988 consensus_queue.cc:237] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
W20260709 13:23:04.309127 23249 leader_election.cc:336] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:04.319393 23323 consensus_peers.cc:597] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:04.321696 23281 raft_consensus.cc:1275] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.323587 23909 consensus_queue.cc:1048] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.341544 23034 catalog_manager.cc:5697] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 2 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.343693 23034 catalog_manager.cc:5697] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 2 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.350770 23283 raft_consensus.cc:1275] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.373844 23355 raft_consensus.cc:1275] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Refusing update from remote peer b1f5ee52ad2f442bac6959931126746d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.376102 23033 catalog_manager.cc:5697] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to b1f5ee52ad2f442bac6959931126746d (127.12.208.131). New cstate: current_term: 2 leader_uuid: "b1f5ee52ad2f442bac6959931126746d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:04.377491 23909 consensus_queue.cc:1048] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.381050 23966 consensus_queue.cc:1048] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.387252 23208 raft_consensus.cc:1275] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.390209 23967 consensus_queue.cc:1048] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:04.392328 23249 consensus_peers.cc:597] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:04.407342 23323 consensus_peers.cc:597] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:04.436084 23034 catalog_manager.cc:5697] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:04.439258 23034 catalog_manager.cc:5697] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 reported cstate change: term changed from 1 to 2, leader changed from 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129) to 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
W20260709 13:23:04.484288 23323 consensus_peers.cc:597] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:04.487403 23175 consensus_peers.cc:597] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:04.500684 23175 consensus_peers.cc:597] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:04.521166 23249 consensus_peers.cc:597] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:04.533376 23281 raft_consensus.cc:1275] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 0f0dc6416e1e43ee863a6af614ece6c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.539983 23962 consensus_queue.cc:1048] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.540896 23356 raft_consensus.cc:1275] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Refusing update from remote peer b1f5ee52ad2f442bac6959931126746d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.542322 23777 consensus_queue.cc:1048] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:04.548363 23249 consensus_peers.cc:597] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:04.564577 23323 consensus_peers.cc:597] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:04.575794 23356 raft_consensus.cc:1275] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Refusing update from remote peer 0f0dc6416e1e43ee863a6af614ece6c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.577198 23962 consensus_queue.cc:1048] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:04.609210 13122 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23157)
W20260709 13:23:04.649834 23249 consensus_peers.cc:597] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:04.702286 23175 consensus_peers.cc:597] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:04.703019 23249 consensus_peers.cc:597] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:04.717096 23249 consensus_peers.cc:597] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:04.774238 23175 consensus_peers.cc:597] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:04.812492 23175 consensus_peers.cc:597] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:04.827239 23210 raft_consensus.cc:1275] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer b1f5ee52ad2f442bac6959931126746d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:23:04.829674 23175 consensus_peers.cc:597] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:04.829725 23840 consensus_queue.cc:1048] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:23:04.831135 23249 consensus_peers.cc:597] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:04.869645 23175 consensus_peers.cc:597] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:04.884902 23283 raft_consensus.cc:1275] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 0f0dc6416e1e43ee863a6af614ece6c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.886639 23990 consensus_queue.cc:1048] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.901677 23357 raft_consensus.cc:1275] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Refusing update from remote peer 0f0dc6416e1e43ee863a6af614ece6c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.905182 23996 consensus_queue.cc:1048] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:23:04.907646 23175 consensus_peers.cc:597] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:04.908210 23175 consensus_peers.cc:597] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:04.908715 23175 consensus_peers.cc:597] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:04.943902 23249 consensus_peers.cc:597] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:04.988667 23175 consensus_peers.cc:597] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.002130 23249 consensus_peers.cc:597] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.003964 23175 consensus_peers.cc:597] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.015571 23249 consensus_peers.cc:597] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.021713 23323 consensus_peers.cc:597] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.058269 23323 consensus_peers.cc:597] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.070119 23249 consensus_peers.cc:597] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.094899 23175 consensus_peers.cc:597] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.101173 23323 consensus_peers.cc:597] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.119174 23249 consensus_peers.cc:597] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.161800 23175 consensus_peers.cc:597] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.165778 23249 consensus_peers.cc:597] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.167219 23249 consensus_peers.cc:597] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.249404 23175 consensus_peers.cc:597] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.309656 23175 consensus_peers.cc:597] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.329906 23249 consensus_peers.cc:597] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.407207 23323 consensus_peers.cc:597] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.417932 23249 consensus_peers.cc:597] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.472508 23249 consensus_peers.cc:597] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:05.609737 13122 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 23157)
W20260709 13:23:06.563820 23175 consensus_peers.cc:597] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:06.610538 13122 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 23157)
W20260709 13:23:06.612072 23323 consensus_peers.cc:597] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:06.706439 23323 consensus_peers.cc:597] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:06.789613 23323 consensus_peers.cc:597] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:06.790840 23175 consensus_peers.cc:597] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:06.808709 23175 consensus_peers.cc:597] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:06.825085 23249 consensus_peers.cc:597] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:06.825618 23175 consensus_peers.cc:597] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:06.871371 23323 consensus_peers.cc:597] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:07.013377 23249 consensus_peers.cc:597] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:07.069936 23323 consensus_peers.cc:597] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.118791 23249 consensus_peers.cc:597] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:07.147990 23249 consensus_peers.cc:597] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:07.196789 23175 consensus_peers.cc:597] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:07.213286 23175 consensus_peers.cc:597] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.217698 23175 consensus_peers.cc:597] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.228016 23249 consensus_peers.cc:597] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.230644 23175 consensus_peers.cc:597] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:07.266294 23175 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111) [suppressed 433 similar messages]
W20260709 13:23:07.270746 23175 consensus_peers.cc:597] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.330947 23249 consensus_peers.cc:597] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.342679 23175 consensus_peers.cc:597] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.349855 23249 consensus_peers.cc:597] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.355382 23175 consensus_peers.cc:597] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:07.371942 23175 consensus_peers.cc:597] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.451419 23249 consensus_peers.cc:597] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.458927 23175 consensus_peers.cc:597] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.470417 23249 consensus_peers.cc:597] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.482306 23249 consensus_peers.cc:597] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.493146 23175 consensus_peers.cc:597] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.522769 23323 consensus_peers.cc:597] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.536605 23323 consensus_peers.cc:597] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.544899 23175 consensus_peers.cc:597] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.587957 23175 consensus_peers.cc:597] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.590381 23249 consensus_peers.cc:597] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.598567 23175 consensus_peers.cc:597] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.608075 23249 consensus_peers.cc:597] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.611253 13122 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 23157)
W20260709 13:23:07.641775 23249 consensus_peers.cc:597] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.664047 23175 consensus_peers.cc:597] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.729900 23175 consensus_peers.cc:597] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.755693 23249 consensus_peers.cc:597] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.803946 23249 consensus_peers.cc:597] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.813236 23323 consensus_peers.cc:597] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.814458 23249 consensus_peers.cc:597] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:07.996452 23249 consensus_peers.cc:597] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:08.202994 23323 consensus_peers.cc:597] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:08.629369 13122 tablet_server.cc:196] TabletServer@127.12.208.129:0 shutdown complete.
I20260709 13:23:08.765957 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:08.774302 24035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:08.774506 24036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:08.775965 24038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:08.775995 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:08.779227 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:08.779605 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:08.779906 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603388779882 us; error 0 us; skew 500 ppm
I20260709 13:23:08.780835 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:08.785058 13122 webserver.cc:533] Webserver started at http://127.12.208.129:43773/ using document root <none> and password file <none>
I20260709 13:23:08.785629 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:08.785832 13122 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:23:08.789552 13122 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:23:08.798933 24043 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:08.800824 13122 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:23:08.801614 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-0-root
uuid: "72629382bd4c46b09b2efeaf08c1460d"
format_stamp: "Formatted at 2026-07-09 13:22:49 on dist-test-slave-ll1f"
I20260709 13:23:08.802289 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603003722080-13122-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:08.837884 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:08.839416 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:08.850955 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:08.857822 24050 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:23:09.070633 23323 consensus_peers.cc:597] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:09.097208 23323 consensus_peers.cc:597] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:09.148844 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:23:09.149281 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.293s	user 0.006s	sys 0.005s
I20260709 13:23:09.149663 13122 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:23:09.156920 24050 tablet_bootstrap.cc:492] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.173722 24050 tablet_bootstrap.cc:492] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.174660 24050 tablet_bootstrap.cc:492] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.175377 24050 ts_tablet_manager.cc:1403] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:23:09.178241 24050 raft_consensus.cc:359] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.179298 24050 raft_consensus.cc:740] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.180733 24050 consensus_queue.cc:260] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.184408 24050 ts_tablet_manager.cc:1434] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:23:09.185221 24050 tablet_bootstrap.cc:492] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:09.196175 23175 consensus_peers.cc:597] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:09.203071 24050 tablet_bootstrap.cc:492] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.204135 24050 tablet_bootstrap.cc:492] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.205138 24050 ts_tablet_manager.cc:1403] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 13:23:09.207690 24050 raft_consensus.cc:359] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
W20260709 13:23:09.207827 23175 consensus_peers.cc:597] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:09.208295 24050 raft_consensus.cc:740] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.209015 24050 consensus_queue.cc:260] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.210609 24050 ts_tablet_manager.cc:1434] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:09.211337 24050 tablet_bootstrap.cc:492] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.226912 24050 tablet_bootstrap.cc:492] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.227865 24050 tablet_bootstrap.cc:492] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.228382 24050 ts_tablet_manager.cc:1403] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:23:09.230466 24050 raft_consensus.cc:359] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.230968 24050 raft_consensus.cc:740] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.231599 24050 consensus_queue.cc:260] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.233006 24050 ts_tablet_manager.cc:1434] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:23:09.233609 24050 tablet_bootstrap.cc:492] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.249433 24050 tablet_bootstrap.cc:492] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.251406 24050 tablet_bootstrap.cc:492] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.252070 24050 ts_tablet_manager.cc:1403] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:23:09.254482 24050 raft_consensus.cc:359] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.255165 24050 raft_consensus.cc:740] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.255800 24050 consensus_queue.cc:260] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.257531 24050 ts_tablet_manager.cc:1434] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:23:09.258337 24050 tablet_bootstrap.cc:492] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:09.260135 23323 consensus_peers.cc:597] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:09.282092 24050 tablet_bootstrap.cc:492] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.283181 24050 tablet_bootstrap.cc:492] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.283936 24050 ts_tablet_manager.cc:1403] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:23:09.286581 24050 raft_consensus.cc:359] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.287307 24050 raft_consensus.cc:740] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.288062 24050 consensus_queue.cc:260] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.290289 24050 ts_tablet_manager.cc:1434] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:23:09.291410 24050 tablet_bootstrap.cc:492] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:09.306708 23175 consensus_peers.cc:597] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:09.311421 24050 tablet_bootstrap.cc:492] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.312443 24050 tablet_bootstrap.cc:492] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.313102 24050 ts_tablet_manager.cc:1403] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 13:23:09.315411 24050 raft_consensus.cc:359] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.315995 24050 raft_consensus.cc:740] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.316560 24050 consensus_queue.cc:260] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.317987 24050 ts_tablet_manager.cc:1434] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:09.318856 24050 tablet_bootstrap.cc:492] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.338033 24050 tablet_bootstrap.cc:492] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.338979 24050 tablet_bootstrap.cc:492] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.339673 24050 ts_tablet_manager.cc:1403] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:23:09.342201 24050 raft_consensus.cc:359] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.342886 24050 raft_consensus.cc:740] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.343546 24050 consensus_queue.cc:260] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.345461 24050 ts_tablet_manager.cc:1434] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:23:09.346268 24050 tablet_bootstrap.cc:492] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.361397 24050 tablet_bootstrap.cc:492] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.362362 24050 tablet_bootstrap.cc:492] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.362996 24050 ts_tablet_manager.cc:1403] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:23:09.365662 24050 raft_consensus.cc:359] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.366400 24050 raft_consensus.cc:740] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.367105 24050 consensus_queue.cc:260] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.369045 24050 ts_tablet_manager.cc:1434] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:09.369901 24050 tablet_bootstrap.cc:492] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.385095 24050 tablet_bootstrap.cc:492] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.386072 24050 tablet_bootstrap.cc:492] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.386715 24050 ts_tablet_manager.cc:1403] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:23:09.389109 24050 raft_consensus.cc:359] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.389848 24050 raft_consensus.cc:740] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.390489 24050 consensus_queue.cc:260] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.392663 24050 ts_tablet_manager.cc:1434] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:09.393585 24050 tablet_bootstrap.cc:492] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.410271 24050 tablet_bootstrap.cc:492] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.411254 24050 tablet_bootstrap.cc:492] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.412041 24050 ts_tablet_manager.cc:1403] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:23:09.414037 24050 raft_consensus.cc:359] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.414565 24050 raft_consensus.cc:740] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.415153 24050 consensus_queue.cc:260] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.416762 24050 ts_tablet_manager.cc:1434] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:23:09.417492 24050 tablet_bootstrap.cc:492] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:09.423331 23249 consensus_peers.cc:597] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:09.424101 13122 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:23:09.425251 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.276s	user 0.264s	sys 0.000s
I20260709 13:23:09.436805 24050 tablet_bootstrap.cc:492] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.438052 24050 tablet_bootstrap.cc:492] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.438758 24050 ts_tablet_manager.cc:1403] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:23:09.442456 24050 raft_consensus.cc:359] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.443238 24050 raft_consensus.cc:740] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.444051 24050 consensus_queue.cc:260] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.445607 24050 ts_tablet_manager.cc:1434] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:23:09.446498 24050 tablet_bootstrap.cc:492] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.476392 24050 tablet_bootstrap.cc:492] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.478133 24050 tablet_bootstrap.cc:492] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.478813 24050 ts_tablet_manager.cc:1403] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.008s
I20260709 13:23:09.481365 24050 raft_consensus.cc:359] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.482141 24050 raft_consensus.cc:740] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.482919 24050 consensus_queue.cc:260] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.485316 24050 ts_tablet_manager.cc:1434] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:23:09.490141 23323 consensus_peers.cc:597] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:09.490849 23249 consensus_peers.cc:597] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:09.490439 24050 tablet_bootstrap.cc:492] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.513113 24050 tablet_bootstrap.cc:492] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.514139 24050 tablet_bootstrap.cc:492] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.516743 24050 ts_tablet_manager.cc:1403] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.000s
I20260709 13:23:09.519749 24050 raft_consensus.cc:359] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.520474 24050 raft_consensus.cc:740] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.521232 24050 consensus_queue.cc:260] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.523397 24050 ts_tablet_manager.cc:1434] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:23:09.524207 24050 tablet_bootstrap.cc:492] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.544088 24050 tablet_bootstrap.cc:492] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.545046 24050 tablet_bootstrap.cc:492] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.545682 24050 ts_tablet_manager.cc:1403] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.007s
I20260709 13:23:09.548156 24050 raft_consensus.cc:359] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.548838 24050 raft_consensus.cc:740] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.549525 24050 consensus_queue.cc:260] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.551726 24050 ts_tablet_manager.cc:1434] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:09.552510 24050 tablet_bootstrap.cc:492] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:09.579406 23175 consensus_peers.cc:597] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:09.591020 23323 consensus_peers.cc:597] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:23:09.595444 24050 tablet_bootstrap.cc:492] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.596519 24050 tablet_bootstrap.cc:492] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.597319 24050 ts_tablet_manager.cc:1403] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.028s
I20260709 13:23:09.600983 24050 raft_consensus.cc:359] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.601702 24050 raft_consensus.cc:740] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.602417 24050 consensus_queue.cc:260] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.604696 24050 ts_tablet_manager.cc:1434] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:23:09.605507 24050 tablet_bootstrap.cc:492] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:09.624483 23249 consensus_peers.cc:597] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:09.628997 24050 tablet_bootstrap.cc:492] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.630192 24050 tablet_bootstrap.cc:492] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.630873 24050 ts_tablet_manager.cc:1403] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
W20260709 13:23:09.632539 23249 consensus_peers.cc:597] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:09.633386 24050 raft_consensus.cc:359] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.634212 24050 raft_consensus.cc:740] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.634876 24050 consensus_queue.cc:260] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.636713 24050 ts_tablet_manager.cc:1434] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:09.637534 24050 tablet_bootstrap.cc:492] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.656514 24050 tablet_bootstrap.cc:492] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.657311 24050 tablet_bootstrap.cc:492] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.657939 24050 ts_tablet_manager.cc:1403] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:23:09.659809 24050 raft_consensus.cc:359] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.660457 24050 raft_consensus.cc:740] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.661111 24050 consensus_queue.cc:260] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.662684 24050 ts_tablet_manager.cc:1434] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:23:09.663357 24050 tablet_bootstrap.cc:492] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.663766 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.129:33547
I20260709 13:23:09.663933 24127 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.129:33547 every 8 connection(s)
I20260709 13:23:09.702860 24050 tablet_bootstrap.cc:492] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.703929 24050 tablet_bootstrap.cc:492] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.704643 24050 ts_tablet_manager.cc:1403] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.012s
I20260709 13:23:09.706398 24128 heartbeater.cc:344] Connected to a master server at 127.12.208.190:34953
I20260709 13:23:09.706921 24128 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:09.707520 24050 raft_consensus.cc:359] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.707929 24128 heartbeater.cc:507] Master 127.12.208.190:34953 requested a full tablet report, sending...
I20260709 13:23:09.708290 24050 raft_consensus.cc:740] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.709030 24050 consensus_queue.cc:260] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.711244 24050 ts_tablet_manager.cc:1434] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:09.712126 24050 tablet_bootstrap.cc:492] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.731730 24050 tablet_bootstrap.cc:492] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.732705 24050 tablet_bootstrap.cc:492] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.733392 24050 ts_tablet_manager.cc:1403] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.002s
I20260709 13:23:09.735941 24050 raft_consensus.cc:359] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.736601 24050 raft_consensus.cc:740] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.737213 24050 consensus_queue.cc:260] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.739277 24050 ts_tablet_manager.cc:1434] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:23:09.740698 24050 tablet_bootstrap.cc:492] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.751093 24096 raft_consensus.cc:3060] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.753162 23034 ts_manager.cc:194] Re-registered known tserver with Master: 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
I20260709 13:23:09.759342 24050 tablet_bootstrap.cc:492] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.760447 24050 tablet_bootstrap.cc:492] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.761205 24050 ts_tablet_manager.cc:1403] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.008s
I20260709 13:23:09.763947 24050 raft_consensus.cc:359] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.764648 24050 raft_consensus.cc:740] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.765666 24050 consensus_queue.cc:260] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.767935 24050 ts_tablet_manager.cc:1434] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.004s
I20260709 13:23:09.768781 24050 tablet_bootstrap.cc:492] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:09.780378 23249 consensus_peers.cc:597] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:23:09.793665 24050 tablet_bootstrap.cc:492] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.794560 24050 tablet_bootstrap.cc:492] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.795207 24050 ts_tablet_manager.cc:1403] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 13:23:09.797521 24050 raft_consensus.cc:359] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.798169 24050 raft_consensus.cc:740] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.798806 24050 consensus_queue.cc:260] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.800657 24050 ts_tablet_manager.cc:1434] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:09.801302 24050 tablet_bootstrap.cc:492] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.806939 24096 raft_consensus.cc:3060] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.808915 23034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47682
I20260709 13:23:09.814252 24128 heartbeater.cc:499] Master 127.12.208.190:34953 was elected leader, sending a full tablet report...
I20260709 13:23:09.821651 24050 tablet_bootstrap.cc:492] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.823071 24050 tablet_bootstrap.cc:492] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.824131 24050 ts_tablet_manager.cc:1403] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
W20260709 13:23:09.826386 23175 consensus_peers.cc:597] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:23:09.828245 24050 raft_consensus.cc:359] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.828910 24050 raft_consensus.cc:740] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.829630 24050 consensus_queue.cc:260] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.831718 24050 ts_tablet_manager.cc:1434] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:23:09.832535 24050 tablet_bootstrap.cc:492] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:09.836684 23175 consensus_peers.cc:597] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:23:09.847752 24050 tablet_bootstrap.cc:492] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.848830 24050 tablet_bootstrap.cc:492] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.849581 24050 ts_tablet_manager.cc:1403] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 13:23:09.852305 24050 raft_consensus.cc:359] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.853060 24050 raft_consensus.cc:740] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.853729 24050 consensus_queue.cc:260] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.855885 24050 ts_tablet_manager.cc:1434] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:09.856688 24050 tablet_bootstrap.cc:492] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:09.866060 23175 consensus_peers.cc:597] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:09.872408 24050 tablet_bootstrap.cc:492] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.873371 24050 tablet_bootstrap.cc:492] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.874037 24050 ts_tablet_manager.cc:1403] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:23:09.876174 24050 raft_consensus.cc:359] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.876839 24050 raft_consensus.cc:740] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.877492 24050 consensus_queue.cc:260] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:09.879531 24050 ts_tablet_manager.cc:1434] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:09.880379 24050 tablet_bootstrap.cc:492] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:09.893477 23175 consensus_peers.cc:597] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:23:09.895925 24050 tablet_bootstrap.cc:492] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.896952 24050 tablet_bootstrap.cc:492] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.897629 24050 ts_tablet_manager.cc:1403] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:23:09.900355 24050 raft_consensus.cc:359] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.901007 24050 raft_consensus.cc:740] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.901685 24050 consensus_queue.cc:260] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:09.904058 24050 ts_tablet_manager.cc:1434] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:09.904923 24050 tablet_bootstrap.cc:492] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:09.907662 24097 raft_consensus.cc:3060] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:09.925859 23175 consensus_peers.cc:597] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:23:09.926954 24050 tablet_bootstrap.cc:492] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.928013 24050 tablet_bootstrap.cc:492] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.928678 24050 ts_tablet_manager.cc:1403] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 13:23:09.932144 24096 raft_consensus.cc:3060] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:09.931597 24050 raft_consensus.cc:359] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.936070 24050 raft_consensus.cc:740] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.936864 24050 consensus_queue.cc:260] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.938446 24050 ts_tablet_manager.cc:1434] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:23:09.939745 24050 tablet_bootstrap.cc:492] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:09.949425 23175 consensus_peers.cc:597] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:09.973007 24050 tablet_bootstrap.cc:492] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:09.974301 24050 tablet_bootstrap.cc:492] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:09.975073 24050 ts_tablet_manager.cc:1403] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.008s
I20260709 13:23:09.977962 24050 raft_consensus.cc:359] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.978720 24050 raft_consensus.cc:740] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:09.979475 24050 consensus_queue.cc:260] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:09.981884 24050 ts_tablet_manager.cc:1434] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:09.982791 24050 tablet_bootstrap.cc:492] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.000213 24097 raft_consensus.cc:3060] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:10.004763 24050 tablet_bootstrap.cc:492] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.005972 24050 tablet_bootstrap.cc:492] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.006680 24050 ts_tablet_manager.cc:1403] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:23:10.009411 24050 raft_consensus.cc:359] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.010198 24050 raft_consensus.cc:740] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.010835 24050 consensus_queue.cc:260] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.012883 24050 ts_tablet_manager.cc:1434] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:10.013731 24050 tablet_bootstrap.cc:492] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.041863 24050 tablet_bootstrap.cc:492] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.043344 24050 tablet_bootstrap.cc:492] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.044160 24050 ts_tablet_manager.cc:1403] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 13:23:10.047024 24050 raft_consensus.cc:359] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:10.047799 24050 raft_consensus.cc:740] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.048542 24050 consensus_queue.cc:260] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:10.051288 24050 ts_tablet_manager.cc:1434] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:23:10.053472 24097 raft_consensus.cc:3060] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:10.059329 24050 tablet_bootstrap.cc:492] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.072057 24095 raft_consensus.cc:3060] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:10.073117 23249 consensus_peers.cc:597] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:23:10.080679 24050 tablet_bootstrap.cc:492] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.082356 24050 tablet_bootstrap.cc:492] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.083173 24050 ts_tablet_manager.cc:1403] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.002s
I20260709 13:23:10.086351 24050 raft_consensus.cc:359] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.087064 24050 raft_consensus.cc:740] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.091513 24097 raft_consensus.cc:3060] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:10.087786 24050 consensus_queue.cc:260] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.097397 24050 ts_tablet_manager.cc:1434] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:23:10.098431 24050 tablet_bootstrap.cc:492] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:10.099817 23175 consensus_peers.cc:597] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:23:10.115731 24096 raft_consensus.cc:3060] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:10.183151 23176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 48283.2us
I20260709 13:23:10.188848 24050 tablet_bootstrap.cc:492] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.189951 24050 tablet_bootstrap.cc:492] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.190644 24050 ts_tablet_manager.cc:1403] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.092s	user 0.026s	sys 0.035s
I20260709 13:23:10.194728 24050 raft_consensus.cc:359] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.199914 24050 raft_consensus.cc:740] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.203549 24050 consensus_queue.cc:260] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.205610 24050 ts_tablet_manager.cc:1434] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:23:10.206449 24050 tablet_bootstrap.cc:492] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:10.274255 23323 consensus_peers.cc:597] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:23:10.277756 24095 raft_consensus.cc:3060] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:10.300406 24050 tablet_bootstrap.cc:492] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.301512 24050 tablet_bootstrap.cc:492] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.302232 24050 ts_tablet_manager.cc:1403] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.006s
I20260709 13:23:10.305023 24050 raft_consensus.cc:359] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.305729 24050 raft_consensus.cc:740] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.306574 24050 consensus_queue.cc:260] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.308745 24050 ts_tablet_manager.cc:1434] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:10.309605 24050 tablet_bootstrap.cc:492] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.323154 24050 tablet_bootstrap.cc:492] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.323982 24050 tablet_bootstrap.cc:492] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.324719 24050 ts_tablet_manager.cc:1403] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:23:10.327271 24050 raft_consensus.cc:359] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.328022 24050 raft_consensus.cc:740] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.328694 24050 consensus_queue.cc:260] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.330806 24050 ts_tablet_manager.cc:1434] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:10.331645 24050 tablet_bootstrap.cc:492] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
W20260709 13:23:10.344739 23175 consensus_peers.cc:597] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:23:10.349639 24050 tablet_bootstrap.cc:492] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.350634 24050 tablet_bootstrap.cc:492] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.351289 24050 ts_tablet_manager.cc:1403] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:23:10.353694 24050 raft_consensus.cc:359] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.354362 24050 raft_consensus.cc:740] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.354976 24050 consensus_queue.cc:260] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.356916 24050 ts_tablet_manager.cc:1434] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:10.358220 24050 tablet_bootstrap.cc:492] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.382254 24050 tablet_bootstrap.cc:492] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.383286 24050 tablet_bootstrap.cc:492] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.384322 24050 ts_tablet_manager.cc:1403] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.007s
I20260709 13:23:10.387171 24050 raft_consensus.cc:359] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:10.388084 24050 raft_consensus.cc:740] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.388789 24050 consensus_queue.cc:260] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:10.391348 24050 ts_tablet_manager.cc:1434] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:23:10.392163 24050 tablet_bootstrap.cc:492] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.412701 24050 tablet_bootstrap.cc:492] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.413717 24050 tablet_bootstrap.cc:492] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.414424 24050 ts_tablet_manager.cc:1403] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 13:23:10.416786 24050 raft_consensus.cc:359] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.417448 24050 raft_consensus.cc:740] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.418174 24050 consensus_queue.cc:260] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.420161 24050 ts_tablet_manager.cc:1434] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:10.421444 24050 tablet_bootstrap.cc:492] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.442243 24050 tablet_bootstrap.cc:492] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.443171 24050 tablet_bootstrap.cc:492] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.443902 24050 ts_tablet_manager.cc:1403] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 13:23:10.446563 24050 raft_consensus.cc:359] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.447273 24050 raft_consensus.cc:740] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.447927 24050 consensus_queue.cc:260] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.449990 24050 ts_tablet_manager.cc:1434] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:10.450809 24050 tablet_bootstrap.cc:492] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.468972 24050 tablet_bootstrap.cc:492] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.469906 24050 tablet_bootstrap.cc:492] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.470489 24050 ts_tablet_manager.cc:1403] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:23:10.472930 24050 raft_consensus.cc:359] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.473608 24050 raft_consensus.cc:740] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.474428 24050 consensus_queue.cc:260] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.476538 24050 ts_tablet_manager.cc:1434] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:10.477774 24050 tablet_bootstrap.cc:492] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.493903 24050 tablet_bootstrap.cc:492] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.494686 24050 tablet_bootstrap.cc:492] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.495347 24050 ts_tablet_manager.cc:1403] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:23:10.497334 24050 raft_consensus.cc:359] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.497838 24050 raft_consensus.cc:740] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.498438 24050 consensus_queue.cc:260] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.500087 24050 ts_tablet_manager.cc:1434] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:23:10.501243 24050 tablet_bootstrap.cc:492] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.529503 24050 tablet_bootstrap.cc:492] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.531009 24050 tablet_bootstrap.cc:492] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.531715 24050 ts_tablet_manager.cc:1403] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.007s
I20260709 13:23:10.534888 24050 raft_consensus.cc:359] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.535589 24050 raft_consensus.cc:740] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.536268 24050 consensus_queue.cc:260] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.536943 24098 raft_consensus.cc:3060] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:10.538518 24050 ts_tablet_manager.cc:1434] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:23:10.539803 24050 tablet_bootstrap.cc:492] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.592727 24050 tablet_bootstrap.cc:492] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.593525 24050 tablet_bootstrap.cc:492] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.594147 24050 ts_tablet_manager.cc:1403] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.012s
I20260709 13:23:10.596410 24050 raft_consensus.cc:359] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.597060 24050 raft_consensus.cc:740] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.597813 24050 consensus_queue.cc:260] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.599570 24050 ts_tablet_manager.cc:1434] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:10.601001 24050 tablet_bootstrap.cc:492] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.613435 24050 tablet_bootstrap.cc:492] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.614399 24050 tablet_bootstrap.cc:492] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.615094 24050 ts_tablet_manager.cc:1403] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:23:10.617583 24050 raft_consensus.cc:359] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:10.618532 24050 raft_consensus.cc:740] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.619277 24050 consensus_queue.cc:260] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:10.621376 24050 ts_tablet_manager.cc:1434] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:23:10.622558 24050 tablet_bootstrap.cc:492] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.641966 24050 tablet_bootstrap.cc:492] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.642980 24050 tablet_bootstrap.cc:492] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.643672 24050 ts_tablet_manager.cc:1403] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.001s
I20260709 13:23:10.646256 24050 raft_consensus.cc:359] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.647073 24050 raft_consensus.cc:740] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.647768 24050 consensus_queue.cc:260] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:10.649914 24050 ts_tablet_manager.cc:1434] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:10.650902 24050 tablet_bootstrap.cc:492] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.671598 24050 tablet_bootstrap.cc:492] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.672622 24050 tablet_bootstrap.cc:492] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.673379 24050 ts_tablet_manager.cc:1403] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:23:10.675998 24050 raft_consensus.cc:359] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:10.676723 24050 raft_consensus.cc:740] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.677456 24050 consensus_queue.cc:260] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:10.679057 24050 ts_tablet_manager.cc:1434] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:23:10.679863 24050 tablet_bootstrap.cc:492] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap starting.
I20260709 13:23:10.699352 24050 tablet_bootstrap.cc:492] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:10.700387 24050 tablet_bootstrap.cc:492] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d: Bootstrap complete.
I20260709 13:23:10.701050 24050 ts_tablet_manager.cc:1403] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:23:10.703621 24050 raft_consensus.cc:359] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.704360 24050 raft_consensus.cc:740] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Initialized, Role: FOLLOWER
I20260709 13:23:10.705031 24050 consensus_queue.cc:260] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:10.707255 24050 ts_tablet_manager.cc:1434] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:10.785252 24098 raft_consensus.cc:3060] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:10.814096 24096 raft_consensus.cc:3060] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:10.896478 24095 raft_consensus.cc:3060] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:10.935487 24095 raft_consensus.cc:3060] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:16.676335 23323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:34617, user_credentials={real_user=slave}} blocked reactor thread for 45015.5us
W20260709 13:23:16.738672 23176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 47434.4us
W20260709 13:23:16.796299 23174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:38439, user_credentials={real_user=slave}} blocked reactor thread for 76932us
W20260709 13:23:16.815637 23250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.132:34331, user_credentials={real_user=slave}} blocked reactor thread for 56980.5us
I20260709 13:23:19.669101 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:19.732630 23210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "006dd6ad5ee14da39d65b4a6f97b32a4"
dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:23:19.733397 23210 raft_consensus.cc:606] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:19.763340 23283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0"
dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:47938
I20260709 13:23:19.764003 23283 raft_consensus.cc:606] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:19.766713 23210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56"
dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:23:19.767331 23210 raft_consensus.cc:606] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:19.770319 23205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7"
dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:23:19.770975 23205 raft_consensus.cc:606] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:19.774935 23205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3"
dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:23:19.775534 23205 raft_consensus.cc:606] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:19.778797 23205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3b9027733f4b1c9800874f86d1b054"
dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:23:19.779453 23205 raft_consensus.cc:606] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:19.780834 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:23:19.782136 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:19.813635 24226 raft_consensus.cc:993] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:19.814368 24226 raft_consensus.cc:1081] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:19.816373 24095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:23:19.817039 24095 raft_consensus.cc:493] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:19.817462 24095 raft_consensus.cc:3060] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:19.831485 24095 raft_consensus.cc:515] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:19.836098 24095 leader_election.cc:290] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:19.849923 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:19.850525 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "283ea57ae7df4e8aab22865b9922ad56" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:19.850734 23210 raft_consensus.cc:3055] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:19.851239 23357 raft_consensus.cc:3060] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:19.851226 23210 raft_consensus.cc:740] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:19.852346 23210 consensus_queue.cc:260] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:19.853566 23210 raft_consensus.cc:3060] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:19.860486 23357 raft_consensus.cc:2468] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:19.860945 23210 raft_consensus.cc:2468] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:19.862142 24046 leader_election.cc:304] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:19.864238 24232 raft_consensus.cc:2804] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:19.865628 24232 raft_consensus.cc:697] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:19.866919 24232 consensus_queue.cc:237] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:19.878327 23033 catalog_manager.cc:5697] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 2 to 3, leader changed from 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 3 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:19.886263 24228 raft_consensus.cc:993] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:19.887044 24189 raft_consensus.cc:1081] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:19.888517 24095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51958
I20260709 13:23:19.888998 24095 raft_consensus.cc:493] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:19.889329 24095 raft_consensus.cc:3060] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:19.897977 24095 raft_consensus.cc:515] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:19.901351 24095 leader_election.cc:290] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:23:19.901973 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:19.902654 23356 raft_consensus.cc:3060] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:19.909264 23356 raft_consensus.cc:2468] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:19.909302 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076db0f4793e437cbb23e56b1f75f2d0" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:19.910045 23281 raft_consensus.cc:3055] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:19.910379 23281 raft_consensus.cc:740] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:19.910550 24046 leader_election.cc:304] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:19.911037 23281 consensus_queue.cc:260] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:19.911505 24232 raft_consensus.cc:2804] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:19.912061 24232 raft_consensus.cc:697] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:19.912274 23281 raft_consensus.cc:3060] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:19.912931 24232 consensus_queue.cc:237] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:19.919179 23281 raft_consensus.cc:2468] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:19.923739 23033 catalog_manager.cc:5697] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 2 to 3, leader changed from b1f5ee52ad2f442bac6959931126746d (127.12.208.131) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 3 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:19.939796 24215 raft_consensus.cc:993] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:19.940337 24226 raft_consensus.cc:1081] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:19.941751 24095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3b9027733f4b1c9800874f86d1b054"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:23:19.942251 24095 raft_consensus.cc:493] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:19.942481 24095 raft_consensus.cc:3060] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.947237 24095 raft_consensus.cc:515] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:19.948709 24095 leader_election.cc:290] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:19.949632 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3b9027733f4b1c9800874f86d1b054" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:19.949689 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3b9027733f4b1c9800874f86d1b054" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:19.950363 23210 raft_consensus.cc:3055] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:19.950421 23281 raft_consensus.cc:3060] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.950755 23210 raft_consensus.cc:740] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:19.951473 23210 consensus_queue.cc:260] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:19.952456 23210 raft_consensus.cc:3060] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.955714 23281 raft_consensus.cc:2468] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:19.956979 24044 leader_election.cc:304] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:19.957590 23210 raft_consensus.cc:2468] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:19.957690 24232 raft_consensus.cc:2804] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:19.958356 24232 raft_consensus.cc:697] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:19.959237 24232 consensus_queue.cc:237] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:19.972095 23033 catalog_manager.cc:5697] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 1 to 2, leader changed from 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 2 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:19.982196 24218 raft_consensus.cc:993] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:19.982681 24226 raft_consensus.cc:1081] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:19.984208 24095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "006dd6ad5ee14da39d65b4a6f97b32a4"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:23:19.984745 24095 raft_consensus.cc:493] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:19.985164 24095 raft_consensus.cc:3060] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.991302 24095 raft_consensus.cc:515] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:19.993278 24095 leader_election.cc:290] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:19.994608 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006dd6ad5ee14da39d65b4a6f97b32a4" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:19.995376 23356 raft_consensus.cc:3060] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:19.995945 23205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006dd6ad5ee14da39d65b4a6f97b32a4" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:19.996905 23205 raft_consensus.cc:3055] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:19.997210 23205 raft_consensus.cc:740] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:19.998188 23205 consensus_queue.cc:260] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:19.999610 23205 raft_consensus.cc:3060] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:20.003394 23356 raft_consensus.cc:2468] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:20.007272 23205 raft_consensus.cc:2468] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:20.008581 24045 leader_election.cc:304] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:20.009850 24232 raft_consensus.cc:2804] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:20.010396 24232 raft_consensus.cc:697] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:20.011260 24232 consensus_queue.cc:237] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:20.013136 24215 raft_consensus.cc:993] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:20.013674 24218 raft_consensus.cc:1081] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:20.022581 24095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:23:20.023102 24095 raft_consensus.cc:493] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:20.023418 24095 raft_consensus.cc:3060] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:20.028792 23033 catalog_manager.cc:5697] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 1 to 2, leader changed from 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 2 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:20.029670 24095 raft_consensus.cc:515] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:20.031745 24095 leader_election.cc:290] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:20.032797 23205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:20.033449 23205 raft_consensus.cc:3055] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:20.033659 23205 raft_consensus.cc:740] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:20.034417 23205 consensus_queue.cc:260] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:20.035563 23205 raft_consensus.cc:3060] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:20.035655 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550e909e22344eeda8dddcbefde935c7" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:20.038160 23281 raft_consensus.cc:3060] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:20.044814 23281 raft_consensus.cc:2468] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:20.044865 23205 raft_consensus.cc:2468] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:20.046033 24045 leader_election.cc:304] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:20.046869 24232 raft_consensus.cc:2804] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:20.047382 24232 raft_consensus.cc:697] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:20.048269 24232 consensus_queue.cc:237] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:20.057960 23033 catalog_manager.cc:5697] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 2 to 3, leader changed from 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 3 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:20.379088 24226 raft_consensus.cc:993] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:20.379616 24215 raft_consensus.cc:1081] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:20.381102 24096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:23:20.381642 24096 raft_consensus.cc:493] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:20.383164 24096 raft_consensus.cc:3060] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:20.386610 23357 raft_consensus.cc:1275] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:20.388010 24232 consensus_queue.cc:1048] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:20.390780 24096 raft_consensus.cc:515] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:20.392779 24096 leader_election.cc:290] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:20.393801 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:20.394434 23283 raft_consensus.cc:3060] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:20.398379 23205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db75cc4c217c4476bcc60a4f91750ed3" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:20.399308 23205 raft_consensus.cc:3055] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:20.399770 23205 raft_consensus.cc:740] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:20.402661 23356 raft_consensus.cc:1275] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:20.403240 23283 raft_consensus.cc:2468] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:20.404620 24232 consensus_queue.cc:1048] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:20.407099 24044 leader_election.cc:304] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:20.408126 24232 raft_consensus.cc:2804] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:20.409489 23283 raft_consensus.cc:1275] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:20.400980 23205 consensus_queue.cc:260] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:20.412880 23205 raft_consensus.cc:3060] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:20.416553 24244 consensus_queue.cc:1048] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:23:20.422473 23210 raft_consensus.cc:1275] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:20.424290 24232 raft_consensus.cc:697] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:20.425539 24232 consensus_queue.cc:237] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:20.424753 24247 consensus_queue.cc:1048] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:23:20.436393 23209 raft_consensus.cc:1275] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:20.439783 24244 consensus_queue.cc:1048] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:23:20.448402 23209 raft_consensus.cc:1275] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:20.462543 23208 raft_consensus.cc:1275] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:20.460619 24247 consensus_queue.cc:1048] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:23:20.466343 23356 raft_consensus.cc:1275] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:20.478598 24247 consensus_queue.cc:1048] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:20.482336 24247 consensus_queue.cc:1048] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:20.495704 23027 catalog_manager.cc:5697] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 2 to 3, leader changed from 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 3 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:20.456590 23205 raft_consensus.cc:2468] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:20.508898 23283 raft_consensus.cc:1275] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:20.513804 24233 consensus_queue.cc:1048] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:20.518059 23281 raft_consensus.cc:1275] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:20.528086 24244 consensus_queue.cc:1048] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:20.783396 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:20.823836 23281 raft_consensus.cc:1275] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:20.825176 24244 consensus_queue.cc:1048] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:20.827041 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:20.851306 23208 raft_consensus.cc:1275] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:20.854610 24244 consensus_queue.cc:1048] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:20.885313 23281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d430d760648423c8b3c2e0861c6bfcf"
dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
mode: GRACEFUL
new_leader_uuid: "28222c0dd7a1411692efad3387118115"
 from {username='slave'} at 127.0.0.1:47938
I20260709 13:23:20.885960 23281 raft_consensus.cc:606] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Received request to transfer leadership to TS 28222c0dd7a1411692efad3387118115
I20260709 13:23:20.890944 23208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4"
dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:23:20.891628 23208 raft_consensus.cc:606] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:20.894286 23281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d41e7244bf04a4c8c6d02911a829766"
dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
mode: GRACEFUL
new_leader_uuid: "28222c0dd7a1411692efad3387118115"
 from {username='slave'} at 127.0.0.1:47938
I20260709 13:23:20.894876 23281 raft_consensus.cc:606] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Received request to transfer leadership to TS 28222c0dd7a1411692efad3387118115
I20260709 13:23:20.897603 23208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e74c84af241495bb52d0ecfd1cce7ff"
dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
mode: GRACEFUL
new_leader_uuid: "28222c0dd7a1411692efad3387118115"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:23:20.898160 23208 raft_consensus.cc:606] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Received request to transfer leadership to TS 28222c0dd7a1411692efad3387118115
I20260709 13:23:20.901307 23208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a"
dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:40602
I20260709 13:23:20.901891 23208 raft_consensus.cc:606] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:20.903033 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:23:20.904886 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:21.073226 24226 raft_consensus.cc:993] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:21.073705 24215 raft_consensus.cc:1081] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:21.075141 24095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:23:21.075601 24095 raft_consensus.cc:493] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:21.075896 24095 raft_consensus.cc:3060] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:21.084273 24215 raft_consensus.cc:993] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:21.084873 24226 raft_consensus.cc:1081] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:21.086313 24095 raft_consensus.cc:515] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:21.088243 24095 leader_election.cc:290] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:21.089877 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:21.090420 23283 raft_consensus.cc:3060] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:21.094141 24097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:23:21.094761 24097 raft_consensus.cc:493] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:21.095129 24097 raft_consensus.cc:3060] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.097378 23283 raft_consensus.cc:2468] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:21.098634 24044 leader_election.cc:304] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:21.099562 24247 raft_consensus.cc:2804] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:21.100066 24247 raft_consensus.cc:697] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:21.100910 24247 consensus_queue.cc:237] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:21.102442 24097 raft_consensus.cc:515] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:21.104718 24097 leader_election.cc:290] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Requested vote from peers 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331), 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617)
I20260709 13:23:21.105410 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:21.106120 23356 raft_consensus.cc:3060] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.099417 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5a1889477743c5844083786cef2ef4" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:21.106732 23208 raft_consensus.cc:3055] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:21.107050 23208 raft_consensus.cc:740] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:21.107658 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad073f97fcad4d19bc9e16ecd3235c2a" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:21.108289 23209 raft_consensus.cc:3055] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:21.107952 23208 consensus_queue.cc:260] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:21.108593 23209 raft_consensus.cc:740] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:21.109484 23209 consensus_queue.cc:260] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:21.110212 23208 raft_consensus.cc:3060] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:21.110711 23209 raft_consensus.cc:3060] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.116644 23356 raft_consensus.cc:2468] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:21.121114 24046 leader_election.cc:304] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:21.122078 24244 raft_consensus.cc:2804] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:21.122613 24244 raft_consensus.cc:697] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:21.123685 23209 raft_consensus.cc:2468] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:21.123562 24244 consensus_queue.cc:237] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } }
I20260709 13:23:21.127239 23208 raft_consensus.cc:2468] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:21.134485 23027 catalog_manager.cc:5697] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 2 to 3, leader changed from 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 3 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:21.163808 23027 catalog_manager.cc:5697] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 1 to 2, leader changed from 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 2 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:21.218294 24228 raft_consensus.cc:993] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d: : Instructing follower 28222c0dd7a1411692efad3387118115 to start an election
I20260709 13:23:21.218735 24189 raft_consensus.cc:1081] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Signalling peer 28222c0dd7a1411692efad3387118115 to start an election
I20260709 13:23:21.220212 23357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d430d760648423c8b3c2e0861c6bfcf"
dest_uuid: "28222c0dd7a1411692efad3387118115"
 from {username='slave'} at 127.0.0.1:59862
I20260709 13:23:21.220752 23357 raft_consensus.cc:493] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:21.221086 23357 raft_consensus.cc:3060] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.228411 23357 raft_consensus.cc:515] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:21.230387 23357 leader_election.cc:290] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:21.231447 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d430d760648423c8b3c2e0861c6bfcf" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:21.231700 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d430d760648423c8b3c2e0861c6bfcf" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:21.232251 23283 raft_consensus.cc:3055] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:21.232326 23208 raft_consensus.cc:3060] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.232743 23283 raft_consensus.cc:740] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:21.233703 23283 consensus_queue.cc:260] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:21.235219 23283 raft_consensus.cc:3060] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.239440 23208 raft_consensus.cc:2468] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:21.240624 23323 leader_election.cc:304] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:23:21.240788 23283 raft_consensus.cc:2468] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:21.241482 24222 raft_consensus.cc:2804] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:21.242033 24222 raft_consensus.cc:697] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:23:21.242877 24222 consensus_queue.cc:237] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:21.252678 23027 catalog_manager.cc:5697] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 1 to 2, leader changed from b1f5ee52ad2f442bac6959931126746d (127.12.208.131) to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 2 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:21.366799 24218 raft_consensus.cc:993] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0: : Instructing follower 28222c0dd7a1411692efad3387118115 to start an election
I20260709 13:23:21.367337 24226 raft_consensus.cc:1081] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Signalling peer 28222c0dd7a1411692efad3387118115 to start an election
I20260709 13:23:21.369081 23357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e74c84af241495bb52d0ecfd1cce7ff"
dest_uuid: "28222c0dd7a1411692efad3387118115"
 from {username='slave'} at 127.0.0.1:59868
I20260709 13:23:21.369710 23357 raft_consensus.cc:493] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:21.370122 23357 raft_consensus.cc:3060] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.375396 23357 raft_consensus.cc:515] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:21.377731 23357 leader_election.cc:290] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:21.378264 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e74c84af241495bb52d0ecfd1cce7ff" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:21.377975 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e74c84af241495bb52d0ecfd1cce7ff" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:21.378925 23283 raft_consensus.cc:3060] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.379068 23208 raft_consensus.cc:3055] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:21.379429 23208 raft_consensus.cc:740] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f0dc6416e1e43ee863a6af614ece6c0, State: Running, Role: LEADER
I20260709 13:23:21.380196 23208 consensus_queue.cc:260] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:21.381420 23208 raft_consensus.cc:3060] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.386004 23283 raft_consensus.cc:2468] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:21.388501 23322 leader_election.cc:304] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:21.389369 24222 raft_consensus.cc:2804] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:21.389881 24222 raft_consensus.cc:697] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:23:21.390854 23208 raft_consensus.cc:2468] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:21.391532 24222 consensus_queue.cc:237] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:21.401253 24189 raft_consensus.cc:993] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d: : Instructing follower 28222c0dd7a1411692efad3387118115 to start an election
I20260709 13:23:21.402287 24228 raft_consensus.cc:1081] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Signalling peer 28222c0dd7a1411692efad3387118115 to start an election
I20260709 13:23:21.404363 23357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d41e7244bf04a4c8c6d02911a829766"
dest_uuid: "28222c0dd7a1411692efad3387118115"
 from {username='slave'} at 127.0.0.1:59862
I20260709 13:23:21.405193 23357 raft_consensus.cc:493] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:21.404337 23027 catalog_manager.cc:5697] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 1 to 2, leader changed from 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130) to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 2 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:21.405540 23357 raft_consensus.cc:3060] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.414095 23357 raft_consensus.cc:515] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:21.417145 23209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d41e7244bf04a4c8c6d02911a829766" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:21.422036 23357 leader_election.cc:290] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:21.418001 23209 raft_consensus.cc:3060] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.429286 23283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d41e7244bf04a4c8c6d02911a829766" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:21.429919 23283 raft_consensus.cc:3055] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:21.430315 23283 raft_consensus.cc:740] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:21.431267 23283 consensus_queue.cc:260] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:21.433154 23283 raft_consensus.cc:3060] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:21.433531 23209 raft_consensus.cc:2468] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:21.434734 23323 leader_election.cc:304] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 28222c0dd7a1411692efad3387118115; no voters: 
I20260709 13:23:21.435750 24222 raft_consensus.cc:2804] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:21.436236 24222 raft_consensus.cc:697] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:23:21.437147 24222 consensus_queue.cc:237] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:21.444402 23283 raft_consensus.cc:2468] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:21.462023 23027 catalog_manager.cc:5697] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 1 to 2, leader changed from b1f5ee52ad2f442bac6959931126746d (127.12.208.131) to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 2 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:21.500670 23209 raft_consensus.cc:1275] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:21.502066 24244 consensus_queue.cc:1048] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:21.503871 23209 raft_consensus.cc:1275] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:21.506172 24244 consensus_queue.cc:1048] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:21.519526 23357 raft_consensus.cc:1275] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:21.522192 24233 consensus_queue.cc:1048] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:21.535633 23283 raft_consensus.cc:1275] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:21.537539 24279 consensus_queue.cc:1048] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:21.689601 23283 raft_consensus.cc:1275] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:21.691352 24272 consensus_queue.cc:1048] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:21.702232 23209 raft_consensus.cc:1275] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:21.704571 24186 consensus_queue.cc:1048] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:21.835970 23209 raft_consensus.cc:1275] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:21.837262 24222 consensus_queue.cc:1048] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:21.847530 23283 raft_consensus.cc:1275] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:21.849370 24288 consensus_queue.cc:1048] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:21.906009 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:21.908195 23283 raft_consensus.cc:1275] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:21.911542 24288 consensus_queue.cc:1048] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:21.922871 23209 raft_consensus.cc:1275] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:21.924729 24186 consensus_queue.cc:1048] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:21.974481 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:22.023372 23281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41"
dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
mode: GRACEFUL
new_leader_uuid: "28222c0dd7a1411692efad3387118115"
 from {username='slave'} at 127.0.0.1:47938
I20260709 13:23:22.024065 23281 raft_consensus.cc:606] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Received request to transfer leadership to TS 28222c0dd7a1411692efad3387118115
I20260709 13:23:22.028167 23283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24160013ee8743f88e93c264fde917b3"
dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:47938
I20260709 13:23:22.028818 23283 raft_consensus.cc:606] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:22.031556 23281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846"
dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:47938
I20260709 13:23:22.032121 23281 raft_consensus.cc:606] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:22.035404 23281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c"
dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:47938
I20260709 13:23:22.036005 23281 raft_consensus.cc:606] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:22.038260 23281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6fd3cdd94174b018ebe04f44a1cc4fb"
dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:47938
I20260709 13:23:22.038791 23281 raft_consensus.cc:606] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:22.039764 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:23:22.040931 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:22.202694 24274 raft_consensus.cc:993] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:22.203305 24274 raft_consensus.cc:1081] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:22.204942 24097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51958
I20260709 13:23:22.205510 24097 raft_consensus.cc:493] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:22.205967 24097 raft_consensus.cc:3060] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.211391 24097 raft_consensus.cc:515] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:22.213655 24097 leader_election.cc:290] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:23:22.214176 23357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:22.214814 23357 raft_consensus.cc:3060] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.214892 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e7ed81a129474a91e895ef75e45846" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:22.215538 23281 raft_consensus.cc:3055] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:22.215894 23281 raft_consensus.cc:740] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:22.216621 23281 consensus_queue.cc:260] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:22.217512 23281 raft_consensus.cc:3060] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.220216 23357 raft_consensus.cc:2468] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:22.221412 24046 leader_election.cc:304] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:22.222214 24279 raft_consensus.cc:2804] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:22.222486 23281 raft_consensus.cc:2468] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:22.222721 24279 raft_consensus.cc:697] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:22.223747 24279 consensus_queue.cc:237] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:22.234839 23033 catalog_manager.cc:5697] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 1 to 2, leader changed from b1f5ee52ad2f442bac6959931126746d (127.12.208.131) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 2 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:22.399430 24274 raft_consensus.cc:993] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:22.399991 24189 raft_consensus.cc:1081] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:22.401629 24097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24160013ee8743f88e93c264fde917b3"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51958
I20260709 13:23:22.402242 24097 raft_consensus.cc:493] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:22.402626 24097 raft_consensus.cc:3060] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.408818 24097 raft_consensus.cc:515] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:22.412657 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24160013ee8743f88e93c264fde917b3" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:22.413281 23208 raft_consensus.cc:3060] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.418532 24097 leader_election.cc:290] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:22.419991 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24160013ee8743f88e93c264fde917b3" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:22.420634 23281 raft_consensus.cc:3055] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:22.420919 23281 raft_consensus.cc:740] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:22.421664 23281 consensus_queue.cc:260] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:22.423013 23281 raft_consensus.cc:3060] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.426703 23208 raft_consensus.cc:2468] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:22.428061 24045 leader_election.cc:304] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:22.428978 24280 raft_consensus.cc:2804] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:22.429431 24280 raft_consensus.cc:697] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:22.430336 24280 consensus_queue.cc:237] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:22.440019 23281 raft_consensus.cc:2468] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:22.445236 23033 catalog_manager.cc:5697] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 1 to 2, leader changed from b1f5ee52ad2f442bac6959931126746d (127.12.208.131) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 2 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:22.494997 24228 raft_consensus.cc:993] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:22.495857 24274 raft_consensus.cc:1081] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:22.497509 24097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6fd3cdd94174b018ebe04f44a1cc4fb"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51958
I20260709 13:23:22.498216 24097 raft_consensus.cc:493] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:22.498885 24097 raft_consensus.cc:3060] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.506011 24097 raft_consensus.cc:515] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:22.508285 24097 leader_election.cc:290] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:23:22.509334 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3cdd94174b018ebe04f44a1cc4fb" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:22.509981 23356 raft_consensus.cc:3060] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.512324 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3cdd94174b018ebe04f44a1cc4fb" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:22.512977 23281 raft_consensus.cc:3055] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:22.513262 23281 raft_consensus.cc:740] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:22.514070 23281 consensus_queue.cc:260] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:22.515666 23281 raft_consensus.cc:3060] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.522085 24228 raft_consensus.cc:993] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d: : Instructing follower 28222c0dd7a1411692efad3387118115 to start an election
I20260709 13:23:22.522533 23356 raft_consensus.cc:2468] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:22.522671 24274 raft_consensus.cc:1081] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Signalling peer 28222c0dd7a1411692efad3387118115 to start an election
I20260709 13:23:22.522533 23281 raft_consensus.cc:2468] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:22.524055 24046 leader_election.cc:304] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:22.524775 24280 raft_consensus.cc:2804] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:22.525290 24280 raft_consensus.cc:697] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:22.526592 23356 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41"
dest_uuid: "28222c0dd7a1411692efad3387118115"
 from {username='slave'} at 127.0.0.1:59862
I20260709 13:23:22.526289 24280 consensus_queue.cc:237] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:22.527153 23356 raft_consensus.cc:493] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:22.527525 23356 raft_consensus.cc:3060] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.535275 23356 raft_consensus.cc:515] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:22.537367 23356 leader_election.cc:290] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:22.538542 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:22.537966 23033 catalog_manager.cc:5697] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 1 to 2, leader changed from b1f5ee52ad2f442bac6959931126746d (127.12.208.131) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 2 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:22.539064 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17a57dd75f694365ba2ab18b8b2cbe41" candidate_uuid: "28222c0dd7a1411692efad3387118115" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:22.539152 23208 raft_consensus.cc:3060] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.539685 23281 raft_consensus.cc:3055] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:22.539989 23281 raft_consensus.cc:740] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:22.540848 23281 consensus_queue.cc:260] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:22.542099 23281 raft_consensus.cc:3060] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:22.543596 24274 raft_consensus.cc:993] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:22.544121 24274 raft_consensus.cc:1081] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:22.547223 24095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51958
I20260709 13:23:22.547794 24095 raft_consensus.cc:493] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:22.548107 24095 raft_consensus.cc:3060] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:22.549158 23281 raft_consensus.cc:2468] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:22.550608 23322 leader_election.cc:304] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28222c0dd7a1411692efad3387118115, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:22.552155 24222 raft_consensus.cc:2804] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:22.552659 24222 raft_consensus.cc:697] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Becoming Leader. State: Replica: 28222c0dd7a1411692efad3387118115, State: Running, Role: LEADER
I20260709 13:23:22.553474 24222 consensus_queue.cc:237] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } }
I20260709 13:23:22.555661 24095 raft_consensus.cc:515] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:22.557930 23208 raft_consensus.cc:2468] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28222c0dd7a1411692efad3387118115 in term 2.
I20260709 13:23:22.562354 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:22.563201 24095 leader_election.cc:290] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Requested vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 28222c0dd7a1411692efad3387118115 (127.12.208.132:34331)
I20260709 13:23:22.563120 23281 raft_consensus.cc:3055] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:22.563700 23356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92eec5b6386a41c0b92608938ef9162c" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28222c0dd7a1411692efad3387118115"
I20260709 13:23:22.564221 23281 raft_consensus.cc:740] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:22.564457 23356 raft_consensus.cc:3060] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:22.565038 23281 consensus_queue.cc:260] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:22.566233 23281 raft_consensus.cc:3060] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:22.575752 23281 raft_consensus.cc:2468] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:22.576773 24044 leader_election.cc:304] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d; no voters: 
I20260709 13:23:22.577570 24280 raft_consensus.cc:2804] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:22.578131 24280 raft_consensus.cc:697] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:22.578380 23356 raft_consensus.cc:2468] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 3.
I20260709 13:23:22.579138 24280 consensus_queue.cc:237] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:22.580952 23033 catalog_manager.cc:5697] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 reported cstate change: term changed from 1 to 2, leader changed from b1f5ee52ad2f442bac6959931126746d (127.12.208.131) to 28222c0dd7a1411692efad3387118115 (127.12.208.132). New cstate: current_term: 2 leader_uuid: "28222c0dd7a1411692efad3387118115" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:22.590613 23034 catalog_manager.cc:5697] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 2 to 3, leader changed from b1f5ee52ad2f442bac6959931126746d (127.12.208.131) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 3 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:22.737426 23281 raft_consensus.cc:1275] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:22.738922 24244 consensus_queue.cc:1048] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:22.756585 23356 raft_consensus.cc:1275] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:22.758697 24280 consensus_queue.cc:1048] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:22.976372 23357 raft_consensus.cc:1275] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:22.977535 24280 consensus_queue.cc:1048] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:22.986682 23281 raft_consensus.cc:1275] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:22.988137 24279 consensus_queue.cc:1048] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:23.006677 23208 raft_consensus.cc:1275] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:23.008141 24279 consensus_queue.cc:1048] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:23.020128 23281 raft_consensus.cc:1275] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:23.021577 24279 consensus_queue.cc:1048] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:23.041843 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:23.052098 23281 raft_consensus.cc:1275] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:23.053421 24279 consensus_queue.cc:1048] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:23.075228 23356 raft_consensus.cc:1275] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:23.077169 24279 consensus_queue.cc:1048] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:23.110391 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:23.130637 23208 raft_consensus.cc:1275] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:23.132189 24222 consensus_queue.cc:1048] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:23.151788 23285 raft_consensus.cc:1275] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 28222c0dd7a1411692efad3387118115: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:23.160487 23285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2"
dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:47938
I20260709 13:23:23.161139 23285 raft_consensus.cc:606] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:23.159902 24315 consensus_queue.cc:1048] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:23:23.165162 23281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afda95fa80ad4b20905e75de45272508"
dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
mode: GRACEFUL
new_leader_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:47938
I20260709 13:23:23.165740 23281 raft_consensus.cc:606] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Received request to transfer leadership to TS 72629382bd4c46b09b2efeaf08c1460d
I20260709 13:23:23.167923 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:23.170248 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:23.310165 24228 raft_consensus.cc:993] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:23.310799 24228 raft_consensus.cc:1081] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:23.312876 24097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afda95fa80ad4b20905e75de45272508"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51958
I20260709 13:23:23.313472 24097 raft_consensus.cc:493] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:23.313870 24097 raft_consensus.cc:3060] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.319875 24097 raft_consensus.cc:515] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:23.321748 24097 leader_election.cc:290] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:23.322661 23210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda95fa80ad4b20905e75de45272508" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:23.322803 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda95fa80ad4b20905e75de45272508" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:23.323388 23210 raft_consensus.cc:3060] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.323498 23281 raft_consensus.cc:3055] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:23.323879 23281 raft_consensus.cc:740] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:23.324620 23281 consensus_queue.cc:260] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:23.325881 23281 raft_consensus.cc:3060] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.329771 23210 raft_consensus.cc:2468] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:23.331343 24045 leader_election.cc:304] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:23.331561 23281 raft_consensus.cc:2468] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:23.332160 24280 raft_consensus.cc:2804] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:23.332651 24280 raft_consensus.cc:697] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:23.333843 24280 consensus_queue.cc:237] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:23.343967 23033 catalog_manager.cc:5697] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 1 to 2, leader changed from b1f5ee52ad2f442bac6959931126746d (127.12.208.131) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 2 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:23.716092 24319 raft_consensus.cc:993] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d: : Instructing follower 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:23.716624 24228 raft_consensus.cc:1081] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Signalling peer 72629382bd4c46b09b2efeaf08c1460d to start an election
I20260709 13:23:23.718029 24097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2"
dest_uuid: "72629382bd4c46b09b2efeaf08c1460d"
 from {username='slave'} at 127.0.0.1:51958
I20260709 13:23:23.718499 24097 raft_consensus.cc:493] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:23.718817 24097 raft_consensus.cc:3060] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.724725 24097 raft_consensus.cc:515] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:23.727092 23208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f0dc6416e1e43ee863a6af614ece6c0"
I20260709 13:23:23.727334 24097 leader_election.cc:290] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Requested vote from peers 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617), b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439)
I20260709 13:23:23.727783 23208 raft_consensus.cc:3060] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.728327 23281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b4ab214feb430ca8ca7034b0903fd2" candidate_uuid: "72629382bd4c46b09b2efeaf08c1460d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1f5ee52ad2f442bac6959931126746d"
I20260709 13:23:23.729351 23281 raft_consensus.cc:3055] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:23.729657 23281 raft_consensus.cc:740] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1f5ee52ad2f442bac6959931126746d, State: Running, Role: LEADER
I20260709 13:23:23.730515 23281 consensus_queue.cc:260] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:23.731719 23281 raft_consensus.cc:3060] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.735913 23208 raft_consensus.cc:2468] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:23.737046 24045 leader_election.cc:304] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0dc6416e1e43ee863a6af614ece6c0, 72629382bd4c46b09b2efeaf08c1460d; no voters: 
I20260709 13:23:23.737895 24279 raft_consensus.cc:2804] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:23.738097 23281 raft_consensus.cc:2468] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72629382bd4c46b09b2efeaf08c1460d in term 2.
I20260709 13:23:23.738466 24279 raft_consensus.cc:697] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Becoming Leader. State: Replica: 72629382bd4c46b09b2efeaf08c1460d, State: Running, Role: LEADER
I20260709 13:23:23.739480 24279 consensus_queue.cc:237] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } }
I20260709 13:23:23.760522 23033 catalog_manager.cc:5697] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d reported cstate change: term changed from 1 to 2, leader changed from b1f5ee52ad2f442bac6959931126746d (127.12.208.131) to 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129). New cstate: current_term: 2 leader_uuid: "72629382bd4c46b09b2efeaf08c1460d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:23.916036 23281 raft_consensus.cc:1275] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:23.917366 24280 consensus_queue.cc:1048] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:23.923568 23210 raft_consensus.cc:1275] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:23.925310 24280 consensus_queue.cc:1048] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:24.171309 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:24.207496 13122 tablet_server.cc:179] TabletServer@127.12.208.129:33547 shutting down...
I20260709 13:23:24.213464 23281 raft_consensus.cc:1275] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.215912 24280 consensus_queue.cc:1048] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:23:24.217002 23175 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 212 similar messages]
W20260709 13:23:24.221549 23175 consensus_peers.cc:597] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.238390 23210 raft_consensus.cc:1275] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Refusing update from remote peer 72629382bd4c46b09b2efeaf08c1460d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.241492 24318 consensus_queue.cc:1048] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0dc6416e1e43ee863a6af614ece6c0" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:24.278861 23249 consensus_peers.cc:597] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.277972 23175 consensus_peers.cc:597] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.280432 23175 consensus_peers.cc:597] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.280946 23175 consensus_peers.cc:597] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.281910 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:24.283090 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.286814 13122 raft_consensus.cc:2243] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.287333 13122 raft_consensus.cc:2272] T 3e44018374b34e9ab7172698203fddd0 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.290680 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.291644 13122 raft_consensus.cc:2243] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.292232 13122 raft_consensus.cc:2272] T 16a37225566b46a499f90759aadbf267 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.296686 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.297595 13122 raft_consensus.cc:2243] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:23:24.297966 23175 consensus_peers.cc:597] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.298369 13122 raft_consensus.cc:2272] T 28937175e4764f6484d66b61a7e1592a P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.299832 23323 consensus_peers.cc:597] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.301924 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.302879 13122 raft_consensus.cc:2243] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.303350 13122 raft_consensus.cc:2272] T 480935b908a045248a3d3c02deab6648 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.306459 23249 consensus_peers.cc:597] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.306668 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.307752 13122 raft_consensus.cc:2243] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.308852 13122 raft_consensus.cc:2272] T 283ea57ae7df4e8aab22865b9922ad56 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.311578 23323 consensus_peers.cc:597] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.312237 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.313045 13122 raft_consensus.cc:2243] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.313597 13122 raft_consensus.cc:2272] T 9632791a4410453a8a5b95e7570c0565 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.316419 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.317215 13122 raft_consensus.cc:2243] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.317778 13122 raft_consensus.cc:2272] T 3a590581b50b42b2ae1ce08dcfe237e7 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.320968 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.321543 13122 raft_consensus.cc:2243] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.322345 13122 raft_consensus.cc:2272] T fc3b9027733f4b1c9800874f86d1b054 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.324364 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.324913 13122 raft_consensus.cc:2243] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.325309 13122 raft_consensus.cc:2272] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.327786 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.328501 13122 raft_consensus.cc:2243] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.329046 13122 raft_consensus.cc:2272] T 987cdec3ef244fddafb031e68024c1dc P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.332186 13122 tablet_replica.cc:333] stopping tablet replica
W20260709 13:23:24.332809 23323 consensus_peers.cc:597] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.333104 13122 raft_consensus.cc:2243] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.333829 13122 raft_consensus.cc:2272] T 9fac600ebf36450b96343e8ad119b130 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.337162 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.338120 13122 raft_consensus.cc:2243] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.338763 13122 raft_consensus.cc:2272] T 797ae11a97f84ad783704a5f0b287330 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.341735 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.342521 13122 raft_consensus.cc:2243] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.343045 13122 raft_consensus.cc:2272] T f479db0348074d559c5290d442d0c297 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.345470 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.346097 13122 raft_consensus.cc:2243] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.346467 13122 raft_consensus.cc:2272] T 17cabb464d6148dab5eba6d8ba9d13e5 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.348551 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.349079 13122 raft_consensus.cc:2243] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.349982 13122 raft_consensus.cc:2272] T 076db0f4793e437cbb23e56b1f75f2d0 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.352110 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.352685 13122 raft_consensus.cc:2243] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.353487 13122 raft_consensus.cc:2272] T 79e7ed81a129474a91e895ef75e45846 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.355710 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.356287 13122 raft_consensus.cc:2243] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.357057 13122 raft_consensus.cc:2272] T 24160013ee8743f88e93c264fde917b3 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.359099 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.359787 13122 raft_consensus.cc:2243] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.360343 13122 raft_consensus.cc:2272] T 7fd01caec9d94514a02b3e251a1ea509 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.363333 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.364015 13122 raft_consensus.cc:2243] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.364450 13122 raft_consensus.cc:2272] T 61b02752797c494ea2853b042faf1da6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.365326 23175 consensus_peers.cc:597] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.366807 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.367533 13122 raft_consensus.cc:2243] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.367964 13122 raft_consensus.cc:2272] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.370673 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.371318 13122 raft_consensus.cc:2243] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.372110 13122 raft_consensus.cc:2272] T db75cc4c217c4476bcc60a4f91750ed3 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.374411 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.375047 13122 raft_consensus.cc:2243] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.375831 13122 raft_consensus.cc:2272] T e6fd3cdd94174b018ebe04f44a1cc4fb P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.378005 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.378669 13122 raft_consensus.cc:2243] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.379554 13122 raft_consensus.cc:2272] T 74b4ab214feb430ca8ca7034b0903fd2 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.382516 13122 tablet_replica.cc:333] stopping tablet replica
W20260709 13:23:24.383193 23249 consensus_peers.cc:597] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.383281 13122 raft_consensus.cc:2243] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.383991 13122 raft_consensus.cc:2272] T e0ff21f76a0b4747afdcad23fe926e14 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.386884 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.387584 13122 raft_consensus.cc:2243] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.388556 13122 raft_consensus.cc:2272] T 92eec5b6386a41c0b92608938ef9162c P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.390726 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.391367 13122 raft_consensus.cc:2243] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.391785 13122 raft_consensus.cc:2272] T f6370231c76d43af900444679754d8e6 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.394393 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.395197 13122 raft_consensus.cc:2243] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.395702 13122 raft_consensus.cc:2272] T 514b8e2595b64695ae570184026e6b10 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.398149 23249 consensus_peers.cc:597] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.398855 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.399632 13122 raft_consensus.cc:2243] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.400095 13122 raft_consensus.cc:2272] T dd7d9a54537545268b3b0ac024d58a93 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.402674 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.403533 13122 raft_consensus.cc:2243] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.404865 13122 raft_consensus.cc:2272] T ad073f97fcad4d19bc9e16ecd3235c2a P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.407895 13122 tablet_replica.cc:333] stopping tablet replica
W20260709 13:23:24.407980 23249 consensus_peers.cc:597] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.408687 13122 raft_consensus.cc:2243] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.409238 13122 raft_consensus.cc:2272] T 4d36b6bd10764558b6db3eb4e2238a3f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.411310 23175 consensus_peers.cc:597] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.412422 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.413264 13122 raft_consensus.cc:2243] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.413776 13122 raft_consensus.cc:2272] T 81b244c487d44b40a9f7800f2ae45a24 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.414705 23249 consensus_peers.cc:597] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.416901 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.417574 13122 raft_consensus.cc:2243] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.418097 13122 raft_consensus.cc:2272] T a537c251284f4165af8ff6b08343c427 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.420881 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.421530 13122 raft_consensus.cc:2243] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.422107 13122 raft_consensus.cc:2272] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.422624 23175 consensus_peers.cc:597] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.424275 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.424945 13122 raft_consensus.cc:2243] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.425478 13122 raft_consensus.cc:2272] T 92f3d3eace634645af1d9239ca7bd856 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.428511 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.429194 13122 raft_consensus.cc:2243] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.429551 13122 raft_consensus.cc:2272] T d24f89e5242045f2a28a36e335775561 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.431833 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.432440 13122 raft_consensus.cc:2243] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.432857 13122 raft_consensus.cc:2272] T 7c9c34142ecf4df297b6eff325e4cbd6 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.435433 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.436190 13122 raft_consensus.cc:2243] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.436990 13122 raft_consensus.cc:2272] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.439546 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.440146 13122 raft_consensus.cc:2243] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.440941 13122 raft_consensus.cc:2272] T 7a5a1889477743c5844083786cef2ef4 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.443135 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.443662 13122 raft_consensus.cc:2243] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.444118 13122 raft_consensus.cc:2272] T c922bd920ef0444182579d77023af05e P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.446157 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.446686 13122 raft_consensus.cc:2243] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.447101 13122 raft_consensus.cc:2272] T 4fcda7afa02d4a339af683cf757b6657 P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.449036 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.449540 13122 raft_consensus.cc:2243] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.449996 13122 raft_consensus.cc:2272] T 66e092acaa9541649bd04731cf50ea1c P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.452669 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.453279 13122 raft_consensus.cc:2243] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.454363 13122 raft_consensus.cc:2272] T 550e909e22344eeda8dddcbefde935c7 P 72629382bd4c46b09b2efeaf08c1460d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.455030 23175 consensus_peers.cc:597] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.457165 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.457839 13122 raft_consensus.cc:2243] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.458312 13122 raft_consensus.cc:2272] T 31ee84482afc4bd590fa2592f7fa9f44 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.460532 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.461033 13122 raft_consensus.cc:2243] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.461436 13122 raft_consensus.cc:2272] T d7c657fadabd4fd1802ed83a975d127f P 72629382bd4c46b09b2efeaf08c1460d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.463735 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:24.464285 13122 raft_consensus.cc:2243] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.465082 13122 raft_consensus.cc:2272] T afda95fa80ad4b20905e75de45272508 P 72629382bd4c46b09b2efeaf08c1460d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.541416 13122 tablet_server.cc:196] TabletServer@127.12.208.129:33547 shutdown complete.
W20260709 13:23:24.546240 23175 consensus_peers.cc:597] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.602222 23249 consensus_peers.cc:597] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.603684 23323 consensus_peers.cc:597] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.604350 23323 consensus_peers.cc:597] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.647658 23323 consensus_peers.cc:597] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.652878 13122 tablet_server.cc:179] TabletServer@127.12.208.130:0 shutting down...
W20260709 13:23:24.666615 23323 consensus_peers.cc:597] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.667721 23249 consensus_peers.cc:597] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.671622 23249 consensus_peers.cc:597] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.675405 23249 consensus_peers.cc:597] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.676661 23249 consensus_peers.cc:597] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.685830 23323 consensus_peers.cc:597] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.701596 23323 consensus_peers.cc:597] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.702268 23323 consensus_peers.cc:597] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.710706 23175 consensus_peers.cc:597] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.720849 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:24.722366 13122 tablet_replica.cc:333] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.723306 13122 raft_consensus.cc:2243] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.723795 13122 raft_consensus.cc:2272] T 283ea57ae7df4e8aab22865b9922ad56 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.728648 13122 tablet_replica.cc:333] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.729542 13122 raft_consensus.cc:2243] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:23:24.729939 23323 consensus_peers.cc:597] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.730803 13122 raft_consensus.cc:2272] T 16a37225566b46a499f90759aadbf267 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.734257 13122 tablet_replica.cc:333] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.734903 13122 raft_consensus.cc:2243] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.735327 13122 raft_consensus.cc:2272] T 74b4ab214feb430ca8ca7034b0903fd2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.738061 13122 tablet_replica.cc:333] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.738703 13122 raft_consensus.cc:2243] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.739564 13122 raft_consensus.cc:2272] T f6370231c76d43af900444679754d8e6 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.741724 13122 tablet_replica.cc:333] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.742419 13122 raft_consensus.cc:2243] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.742846 13122 raft_consensus.cc:2272] T b5a4328b7c8048a58b8f49269156e606 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.744949 13122 tablet_replica.cc:333] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.745492 13122 raft_consensus.cc:2243] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.746084 13122 raft_consensus.cc:2272] T fc3b9027733f4b1c9800874f86d1b054 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.749202 13122 tablet_replica.cc:333] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.750293 13122 raft_consensus.cc:2243] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.750914 13122 raft_consensus.cc:2272] T 4689f05e6159426c8b5073075c502f3c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.754346 13122 tablet_replica.cc:333] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
W20260709 13:23:24.754575 23175 consensus_peers.cc:597] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 -> Peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Couldn't send request to peer 72629382bd4c46b09b2efeaf08c1460d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.755309 13122 raft_consensus.cc:2243] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.756472 13122 raft_consensus.cc:2272] T 2e318744c2b64bd3a410e806761d3648 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.759433 13122 tablet_replica.cc:333] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.760361 13122 raft_consensus.cc:2243] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.761615 13122 raft_consensus.cc:2272] T 3a590581b50b42b2ae1ce08dcfe237e7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.764906 13122 tablet_replica.cc:333] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.765772 13122 raft_consensus.cc:2243] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.766965 13122 raft_consensus.cc:2272] T 9632791a4410453a8a5b95e7570c0565 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.769755 13122 tablet_replica.cc:333] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.770695 13122 raft_consensus.cc:2243] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.771730 13122 raft_consensus.cc:2272] T 3e44018374b34e9ab7172698203fddd0 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.773916 13122 tablet_replica.cc:333] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.774497 13122 raft_consensus.cc:2243] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.774993 13122 raft_consensus.cc:2272] T 17a57dd75f694365ba2ab18b8b2cbe41 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.776963 13122 tablet_replica.cc:333] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.777552 13122 raft_consensus.cc:2243] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.778142 13122 raft_consensus.cc:2272] T 2d430d760648423c8b3c2e0861c6bfcf P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.781170 13122 tablet_replica.cc:333] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.782086 13122 raft_consensus.cc:2243] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:23:24.782521 23323 consensus_peers.cc:597] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.783280 13122 raft_consensus.cc:2272] T 81b244c487d44b40a9f7800f2ae45a24 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.786495 13122 tablet_replica.cc:333] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.787355 13122 raft_consensus.cc:2243] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.787948 13122 raft_consensus.cc:2272] T 4d36b6bd10764558b6db3eb4e2238a3f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.790989 13122 tablet_replica.cc:333] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.791721 13122 raft_consensus.cc:2243] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.792273 13122 raft_consensus.cc:2272] T ad073f97fcad4d19bc9e16ecd3235c2a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.794857 13122 tablet_replica.cc:333] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.795616 13122 raft_consensus.cc:2243] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.796096 13122 raft_consensus.cc:2272] T afda95fa80ad4b20905e75de45272508 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.799484 13122 tablet_replica.cc:333] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.800345 13122 raft_consensus.cc:2243] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.800951 13122 raft_consensus.cc:2272] T d7c657fadabd4fd1802ed83a975d127f P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.804265 13122 tablet_replica.cc:333] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.805090 13122 raft_consensus.cc:2243] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.805699 13122 raft_consensus.cc:2272] T 4535c921be9a4e5686183c491ff5f6ca P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.807789 23249 consensus_peers.cc:597] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.808522 13122 tablet_replica.cc:333] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.809451 13122 raft_consensus.cc:2243] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.810039 13122 raft_consensus.cc:2272] T 9d309f995b354b95a4a462a0f9831a85 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.812783 13122 tablet_replica.cc:333] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.813763 13122 raft_consensus.cc:2243] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.814698 13122 raft_consensus.cc:2272] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.817173 13122 tablet_replica.cc:333] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.817864 13122 raft_consensus.cc:2243] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.818342 13122 raft_consensus.cc:2272] T 17cabb464d6148dab5eba6d8ba9d13e5 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.820842 13122 tablet_replica.cc:333] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.821503 13122 raft_consensus.cc:2243] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.822098 13122 raft_consensus.cc:2272] T 053bdd071d8445d1a3e089703a22ab2b P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.825124 13122 tablet_replica.cc:333] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.825723 13122 raft_consensus.cc:2243] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.826819 13122 raft_consensus.cc:2272] T 66e092acaa9541649bd04731cf50ea1c P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.829267 13122 tablet_replica.cc:333] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.829972 13122 raft_consensus.cc:2243] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.830431 13122 raft_consensus.cc:2272] T 550e909e22344eeda8dddcbefde935c7 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.832655 13122 tablet_replica.cc:333] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.833274 13122 raft_consensus.cc:2243] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.834273 13122 raft_consensus.cc:2272] T 8192c710d74b4b1c9b4d67b79426ac48 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.836740 13122 tablet_replica.cc:333] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.837397 13122 raft_consensus.cc:2243] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.837949 13122 raft_consensus.cc:2272] T db75cc4c217c4476bcc60a4f91750ed3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.841207 13122 tablet_replica.cc:333] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.842195 13122 raft_consensus.cc:2243] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.843407 13122 raft_consensus.cc:2272] T dd7d9a54537545268b3b0ac024d58a93 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.846732 13122 tablet_replica.cc:333] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.847551 13122 raft_consensus.cc:2243] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.848692 13122 raft_consensus.cc:2272] T 8bac124d4fc6429bbffe49d0090140f9 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.850217 23323 consensus_peers.cc:597] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.851874 13122 tablet_replica.cc:333] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.852871 13122 raft_consensus.cc:2243] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.853493 13122 raft_consensus.cc:2272] T c9a07ed2cfb44ee09a9b0105bf804006 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.856783 13122 tablet_replica.cc:333] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.857616 13122 raft_consensus.cc:2243] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.858237 13122 raft_consensus.cc:2272] T 7a5a1889477743c5844083786cef2ef4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.861204 13122 tablet_replica.cc:333] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.862015 13122 raft_consensus.cc:2243] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.862576 13122 raft_consensus.cc:2272] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.863421 23323 consensus_peers.cc:597] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.865693 13122 tablet_replica.cc:333] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.866541 13122 raft_consensus.cc:2243] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.867029 13122 raft_consensus.cc:2272] T 7e74c84af241495bb52d0ecfd1cce7ff P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.869299 13122 tablet_replica.cc:333] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.870074 13122 raft_consensus.cc:2243] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.870656 13122 raft_consensus.cc:2272] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.873726 13122 tablet_replica.cc:333] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.874621 13122 raft_consensus.cc:2243] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.875228 13122 raft_consensus.cc:2272] T 797ae11a97f84ad783704a5f0b287330 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.879344 13122 tablet_replica.cc:333] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.880060 13122 raft_consensus.cc:2243] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.880498 13122 raft_consensus.cc:2272] T d451d4f8dd554041a70fc8d71618d090 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.882869 13122 tablet_replica.cc:333] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.883421 13122 raft_consensus.cc:2243] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.883879 13122 raft_consensus.cc:2272] T 7fd01caec9d94514a02b3e251a1ea509 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.886468 13122 tablet_replica.cc:333] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.887001 13122 raft_consensus.cc:2243] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.887931 13122 raft_consensus.cc:2272] T 03dfec3f3a8c4f79bbac529d3b7691a2 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.890210 13122 tablet_replica.cc:333] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.890729 13122 raft_consensus.cc:2243] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.891130 13122 raft_consensus.cc:2272] T 24160013ee8743f88e93c264fde917b3 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.893136 13122 tablet_replica.cc:333] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.893760 13122 raft_consensus.cc:2243] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.894843 13122 raft_consensus.cc:2272] T e0ff21f76a0b4747afdcad23fe926e14 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.897318 13122 tablet_replica.cc:333] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.898023 13122 raft_consensus.cc:2243] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.898440 13122 raft_consensus.cc:2272] T c922bd920ef0444182579d77023af05e P 0f0dc6416e1e43ee863a6af614ece6c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.900949 13122 tablet_replica.cc:333] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
W20260709 13:23:24.901440 23249 consensus_peers.cc:597] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.901614 13122 raft_consensus.cc:2243] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:24.902549 13122 raft_consensus.cc:2272] T 987cdec3ef244fddafb031e68024c1dc P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.904716 13122 tablet_replica.cc:333] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.905257 13122 raft_consensus.cc:2243] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.905652 13122 raft_consensus.cc:2272] T 7d41e7244bf04a4c8c6d02911a829766 P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:24.907837 13122 tablet_replica.cc:333] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0: stopping tablet replica
I20260709 13:23:24.908428 13122 raft_consensus.cc:2243] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:24.908941 13122 raft_consensus.cc:2272] T 28937175e4764f6484d66b61a7e1592a P 0f0dc6416e1e43ee863a6af614ece6c0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:24.920818 23323 consensus_peers.cc:597] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.930253 23249 consensus_peers.cc:597] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.943459 23249 consensus_peers.cc:597] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:24.957967 23249 consensus_peers.cc:597] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:24.985154 13122 tablet_server.cc:196] TabletServer@127.12.208.130:0 shutdown complete.
W20260709 13:23:25.013842 23323 consensus_peers.cc:597] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:34617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:25.029435 23249 consensus_peers.cc:597] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:34617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:25.063798 23323 consensus_peers.cc:597] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:34617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:25.074469 23249 consensus_peers.cc:597] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:34617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.085335 13122 tablet_server.cc:179] TabletServer@127.12.208.131:0 shutting down...
W20260709 13:23:25.110407 23323 consensus_peers.cc:597] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:34617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:25.119773 23322 consensus_peers.cc:597] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:25.121909 23323 consensus_peers.cc:597] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:34617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.136668 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:25.137603 13122 tablet_replica.cc:333] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.138463 13122 raft_consensus.cc:2243] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.139043 13122 raft_consensus.cc:2272] T 16a37225566b46a499f90759aadbf267 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.141292 13122 tablet_replica.cc:333] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.141979 13122 raft_consensus.cc:2243] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.142478 13122 raft_consensus.cc:2272] T e6fd3cdd94174b018ebe04f44a1cc4fb P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.144455 13122 tablet_replica.cc:333] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.145013 13122 raft_consensus.cc:2243] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.145491 13122 raft_consensus.cc:2272] T 74b4ab214feb430ca8ca7034b0903fd2 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.148870 13122 tablet_replica.cc:333] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.149663 13122 raft_consensus.cc:2243] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.150206 13122 raft_consensus.cc:2272] T 92eec5b6386a41c0b92608938ef9162c P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.153123 13122 tablet_replica.cc:333] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.154048 13122 raft_consensus.cc:2243] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.154918 13122 raft_consensus.cc:2272] T 514b8e2595b64695ae570184026e6b10 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.157703 13122 tablet_replica.cc:333] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.158499 13122 raft_consensus.cc:2243] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.159585 13122 raft_consensus.cc:2272] T b5a4328b7c8048a58b8f49269156e606 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.161892 13122 tablet_replica.cc:333] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.162453 13122 raft_consensus.cc:2243] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.162868 13122 raft_consensus.cc:2272] T fc3b9027733f4b1c9800874f86d1b054 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.164906 13122 tablet_replica.cc:333] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.165472 13122 raft_consensus.cc:2243] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.166265 13122 raft_consensus.cc:2272] T 4689f05e6159426c8b5073075c502f3c P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.168257 13122 tablet_replica.cc:333] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.168820 13122 raft_consensus.cc:2243] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.169232 13122 raft_consensus.cc:2272] T 2e318744c2b64bd3a410e806761d3648 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.171326 13122 tablet_replica.cc:333] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.171912 13122 raft_consensus.cc:2243] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.172330 13122 raft_consensus.cc:2272] T 2d430d760648423c8b3c2e0861c6bfcf P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.174463 13122 tablet_replica.cc:333] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.175030 13122 raft_consensus.cc:2243] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.175535 13122 raft_consensus.cc:2272] T 7c9c34142ecf4df297b6eff325e4cbd6 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.177740 13122 tablet_replica.cc:333] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.178382 13122 raft_consensus.cc:2243] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.178807 13122 raft_consensus.cc:2272] T 7a5a1889477743c5844083786cef2ef4 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.180825 13122 tablet_replica.cc:333] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.181433 13122 raft_consensus.cc:2243] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.181911 13122 raft_consensus.cc:2272] T a537c251284f4165af8ff6b08343c427 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.184254 13122 tablet_replica.cc:333] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.184990 13122 raft_consensus.cc:2243] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.186074 13122 raft_consensus.cc:2272] T 92f3d3eace634645af1d9239ca7bd856 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.189102 13122 tablet_replica.cc:333] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.189934 13122 raft_consensus.cc:2243] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.190464 13122 raft_consensus.cc:2272] T 7e74c84af241495bb52d0ecfd1cce7ff P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.193130 13122 tablet_replica.cc:333] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.193921 13122 raft_consensus.cc:2243] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.194924 13122 raft_consensus.cc:2272] T d24f89e5242045f2a28a36e335775561 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.197314 13122 tablet_replica.cc:333] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.197969 13122 raft_consensus.cc:2243] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.198437 13122 raft_consensus.cc:2272] T 3a590581b50b42b2ae1ce08dcfe237e7 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.201375 13122 tablet_replica.cc:333] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.202209 13122 raft_consensus.cc:2243] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.202726 13122 raft_consensus.cc:2272] T 17a57dd75f694365ba2ab18b8b2cbe41 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.205466 13122 tablet_replica.cc:333] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.206205 13122 raft_consensus.cc:2243] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.206755 13122 raft_consensus.cc:2272] T 550e909e22344eeda8dddcbefde935c7 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.209393 13122 tablet_replica.cc:333] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.210284 13122 raft_consensus.cc:2243] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.211292 13122 raft_consensus.cc:2272] T 17cabb464d6148dab5eba6d8ba9d13e5 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.214080 13122 tablet_replica.cc:333] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.214917 13122 raft_consensus.cc:2243] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:23:25.214921 23322 consensus_peers.cc:597] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.215539 13122 raft_consensus.cc:2272] T 076db0f4793e437cbb23e56b1f75f2d0 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:25.216995 23249 consensus_peers.cc:597] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d -> Peer 0f0dc6416e1e43ee863a6af614ece6c0 (127.12.208.130:34617): Couldn't send request to peer 0f0dc6416e1e43ee863a6af614ece6c0. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:34617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.218043 13122 tablet_replica.cc:333] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.219065 13122 raft_consensus.cc:2243] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.219933 13122 raft_consensus.cc:2272] T 053bdd071d8445d1a3e089703a22ab2b P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.222288 13122 tablet_replica.cc:333] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.222823 13122 raft_consensus.cc:2243] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.223572 13122 raft_consensus.cc:2272] T 9fac600ebf36450b96343e8ad119b130 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.225487 13122 tablet_replica.cc:333] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.226080 13122 raft_consensus.cc:2243] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.226572 13122 raft_consensus.cc:2272] T 8192c710d74b4b1c9b4d67b79426ac48 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.228509 13122 tablet_replica.cc:333] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.229060 13122 raft_consensus.cc:2243] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.229578 13122 raft_consensus.cc:2272] T c9a07ed2cfb44ee09a9b0105bf804006 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.232141 13122 tablet_replica.cc:333] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.232796 13122 raft_consensus.cc:2243] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.233314 13122 raft_consensus.cc:2272] T db75cc4c217c4476bcc60a4f91750ed3 P b1f5ee52ad2f442bac6959931126746d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.235630 13122 tablet_replica.cc:333] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.236331 13122 raft_consensus.cc:2243] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.236860 13122 raft_consensus.cc:2272] T 8bac124d4fc6429bbffe49d0090140f9 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.239499 13122 tablet_replica.cc:333] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.240216 13122 raft_consensus.cc:2243] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.241092 13122 raft_consensus.cc:2272] T 4535c921be9a4e5686183c491ff5f6ca P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.243348 13122 tablet_replica.cc:333] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.244112 13122 raft_consensus.cc:2243] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.244625 13122 raft_consensus.cc:2272] T 9d309f995b354b95a4a462a0f9831a85 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.247395 13122 tablet_replica.cc:333] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.248062 13122 raft_consensus.cc:2243] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.248881 13122 raft_consensus.cc:2272] T d7c657fadabd4fd1802ed83a975d127f P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.251139 13122 tablet_replica.cc:333] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.251927 13122 raft_consensus.cc:2243] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.252451 13122 raft_consensus.cc:2272] T 31ee84482afc4bd590fa2592f7fa9f44 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.255291 13122 tablet_replica.cc:333] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.255877 13122 raft_consensus.cc:2243] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.256335 13122 raft_consensus.cc:2272] T afda95fa80ad4b20905e75de45272508 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:25.256994 23322 consensus_peers.cc:597] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.258363 13122 tablet_replica.cc:333] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.258963 13122 raft_consensus.cc:2243] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.259732 13122 raft_consensus.cc:2272] T d451d4f8dd554041a70fc8d71618d090 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.262609 13122 tablet_replica.cc:333] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.263279 13122 raft_consensus.cc:2243] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.264106 13122 raft_consensus.cc:2272] T f479db0348074d559c5290d442d0c297 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.266144 13122 tablet_replica.cc:333] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.266727 13122 raft_consensus.cc:2243] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.267179 13122 raft_consensus.cc:2272] T 480935b908a045248a3d3c02deab6648 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.269728 13122 tablet_replica.cc:333] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.270375 13122 raft_consensus.cc:2243] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.271142 13122 raft_consensus.cc:2272] T 28937175e4764f6484d66b61a7e1592a P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:25.272241 23322 consensus_peers.cc:597] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.273326 13122 tablet_replica.cc:333] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.274000 13122 raft_consensus.cc:2243] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.274459 13122 raft_consensus.cc:2272] T 4fcda7afa02d4a339af683cf757b6657 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.276445 13122 tablet_replica.cc:333] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.277042 13122 raft_consensus.cc:2243] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.277774 13122 raft_consensus.cc:2272] T c922bd920ef0444182579d77023af05e P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.280092 13122 tablet_replica.cc:333] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.280648 13122 raft_consensus.cc:2243] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.281133 13122 raft_consensus.cc:2272] T 79e7ed81a129474a91e895ef75e45846 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.283319 13122 tablet_replica.cc:333] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.283946 13122 raft_consensus.cc:2243] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.284363 13122 raft_consensus.cc:2272] T 7d41e7244bf04a4c8c6d02911a829766 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.286520 13122 tablet_replica.cc:333] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.287037 13122 raft_consensus.cc:2243] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.287457 13122 raft_consensus.cc:2272] T 3e44018374b34e9ab7172698203fddd0 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.289449 13122 tablet_replica.cc:333] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.289994 13122 raft_consensus.cc:2243] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.290416 13122 raft_consensus.cc:2272] T 03dfec3f3a8c4f79bbac529d3b7691a2 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.292476 13122 tablet_replica.cc:333] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.292987 13122 raft_consensus.cc:2243] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.293406 13122 raft_consensus.cc:2272] T 24160013ee8743f88e93c264fde917b3 P b1f5ee52ad2f442bac6959931126746d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.295759 13122 tablet_replica.cc:333] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d: stopping tablet replica
I20260709 13:23:25.296233 13122 raft_consensus.cc:2243] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.296989 13122 raft_consensus.cc:2272] T 61b02752797c494ea2853b042faf1da6 P b1f5ee52ad2f442bac6959931126746d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:25.298000 23322 consensus_peers.cc:597] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.390362 13122 tablet_server.cc:196] TabletServer@127.12.208.131:0 shutdown complete.
W20260709 13:23:25.390605 23322 consensus_peers.cc:597] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.131:38439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:25.397576 23322 consensus_peers.cc:597] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.131:38439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:25.425886 23322 consensus_peers.cc:597] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.131:38439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.437304 24345 raft_consensus.cc:493] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72629382bd4c46b09b2efeaf08c1460d)
I20260709 13:23:25.438107 24345 raft_consensus.cc:515] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5ee52ad2f442bac6959931126746d" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38439 } } peers { permanent_uuid: "28222c0dd7a1411692efad3387118115" member_type: VOTER last_known_addr { host: "127.12.208.132" port: 34331 } } peers { permanent_uuid: "72629382bd4c46b09b2efeaf08c1460d" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 33547 } }
I20260709 13:23:25.443106 24345 leader_election.cc:290] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439), 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547)
W20260709 13:23:25.446110 23323 leader_election.cc:336] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 72629382bd4c46b09b2efeaf08c1460d (127.12.208.129:33547): Network error: Client connection negotiation failed: client connection to 127.12.208.129:33547: connect: Connection refused (error 111)
W20260709 13:23:25.447817 23322 consensus_peers.cc:597] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.131:38439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:25.452138 23322 leader_election.cc:336] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Network error: Client connection negotiation failed: client connection to 127.12.208.131:38439: connect: Connection refused (error 111)
I20260709 13:23:25.452576 23322 leader_election.cc:304] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28222c0dd7a1411692efad3387118115; no voters: 72629382bd4c46b09b2efeaf08c1460d, b1f5ee52ad2f442bac6959931126746d
I20260709 13:23:25.453337 24341 raft_consensus.cc:2749] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:23:25.460455 23322 consensus_peers.cc:597] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.131:38439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.475558 13122 tablet_server.cc:179] TabletServer@127.12.208.132:0 shutting down...
I20260709 13:23:25.519657 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:25.520479 13122 tablet_replica.cc:333] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.521174 13122 raft_consensus.cc:2243] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.521689 13122 raft_consensus.cc:2272] T b5a4328b7c8048a58b8f49269156e606 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.523787 13122 tablet_replica.cc:333] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.524416 13122 raft_consensus.cc:2243] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.524880 13122 raft_consensus.cc:2272] T e6fd3cdd94174b018ebe04f44a1cc4fb P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.526894 13122 tablet_replica.cc:333] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.527475 13122 raft_consensus.cc:2243] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.528319 13122 raft_consensus.cc:2272] T 7c9c34142ecf4df297b6eff325e4cbd6 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.530546 13122 tablet_replica.cc:333] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.531112 13122 raft_consensus.cc:2243] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.531603 13122 raft_consensus.cc:2272] T 9632791a4410453a8a5b95e7570c0565 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.533911 13122 tablet_replica.cc:333] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.534520 13122 raft_consensus.cc:2243] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.534952 13122 raft_consensus.cc:2272] T 4689f05e6159426c8b5073075c502f3c P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.536998 13122 tablet_replica.cc:333] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.537586 13122 raft_consensus.cc:2243] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.538035 13122 raft_consensus.cc:2272] T 2e318744c2b64bd3a410e806761d3648 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.539970 13122 tablet_replica.cc:333] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.540548 13122 raft_consensus.cc:2243] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.541019 13122 raft_consensus.cc:2272] T 92eec5b6386a41c0b92608938ef9162c P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.542990 13122 tablet_replica.cc:333] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.543548 13122 raft_consensus.cc:2243] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.543989 13122 raft_consensus.cc:2272] T f6370231c76d43af900444679754d8e6 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.546028 13122 tablet_replica.cc:333] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.546584 13122 raft_consensus.cc:2243] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.547004 13122 raft_consensus.cc:2272] T 514b8e2595b64695ae570184026e6b10 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.548877 13122 tablet_replica.cc:333] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.549433 13122 raft_consensus.cc:2243] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.550279 13122 raft_consensus.cc:2272] T a537c251284f4165af8ff6b08343c427 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.552516 13122 tablet_replica.cc:333] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.553259 13122 raft_consensus.cc:2243] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.553768 13122 raft_consensus.cc:2272] T 92f3d3eace634645af1d9239ca7bd856 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.555934 13122 tablet_replica.cc:333] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.556537 13122 raft_consensus.cc:2243] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.557309 13122 raft_consensus.cc:2272] T 7e74c84af241495bb52d0ecfd1cce7ff P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.559285 13122 tablet_replica.cc:333] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.559902 13122 raft_consensus.cc:2243] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.560676 13122 raft_consensus.cc:2272] T c07f8c2c87cd4a47aa2f08e7750ae0ba P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.562638 13122 tablet_replica.cc:333] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.563263 13122 raft_consensus.cc:2243] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.563635 13122 raft_consensus.cc:2272] T d24f89e5242045f2a28a36e335775561 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.565498 13122 tablet_replica.cc:333] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.566053 13122 raft_consensus.cc:2243] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.566414 13122 raft_consensus.cc:2272] T 66e092acaa9541649bd04731cf50ea1c P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.568200 13122 tablet_replica.cc:333] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.568722 13122 raft_consensus.cc:2243] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.569135 13122 raft_consensus.cc:2272] T 8192c710d74b4b1c9b4d67b79426ac48 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.571115 13122 tablet_replica.cc:333] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.571615 13122 raft_consensus.cc:2243] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.571967 13122 raft_consensus.cc:2272] T 053bdd071d8445d1a3e089703a22ab2b P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.573853 13122 tablet_replica.cc:333] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.574329 13122 raft_consensus.cc:2243] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.574697 13122 raft_consensus.cc:2272] T 076db0f4793e437cbb23e56b1f75f2d0 P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.576531 13122 tablet_replica.cc:333] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.576985 13122 raft_consensus.cc:2243] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.577677 13122 raft_consensus.cc:2272] T 17a57dd75f694365ba2ab18b8b2cbe41 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.579591 13122 tablet_replica.cc:333] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.580154 13122 raft_consensus.cc:2243] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.580654 13122 raft_consensus.cc:2272] T 9fac600ebf36450b96343e8ad119b130 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.582643 13122 tablet_replica.cc:333] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.583190 13122 raft_consensus.cc:2243] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.583952 13122 raft_consensus.cc:2272] T 2d430d760648423c8b3c2e0861c6bfcf P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.585872 13122 tablet_replica.cc:333] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.586373 13122 raft_consensus.cc:2243] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.586750 13122 raft_consensus.cc:2272] T 81b244c487d44b40a9f7800f2ae45a24 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.589285 13122 tablet_replica.cc:333] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.590132 13122 raft_consensus.cc:2243] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.591130 13122 raft_consensus.cc:2272] T 4d36b6bd10764558b6db3eb4e2238a3f P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:25.592541 23322 consensus_peers.cc:597] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 -> Peer b1f5ee52ad2f442bac6959931126746d (127.12.208.131:38439): Couldn't send request to peer b1f5ee52ad2f442bac6959931126746d. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.131:38439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:25.593691 13122 tablet_replica.cc:333] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.594411 13122 raft_consensus.cc:2243] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.594835 13122 raft_consensus.cc:2272] T ad073f97fcad4d19bc9e16ecd3235c2a P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.596752 13122 tablet_replica.cc:333] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.597318 13122 raft_consensus.cc:2243] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.598133 13122 raft_consensus.cc:2272] T 4fcda7afa02d4a339af683cf757b6657 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.600152 13122 tablet_replica.cc:333] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.600706 13122 raft_consensus.cc:2243] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.601153 13122 raft_consensus.cc:2272] T 283ea57ae7df4e8aab22865b9922ad56 P 28222c0dd7a1411692efad3387118115 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.603163 13122 tablet_replica.cc:333] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.603719 13122 raft_consensus.cc:2243] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.604583 13122 raft_consensus.cc:2272] T 480935b908a045248a3d3c02deab6648 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.606726 13122 tablet_replica.cc:333] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.607282 13122 raft_consensus.cc:2243] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.607707 13122 raft_consensus.cc:2272] T dd7d9a54537545268b3b0ac024d58a93 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.609710 13122 tablet_replica.cc:333] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.610333 13122 raft_consensus.cc:2243] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.610788 13122 raft_consensus.cc:2272] T 8bac124d4fc6429bbffe49d0090140f9 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.612890 13122 tablet_replica.cc:333] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.613550 13122 raft_consensus.cc:2243] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.614369 13122 raft_consensus.cc:2272] T c9a07ed2cfb44ee09a9b0105bf804006 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.617075 13122 tablet_replica.cc:333] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.617913 13122 raft_consensus.cc:2243] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.618443 13122 raft_consensus.cc:2272] T 006dd6ad5ee14da39d65b4a6f97b32a4 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.621097 13122 tablet_replica.cc:333] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.621737 13122 raft_consensus.cc:2243] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.622452 13122 raft_consensus.cc:2272] T 4535c921be9a4e5686183c491ff5f6ca P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.624595 13122 tablet_replica.cc:333] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.625198 13122 raft_consensus.cc:2243] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.626075 13122 raft_consensus.cc:2272] T 9d309f995b354b95a4a462a0f9831a85 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.628786 13122 tablet_replica.cc:333] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.629686 13122 raft_consensus.cc:2243] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.630342 13122 raft_consensus.cc:2272] T 87cb4ccf648b4137bbe92d1a4e9ce542 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.632742 13122 tablet_replica.cc:333] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.633344 13122 raft_consensus.cc:2243] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.634258 13122 raft_consensus.cc:2272] T 7fd01caec9d94514a02b3e251a1ea509 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.636358 13122 tablet_replica.cc:333] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.636919 13122 raft_consensus.cc:2243] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.637382 13122 raft_consensus.cc:2272] T 61b02752797c494ea2853b042faf1da6 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.639487 13122 tablet_replica.cc:333] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.640050 13122 raft_consensus.cc:2243] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.640875 13122 raft_consensus.cc:2272] T 797ae11a97f84ad783704a5f0b287330 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.643304 13122 tablet_replica.cc:333] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.643889 13122 raft_consensus.cc:2243] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.644323 13122 raft_consensus.cc:2272] T f479db0348074d559c5290d442d0c297 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.646545 13122 tablet_replica.cc:333] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.647078 13122 raft_consensus.cc:2243] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.647509 13122 raft_consensus.cc:2272] T d451d4f8dd554041a70fc8d71618d090 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.649729 13122 tablet_replica.cc:333] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.650266 13122 raft_consensus.cc:2243] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.650673 13122 raft_consensus.cc:2272] T 987cdec3ef244fddafb031e68024c1dc P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.652936 13122 tablet_replica.cc:333] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.653457 13122 raft_consensus.cc:2243] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.654279 13122 raft_consensus.cc:2272] T 7d41e7244bf04a4c8c6d02911a829766 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.656354 13122 tablet_replica.cc:333] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.657006 13122 raft_consensus.cc:2243] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.657876 13122 raft_consensus.cc:2272] T 31ee84482afc4bd590fa2592f7fa9f44 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.661414 13122 tablet_replica.cc:333] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.662037 13122 raft_consensus.cc:2243] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.662506 13122 raft_consensus.cc:2272] T 79e7ed81a129474a91e895ef75e45846 P 28222c0dd7a1411692efad3387118115 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.664685 13122 tablet_replica.cc:333] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115: stopping tablet replica
I20260709 13:23:25.665231 13122 raft_consensus.cc:2243] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:25.665710 13122 raft_consensus.cc:2272] T e0ff21f76a0b4747afdcad23fe926e14 P 28222c0dd7a1411692efad3387118115 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.739184 13122 tablet_server.cc:196] TabletServer@127.12.208.132:0 shutdown complete.
I20260709 13:23:25.804546 13122 master.cc:562] Master@127.12.208.190:34953 shutting down...
I20260709 13:23:25.828155 13122 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:25.828751 13122 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:25.829092 13122 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4dd92c05a57d451dbd11c9187ce49148: stopping tablet replica
I20260709 13:23:25.854183 13122 master.cc:584] Master@127.12.208.190:34953 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (37112 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:23:25.953842 13122 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.208.190:37757
I20260709 13:23:25.955013 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:25.960999 24347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:25.961038 24348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:25.962047 24350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:25.963021 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:25.964207 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:25.964457 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:25.964623 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603405964588 us; error 0 us; skew 500 ppm
I20260709 13:23:25.965162 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:25.967916 13122 webserver.cc:533] Webserver started at http://127.12.208.190:39675/ using document root <none> and password file <none>
I20260709 13:23:25.968436 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:25.968627 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:25.968914 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:25.970422 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/master-0-root/instance:
uuid: "6c2b40b8a0ce430bb0b6074941bbb5ab"
format_stamp: "Formatted at 2026-07-09 13:23:25 on dist-test-slave-ll1f"
I20260709 13:23:25.974753 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:23:25.978179 24355 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:25.978933 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:23:25.979241 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/master-0-root
uuid: "6c2b40b8a0ce430bb0b6074941bbb5ab"
format_stamp: "Formatted at 2026-07-09 13:23:25 on dist-test-slave-ll1f"
I20260709 13:23:25.979523 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:26.000418 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:26.001708 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:26.041316 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.190:37757
I20260709 13:23:26.041489 24406 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.190:37757 every 8 connection(s)
I20260709 13:23:26.045372 24407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.056195 24407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab: Bootstrap starting.
I20260709 13:23:26.061071 24407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.065430 24407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab: No bootstrap required, opened a new log
I20260709 13:23:26.067711 24407 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b40b8a0ce430bb0b6074941bbb5ab" member_type: VOTER }
I20260709 13:23:26.068126 24407 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:26.068303 24407 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c2b40b8a0ce430bb0b6074941bbb5ab, State: Initialized, Role: FOLLOWER
I20260709 13:23:26.068905 24407 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b40b8a0ce430bb0b6074941bbb5ab" member_type: VOTER }
I20260709 13:23:26.069319 24407 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:23:26.069514 24407 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:23:26.069716 24407 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:26.074704 24407 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b40b8a0ce430bb0b6074941bbb5ab" member_type: VOTER }
I20260709 13:23:26.075461 24407 leader_election.cc:304] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c2b40b8a0ce430bb0b6074941bbb5ab; no voters: 
I20260709 13:23:26.076574 24407 leader_election.cc:290] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:23:26.077009 24410 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:26.078493 24410 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [term 1 LEADER]: Becoming Leader. State: Replica: 6c2b40b8a0ce430bb0b6074941bbb5ab, State: Running, Role: LEADER
I20260709 13:23:26.079195 24410 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b40b8a0ce430bb0b6074941bbb5ab" member_type: VOTER }
I20260709 13:23:26.079689 24407 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:23:26.083788 24412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c2b40b8a0ce430bb0b6074941bbb5ab. Latest consensus state: current_term: 1 leader_uuid: "6c2b40b8a0ce430bb0b6074941bbb5ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b40b8a0ce430bb0b6074941bbb5ab" member_type: VOTER } }
I20260709 13:23:26.083668 24411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c2b40b8a0ce430bb0b6074941bbb5ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2b40b8a0ce430bb0b6074941bbb5ab" member_type: VOTER } }
I20260709 13:23:26.084568 24412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:26.084795 24411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:26.087608 24417 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:23:26.095793 24417 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:23:26.096786 13122 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:23:26.105003 24417 catalog_manager.cc:1383] Generated new cluster ID: 8989b9862cdc4a01b1c207cd154a073a
I20260709 13:23:26.105365 24417 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:23:26.141991 24417 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:23:26.143422 24417 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:23:26.156888 24417 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab: Generated new TSK 0
I20260709 13:23:26.157516 24417 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:23:26.163492 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:26.170840 24428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:26.172240 24429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:26.174408 13122 server_base.cc:1061] running on GCE node
W20260709 13:23:26.175267 24431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:26.176539 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:26.176836 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:26.177002 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603406176989 us; error 0 us; skew 500 ppm
I20260709 13:23:26.177670 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:26.180222 13122 webserver.cc:533] Webserver started at http://127.12.208.129:40011/ using document root <none> and password file <none>
I20260709 13:23:26.180838 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:26.181066 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:26.181347 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:26.182597 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-0-root/instance:
uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
format_stamp: "Formatted at 2026-07-09 13:23:26 on dist-test-slave-ll1f"
I20260709 13:23:26.187299 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:23:26.191133 24436 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.192080 13122 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:23:26.192459 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-0-root
uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
format_stamp: "Formatted at 2026-07-09 13:23:26 on dist-test-slave-ll1f"
I20260709 13:23:26.192732 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:26.206735 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:26.207924 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:26.209357 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:26.211839 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:26.212029 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.212355 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:26.212509 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.253258 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.129:34907
I20260709 13:23:26.253361 24498 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.129:34907 every 8 connection(s)
I20260709 13:23:26.258291 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:26.266453 24503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:26.268326 24504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:26.271530 24506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:26.271907 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:26.273097 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:26.273332 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:26.273566 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603406273530 us; error 0 us; skew 500 ppm
I20260709 13:23:26.274303 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:26.276969 24499 heartbeater.cc:344] Connected to a master server at 127.12.208.190:37757
I20260709 13:23:26.277370 24499 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:26.277647 13122 webserver.cc:533] Webserver started at http://127.12.208.130:37317/ using document root <none> and password file <none>
I20260709 13:23:26.278290 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:26.278522 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:26.278332 24499 heartbeater.cc:507] Master 127.12.208.190:37757 requested a full tablet report, sending...
I20260709 13:23:26.278910 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:26.280117 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-1-root/instance:
uuid: "4b5975ac353a4b21a2a51f5c5820e807"
format_stamp: "Formatted at 2026-07-09 13:23:26 on dist-test-slave-ll1f"
I20260709 13:23:26.280997 24372 ts_manager.cc:194] Registered new tserver with Master: 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907)
I20260709 13:23:26.283579 24372 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52814
I20260709 13:23:26.286542 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:23:26.290098 24511 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.291028 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:23:26.291354 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-1-root
uuid: "4b5975ac353a4b21a2a51f5c5820e807"
format_stamp: "Formatted at 2026-07-09 13:23:26 on dist-test-slave-ll1f"
I20260709 13:23:26.291621 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:26.315533 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:26.316825 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:26.318336 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:26.320528 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:26.320750 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.321005 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:26.321177 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.362270 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.130:39571
I20260709 13:23:26.362341 24574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.130:39571 every 8 connection(s)
I20260709 13:23:26.368675 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:26.376832 24578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:26.377846 24579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:26.381208 24581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:26.382125 24575 heartbeater.cc:344] Connected to a master server at 127.12.208.190:37757
I20260709 13:23:26.382709 24575 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:26.382802 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:26.383817 24575 heartbeater.cc:507] Master 127.12.208.190:37757 requested a full tablet report, sending...
I20260709 13:23:26.383976 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:26.384315 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:26.384501 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603406384485 us; error 0 us; skew 500 ppm
I20260709 13:23:26.385066 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:26.386348 24372 ts_manager.cc:194] Registered new tserver with Master: 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:26.387815 13122 webserver.cc:533] Webserver started at http://127.12.208.131:33557/ using document root <none> and password file <none>
I20260709 13:23:26.388273 24372 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52816
I20260709 13:23:26.388434 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:26.388799 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:26.389081 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:26.390327 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-2-root/instance:
uuid: "d033885e21614e9f886d1bdeea04bb03"
format_stamp: "Formatted at 2026-07-09 13:23:26 on dist-test-slave-ll1f"
I20260709 13:23:26.395300 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:23:26.398900 24586 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.399788 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:23:26.400131 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-2-root
uuid: "d033885e21614e9f886d1bdeea04bb03"
format_stamp: "Formatted at 2026-07-09 13:23:26 on dist-test-slave-ll1f"
I20260709 13:23:26.400453 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:26.421578 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:26.422837 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:26.424413 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:26.426715 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:26.426962 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.427218 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:26.427402 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:26.470803 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.131:38565
I20260709 13:23:26.470919 24648 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.131:38565 every 8 connection(s)
I20260709 13:23:26.486091 24649 heartbeater.cc:344] Connected to a master server at 127.12.208.190:37757
I20260709 13:23:26.486506 24649 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:26.487246 24649 heartbeater.cc:507] Master 127.12.208.190:37757 requested a full tablet report, sending...
I20260709 13:23:26.489193 24372 ts_manager.cc:194] Registered new tserver with Master: d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:26.490163 13122 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015875152s
I20260709 13:23:26.490751 24372 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52826
I20260709 13:23:26.521015 24372 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52830:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:26.526055 24372 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:26.608743 24464 tablet_service.cc:1511] Processing CreateTablet for tablet 872fb3854aab4c5dae7af7aa64d81c7a (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:23:26.610312 24464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872fb3854aab4c5dae7af7aa64d81c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.614655 24462 tablet_service.cc:1511] Processing CreateTablet for tablet 3027dd8371184256ad03c98f665371d3 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:23:26.609746 24463 tablet_service.cc:1511] Processing CreateTablet for tablet 9f02379f20f647b18d74372feea9a030 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:23:26.616302 24462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3027dd8371184256ad03c98f665371d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.617264 24463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f02379f20f647b18d74372feea9a030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.619438 24461 tablet_service.cc:1511] Processing CreateTablet for tablet 51cb995dacb74be1b4ac3789fe681cf9 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:23:26.621079 24461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cb995dacb74be1b4ac3789fe681cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.626914 24460 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae0e7715d4d435993f754451d636154 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:23:26.628494 24460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae0e7715d4d435993f754451d636154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.630929 24459 tablet_service.cc:1511] Processing CreateTablet for tablet d0789cc1d37443e691a175f9a3364b17 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:23:26.632426 24459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0789cc1d37443e691a175f9a3364b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.635828 24458 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb5aaf8e75943deb9195ab290ff89ee (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:23:26.638463 24458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb5aaf8e75943deb9195ab290ff89ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.640873 24540 tablet_service.cc:1511] Processing CreateTablet for tablet 872fb3854aab4c5dae7af7aa64d81c7a (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:23:26.642560 24540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872fb3854aab4c5dae7af7aa64d81c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.647955 24539 tablet_service.cc:1511] Processing CreateTablet for tablet 9f02379f20f647b18d74372feea9a030 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:23:26.649658 24539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f02379f20f647b18d74372feea9a030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.651660 24538 tablet_service.cc:1511] Processing CreateTablet for tablet 3027dd8371184256ad03c98f665371d3 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:23:26.653301 24538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3027dd8371184256ad03c98f665371d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.667218 24535 tablet_service.cc:1511] Processing CreateTablet for tablet d0789cc1d37443e691a175f9a3364b17 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:23:26.668953 24535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0789cc1d37443e691a175f9a3364b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.672576 24534 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb5aaf8e75943deb9195ab290ff89ee (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:23:26.680670 24532 tablet_service.cc:1511] Processing CreateTablet for tablet d6f2b40ea64f40848731725e48023f0e (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:23:26.655107 24537 tablet_service.cc:1511] Processing CreateTablet for tablet 51cb995dacb74be1b4ac3789fe681cf9 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:23:26.682686 24536 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae0e7715d4d435993f754451d636154 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:23:26.684149 24534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb5aaf8e75943deb9195ab290ff89ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.687475 24536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae0e7715d4d435993f754451d636154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.690179 24532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f2b40ea64f40848731725e48023f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.691646 24537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cb995dacb74be1b4ac3789fe681cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.727347 24665 tablet_bootstrap.cc:492] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:26.778613 24457 tablet_service.cc:1511] Processing CreateTablet for tablet 0f456236139d469a84bdb9cf93f17879 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:23:26.783115 24457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f456236139d469a84bdb9cf93f17879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.791925 24460 tablet_service.cc:1511] Processing CreateTablet for tablet 7a98573426d44b2a854f6cd791e04430 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:23:26.794602 24460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a98573426d44b2a854f6cd791e04430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.803073 24463 tablet_service.cc:1511] Processing CreateTablet for tablet d6f2b40ea64f40848731725e48023f0e (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:23:26.805981 24463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f2b40ea64f40848731725e48023f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.812279 24612 tablet_service.cc:1511] Processing CreateTablet for tablet 3027dd8371184256ad03c98f665371d3 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:23:26.817991 24608 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb5aaf8e75943deb9195ab290ff89ee (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:23:26.818269 24607 tablet_service.cc:1511] Processing CreateTablet for tablet d6f2b40ea64f40848731725e48023f0e (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:23:26.818683 24611 tablet_service.cc:1511] Processing CreateTablet for tablet 51cb995dacb74be1b4ac3789fe681cf9 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:23:26.818879 24613 tablet_service.cc:1511] Processing CreateTablet for tablet 9f02379f20f647b18d74372feea9a030 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:23:26.819869 24610 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae0e7715d4d435993f754451d636154 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:23:26.817977 24606 tablet_service.cc:1511] Processing CreateTablet for tablet 7a98573426d44b2a854f6cd791e04430 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:23:26.820973 24531 tablet_service.cc:1511] Processing CreateTablet for tablet 0f456236139d469a84bdb9cf93f17879 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:23:26.822350 24531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f456236139d469a84bdb9cf93f17879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.824899 24609 tablet_service.cc:1511] Processing CreateTablet for tablet d0789cc1d37443e691a175f9a3364b17 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:23:26.827798 24605 tablet_service.cc:1511] Processing CreateTablet for tablet 0f456236139d469a84bdb9cf93f17879 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:23:26.831439 24665 tablet_bootstrap.cc:654] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.831058 24614 tablet_service.cc:1511] Processing CreateTablet for tablet 872fb3854aab4c5dae7af7aa64d81c7a (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:23:26.833931 24536 tablet_service.cc:1511] Processing CreateTablet for tablet 7a98573426d44b2a854f6cd791e04430 (DEFAULT_TABLE table=test-workload [id=b1e868eddf2a4477b10e6e931e274293]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:23:26.835920 24536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a98573426d44b2a854f6cd791e04430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.838726 24612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3027dd8371184256ad03c98f665371d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.861609 24614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872fb3854aab4c5dae7af7aa64d81c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.873209 24666 tablet_bootstrap.cc:492] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807: Bootstrap starting.
I20260709 13:23:26.874719 24609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0789cc1d37443e691a175f9a3364b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.875550 24606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a98573426d44b2a854f6cd791e04430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.876685 24608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb5aaf8e75943deb9195ab290ff89ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.878118 24613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f02379f20f647b18d74372feea9a030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.878916 24611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cb995dacb74be1b4ac3789fe681cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.883775 24665 tablet_bootstrap.cc:492] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: No bootstrap required, opened a new log
I20260709 13:23:26.884711 24665 ts_tablet_manager.cc:1403] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.158s	user 0.006s	sys 0.014s
I20260709 13:23:26.886569 24605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f456236139d469a84bdb9cf93f17879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.890182 24610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae0e7715d4d435993f754451d636154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.892920 24607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f2b40ea64f40848731725e48023f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:26.951193 24668 tablet_bootstrap.cc:492] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03: Bootstrap starting.
W20260709 13:23:26.962862 24356 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.208.130:39571, user_credentials={real_user=slave}} blocked reactor thread for 64561.3us
W20260709 13:23:26.963372 24357 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.208.129:34907, user_credentials={real_user=slave}} blocked reactor thread for 62179.2us
I20260709 13:23:26.951483 24665 raft_consensus.cc:359] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:26.967348 24665 raft_consensus.cc:385] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:26.967756 24665 raft_consensus.cc:740] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:26.968715 24665 consensus_queue.cc:260] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:26.970100 24668 tablet_bootstrap.cc:654] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.980307 24499 heartbeater.cc:499] Master 127.12.208.190:37757 was elected leader, sending a full tablet report...
I20260709 13:23:26.982901 24665 ts_tablet_manager.cc:1434] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.007s
I20260709 13:23:26.984195 24665 tablet_bootstrap.cc:492] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:26.992935 24665 tablet_bootstrap.cc:654] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:26.999509 24669 raft_consensus.cc:493] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.000509 24669 raft_consensus.cc:515] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.039276 24668 tablet_bootstrap.cc:492] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03: No bootstrap required, opened a new log
I20260709 13:23:27.040163 24668 ts_tablet_manager.cc:1403] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03: Time spent bootstrapping tablet: real 0.091s	user 0.026s	sys 0.033s
I20260709 13:23:27.046463 24669 leader_election.cc:290] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.048856 24668 raft_consensus.cc:359] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.049753 24668 raft_consensus.cc:385] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:23:27.049998 24500 tablet.cc:2406] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:23:27.050093 24668 raft_consensus.cc:740] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.051285 24668 consensus_queue.cc:260] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.055851 24665 tablet_bootstrap.cc:492] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f: No bootstrap required, opened a new log
I20260709 13:23:27.056622 24665 ts_tablet_manager.cc:1403] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.073s	user 0.019s	sys 0.005s
I20260709 13:23:27.061100 24666 tablet_bootstrap.cc:654] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.085131 24668 ts_tablet_manager.cc:1434] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.019s
I20260709 13:23:27.085032 24665 raft_consensus.cc:359] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.086555 24665 raft_consensus.cc:385] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.087020 24665 raft_consensus.cc:740] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.088691 24649 heartbeater.cc:499] Master 127.12.208.190:37757 was elected leader, sending a full tablet report...
I20260709 13:23:27.088964 24668 tablet_bootstrap.cc:492] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03: Bootstrap starting.
I20260709 13:23:27.085436 24666 tablet_bootstrap.cc:492] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807: No bootstrap required, opened a new log
I20260709 13:23:27.093556 24666 ts_tablet_manager.cc:1403] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent bootstrapping tablet: real 0.221s	user 0.019s	sys 0.004s
W20260709 13:23:27.093647 24420 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:27.097540 24668 tablet_bootstrap.cc:654] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.097318 24666 raft_consensus.cc:359] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.098239 24666 raft_consensus.cc:385] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.098580 24666 raft_consensus.cc:740] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.099515 24666 consensus_queue.cc:260] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.102080 24665 consensus_queue.cc:260] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.104408 24575 heartbeater.cc:499] Master 127.12.208.190:37757 was elected leader, sending a full tablet report...
I20260709 13:23:27.104627 24665 ts_tablet_manager.cc:1434] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.001s
I20260709 13:23:27.114516 24665 tablet_bootstrap.cc:492] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:27.118494 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3027dd8371184256ad03c98f665371d3" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
W20260709 13:23:27.123934 24437 leader_election.cc:343] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.124769 24665 tablet_bootstrap.cc:654] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.126438 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3027dd8371184256ad03c98f665371d3" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:27.127279 24624 raft_consensus.cc:2468] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 402bbb7e7d924efab283bb5e9c08fb1f in term 0.
I20260709 13:23:27.128091 24666 ts_tablet_manager.cc:1434] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:23:27.128849 24437 leader_election.cc:304] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:27.129200 24666 tablet_bootstrap.cc:492] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807: Bootstrap starting.
I20260709 13:23:27.130182 24669 raft_consensus.cc:2804] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.130571 24669 raft_consensus.cc:493] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.130926 24669 raft_consensus.cc:3060] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.135281 24668 tablet_bootstrap.cc:492] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03: No bootstrap required, opened a new log
I20260709 13:23:27.136132 24668 ts_tablet_manager.cc:1403] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.008s
I20260709 13:23:27.137890 24666 tablet_bootstrap.cc:654] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.140226 24669 raft_consensus.cc:515] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.140596 24668 raft_consensus.cc:359] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.141719 24668 raft_consensus.cc:385] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.142828 24668 raft_consensus.cc:740] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.143762 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3027dd8371184256ad03c98f665371d3" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:27.144309 24668 consensus_queue.cc:260] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
W20260709 13:23:27.145612 24437 leader_election.cc:343] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.148150 24668 ts_tablet_manager.cc:1434] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:23:27.148202 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3027dd8371184256ad03c98f665371d3" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:27.149680 24624 raft_consensus.cc:3060] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.149753 24668 tablet_bootstrap.cc:492] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03: Bootstrap starting.
I20260709 13:23:27.153755 24665 tablet_bootstrap.cc:492] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f: No bootstrap required, opened a new log
I20260709 13:23:27.154490 24665 ts_tablet_manager.cc:1403] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.017s
I20260709 13:23:27.158074 24668 tablet_bootstrap.cc:654] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.157927 24665 raft_consensus.cc:359] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.158802 24665 raft_consensus.cc:385] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.159171 24665 raft_consensus.cc:740] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.160056 24665 consensus_queue.cc:260] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.170110 24665 ts_tablet_manager.cc:1434] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.008s
I20260709 13:23:27.170532 24669 leader_election.cc:290] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Requested vote from peers 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.174166 24668 tablet_bootstrap.cc:492] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03: No bootstrap required, opened a new log
I20260709 13:23:27.174775 24668 ts_tablet_manager.cc:1403] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.006s
I20260709 13:23:27.171515 24665 tablet_bootstrap.cc:492] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:27.173545 24624 raft_consensus.cc:2468] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 402bbb7e7d924efab283bb5e9c08fb1f in term 1.
I20260709 13:23:27.176631 24437 leader_election.cc:304] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:27.177824 24669 raft_consensus.cc:2804] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.178324 24669 raft_consensus.cc:697] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 LEADER]: Becoming Leader. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Running, Role: LEADER
I20260709 13:23:27.178095 24668 raft_consensus.cc:359] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.179008 24668 raft_consensus.cc:385] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.179344 24669 consensus_queue.cc:237] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.179342 24668 raft_consensus.cc:740] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.181483 24666 tablet_bootstrap.cc:492] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807: No bootstrap required, opened a new log
I20260709 13:23:27.182178 24666 ts_tablet_manager.cc:1403] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.019s
I20260709 13:23:27.181903 24668 consensus_queue.cc:260] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.186792 24666 raft_consensus.cc:359] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.187767 24668 ts_tablet_manager.cc:1434] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 13:23:27.188043 24666 raft_consensus.cc:385] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.188657 24666 raft_consensus.cc:740] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.189348 24674 raft_consensus.cc:493] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.189940 24674 raft_consensus.cc:515] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.191267 24665 tablet_bootstrap.cc:654] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.190106 24666 consensus_queue.cc:260] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.199558 24674 leader_election.cc:290] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.217752 24666 ts_tablet_manager.cc:1434] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:23:27.220862 24668 tablet_bootstrap.cc:492] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03: Bootstrap starting.
I20260709 13:23:27.227473 24370 catalog_manager.cc:5697] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129). New cstate: current_term: 1 leader_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.231325 24666 tablet_bootstrap.cc:492] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807: Bootstrap starting.
I20260709 13:23:27.240093 24668 tablet_bootstrap.cc:654] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.243438 24666 tablet_bootstrap.cc:654] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.248428 24665 tablet_bootstrap.cc:492] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f: No bootstrap required, opened a new log
I20260709 13:23:27.249056 24674 raft_consensus.cc:493] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.249689 24674 raft_consensus.cc:515] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.251982 24674 leader_election.cc:290] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.249063 24665 ts_tablet_manager.cc:1403] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.078s	user 0.031s	sys 0.024s
I20260709 13:23:27.253360 24668 tablet_bootstrap.cc:492] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03: No bootstrap required, opened a new log
I20260709 13:23:27.256177 24665 raft_consensus.cc:359] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:27.257068 24665 raft_consensus.cc:385] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.257504 24665 raft_consensus.cc:740] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.258632 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0789cc1d37443e691a175f9a3364b17" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" is_pre_election: true
I20260709 13:23:27.258482 24665 consensus_queue.cc:260] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:27.260776 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" is_pre_election: true
I20260709 13:23:27.261008 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0789cc1d37443e691a175f9a3364b17" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:27.261528 24665 ts_tablet_manager.cc:1434] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:23:27.262015 24550 raft_consensus.cc:2468] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 0.
W20260709 13:23:27.262544 24588 leader_election.cc:343] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.262817 24665 tablet_bootstrap.cc:492] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:27.263756 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:27.266350 24587 leader_election.cc:304] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f
I20260709 13:23:27.269671 24674 raft_consensus.cc:2804] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.270287 24674 raft_consensus.cc:493] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.270746 24674 raft_consensus.cc:3060] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.273128 24665 tablet_bootstrap.cc:654] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:27.263805 24588 leader_election.cc:343] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:27.274801 24587 leader_election.cc:343] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.282224 24587 leader_election.cc:304] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:27.289322 24665 tablet_bootstrap.cc:492] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f: No bootstrap required, opened a new log
I20260709 13:23:27.289966 24668 ts_tablet_manager.cc:1403] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.005s
I20260709 13:23:27.290683 24665 ts_tablet_manager.cc:1403] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.028s	user 0.024s	sys 0.002s
I20260709 13:23:27.296073 24693 raft_consensus.cc:2749] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:27.299397 24668 raft_consensus.cc:359] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.300390 24668 raft_consensus.cc:385] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.300117 24674 raft_consensus.cc:515] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.302484 24665 raft_consensus.cc:359] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.303431 24665 raft_consensus.cc:385] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.303817 24665 raft_consensus.cc:740] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.300786 24668 raft_consensus.cc:740] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.304854 24665 consensus_queue.cc:260] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.306615 24668 consensus_queue.cc:260] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.307595 24665 ts_tablet_manager.cc:1434] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:23:27.308831 24665 tablet_bootstrap.cc:492] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:27.312477 24668 ts_tablet_manager.cc:1434] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:23:27.314002 24668 tablet_bootstrap.cc:492] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03: Bootstrap starting.
I20260709 13:23:27.316533 24665 tablet_bootstrap.cc:654] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.323040 24668 tablet_bootstrap.cc:654] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.331492 24666 tablet_bootstrap.cc:492] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807: No bootstrap required, opened a new log
I20260709 13:23:27.331652 24665 tablet_bootstrap.cc:492] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f: No bootstrap required, opened a new log
I20260709 13:23:27.332049 24666 ts_tablet_manager.cc:1403] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent bootstrapping tablet: real 0.101s	user 0.042s	sys 0.050s
I20260709 13:23:27.332347 24665 ts_tablet_manager.cc:1403] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.012s
I20260709 13:23:27.335268 24666 raft_consensus.cc:359] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.336095 24666 raft_consensus.cc:385] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.335891 24665 raft_consensus.cc:359] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.336526 24666 raft_consensus.cc:740] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.336593 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0789cc1d37443e691a175f9a3364b17" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:27.336890 24665 raft_consensus.cc:385] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.337311 24665 raft_consensus.cc:740] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.337570 24666 consensus_queue.cc:260] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.338238 24665 consensus_queue.cc:260] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.339094 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0789cc1d37443e691a175f9a3364b17" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:27.339711 24549 raft_consensus.cc:3060] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.341331 24665 ts_tablet_manager.cc:1434] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:23:27.342689 24665 tablet_bootstrap.cc:492] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:27.342970 24666 ts_tablet_manager.cc:1434] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:23:27.344117 24666 tablet_bootstrap.cc:492] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807: Bootstrap starting.
I20260709 13:23:27.345129 24668 tablet_bootstrap.cc:492] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03: No bootstrap required, opened a new log
I20260709 13:23:27.345943 24668 ts_tablet_manager.cc:1403] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.008s
I20260709 13:23:27.345973 24474 raft_consensus.cc:3060] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.350381 24665 tablet_bootstrap.cc:654] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.349933 24668 raft_consensus.cc:359] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:27.351083 24668 raft_consensus.cc:385] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.351537 24668 raft_consensus.cc:740] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.352660 24668 consensus_queue.cc:260] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:27.357842 24666 tablet_bootstrap.cc:654] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.359758 24668 ts_tablet_manager.cc:1434] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:23:27.361377 24668 tablet_bootstrap.cc:492] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03: Bootstrap starting.
I20260709 13:23:27.363092 24665 tablet_bootstrap.cc:492] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f: No bootstrap required, opened a new log
I20260709 13:23:27.365136 24665 ts_tablet_manager.cc:1403] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:23:27.368832 24665 raft_consensus.cc:359] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.369346 24668 tablet_bootstrap.cc:654] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.369778 24665 raft_consensus.cc:385] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.370184 24665 raft_consensus.cc:740] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.371270 24665 consensus_queue.cc:260] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.376405 24665 ts_tablet_manager.cc:1434] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:23:27.377720 24549 raft_consensus.cc:2468] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 1.
I20260709 13:23:27.383387 24681 raft_consensus.cc:493] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.377854 24665 tablet_bootstrap.cc:492] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:27.382632 24669 raft_consensus.cc:493] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.384001 24681 raft_consensus.cc:515] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:27.384186 24474 raft_consensus.cc:2468] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 1.
I20260709 13:23:27.386068 24669 raft_consensus.cc:515] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.387698 24668 tablet_bootstrap.cc:492] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03: No bootstrap required, opened a new log
I20260709 13:23:27.388329 24668 ts_tablet_manager.cc:1403] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.004s
I20260709 13:23:27.388433 24681 leader_election.cc:290] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.385145 24587 leader_election.cc:304] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:27.390228 24693 raft_consensus.cc:2804] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.392369 24665 tablet_bootstrap.cc:654] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.393126 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae0e7715d4d435993f754451d636154" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:27.394017 24549 raft_consensus.cc:2468] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 402bbb7e7d924efab283bb5e9c08fb1f in term 0.
I20260709 13:23:27.395604 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae0e7715d4d435993f754451d636154" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:27.396378 24693 raft_consensus.cc:697] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Becoming Leader. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:27.393065 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:27.397424 24693 consensus_queue.cc:237] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.399474 24437 leader_election.cc:304] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
W20260709 13:23:27.400627 24437 leader_election.cc:343] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.394809 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:27.402465 24624 raft_consensus.cc:2468] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 402bbb7e7d924efab283bb5e9c08fb1f in term 0.
W20260709 13:23:27.402666 24437 leader_election.cc:343] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.402262 24668 raft_consensus.cc:359] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.404374 24437 leader_election.cc:304] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:27.402330 24665 tablet_bootstrap.cc:492] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f: No bootstrap required, opened a new log
I20260709 13:23:27.388479 24669 leader_election.cc:290] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.403543 24681 raft_consensus.cc:2804] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.405548 24665 ts_tablet_manager.cc:1403] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260709 13:23:27.405812 24681 raft_consensus.cc:493] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.405850 24669 raft_consensus.cc:2804] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.383028 24674 leader_election.cc:290] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.406399 24666 tablet_bootstrap.cc:492] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807: No bootstrap required, opened a new log
I20260709 13:23:27.406445 24669 raft_consensus.cc:493] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.407203 24666 ts_tablet_manager.cc:1403] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807: Time spent bootstrapping tablet: real 0.063s	user 0.024s	sys 0.010s
I20260709 13:23:27.404749 24668 raft_consensus.cc:385] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.407931 24668 raft_consensus.cc:740] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.406402 24681 raft_consensus.cc:3060] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.410537 24666 raft_consensus.cc:359] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.411350 24666 raft_consensus.cc:385] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.411713 24666 raft_consensus.cc:740] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.411500 24668 consensus_queue.cc:260] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.412799 24666 consensus_queue.cc:260] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.407238 24669 raft_consensus.cc:3060] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.414788 24668 ts_tablet_manager.cc:1434] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:23:27.417019 24668 tablet_bootstrap.cc:492] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03: Bootstrap starting.
I20260709 13:23:27.418963 24666 ts_tablet_manager.cc:1434] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:23:27.420338 24666 tablet_bootstrap.cc:492] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807: Bootstrap starting.
I20260709 13:23:27.420883 24681 raft_consensus.cc:515] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.409994 24665 raft_consensus.cc:359] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.422297 24665 raft_consensus.cc:385] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.422622 24665 raft_consensus.cc:740] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.423380 24665 consensus_queue.cc:260] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.425515 24665 ts_tablet_manager.cc:1434] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:23:27.428038 24665 tablet_bootstrap.cc:492] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:27.428411 24666 tablet_bootstrap.cc:654] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.432035 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae0e7715d4d435993f754451d636154" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:27.432886 24550 raft_consensus.cc:3060] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.434146 24674 raft_consensus.cc:493] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.434698 24674 raft_consensus.cc:515] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.435580 24681 leader_election.cc:290] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Requested vote from peers 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.436208 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae0e7715d4d435993f754451d636154" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:27.436909 24674 leader_election.cc:290] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.438274 24665 tablet_bootstrap.cc:654] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.438557 24668 tablet_bootstrap.cc:654] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.439025 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5aaf8e75943deb9195ab290ff89ee" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" is_pre_election: true
I20260709 13:23:27.439744 24474 raft_consensus.cc:2468] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 0.
W20260709 13:23:27.438620 24437 leader_election.cc:343] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.441007 24681 raft_consensus.cc:493] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.441748 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5aaf8e75943deb9195ab290ff89ee" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:27.441766 24588 leader_election.cc:304] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:27.442138 24550 raft_consensus.cc:2468] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 402bbb7e7d924efab283bb5e9c08fb1f in term 1.
I20260709 13:23:27.442649 24549 raft_consensus.cc:2468] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 0.
I20260709 13:23:27.443022 24674 raft_consensus.cc:2804] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.443420 24674 raft_consensus.cc:493] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.443447 24437 leader_election.cc:304] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:27.444234 24674 raft_consensus.cc:3060] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.450124 24702 raft_consensus.cc:2804] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.457890 24669 raft_consensus.cc:515] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:27.460620 24669 leader_election.cc:290] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Requested vote from peers d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.461107 24369 catalog_manager.cc:5697] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 reported cstate change: term changed from 0 to 1, leader changed from <none> to d033885e21614e9f886d1bdeea04bb03 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "d033885e21614e9f886d1bdeea04bb03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:27.462627 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:27.463320 24624 raft_consensus.cc:3060] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.445619 24681 raft_consensus.cc:515] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.467937 24666 tablet_bootstrap.cc:492] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807: No bootstrap required, opened a new log
I20260709 13:23:27.468272 24681 leader_election.cc:290] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.468747 24666 ts_tablet_manager.cc:1403] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.011s
I20260709 13:23:27.471112 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:27.471863 24549 raft_consensus.cc:2468] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 402bbb7e7d924efab283bb5e9c08fb1f in term 0.
I20260709 13:23:27.472949 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:27.473189 24437 leader_election.cc:304] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:27.474269 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
W20260709 13:23:27.475122 24437 leader_election.cc:343] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:27.476214 24437 leader_election.cc:343] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.477481 24674 raft_consensus.cc:515] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.477247 24666 raft_consensus.cc:359] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.478453 24666 raft_consensus.cc:385] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.478842 24666 raft_consensus.cc:740] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.480013 24666 consensus_queue.cc:260] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.483692 24666 ts_tablet_manager.cc:1434] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:23:27.485045 24666 tablet_bootstrap.cc:492] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807: Bootstrap starting.
I20260709 13:23:27.486153 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5aaf8e75943deb9195ab290ff89ee" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:27.486837 24474 raft_consensus.cc:3060] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.495301 24666 tablet_bootstrap.cc:654] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.485148 24681 raft_consensus.cc:2804] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.498811 24681 raft_consensus.cc:493] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.499209 24681 raft_consensus.cc:3060] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.498458 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5aaf8e75943deb9195ab290ff89ee" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:27.493726 24674 leader_election.cc:290] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.499919 24550 raft_consensus.cc:3060] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.500633 24624 raft_consensus.cc:2468] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 402bbb7e7d924efab283bb5e9c08fb1f in term 1.
I20260709 13:23:27.505426 24702 raft_consensus.cc:697] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 LEADER]: Becoming Leader. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Running, Role: LEADER
I20260709 13:23:27.507335 24702 consensus_queue.cc:237] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.505779 24437 leader_election.cc:304] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:27.510633 24669 raft_consensus.cc:2804] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.503679 24474 raft_consensus.cc:2468] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 1.
I20260709 13:23:27.511874 24669 raft_consensus.cc:697] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 LEADER]: Becoming Leader. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Running, Role: LEADER
I20260709 13:23:27.513425 24669 consensus_queue.cc:237] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:27.514511 24665 tablet_bootstrap.cc:492] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f: No bootstrap required, opened a new log
I20260709 13:23:27.515097 24665 ts_tablet_manager.cc:1403] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.087s	user 0.019s	sys 0.006s
I20260709 13:23:27.517983 24665 raft_consensus.cc:359] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.518770 24665 raft_consensus.cc:385] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.519057 24665 raft_consensus.cc:740] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.518424 24681 raft_consensus.cc:515] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.520711 24665 consensus_queue.cc:260] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.522451 24681 leader_election.cc:290] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Requested vote from peers 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.522879 24665 ts_tablet_manager.cc:1434] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:23:27.523767 24665 tablet_bootstrap.cc:492] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:27.523902 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:27.524492 24549 raft_consensus.cc:3060] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.524536 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
W20260709 13:23:27.526628 24437 leader_election.cc:343] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.530124 24550 raft_consensus.cc:2468] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 1.
I20260709 13:23:27.530359 24588 leader_election.cc:304] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:27.531601 24674 raft_consensus.cc:2804] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.532135 24674 raft_consensus.cc:697] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Becoming Leader. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:27.532445 24549 raft_consensus.cc:2468] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 402bbb7e7d924efab283bb5e9c08fb1f in term 1.
I20260709 13:23:27.533006 24674 consensus_queue.cc:237] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.535321 24668 tablet_bootstrap.cc:492] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03: No bootstrap required, opened a new log
I20260709 13:23:27.535920 24668 ts_tablet_manager.cc:1403] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03: Time spent bootstrapping tablet: real 0.119s	user 0.022s	sys 0.014s
I20260709 13:23:27.536103 24437 leader_election.cc:304] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:27.537918 24693 raft_consensus.cc:493] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.538445 24693 raft_consensus.cc:515] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.541399 24665 tablet_bootstrap.cc:654] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.541879 24681 raft_consensus.cc:2804] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.546558 24681 raft_consensus.cc:697] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 LEADER]: Becoming Leader. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Running, Role: LEADER
I20260709 13:23:27.546715 24666 tablet_bootstrap.cc:492] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807: No bootstrap required, opened a new log
I20260709 13:23:27.547375 24666 ts_tablet_manager.cc:1403] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.013s
I20260709 13:23:27.547472 24681 consensus_queue.cc:237] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.545552 24668 raft_consensus.cc:359] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.550632 24693 leader_election.cc:290] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.550884 24370 catalog_manager.cc:5697] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129). New cstate: current_term: 1 leader_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.549079 24668 raft_consensus.cc:385] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.551679 24666 raft_consensus.cc:359] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.552371 24668 raft_consensus.cc:740] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.552587 24666 raft_consensus.cc:385] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.552379 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f2b40ea64f40848731725e48023f0e" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:27.553056 24666 raft_consensus.cc:740] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.553843 24666 consensus_queue.cc:260] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
W20260709 13:23:27.554266 24587 leader_election.cc:343] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.558085 24666 ts_tablet_manager.cc:1434] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:23:27.562294 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f2b40ea64f40848731725e48023f0e" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" is_pre_election: true
I20260709 13:23:27.563033 24474 raft_consensus.cc:2468] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 0.
I20260709 13:23:27.564191 24588 leader_election.cc:304] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:27.566573 24693 raft_consensus.cc:2804] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.566959 24693 raft_consensus.cc:493] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.567287 24693 raft_consensus.cc:3060] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:27.572706 24437 consensus_peers.cc:597] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f -> Peer 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571): Couldn't send request to peer 4b5975ac353a4b21a2a51f5c5820e807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.553383 24668 consensus_queue.cc:260] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.576596 24668 ts_tablet_manager.cc:1434] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:23:27.577960 24668 tablet_bootstrap.cc:492] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03: Bootstrap starting.
I20260709 13:23:27.581664 24669 raft_consensus.cc:493] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.582507 24669 raft_consensus.cc:515] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.587121 24669 leader_election.cc:290] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.595701 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:27.596585 24666 tablet_bootstrap.cc:492] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807: Bootstrap starting.
I20260709 13:23:27.596698 24550 raft_consensus.cc:2468] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 402bbb7e7d924efab283bb5e9c08fb1f in term 0.
I20260709 13:23:27.599339 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:27.599960 24668 tablet_bootstrap.cc:654] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.601538 24437 leader_election.cc:304] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:27.608745 24666 tablet_bootstrap.cc:654] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:27.609368 24437 leader_election.cc:343] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.610499 24681 raft_consensus.cc:2804] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.610971 24681 raft_consensus.cc:493] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.611356 24681 raft_consensus.cc:3060] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.608844 24665 tablet_bootstrap.cc:492] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f: No bootstrap required, opened a new log
I20260709 13:23:27.622673 24665 ts_tablet_manager.cc:1403] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.099s	user 0.029s	sys 0.015s
I20260709 13:23:27.627692 24681 raft_consensus.cc:515] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.630595 24371 catalog_manager.cc:5697] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 reported cstate change: term changed from 0 to 1, leader changed from <none> to d033885e21614e9f886d1bdeea04bb03 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "d033885e21614e9f886d1bdeea04bb03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:27.632750 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:27.633623 24550 raft_consensus.cc:3060] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.629186 24665 raft_consensus.cc:359] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.634299 24665 raft_consensus.cc:385] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.634690 24665 raft_consensus.cc:740] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.635666 24665 consensus_queue.cc:260] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.622713 24370 catalog_manager.cc:5697] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129). New cstate: current_term: 1 leader_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.639364 24370 catalog_manager.cc:5697] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129). New cstate: current_term: 1 leader_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.643837 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9" candidate_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:27.644920 24665 ts_tablet_manager.cc:1434] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 13:23:27.649828 24668 tablet_bootstrap.cc:492] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03: No bootstrap required, opened a new log
I20260709 13:23:27.650372 24668 ts_tablet_manager.cc:1403] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03: Time spent bootstrapping tablet: real 0.073s	user 0.029s	sys 0.023s
I20260709 13:23:27.650367 24550 raft_consensus.cc:2468] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 402bbb7e7d924efab283bb5e9c08fb1f in term 1.
I20260709 13:23:27.647104 24681 leader_election.cc:290] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Requested vote from peers 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.646051 24674 raft_consensus.cc:493] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.651477 24693 raft_consensus.cc:515] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.653577 24674 raft_consensus.cc:515] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
W20260709 13:23:27.646325 24437 leader_election.cc:343] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.654995 24668 raft_consensus.cc:359] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.656081 24668 raft_consensus.cc:385] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.656373 24668 raft_consensus.cc:740] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.656751 24437 leader_election.cc:304] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:27.656831 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f2b40ea64f40848731725e48023f0e" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:27.657104 24668 consensus_queue.cc:260] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.657704 24474 raft_consensus.cc:3060] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.657853 24693 leader_election.cc:290] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.659137 24668 ts_tablet_manager.cc:1434] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:23:27.659535 24674 leader_election.cc:290] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.660157 24668 tablet_bootstrap.cc:492] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03: Bootstrap starting.
I20260709 13:23:27.660677 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:27.661453 24549 raft_consensus.cc:2393] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d033885e21614e9f886d1bdeea04bb03 in current term 1: Already voted for candidate 402bbb7e7d924efab283bb5e9c08fb1f in this term.
I20260709 13:23:27.663746 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" is_pre_election: true
I20260709 13:23:27.665426 24588 leader_election.cc:304] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:27.665737 24474 raft_consensus.cc:2468] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 1.
I20260709 13:23:27.666268 24674 raft_consensus.cc:3060] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.666033 24668 tablet_bootstrap.cc:654] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.668236 24588 leader_election.cc:304] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:27.669157 24693 raft_consensus.cc:2804] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.669947 24693 raft_consensus.cc:697] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Becoming Leader. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:27.670894 24693 consensus_queue.cc:237] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.666281 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f2b40ea64f40848731725e48023f0e" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
W20260709 13:23:27.673602 24587 leader_election.cc:343] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:27.677692 24674 raft_consensus.cc:2749] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:27.686324 24681 raft_consensus.cc:2804] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.687469 24681 raft_consensus.cc:697] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 LEADER]: Becoming Leader. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Running, Role: LEADER
I20260709 13:23:27.688678 24681 consensus_queue.cc:237] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.696323 24666 tablet_bootstrap.cc:492] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807: No bootstrap required, opened a new log
I20260709 13:23:27.697211 24666 ts_tablet_manager.cc:1403] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807: Time spent bootstrapping tablet: real 0.101s	user 0.019s	sys 0.022s
I20260709 13:23:27.701519 24666 raft_consensus.cc:359] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:27.702826 24666 raft_consensus.cc:385] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.703209 24666 raft_consensus.cc:740] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.704509 24666 consensus_queue.cc:260] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:27.710742 24369 catalog_manager.cc:5697] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129). New cstate: current_term: 1 leader_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.718156 24666 ts_tablet_manager.cc:1434] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.009s
I20260709 13:23:27.718822 24676 raft_consensus.cc:493] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.719373 24676 raft_consensus.cc:515] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.724817 24676 leader_election.cc:290] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.739748 24668 tablet_bootstrap.cc:492] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03: No bootstrap required, opened a new log
I20260709 13:23:27.740465 24668 ts_tablet_manager.cc:1403] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03: Time spent bootstrapping tablet: real 0.081s	user 0.032s	sys 0.029s
I20260709 13:23:27.743422 24668 raft_consensus.cc:359] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.744267 24668 raft_consensus.cc:385] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.744621 24668 raft_consensus.cc:740] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.743773 24369 catalog_manager.cc:5697] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 reported cstate change: term changed from 0 to 1, leader changed from <none> to d033885e21614e9f886d1bdeea04bb03 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "d033885e21614e9f886d1bdeea04bb03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:27.745465 24668 consensus_queue.cc:260] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.748003 24668 ts_tablet_manager.cc:1434] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:23:27.749047 24668 tablet_bootstrap.cc:492] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03: Bootstrap starting.
I20260709 13:23:27.749135 24666 tablet_bootstrap.cc:492] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807: Bootstrap starting.
I20260709 13:23:27.753753 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" is_pre_election: true
I20260709 13:23:27.754576 24474 raft_consensus.cc:2468] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 0.
I20260709 13:23:27.755805 24668 tablet_bootstrap.cc:654] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.756112 24513 leader_election.cc:304] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:27.757073 24676 raft_consensus.cc:2804] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.757439 24676 raft_consensus.cc:493] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.757826 24676 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.758376 24666 tablet_bootstrap.cc:654] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.769742 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:27.770151 24676 raft_consensus.cc:515] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.770586 24624 raft_consensus.cc:2468] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 0.
I20260709 13:23:27.771507 24668 tablet_bootstrap.cc:492] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03: No bootstrap required, opened a new log
I20260709 13:23:27.772058 24668 ts_tablet_manager.cc:1403] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:23:27.773633 24666 tablet_bootstrap.cc:492] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807: No bootstrap required, opened a new log
I20260709 13:23:27.774127 24676 leader_election.cc:290] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.775023 24666 ts_tablet_manager.cc:1403] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.010s
I20260709 13:23:27.774787 24668 raft_consensus.cc:359] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.775069 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:27.775542 24668 raft_consensus.cc:385] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.775760 24474 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.775884 24668 raft_consensus.cc:740] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.776433 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:27.777045 24624 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.776708 24668 consensus_queue.cc:260] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.779079 24668 ts_tablet_manager.cc:1434] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:23:27.783205 24666 raft_consensus.cc:359] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.783840 24474 raft_consensus.cc:2468] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 1.
I20260709 13:23:27.785198 24513 leader_election.cc:304] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:27.783903 24666 raft_consensus.cc:385] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.785663 24624 raft_consensus.cc:2468] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 1.
I20260709 13:23:27.786075 24666 raft_consensus.cc:740] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.786481 24676 raft_consensus.cc:2804] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.786960 24666 consensus_queue.cc:260] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.787711 24676 raft_consensus.cc:697] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 LEADER]: Becoming Leader. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:27.788757 24676 consensus_queue.cc:237] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.789583 24666 ts_tablet_manager.cc:1434] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:23:27.790621 24666 tablet_bootstrap.cc:492] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807: Bootstrap starting.
I20260709 13:23:27.796904 24666 tablet_bootstrap.cc:654] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.798298 24369 catalog_manager.cc:5697] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.801297 24666 tablet_bootstrap.cc:492] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807: No bootstrap required, opened a new log
I20260709 13:23:27.801898 24666 ts_tablet_manager.cc:1403] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 13:23:27.803403 24681 consensus_queue.cc:1048] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:27.804595 24666 raft_consensus.cc:359] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.805303 24666 raft_consensus.cc:385] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.805580 24666 raft_consensus.cc:740] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.806325 24666 consensus_queue.cc:260] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.808421 24666 ts_tablet_manager.cc:1434] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:27.809377 24666 tablet_bootstrap.cc:492] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807: Bootstrap starting.
I20260709 13:23:27.815538 24666 tablet_bootstrap.cc:654] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:27.830178 24666 tablet_bootstrap.cc:492] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807: No bootstrap required, opened a new log
I20260709 13:23:27.830677 24666 ts_tablet_manager.cc:1403] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.006s
I20260709 13:23:27.833026 24666 raft_consensus.cc:359] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.833586 24666 raft_consensus.cc:385] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:27.833870 24666 raft_consensus.cc:740] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Initialized, Role: FOLLOWER
I20260709 13:23:27.834537 24666 consensus_queue.cc:260] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.836122 24666 ts_tablet_manager.cc:1434] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:27.841953 24676 raft_consensus.cc:493] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.842567 24676 raft_consensus.cc:515] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.844655 24676 leader_election.cc:290] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.845476 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3027dd8371184256ad03c98f665371d3" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" is_pre_election: true
I20260709 13:23:27.845875 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3027dd8371184256ad03c98f665371d3" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:27.847604 24512 leader_election.cc:304] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:27.848456 24676 raft_consensus.cc:2749] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:27.882467 24693 raft_consensus.cc:493] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.883091 24693 raft_consensus.cc:515] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.885068 24693 leader_election.cc:290] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.886142 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" is_pre_election: true
I20260709 13:23:27.886912 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:27.887723 24550 raft_consensus.cc:2393] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d033885e21614e9f886d1bdeea04bb03 in current term 1: Already voted for candidate 402bbb7e7d924efab283bb5e9c08fb1f in this term.
I20260709 13:23:27.888531 24587 leader_election.cc:304] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:27.889205 24693 raft_consensus.cc:3060] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.894834 24693 raft_consensus.cc:2749] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:27.911728 24693 consensus_queue.cc:1048] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:27.923084 24674 consensus_queue.cc:1048] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:27.926134 24676 raft_consensus.cc:493] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.926723 24676 raft_consensus.cc:515] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.929733 24473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" is_pre_election: true
I20260709 13:23:27.930461 24473 raft_consensus.cc:2468] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 0.
I20260709 13:23:27.932199 24513 leader_election.cc:304] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:27.933054 24723 raft_consensus.cc:2804] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:27.933300 24676 leader_election.cc:290] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.933455 24723 raft_consensus.cc:493] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:27.934007 24723 raft_consensus.cc:3060] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.934530 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:27.935245 24624 raft_consensus.cc:2468] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 0.
I20260709 13:23:27.939783 24669 consensus_queue.cc:1048] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:27.943050 24723 raft_consensus.cc:515] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.946051 24723 leader_election.cc:290] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:27.946038 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:27.946285 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:27.947001 24474 raft_consensus.cc:3060] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.947024 24624 raft_consensus.cc:3060] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.955106 24474 raft_consensus.cc:2468] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 1.
I20260709 13:23:27.956332 24681 consensus_queue.cc:1048] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:27.956604 24513 leader_election.cc:304] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:27.957525 24723 raft_consensus.cc:2804] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:27.958071 24723 raft_consensus.cc:697] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 LEADER]: Becoming Leader. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:27.958901 24723 consensus_queue.cc:237] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.961551 24624 raft_consensus.cc:2468] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 1.
I20260709 13:23:27.967119 24550 raft_consensus.cc:3060] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.977418 24681 consensus_queue.cc:1048] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:27.979290 24369 catalog_manager.cc:5697] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:27.987072 24699 raft_consensus.cc:493] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:27.987715 24699 raft_consensus.cc:515] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:27.990211 24699 leader_election.cc:290] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:27.991149 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae0e7715d4d435993f754451d636154" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" is_pre_election: true
I20260709 13:23:27.994207 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae0e7715d4d435993f754451d636154" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:27.995035 24549 raft_consensus.cc:2393] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d033885e21614e9f886d1bdeea04bb03 in current term 1: Already voted for candidate 402bbb7e7d924efab283bb5e9c08fb1f in this term.
I20260709 13:23:27.996304 24587 leader_election.cc:304] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:27.997133 24699 raft_consensus.cc:3060] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:27.996958 24702 consensus_queue.cc:1048] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:28.006228 24699 raft_consensus.cc:2749] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:28.011008 24699 consensus_queue.cc:1048] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:28.022657 24693 consensus_queue.cc:1048] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:28.032035 24702 consensus_queue.cc:1048] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:28.039798 24550 raft_consensus.cc:3060] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:28.044816 24681 consensus_queue.cc:1048] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:28.087774 24723 raft_consensus.cc:493] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:28.088335 24723 raft_consensus.cc:515] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:28.090353 24723 leader_election.cc:290] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:28.091316 24474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f2b40ea64f40848731725e48023f0e" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" is_pre_election: true
I20260709 13:23:28.091427 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f2b40ea64f40848731725e48023f0e" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:28.092099 24474 raft_consensus.cc:2393] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b5975ac353a4b21a2a51f5c5820e807 in current term 1: Already voted for candidate d033885e21614e9f886d1bdeea04bb03 in this term.
I20260709 13:23:28.093137 24513 leader_election.cc:304] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:28.093945 24723 raft_consensus.cc:3060] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:28.099303 24723 raft_consensus.cc:2749] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:28.125898 13122 ts_manager.cc:295] Set tserver state for 402bbb7e7d924efab283bb5e9c08fb1f to MAINTENANCE_MODE
I20260709 13:23:28.126905 13122 tablet_server.cc:179] TabletServer@127.12.208.129:0 shutting down...
I20260709 13:23:28.140654 24681 consensus_queue.cc:1048] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:28.161079 24702 consensus_queue.cc:1048] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:28.174582 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:28.175776 13122 tablet_replica.cc:333] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f: stopping tablet replica
I20260709 13:23:28.176537 13122 raft_consensus.cc:2243] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.177002 13122 raft_consensus.cc:2272] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.179356 13122 tablet_replica.cc:333] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f: stopping tablet replica
I20260709 13:23:28.179987 13122 raft_consensus.cc:2243] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.180416 13122 raft_consensus.cc:2272] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.182991 13122 tablet_replica.cc:333] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f: stopping tablet replica
I20260709 13:23:28.183845 13122 raft_consensus.cc:2243] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.184429 13122 raft_consensus.cc:2272] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.187296 13122 tablet_replica.cc:333] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f: stopping tablet replica
I20260709 13:23:28.187842 13122 raft_consensus.cc:2243] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.188186 13122 raft_consensus.cc:2272] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.190080 13122 tablet_replica.cc:333] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f: stopping tablet replica
I20260709 13:23:28.190572 13122 raft_consensus.cc:2243] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.191149 13122 raft_consensus.cc:2272] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.193969 13122 tablet_replica.cc:333] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f: stopping tablet replica
I20260709 13:23:28.194732 13122 raft_consensus.cc:2243] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.195655 13122 raft_consensus.cc:2272] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:28.196272 24588 consensus_peers.cc:597] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:28.197993 13122 tablet_replica.cc:333] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f: stopping tablet replica
I20260709 13:23:28.198642 13122 raft_consensus.cc:2243] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.199460 13122 raft_consensus.cc:2272] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.201536 13122 tablet_replica.cc:333] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: stopping tablet replica
I20260709 13:23:28.202116 13122 raft_consensus.cc:2243] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.203075 13122 raft_consensus.cc:2272] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.205531 13122 tablet_replica.cc:333] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f: stopping tablet replica
I20260709 13:23:28.206156 13122 raft_consensus.cc:2243] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.207350 13122 raft_consensus.cc:2272] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.209637 13122 tablet_replica.cc:333] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f: stopping tablet replica
I20260709 13:23:28.210191 13122 raft_consensus.cc:2243] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.211026 13122 raft_consensus.cc:2272] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.240911 13122 tablet_server.cc:196] TabletServer@127.12.208.129:0 shutdown complete.
I20260709 13:23:28.245946 24693 consensus_queue.cc:1048] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:23:28.338133 24513 consensus_peers.cc:597] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:28.377403 24588 consensus_peers.cc:597] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:28.411366 24723 consensus_queue.cc:1048] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:28.440062 24723 consensus_queue.cc:1048] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:23:28.454221 24513 consensus_peers.cc:597] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:28.550598 24588 consensus_peers.cc:597] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:29.109627 24420 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:23:29.222375 24588 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111) [suppressed 114 similar messages]
I20260709 13:23:29.319006 24754 raft_consensus.cc:493] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.319550 24754 raft_consensus.cc:515] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.321205 24754 leader_election.cc:290] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:29.322412 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3027dd8371184256ad03c98f665371d3" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
W20260709 13:23:29.324844 24588 leader_election.cc:336] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.325202 24588 leader_election.cc:304] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:29.325767 24754 raft_consensus.cc:2749] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:29.456409 24751 raft_consensus.cc:493] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.457026 24751 raft_consensus.cc:515] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.460119 24751 leader_election.cc:290] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:29.460585 24754 raft_consensus.cc:493] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.461412 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:29.462113 24754 raft_consensus.cc:515] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.463102 24623 raft_consensus.cc:2468] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 1.
W20260709 13:23:29.463382 24513 leader_election.cc:336] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.464344 24754 leader_election.cc:290] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:29.465312 24512 leader_election.cc:304] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f
I20260709 13:23:29.465503 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:29.466285 24550 raft_consensus.cc:2468] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 1.
I20260709 13:23:29.466747 24751 raft_consensus.cc:2804] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:29.467125 24751 raft_consensus.cc:493] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.467413 24587 leader_election.cc:304] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:29.467492 24751 raft_consensus.cc:3060] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:29.468456 24754 raft_consensus.cc:2804] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:23:29.468624 24588 leader_election.cc:336] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.468920 24754 raft_consensus.cc:493] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.469340 24754 raft_consensus.cc:3060] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:29.473690 24751 raft_consensus.cc:515] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.475075 24754 raft_consensus.cc:515] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.476117 24751 leader_election.cc:290] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:29.476939 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:29.477852 24623 raft_consensus.cc:2393] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b5975ac353a4b21a2a51f5c5820e807 in current term 2: Already voted for candidate d033885e21614e9f886d1bdeea04bb03 in this term.
I20260709 13:23:29.478541 24754 leader_election.cc:290] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:29.479076 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:29.479760 24550 raft_consensus.cc:2393] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d033885e21614e9f886d1bdeea04bb03 in current term 2: Already voted for candidate 4b5975ac353a4b21a2a51f5c5820e807 in this term.
W20260709 13:23:29.479903 24513 leader_election.cc:336] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.481101 24512 leader_election.cc:304] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:29.481940 24751 raft_consensus.cc:2749] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:23:29.483448 24588 leader_election.cc:336] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.483866 24588 leader_election.cc:304] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:29.484503 24754 raft_consensus.cc:2749] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:23:29.497249 24751 raft_consensus.cc:493] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.497948 24751 raft_consensus.cc:515] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:29.499720 24751 leader_election.cc:290] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:29.500835 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
W20260709 13:23:29.503140 24513 leader_election.cc:336] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.503486 24513 leader_election.cc:304] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:29.503907 24754 raft_consensus.cc:493] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.504132 24751 raft_consensus.cc:2749] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:29.504566 24754 raft_consensus.cc:515] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:29.506510 24754 leader_election.cc:290] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:29.507622 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:29.508241 24550 raft_consensus.cc:2468] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 1.
I20260709 13:23:29.509527 24587 leader_election.cc:304] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 
W20260709 13:23:29.510160 24588 leader_election.cc:336] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.510383 24754 raft_consensus.cc:2804] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:29.510845 24754 raft_consensus.cc:493] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.511220 24754 raft_consensus.cc:3060] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:29.516306 24754 raft_consensus.cc:515] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:29.518174 24754 leader_election.cc:290] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:29.519480 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:29.520072 24550 raft_consensus.cc:3060] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:29.521970 24588 leader_election.cc:336] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.525856 24550 raft_consensus.cc:2468] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 2.
I20260709 13:23:29.527016 24587 leader_election.cc:304] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f
I20260709 13:23:29.527988 24754 raft_consensus.cc:2804] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:29.529160 24754 raft_consensus.cc:697] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Becoming Leader. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:29.530051 24754 consensus_queue.cc:237] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:29.537168 24370 catalog_manager.cc:5697] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 reported cstate change: term changed from 1 to 2, leader changed from 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129) to d033885e21614e9f886d1bdeea04bb03 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "d033885e21614e9f886d1bdeea04bb03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:29.544250 24751 raft_consensus.cc:493] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.544840 24751 raft_consensus.cc:515] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.547096 24751 leader_election.cc:290] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:29.548390 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae0e7715d4d435993f754451d636154" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:29.549116 24623 raft_consensus.cc:2468] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 1.
I20260709 13:23:29.549718 24754 raft_consensus.cc:493] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.550246 24512 leader_election.cc:304] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:29.550221 24754 raft_consensus.cc:515] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.551247 24751 raft_consensus.cc:2804] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:29.551589 24751 raft_consensus.cc:493] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
W20260709 13:23:29.551792 24513 leader_election.cc:336] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.551898 24751 raft_consensus.cc:3060] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:29.552489 24754 leader_election.cc:290] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:29.554785 24761 raft_consensus.cc:493] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.554916 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae0e7715d4d435993f754451d636154" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:29.555428 24761 raft_consensus.cc:515] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.557559 24761 leader_election.cc:290] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
W20260709 13:23:29.557466 24588 leader_election.cc:336] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.559065 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3027dd8371184256ad03c98f665371d3" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
I20260709 13:23:29.559727 24623 raft_consensus.cc:2468] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 1.
I20260709 13:23:29.559648 24751 raft_consensus.cc:515] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.560925 24512 leader_election.cc:304] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:29.561179 24550 raft_consensus.cc:2393] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d033885e21614e9f886d1bdeea04bb03 in current term 2: Already voted for candidate 4b5975ac353a4b21a2a51f5c5820e807 in this term.
I20260709 13:23:29.561830 24761 raft_consensus.cc:2804] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:29.561950 24751 leader_election.cc:290] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:29.562249 24761 raft_consensus.cc:493] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.562696 24761 raft_consensus.cc:3060] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:29.563138 24587 leader_election.cc:304] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:29.563453 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae0e7715d4d435993f754451d636154" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
W20260709 13:23:29.563800 24513 leader_election.cc:336] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.564111 24623 raft_consensus.cc:3060] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:29.566473 24513 leader_election.cc:336] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.570382 24761 raft_consensus.cc:515] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.571839 24623 raft_consensus.cc:2468] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 2.
I20260709 13:23:29.572458 24754 raft_consensus.cc:2749] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:29.572610 24761 leader_election.cc:290] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:29.573856 24512 leader_election.cc:304] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f
I20260709 13:23:29.574321 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3027dd8371184256ad03c98f665371d3" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:29.574918 24623 raft_consensus.cc:3060] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:29.575107 24761 raft_consensus.cc:2804] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:29.575651 24761 raft_consensus.cc:697] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 LEADER]: Becoming Leader. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:29.576483 24761 consensus_queue.cc:237] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
W20260709 13:23:29.577422 24513 leader_election.cc:336] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.582434 24623 raft_consensus.cc:2468] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 2.
I20260709 13:23:29.583523 24512 leader_election.cc:304] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f
I20260709 13:23:29.584230 24761 raft_consensus.cc:2804] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:29.584702 24761 raft_consensus.cc:697] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 LEADER]: Becoming Leader. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:29.585575 24761 consensus_queue.cc:237] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.585318 24370 catalog_manager.cc:5697] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 reported cstate change: term changed from 1 to 2, leader changed from 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129) to 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:29.597692 24370 catalog_manager.cc:5697] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 reported cstate change: term changed from 1 to 2, leader changed from 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129) to 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:29.658656 24761 raft_consensus.cc:493] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.659369 24761 raft_consensus.cc:515] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.661069 24761 leader_election.cc:290] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:29.662235 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d033885e21614e9f886d1bdeea04bb03" is_pre_election: true
W20260709 13:23:29.664983 24513 leader_election.cc:336] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.665307 24513 leader_election.cc:304] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807; no voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:29.666010 24761 raft_consensus.cc:2749] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:29.666630 24754 raft_consensus.cc:493] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.667106 24754 raft_consensus.cc:515] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.668749 24754 leader_election.cc:290] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:29.669915 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:29.670584 24550 raft_consensus.cc:2468] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 1.
I20260709 13:23:29.671593 24587 leader_election.cc:304] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:29.672382 24754 raft_consensus.cc:2804] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:23:29.672612 24588 leader_election.cc:336] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.672827 24754 raft_consensus.cc:493] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 402bbb7e7d924efab283bb5e9c08fb1f)
I20260709 13:23:29.673207 24754 raft_consensus.cc:3060] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:29.678844 24754 raft_consensus.cc:515] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.680742 24754 leader_election.cc:290] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:29.682154 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:29.682909 24550 raft_consensus.cc:3060] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:29.684690 24588 leader_election.cc:336] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:29.688694 24550 raft_consensus.cc:2468] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 2.
I20260709 13:23:29.689900 24587 leader_election.cc:304] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f
I20260709 13:23:29.690685 24754 raft_consensus.cc:2804] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:29.691150 24754 raft_consensus.cc:697] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Becoming Leader. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:29.691962 24754 consensus_queue.cc:237] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:29.699240 24370 catalog_manager.cc:5697] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 reported cstate change: term changed from 1 to 2, leader changed from 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129) to d033885e21614e9f886d1bdeea04bb03 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "d033885e21614e9f886d1bdeea04bb03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: HEALTHY } } }
W20260709 13:23:29.948215 24588 consensus_peers.cc:597] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:30.050529 24550 raft_consensus.cc:1275] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Refusing update from remote peer d033885e21614e9f886d1bdeea04bb03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:30.052022 24754 consensus_queue.cc:1048] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:30.072902 24513 consensus_peers.cc:597] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:30.110658 24420 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:30.149590 24623 raft_consensus.cc:1275] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:30.151520 24761 consensus_queue.cc:1048] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:30.173130 24513 consensus_peers.cc:597] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:30.176955 24623 raft_consensus.cc:1275] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:30.178318 24761 consensus_queue.cc:1048] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:30.185145 24588 consensus_peers.cc:597] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:30.203299 24550 raft_consensus.cc:1275] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Refusing update from remote peer d033885e21614e9f886d1bdeea04bb03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:30.204608 24755 consensus_queue.cc:1048] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:30.546088 24513 consensus_peers.cc:597] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:30.879630 24588 consensus_peers.cc:597] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:30.934968 24588 consensus_peers.cc:597] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:30.965884 24513 consensus_peers.cc:597] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:31.111807 24420 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:23:31.260265 24588 consensus_peers.cc:597] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:31.567425 24754 raft_consensus.cc:493] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:31.567900 24754 raft_consensus.cc:515] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:31.569643 24754 leader_election.cc:290] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:31.570770 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807" is_pre_election: true
I20260709 13:23:31.571403 24549 raft_consensus.cc:2468] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 2.
I20260709 13:23:31.572438 24587 leader_election.cc:304] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 
W20260709 13:23:31.573060 24588 leader_election.cc:336] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:31.573117 24754 raft_consensus.cc:2804] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:23:31.573586 24754 raft_consensus.cc:493] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:31.573904 24754 raft_consensus.cc:3060] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:31.579027 24754 raft_consensus.cc:515] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:31.581163 24754 leader_election.cc:290] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 3 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:31.582314 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f02379f20f647b18d74372feea9a030" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:31.583007 24549 raft_consensus.cc:3060] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:23:31.585332 24588 leader_election.cc:336] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111)
I20260709 13:23:31.588624 24549 raft_consensus.cc:2468] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 3.
I20260709 13:23:31.589680 24587 leader_election.cc:304] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b5975ac353a4b21a2a51f5c5820e807, d033885e21614e9f886d1bdeea04bb03; no voters: 402bbb7e7d924efab283bb5e9c08fb1f
I20260709 13:23:31.590451 24754 raft_consensus.cc:2804] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:31.590971 24754 raft_consensus.cc:697] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 3 LEADER]: Becoming Leader. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:31.591712 24754 consensus_queue.cc:237] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:31.604254 24371 catalog_manager.cc:5697] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 reported cstate change: term changed from 1 to 3, leader changed from 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129) to d033885e21614e9f886d1bdeea04bb03 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "d033885e21614e9f886d1bdeea04bb03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: HEALTHY } } }
W20260709 13:23:32.112885 24420 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:23:32.129702 24588 consensus_peers.cc:597] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:32.152590 24549 raft_consensus.cc:1275] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Refusing update from remote peer d033885e21614e9f886d1bdeea04bb03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:23:32.153985 24775 consensus_queue.cc:1048] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:32.394970 24588 consensus_peers.cc:597] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:32.588377 24513 consensus_peers.cc:597] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:32.726926 24513 consensus_peers.cc:597] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:32.862725 24588 consensus_peers.cc:597] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:32.895552 24513 consensus_peers.cc:597] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:33.113950 24420 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:33.269770 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:33.277405 24786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:33.277508 24785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:33.278851 24788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:33.279161 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:33.280331 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:33.280586 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:33.280756 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603413280741 us; error 0 us; skew 500 ppm
I20260709 13:23:33.281392 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:33.284291 13122 webserver.cc:533] Webserver started at http://127.12.208.129:40011/ using document root <none> and password file <none>
I20260709 13:23:33.284809 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:33.285025 13122 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:23:33.288854 13122 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:23:33.292796 24793 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:33.293852 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:23:33.294198 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-0-root
uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
format_stamp: "Formatted at 2026-07-09 13:23:26 on dist-test-slave-ll1f"
I20260709 13:23:33.294621 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603003722080-13122-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:33.303968 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:33.305176 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:33.306735 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:33.310963 24800 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:23:33.336337 24513 consensus_peers.cc:597] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:33.363150 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:23:33.363606 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:23:33.363931 13122 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:23:33.369143 24800 tablet_bootstrap.cc:492] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:33.383884 24800 tablet_bootstrap.cc:492] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:33.384980 24800 tablet_bootstrap.cc:492] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap complete.
I20260709 13:23:33.385738 24800 ts_tablet_manager.cc:1403] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:23:33.388464 24800 raft_consensus.cc:359] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.389043 24800 raft_consensus.cc:740] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:33.389863 24800 consensus_queue.cc:260] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.392580 24800 ts_tablet_manager.cc:1434] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:23:33.393595 24800 tablet_bootstrap.cc:492] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:33.411274 24800 tablet_bootstrap.cc:492] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:33.412402 24800 tablet_bootstrap.cc:492] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap complete.
I20260709 13:23:33.413178 24800 ts_tablet_manager.cc:1403] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:23:33.416209 13122 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:23:33.416700 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.053s	user 0.047s	sys 0.003s
I20260709 13:23:33.416164 24800 raft_consensus.cc:359] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.417074 24800 raft_consensus.cc:740] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:33.418184 24800 consensus_queue.cc:260] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.420697 24800 ts_tablet_manager.cc:1434] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:23:33.421715 24800 tablet_bootstrap.cc:492] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:33.440102 24800 tablet_bootstrap.cc:492] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:33.440871 24800 tablet_bootstrap.cc:492] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap complete.
I20260709 13:23:33.441628 24800 ts_tablet_manager.cc:1403] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.011s
I20260709 13:23:33.443886 24800 raft_consensus.cc:359] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.444485 24800 raft_consensus.cc:740] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:33.445173 24800 consensus_queue.cc:260] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.446934 24800 ts_tablet_manager.cc:1434] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:33.447695 24800 tablet_bootstrap.cc:492] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:33.460266 24800 tablet_bootstrap.cc:492] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:33.461127 24800 tablet_bootstrap.cc:492] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap complete.
I20260709 13:23:33.461844 24800 ts_tablet_manager.cc:1403] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.008s
I20260709 13:23:33.463969 24800 raft_consensus.cc:359] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.464594 24800 raft_consensus.cc:740] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:33.465359 24800 consensus_queue.cc:260] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.467195 24800 ts_tablet_manager.cc:1434] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:33.467971 24800 tablet_bootstrap.cc:492] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:33.480701 24800 tablet_bootstrap.cc:492] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:33.482020 24800 tablet_bootstrap.cc:492] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap complete.
I20260709 13:23:33.482702 24800 ts_tablet_manager.cc:1403] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:23:33.484923 24800 raft_consensus.cc:359] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.485529 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.129:34907
I20260709 13:23:33.485668 24862 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.129:34907 every 8 connection(s)
I20260709 13:23:33.485524 24800 raft_consensus.cc:740] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:33.487030 24800 consensus_queue.cc:260] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.488814 24800 ts_tablet_manager.cc:1434] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:33.489558 24800 tablet_bootstrap.cc:492] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:33.491302 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:33.516814 24800 tablet_bootstrap.cc:492] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:33.518072 24800 tablet_bootstrap.cc:492] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap complete.
I20260709 13:23:33.518870 24800 ts_tablet_manager.cc:1403] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.010s
I20260709 13:23:33.521703 24800 raft_consensus.cc:359] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.522581 24800 raft_consensus.cc:740] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:33.523227 24863 heartbeater.cc:344] Connected to a master server at 127.12.208.190:37757
I20260709 13:23:33.523864 24863 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:33.523528 24800 consensus_queue.cc:260] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.525223 24863 heartbeater.cc:507] Master 127.12.208.190:37757 requested a full tablet report, sending...
I20260709 13:23:33.526235 24800 ts_tablet_manager.cc:1434] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:23:33.527308 24800 tablet_bootstrap.cc:492] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:33.546015 24623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a"
dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
mode: GRACEFUL
new_leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:42332
I20260709 13:23:33.546131 24371 ts_manager.cc:194] Re-registered known tserver with Master: 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907)
I20260709 13:23:33.546837 24623 raft_consensus.cc:606] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Received request to transfer leadership to TS 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:33.549633 24800 tablet_bootstrap.cc:492] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:33.549835 24623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0789cc1d37443e691a175f9a3364b17"
dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
mode: GRACEFUL
new_leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:42332
I20260709 13:23:33.550566 24623 raft_consensus.cc:606] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Received request to transfer leadership to TS 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:33.550908 24800 tablet_bootstrap.cc:492] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap complete.
I20260709 13:23:33.551852 24800 ts_tablet_manager.cc:1403] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:23:33.551985 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:33.552695 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:33.553373 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:33.554596 24800 raft_consensus.cc:359] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:33.555454 24800 raft_consensus.cc:740] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:33.556263 24800 consensus_queue.cc:260] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:33.558656 24800 ts_tablet_manager.cc:1434] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:33.559556 24800 tablet_bootstrap.cc:492] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:33.560230 24371 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52842
I20260709 13:23:33.564507 24863 heartbeater.cc:499] Master 127.12.208.190:37757 was elected leader, sending a full tablet report...
W20260709 13:23:33.566430 24588 consensus_peers.cc:597] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:33.576596 24800 tablet_bootstrap.cc:492] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:33.577486 24784 raft_consensus.cc:993] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03: : Instructing follower 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:33.577883 24800 tablet_bootstrap.cc:492] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap complete.
I20260709 13:23:33.578066 24875 raft_consensus.cc:1081] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Signalling peer 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:33.578749 24800 ts_tablet_manager.cc:1403] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:23:33.579939 24549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a"
dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:58432
I20260709 13:23:33.580536 24549 raft_consensus.cc:493] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:33.580853 24549 raft_consensus.cc:3060] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:33.582123 24800 raft_consensus.cc:359] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.582957 24800 raft_consensus.cc:740] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:33.583756 24800 consensus_queue.cc:260] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.586095 24800 ts_tablet_manager.cc:1434] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:23:33.587095 24800 tablet_bootstrap.cc:492] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:33.586942 24549 raft_consensus.cc:515] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:33.590080 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:33.590101 24837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:33.590837 24623 raft_consensus.cc:3055] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:33.591259 24623 raft_consensus.cc:740] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:33.590883 24837 raft_consensus.cc:3060] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:23:33.592190 24623 consensus_queue.cc:260] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:33.593665 24623 raft_consensus.cc:3060] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:33.599851 24837 raft_consensus.cc:2468] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 3.
I20260709 13:23:33.590641 24549 leader_election.cc:290] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 3 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:33.602679 24513 leader_election.cc:304] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:33.601676 24623 raft_consensus.cc:2468] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 3.
I20260709 13:23:33.603574 24800 tablet_bootstrap.cc:492] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:33.603569 24761 raft_consensus.cc:2804] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:33.604846 24800 tablet_bootstrap.cc:492] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap complete.
I20260709 13:23:33.605680 24800 ts_tablet_manager.cc:1403] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 13:23:33.606334 24761 raft_consensus.cc:697] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Becoming Leader. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:33.607372 24761 consensus_queue.cc:237] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:33.608425 24800 raft_consensus.cc:359] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.609193 24800 raft_consensus.cc:740] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:33.609983 24800 consensus_queue.cc:260] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.612138 24800 ts_tablet_manager.cc:1434] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:33.613008 24800 tablet_bootstrap.cc:492] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap starting.
I20260709 13:23:33.622650 24371 catalog_manager.cc:5697] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 reported cstate change: term changed from 2 to 3, leader changed from d033885e21614e9f886d1bdeea04bb03 (127.12.208.131) to 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130). New cstate: current_term: 3 leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:33.629626 24800 tablet_bootstrap.cc:492] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:33.630625 24800 tablet_bootstrap.cc:492] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f: Bootstrap complete.
I20260709 13:23:33.631247 24800 ts_tablet_manager.cc:1403] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:23:33.633839 24800 raft_consensus.cc:359] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.634400 24800 raft_consensus.cc:740] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402bbb7e7d924efab283bb5e9c08fb1f, State: Initialized, Role: FOLLOWER
I20260709 13:23:33.635012 24800 consensus_queue.cc:260] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.636843 24800 ts_tablet_manager.cc:1434] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:33.651618 24837 raft_consensus.cc:3060] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.711205 24837 raft_consensus.cc:3060] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.742570 24837 raft_consensus.cc:3060] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.771804 24837 raft_consensus.cc:3060] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:23:33.785768 24784 raft_consensus.cc:993] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03: : Instructing follower 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:33.786336 24875 raft_consensus.cc:1081] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Signalling peer 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:33.788009 24549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0789cc1d37443e691a175f9a3364b17"
dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:58432
I20260709 13:23:33.788612 24549 raft_consensus.cc:493] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:33.788924 24549 raft_consensus.cc:3060] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.795153 24549 raft_consensus.cc:515] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.796981 24549 leader_election.cc:290] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:33.797762 24837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0789cc1d37443e691a175f9a3364b17" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:33.798467 24837 raft_consensus.cc:3060] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.799116 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0789cc1d37443e691a175f9a3364b17" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:33.799788 24623 raft_consensus.cc:3055] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:33.800062 24623 raft_consensus.cc:740] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:33.800738 24623 consensus_queue.cc:260] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.801728 24623 raft_consensus.cc:3060] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.804302 24837 raft_consensus.cc:2468] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 2.
I20260709 13:23:33.805508 24513 leader_election.cc:304] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:33.806293 24761 raft_consensus.cc:2804] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:33.806705 24761 raft_consensus.cc:697] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 LEADER]: Becoming Leader. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:33.807286 24623 raft_consensus.cc:2468] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 2.
I20260709 13:23:33.807466 24761 consensus_queue.cc:237] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:33.815120 24371 catalog_manager.cc:5697] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 reported cstate change: term changed from 1 to 2, leader changed from d033885e21614e9f886d1bdeea04bb03 (127.12.208.131) to 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:34.065907 24837 raft_consensus.cc:1275] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:34.067478 24891 consensus_queue.cc:1048] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:34.079669 24623 raft_consensus.cc:1275] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:34.081158 24891 consensus_queue.cc:1048] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:23:34.114975 24420 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:34.257731 24623 raft_consensus.cc:1275] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:34.259048 24761 consensus_queue.cc:1048] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:34.267619 24837 raft_consensus.cc:1275] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:34.269641 24761 consensus_queue.cc:1048] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:34.562105 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:34.579860 24550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879"
dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
mode: GRACEFUL
new_leader_uuid: "d033885e21614e9f886d1bdeea04bb03"
 from {username='slave'} at 127.0.0.1:34248
I20260709 13:23:34.580484 24550 raft_consensus.cc:606] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 LEADER]: Received request to transfer leadership to TS d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:34.583554 24550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a"
dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
mode: GRACEFUL
new_leader_uuid: "d033885e21614e9f886d1bdeea04bb03"
 from {username='slave'} at 127.0.0.1:34248
I20260709 13:23:34.584198 24550 raft_consensus.cc:606] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Received request to transfer leadership to TS d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:34.585976 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:34.586540 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:34.587188 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:34.621380 24891 raft_consensus.cc:993] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807: : Instructing follower d033885e21614e9f886d1bdeea04bb03 to start an election
I20260709 13:23:34.622004 24761 raft_consensus.cc:1081] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 LEADER]: Signalling peer d033885e21614e9f886d1bdeea04bb03 to start an election
I20260709 13:23:34.623507 24623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879"
dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
 from {username='slave'} at 127.0.0.1:42320
I20260709 13:23:34.623992 24623 raft_consensus.cc:493] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:34.624249 24623 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:34.630084 24623 raft_consensus.cc:515] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:34.631821 24623 leader_election.cc:290] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:34.632660 24835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:34.633440 24835 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:34.633967 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:34.634617 24549 raft_consensus.cc:3055] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:34.634907 24549 raft_consensus.cc:740] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:34.635628 24549 consensus_queue.cc:260] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:34.636650 24549 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:34.639457 24835 raft_consensus.cc:2468] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 2.
I20260709 13:23:34.640576 24588 leader_election.cc:304] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:34.641294 24784 raft_consensus.cc:2804] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:34.641815 24784 raft_consensus.cc:697] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Becoming Leader. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:34.642565 24549 raft_consensus.cc:2468] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 2.
I20260709 13:23:34.642653 24784 consensus_queue.cc:237] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:34.650524 24369 catalog_manager.cc:5697] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 reported cstate change: term changed from 1 to 2, leader changed from 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130) to d033885e21614e9f886d1bdeea04bb03 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "d033885e21614e9f886d1bdeea04bb03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:35.047251 24891 raft_consensus.cc:993] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807: : Instructing follower d033885e21614e9f886d1bdeea04bb03 to start an election
I20260709 13:23:35.047719 24761 raft_consensus.cc:1081] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Signalling peer d033885e21614e9f886d1bdeea04bb03 to start an election
I20260709 13:23:35.049145 24623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a"
dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
 from {username='slave'} at 127.0.0.1:42320
I20260709 13:23:35.049597 24623 raft_consensus.cc:493] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:35.049934 24623 raft_consensus.cc:3060] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:35.055323 24623 raft_consensus.cc:515] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:35.056977 24623 leader_election.cc:290] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 4 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:35.057865 24835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:35.058218 24549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872fb3854aab4c5dae7af7aa64d81c7a" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:35.058527 24835 raft_consensus.cc:3060] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:35.058759 24549 raft_consensus.cc:3055] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:23:35.059072 24549 raft_consensus.cc:740] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:35.059686 24549 consensus_queue.cc:260] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:35.060822 24549 raft_consensus.cc:3060] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:35.064826 24835 raft_consensus.cc:2468] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 4.
I20260709 13:23:35.066180 24588 leader_election.cc:304] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:35.066583 24549 raft_consensus.cc:2468] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 4.
I20260709 13:23:35.066941 24784 raft_consensus.cc:2804] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:23:35.067531 24784 raft_consensus.cc:697] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 4 LEADER]: Becoming Leader. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:35.068287 24784 consensus_queue.cc:237] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } }
I20260709 13:23:35.074661 24369 catalog_manager.cc:5697] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 reported cstate change: term changed from 3 to 4, leader changed from 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130) to d033885e21614e9f886d1bdeea04bb03 (127.12.208.131). New cstate: current_term: 4 leader_uuid: "d033885e21614e9f886d1bdeea04bb03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:35.103683 24549 raft_consensus.cc:1275] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Refusing update from remote peer d033885e21614e9f886d1bdeea04bb03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:35.105166 24784 consensus_queue.cc:1048] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:35.116295 24420 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:35.119022 24835 raft_consensus.cc:1275] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Refusing update from remote peer d033885e21614e9f886d1bdeea04bb03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:35.120514 24784 consensus_queue.cc:1048] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:35.512099 24835 raft_consensus.cc:1275] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 4 FOLLOWER]: Refusing update from remote peer d033885e21614e9f886d1bdeea04bb03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:23:35.513314 24784 consensus_queue.cc:1048] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:23:35.523600 24550 raft_consensus.cc:1275] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 4 FOLLOWER]: Refusing update from remote peer d033885e21614e9f886d1bdeea04bb03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:23:35.525173 24784 consensus_queue.cc:1048] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:23:35.593981 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:35.601346 24623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879"
dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
mode: GRACEFUL
new_leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:42332
I20260709 13:23:35.601981 24623 raft_consensus.cc:606] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Received request to transfer leadership to TS 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:35.604527 24623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6f2b40ea64f40848731725e48023f0e"
dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
mode: GRACEFUL
new_leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:42332
I20260709 13:23:35.605006 24623 raft_consensus.cc:606] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Received request to transfer leadership to TS 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:35.605984 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:35.606492 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:35.607064 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:35.683691 24784 raft_consensus.cc:993] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03: : Instructing follower 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:35.684109 24784 raft_consensus.cc:1081] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Signalling peer 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:35.685635 24550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879"
dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:58432
I20260709 13:23:35.686168 24550 raft_consensus.cc:493] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:35.686506 24550 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:35.691493 24550 raft_consensus.cc:515] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:35.693120 24550 leader_election.cc:290] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 3 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:35.694365 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:35.694404 24835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:35.694947 24623 raft_consensus.cc:3055] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:35.695161 24835 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:35.695307 24623 raft_consensus.cc:740] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:35.696171 24623 consensus_queue.cc:260] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:35.697199 24623 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:35.701087 24835 raft_consensus.cc:2468] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 3.
I20260709 13:23:35.701937 24623 raft_consensus.cc:2468] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 3.
I20260709 13:23:35.702598 24513 leader_election.cc:304] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:35.703553 24761 raft_consensus.cc:2804] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:35.703991 24761 raft_consensus.cc:697] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Becoming Leader. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:35.704741 24761 consensus_queue.cc:237] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:35.710498 24369 catalog_manager.cc:5697] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 reported cstate change: term changed from 2 to 3, leader changed from d033885e21614e9f886d1bdeea04bb03 (127.12.208.131) to 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130). New cstate: current_term: 3 leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:35.994904 24909 raft_consensus.cc:993] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03: : Instructing follower 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:35.995409 24784 raft_consensus.cc:1081] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Signalling peer 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:35.997028 24550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6f2b40ea64f40848731725e48023f0e"
dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:58432
I20260709 13:23:35.997535 24550 raft_consensus.cc:493] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:35.997844 24550 raft_consensus.cc:3060] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:36.002569 24550 raft_consensus.cc:515] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:36.004084 24550 leader_election.cc:290] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:36.005103 24835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f2b40ea64f40848731725e48023f0e" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:36.005316 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f2b40ea64f40848731725e48023f0e" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:36.006031 24835 raft_consensus.cc:3060] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:36.006081 24623 raft_consensus.cc:3055] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:36.006662 24623 raft_consensus.cc:740] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:36.007546 24623 consensus_queue.cc:260] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:36.008864 24623 raft_consensus.cc:3060] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:36.014361 24835 raft_consensus.cc:2468] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 2.
I20260709 13:23:36.015913 24513 leader_election.cc:304] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:36.016268 24623 raft_consensus.cc:2468] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 2.
I20260709 13:23:36.016894 24761 raft_consensus.cc:2804] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:36.017366 24761 raft_consensus.cc:697] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 LEADER]: Becoming Leader. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:36.018194 24761 consensus_queue.cc:237] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:36.025132 24369 catalog_manager.cc:5697] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 reported cstate change: term changed from 1 to 2, leader changed from d033885e21614e9f886d1bdeea04bb03 (127.12.208.131) to 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
W20260709 13:23:36.117408 24420 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:36.207475 24623 raft_consensus.cc:1275] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:36.208954 24891 consensus_queue.cc:1048] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:36.218973 24835 raft_consensus.cc:1275] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:36.221055 24761 consensus_queue.cc:1048] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:36.402330 24835 raft_consensus.cc:1275] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:36.403823 24761 consensus_queue.cc:1048] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:36.413733 24623 raft_consensus.cc:1275] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:36.415478 24891 consensus_queue.cc:1048] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:36.613402 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:36.622385 24550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879"
dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
mode: GRACEFUL
new_leader_uuid: "d033885e21614e9f886d1bdeea04bb03"
 from {username='slave'} at 127.0.0.1:34248
I20260709 13:23:36.622964 24550 raft_consensus.cc:606] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Received request to transfer leadership to TS d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:36.625917 24550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430"
dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
mode: GRACEFUL
new_leader_uuid: "d033885e21614e9f886d1bdeea04bb03"
 from {username='slave'} at 127.0.0.1:34248
I20260709 13:23:36.626546 24550 raft_consensus.cc:606] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 LEADER]: Received request to transfer leadership to TS d033885e21614e9f886d1bdeea04bb03
I20260709 13:23:36.627723 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:36.628214 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:36.628752 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:37.045621 24891 raft_consensus.cc:993] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807: : Instructing follower d033885e21614e9f886d1bdeea04bb03 to start an election
I20260709 13:23:37.046480 24930 raft_consensus.cc:1081] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 LEADER]: Signalling peer d033885e21614e9f886d1bdeea04bb03 to start an election
I20260709 13:23:37.048270 24624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430"
dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
 from {username='slave'} at 127.0.0.1:42320
I20260709 13:23:37.049014 24624 raft_consensus.cc:493] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:37.049397 24624 raft_consensus.cc:3060] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.062578 24624 raft_consensus.cc:515] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:37.064718 24624 leader_election.cc:290] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:37.066118 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:37.066061 24837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:37.067067 24550 raft_consensus.cc:3055] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:37.067327 24837 raft_consensus.cc:3060] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.067500 24550 raft_consensus.cc:740] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:37.068840 24550 consensus_queue.cc:260] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:37.071246 24550 raft_consensus.cc:3060] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.078600 24837 raft_consensus.cc:2468] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 2.
I20260709 13:23:37.080312 24588 leader_election.cc:304] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:37.081246 24909 raft_consensus.cc:2804] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:37.081248 24550 raft_consensus.cc:2468] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 2.
I20260709 13:23:37.081957 24909 raft_consensus.cc:697] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Becoming Leader. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:37.083477 24909 consensus_queue.cc:237] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:37.093464 24371 catalog_manager.cc:5697] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 reported cstate change: term changed from 1 to 2, leader changed from 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130) to d033885e21614e9f886d1bdeea04bb03 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "d033885e21614e9f886d1bdeea04bb03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: HEALTHY } } }
W20260709 13:23:37.118567 24420 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:37.167797 24891 raft_consensus.cc:993] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807: : Instructing follower d033885e21614e9f886d1bdeea04bb03 to start an election
I20260709 13:23:37.168427 24930 raft_consensus.cc:1081] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Signalling peer d033885e21614e9f886d1bdeea04bb03 to start an election
I20260709 13:23:37.170136 24624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879"
dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
 from {username='slave'} at 127.0.0.1:42320
I20260709 13:23:37.170774 24624 raft_consensus.cc:493] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:37.171155 24624 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:37.177325 24624 raft_consensus.cc:515] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:37.179363 24624 leader_election.cc:290] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 4 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571)
I20260709 13:23:37.180233 24837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:37.180857 24550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f456236139d469a84bdb9cf93f17879" candidate_uuid: "d033885e21614e9f886d1bdeea04bb03" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
I20260709 13:23:37.181089 24837 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:37.181582 24550 raft_consensus.cc:3055] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:23:37.182036 24550 raft_consensus.cc:740] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:37.182927 24550 consensus_queue.cc:260] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:37.184643 24550 raft_consensus.cc:3060] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:37.188155 24837 raft_consensus.cc:2468] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 4.
I20260709 13:23:37.189625 24588 leader_election.cc:304] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, d033885e21614e9f886d1bdeea04bb03; no voters: 
I20260709 13:23:37.190465 24909 raft_consensus.cc:2804] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:23:37.190845 24550 raft_consensus.cc:2468] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d033885e21614e9f886d1bdeea04bb03 in term 4.
I20260709 13:23:37.191010 24909 raft_consensus.cc:697] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 4 LEADER]: Becoming Leader. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:37.192221 24909 consensus_queue.cc:237] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:37.199710 24371 catalog_manager.cc:5697] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 reported cstate change: term changed from 3 to 4, leader changed from 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130) to d033885e21614e9f886d1bdeea04bb03 (127.12.208.131). New cstate: current_term: 4 leader_uuid: "d033885e21614e9f886d1bdeea04bb03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:37.482239 24837 raft_consensus.cc:1275] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Refusing update from remote peer d033885e21614e9f886d1bdeea04bb03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:37.483639 24909 consensus_queue.cc:1048] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:37.498908 24550 raft_consensus.cc:1275] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Refusing update from remote peer d033885e21614e9f886d1bdeea04bb03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:37.500856 24909 consensus_queue.cc:1048] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:37.615739 24837 raft_consensus.cc:1275] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 4 FOLLOWER]: Refusing update from remote peer d033885e21614e9f886d1bdeea04bb03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:23:37.617070 24909 consensus_queue.cc:1048] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:23:37.627193 24550 raft_consensus.cc:1275] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 4 FOLLOWER]: Refusing update from remote peer d033885e21614e9f886d1bdeea04bb03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:23:37.629468 24909 consensus_queue.cc:1048] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:23:37.635682 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:37.649379 24624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9"
dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
mode: GRACEFUL
new_leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:42332
I20260709 13:23:37.650008 24624 raft_consensus.cc:606] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Received request to transfer leadership to TS 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:37.652787 24624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430"
dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
mode: GRACEFUL
new_leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:42332
I20260709 13:23:37.653311 24624 raft_consensus.cc:606] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Received request to transfer leadership to TS 4b5975ac353a4b21a2a51f5c5820e807
I20260709 13:23:37.654428 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:37.655076 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:37.656080 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:37.669737 24942 raft_consensus.cc:993] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03: : Instructing follower 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:37.670496 24909 raft_consensus.cc:1081] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Signalling peer 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:37.672315 24550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9"
dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:58432
I20260709 13:23:37.672808 24550 raft_consensus.cc:493] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:37.673138 24550 raft_consensus.cc:3060] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:37.678674 24550 raft_consensus.cc:515] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:37.680732 24550 leader_election.cc:290] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 3 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:37.681493 24837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:37.681947 24624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb995dacb74be1b4ac3789fe681cf9" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:37.682477 24837 raft_consensus.cc:3060] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:37.682569 24624 raft_consensus.cc:3055] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:37.683032 24624 raft_consensus.cc:740] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:37.683889 24624 consensus_queue.cc:260] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:37.685005 24624 raft_consensus.cc:3060] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:37.688406 24837 raft_consensus.cc:2468] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 3.
I20260709 13:23:37.689724 24513 leader_election.cc:304] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:37.690649 24930 raft_consensus.cc:2804] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:37.691262 24624 raft_consensus.cc:2468] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 3.
I20260709 13:23:37.691979 24930 raft_consensus.cc:697] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Becoming Leader. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:37.693367 24930 consensus_queue.cc:237] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:37.701050 24369 catalog_manager.cc:5697] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 reported cstate change: term changed from 2 to 3, leader changed from d033885e21614e9f886d1bdeea04bb03 (127.12.208.131) to 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130). New cstate: current_term: 3 leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:38.078907 24624 raft_consensus.cc:1275] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:38.080384 24930 consensus_queue.cc:1048] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:38.084687 24932 raft_consensus.cc:993] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03: : Instructing follower 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:38.085189 24942 raft_consensus.cc:1081] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Signalling peer 4b5975ac353a4b21a2a51f5c5820e807 to start an election
I20260709 13:23:38.087167 24550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430"
dest_uuid: "4b5975ac353a4b21a2a51f5c5820e807"
 from {username='slave'} at 127.0.0.1:58432
I20260709 13:23:38.087728 24550 raft_consensus.cc:493] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:38.088114 24550 raft_consensus.cc:3060] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:38.092135 24837 raft_consensus.cc:1275] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:38.094641 24930 consensus_queue.cc:1048] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:38.097281 24550 raft_consensus.cc:515] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:38.099408 24550 leader_election.cc:290] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 3 election: Requested vote from peers 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907), d033885e21614e9f886d1bdeea04bb03 (127.12.208.131:38565)
I20260709 13:23:38.100665 24834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "402bbb7e7d924efab283bb5e9c08fb1f"
I20260709 13:23:38.101547 24834 raft_consensus.cc:3060] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:38.106205 24623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a98573426d44b2a854f6cd791e04430" candidate_uuid: "4b5975ac353a4b21a2a51f5c5820e807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d033885e21614e9f886d1bdeea04bb03"
I20260709 13:23:38.106911 24623 raft_consensus.cc:3055] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:38.107218 24623 raft_consensus.cc:740] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d033885e21614e9f886d1bdeea04bb03, State: Running, Role: LEADER
I20260709 13:23:38.108028 24623 consensus_queue.cc:260] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:38.109313 24623 raft_consensus.cc:3060] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:38.114982 24834 raft_consensus.cc:2468] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 3.
I20260709 13:23:38.116473 24513 leader_election.cc:304] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 402bbb7e7d924efab283bb5e9c08fb1f, 4b5975ac353a4b21a2a51f5c5820e807; no voters: 
I20260709 13:23:38.117540 24930 raft_consensus.cc:2804] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:38.118129 24930 raft_consensus.cc:697] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Becoming Leader. State: Replica: 4b5975ac353a4b21a2a51f5c5820e807, State: Running, Role: LEADER
I20260709 13:23:38.118829 24623 raft_consensus.cc:2468] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5975ac353a4b21a2a51f5c5820e807 in term 3.
W20260709 13:23:38.119786 24420 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:38.119478 24930 consensus_queue.cc:237] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } }
I20260709 13:23:38.126293 24369 catalog_manager.cc:5697] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 reported cstate change: term changed from 2 to 3, leader changed from d033885e21614e9f886d1bdeea04bb03 (127.12.208.131) to 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130). New cstate: current_term: 3 leader_uuid: "4b5975ac353a4b21a2a51f5c5820e807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5975ac353a4b21a2a51f5c5820e807" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 39571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:38.573320 24623 raft_consensus.cc:1275] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:38.574640 24953 consensus_queue.cc:1048] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d033885e21614e9f886d1bdeea04bb03" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:38.583365 24834 raft_consensus.cc:1275] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Refusing update from remote peer 4b5975ac353a4b21a2a51f5c5820e807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:38.584936 24930 consensus_queue.cc:1048] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402bbb7e7d924efab283bb5e9c08fb1f" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:38.663108 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:38.701205 13122 tablet_server.cc:179] TabletServer@127.12.208.129:34907 shutting down...
W20260709 13:23:38.711508 24513 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 91 similar messages]
W20260709 13:23:38.717587 24513 consensus_peers.cc:597] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:38.730427 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:38.731223 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:38.732064 13122 raft_consensus.cc:2243] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.732623 13122 raft_consensus.cc:2272] T 5ae0e7715d4d435993f754451d636154 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.735352 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:38.736013 13122 raft_consensus.cc:2243] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.736585 13122 raft_consensus.cc:2272] T 872fb3854aab4c5dae7af7aa64d81c7a P 402bbb7e7d924efab283bb5e9c08fb1f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.739768 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:38.740525 13122 raft_consensus.cc:2243] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.741073 13122 raft_consensus.cc:2272] T 51cb995dacb74be1b4ac3789fe681cf9 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.743908 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:38.744484 13122 raft_consensus.cc:2243] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.744855 13122 raft_consensus.cc:2272] T 6fb5aaf8e75943deb9195ab290ff89ee P 402bbb7e7d924efab283bb5e9c08fb1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.747776 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:38.748447 13122 raft_consensus.cc:2243] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.748965 13122 raft_consensus.cc:2272] T 0f456236139d469a84bdb9cf93f17879 P 402bbb7e7d924efab283bb5e9c08fb1f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.751565 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:38.752043 13122 raft_consensus.cc:2243] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.752440 13122 raft_consensus.cc:2272] T 7a98573426d44b2a854f6cd791e04430 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.755167 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:38.755700 13122 raft_consensus.cc:2243] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.756187 13122 raft_consensus.cc:2272] T d6f2b40ea64f40848731725e48023f0e P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.758436 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:38.758916 13122 raft_consensus.cc:2243] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.759326 13122 raft_consensus.cc:2272] T d0789cc1d37443e691a175f9a3364b17 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.761724 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:38.762307 13122 raft_consensus.cc:2243] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.762764 13122 raft_consensus.cc:2272] T 3027dd8371184256ad03c98f665371d3 P 402bbb7e7d924efab283bb5e9c08fb1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.764922 13122 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:38.765377 13122 raft_consensus.cc:2243] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.765823 13122 raft_consensus.cc:2272] T 9f02379f20f647b18d74372feea9a030 P 402bbb7e7d924efab283bb5e9c08fb1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.798569 13122 tablet_server.cc:196] TabletServer@127.12.208.129:34907 shutdown complete.
I20260709 13:23:38.828974 13122 tablet_server.cc:179] TabletServer@127.12.208.130:0 shutting down...
I20260709 13:23:38.857231 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:38.858100 13122 tablet_replica.cc:333] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807: stopping tablet replica
I20260709 13:23:38.858860 13122 raft_consensus.cc:2243] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.859762 13122 raft_consensus.cc:2272] T 7a98573426d44b2a854f6cd791e04430 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.862646 13122 tablet_replica.cc:333] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807: stopping tablet replica
I20260709 13:23:38.863260 13122 raft_consensus.cc:2243] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.863752 13122 raft_consensus.cc:2272] T 872fb3854aab4c5dae7af7aa64d81c7a P 4b5975ac353a4b21a2a51f5c5820e807 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.865953 13122 tablet_replica.cc:333] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807: stopping tablet replica
I20260709 13:23:38.866532 13122 raft_consensus.cc:2243] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.867306 13122 raft_consensus.cc:2272] T 51cb995dacb74be1b4ac3789fe681cf9 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.870297 13122 tablet_replica.cc:333] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807: stopping tablet replica
I20260709 13:23:38.871037 13122 raft_consensus.cc:2243] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.871484 13122 raft_consensus.cc:2272] T 0f456236139d469a84bdb9cf93f17879 P 4b5975ac353a4b21a2a51f5c5820e807 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.873903 13122 tablet_replica.cc:333] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807: stopping tablet replica
I20260709 13:23:38.874514 13122 raft_consensus.cc:2243] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.875106 13122 raft_consensus.cc:2272] T 6fb5aaf8e75943deb9195ab290ff89ee P 4b5975ac353a4b21a2a51f5c5820e807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:38.876523 24588 consensus_peers.cc:597] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:38.877700 13122 tablet_replica.cc:333] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807: stopping tablet replica
I20260709 13:23:38.878414 13122 raft_consensus.cc:2243] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.879338 13122 raft_consensus.cc:2272] T 3027dd8371184256ad03c98f665371d3 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.882287 13122 tablet_replica.cc:333] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807: stopping tablet replica
I20260709 13:23:38.882865 13122 raft_consensus.cc:2243] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.883358 13122 raft_consensus.cc:2272] T 9f02379f20f647b18d74372feea9a030 P 4b5975ac353a4b21a2a51f5c5820e807 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.886194 13122 tablet_replica.cc:333] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807: stopping tablet replica
W20260709 13:23:38.886375 24588 consensus_peers.cc:597] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 -> Peer 402bbb7e7d924efab283bb5e9c08fb1f (127.12.208.129:34907): Couldn't send request to peer 402bbb7e7d924efab283bb5e9c08fb1f. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:34907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:38.886837 13122 raft_consensus.cc:2243] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.887787 13122 raft_consensus.cc:2272] T d6f2b40ea64f40848731725e48023f0e P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.890081 13122 tablet_replica.cc:333] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807: stopping tablet replica
I20260709 13:23:38.890655 13122 raft_consensus.cc:2243] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.891507 13122 raft_consensus.cc:2272] T d0789cc1d37443e691a175f9a3364b17 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.893739 13122 tablet_replica.cc:333] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807: stopping tablet replica
I20260709 13:23:38.894374 13122 raft_consensus.cc:2243] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.895275 13122 raft_consensus.cc:2272] T 5ae0e7715d4d435993f754451d636154 P 4b5975ac353a4b21a2a51f5c5820e807 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:38.912761 24515 connection.cc:466] server connection from 127.0.0.1:58432 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58432 (request call id 151) could send its response
W20260709 13:23:38.918550 24587 consensus_peers.cc:597] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 -> Peer 4b5975ac353a4b21a2a51f5c5820e807 (127.12.208.130:39571): Couldn't send request to peer 4b5975ac353a4b21a2a51f5c5820e807. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:39571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:38.920961 13122 tablet_server.cc:196] TabletServer@127.12.208.130:0 shutdown complete.
I20260709 13:23:38.947971 13122 tablet_server.cc:179] TabletServer@127.12.208.131:0 shutting down...
I20260709 13:23:38.973695 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:38.974552 13122 tablet_replica.cc:333] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03: stopping tablet replica
I20260709 13:23:38.975227 13122 raft_consensus.cc:2243] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.975757 13122 raft_consensus.cc:2272] T 5ae0e7715d4d435993f754451d636154 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.978080 13122 tablet_replica.cc:333] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03: stopping tablet replica
I20260709 13:23:38.978626 13122 raft_consensus.cc:2243] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.979000 13122 raft_consensus.cc:2272] T 51cb995dacb74be1b4ac3789fe681cf9 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.981961 13122 tablet_replica.cc:333] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03: stopping tablet replica
I20260709 13:23:38.982498 13122 raft_consensus.cc:2243] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.982878 13122 raft_consensus.cc:2272] T 7a98573426d44b2a854f6cd791e04430 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.986225 13122 tablet_replica.cc:333] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03: stopping tablet replica
I20260709 13:23:38.986734 13122 raft_consensus.cc:2243] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.987588 13122 raft_consensus.cc:2272] T 872fb3854aab4c5dae7af7aa64d81c7a P d033885e21614e9f886d1bdeea04bb03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.989876 13122 tablet_replica.cc:333] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03: stopping tablet replica
I20260709 13:23:38.990478 13122 raft_consensus.cc:2243] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.991037 13122 raft_consensus.cc:2272] T d0789cc1d37443e691a175f9a3364b17 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.993352 13122 tablet_replica.cc:333] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03: stopping tablet replica
I20260709 13:23:38.993980 13122 raft_consensus.cc:2243] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:38.994553 13122 raft_consensus.cc:2272] T d6f2b40ea64f40848731725e48023f0e P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:38.996822 13122 tablet_replica.cc:333] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03: stopping tablet replica
I20260709 13:23:38.997403 13122 raft_consensus.cc:2243] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:38.998415 13122 raft_consensus.cc:2272] T 6fb5aaf8e75943deb9195ab290ff89ee P d033885e21614e9f886d1bdeea04bb03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:39.000746 13122 tablet_replica.cc:333] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03: stopping tablet replica
I20260709 13:23:39.001384 13122 raft_consensus.cc:2243] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:23:39.002274 13122 raft_consensus.cc:2272] T 0f456236139d469a84bdb9cf93f17879 P d033885e21614e9f886d1bdeea04bb03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:39.004585 13122 tablet_replica.cc:333] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03: stopping tablet replica
I20260709 13:23:39.005110 13122 raft_consensus.cc:2243] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:39.006080 13122 raft_consensus.cc:2272] T 9f02379f20f647b18d74372feea9a030 P d033885e21614e9f886d1bdeea04bb03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:39.008360 13122 tablet_replica.cc:333] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03: stopping tablet replica
I20260709 13:23:39.008876 13122 raft_consensus.cc:2243] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:39.009407 13122 raft_consensus.cc:2272] T 3027dd8371184256ad03c98f665371d3 P d033885e21614e9f886d1bdeea04bb03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:39.034915 13122 tablet_server.cc:196] TabletServer@127.12.208.131:0 shutdown complete.
I20260709 13:23:39.061735 13122 master.cc:562] Master@127.12.208.190:37757 shutting down...
I20260709 13:23:39.089708 13122 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:39.090322 13122 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:39.090692 13122 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6c2b40b8a0ce430bb0b6074941bbb5ab: stopping tablet replica
I20260709 13:23:39.113071 13122 master.cc:584] Master@127.12.208.190:37757 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13204 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:23:39.158564 13122 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.208.190:42833
I20260709 13:23:39.159668 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:39.166092 24962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:39.166111 24963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:39.167135 24965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:39.167603 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:39.168556 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:39.168735 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:39.168910 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603419168896 us; error 0 us; skew 500 ppm
I20260709 13:23:39.169411 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:39.171876 13122 webserver.cc:533] Webserver started at http://127.12.208.190:34889/ using document root <none> and password file <none>
I20260709 13:23:39.172376 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:39.172536 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:39.172762 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:39.174091 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/master-0-root/instance:
uuid: "29c07bcc891041e087081222f213a01b"
format_stamp: "Formatted at 2026-07-09 13:23:39 on dist-test-slave-ll1f"
I20260709 13:23:39.178943 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:23:39.182431 24970 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:39.183216 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:23:39.183543 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/master-0-root
uuid: "29c07bcc891041e087081222f213a01b"
format_stamp: "Formatted at 2026-07-09 13:23:39 on dist-test-slave-ll1f"
I20260709 13:23:39.183858 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:39.208424 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:39.209925 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:39.250603 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.190:42833
I20260709 13:23:39.250710 25021 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.190:42833 every 8 connection(s)
I20260709 13:23:39.254660 25022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:39.266821 25022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b: Bootstrap starting.
I20260709 13:23:39.271801 25022 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:39.276434 25022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b: No bootstrap required, opened a new log
I20260709 13:23:39.278816 25022 raft_consensus.cc:359] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c07bcc891041e087081222f213a01b" member_type: VOTER }
I20260709 13:23:39.279415 25022 raft_consensus.cc:385] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:39.279657 25022 raft_consensus.cc:740] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c07bcc891041e087081222f213a01b, State: Initialized, Role: FOLLOWER
I20260709 13:23:39.280318 25022 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c07bcc891041e087081222f213a01b" member_type: VOTER }
I20260709 13:23:39.280767 25022 raft_consensus.cc:399] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:23:39.280975 25022 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:23:39.281185 25022 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:39.286543 25022 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c07bcc891041e087081222f213a01b" member_type: VOTER }
I20260709 13:23:39.287061 25022 leader_election.cc:304] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29c07bcc891041e087081222f213a01b; no voters: 
I20260709 13:23:39.288254 25022 leader_election.cc:290] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:23:39.288722 25025 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:39.290243 25025 raft_consensus.cc:697] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [term 1 LEADER]: Becoming Leader. State: Replica: 29c07bcc891041e087081222f213a01b, State: Running, Role: LEADER
I20260709 13:23:39.291046 25025 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c07bcc891041e087081222f213a01b" member_type: VOTER }
I20260709 13:23:39.291384 25022 sys_catalog.cc:565] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:23:39.298462 25026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29c07bcc891041e087081222f213a01b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c07bcc891041e087081222f213a01b" member_type: VOTER } }
I20260709 13:23:39.298264 25027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29c07bcc891041e087081222f213a01b. Latest consensus state: current_term: 1 leader_uuid: "29c07bcc891041e087081222f213a01b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c07bcc891041e087081222f213a01b" member_type: VOTER } }
I20260709 13:23:39.299167 25026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:39.299180 25027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:39.302656 25034 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:23:39.307816 25034 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:23:39.311270 13122 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:23:39.318254 25034 catalog_manager.cc:1383] Generated new cluster ID: 7c9e89bb342842358d67d80452cadd34
I20260709 13:23:39.318697 25034 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:23:39.338969 25034 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:23:39.340291 25034 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:23:39.352751 25034 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b: Generated new TSK 0
I20260709 13:23:39.353348 25034 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:23:39.382191 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:39.388445 25043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:39.390179 25044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:39.392110 13122 server_base.cc:1061] running on GCE node
W20260709 13:23:39.392505 25046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:39.393584 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:39.393836 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:39.394001 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603419393985 us; error 0 us; skew 500 ppm
I20260709 13:23:39.394622 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:39.397089 13122 webserver.cc:533] Webserver started at http://127.12.208.129:45793/ using document root <none> and password file <none>
I20260709 13:23:39.397590 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:39.397781 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:39.398131 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:39.399284 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-0-root/instance:
uuid: "229cbab44910443fb592ff50d4055dbf"
format_stamp: "Formatted at 2026-07-09 13:23:39 on dist-test-slave-ll1f"
I20260709 13:23:39.404157 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:23:39.408015 25051 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:39.408804 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:23:39.409132 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-0-root
uuid: "229cbab44910443fb592ff50d4055dbf"
format_stamp: "Formatted at 2026-07-09 13:23:39 on dist-test-slave-ll1f"
I20260709 13:23:39.409435 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:39.430332 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:39.431600 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:39.433145 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:39.435664 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:39.435859 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:39.436172 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:39.436331 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:39.481325 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.129:42463
I20260709 13:23:39.481429 25113 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.129:42463 every 8 connection(s)
I20260709 13:23:39.486891 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:39.494995 25118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:39.496320 25119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:39.499763 25121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:39.500500 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:39.501961 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:39.502204 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:39.502419 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603419502392 us; error 0 us; skew 500 ppm
I20260709 13:23:39.502573 25114 heartbeater.cc:344] Connected to a master server at 127.12.208.190:42833
I20260709 13:23:39.503057 25114 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:39.503062 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:39.504050 25114 heartbeater.cc:507] Master 127.12.208.190:42833 requested a full tablet report, sending...
I20260709 13:23:39.506091 13122 webserver.cc:533] Webserver started at http://127.12.208.130:38603/ using document root <none> and password file <none>
I20260709 13:23:39.506560 24987 ts_manager.cc:194] Registered new tserver with Master: 229cbab44910443fb592ff50d4055dbf (127.12.208.129:42463)
I20260709 13:23:39.506692 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:39.507097 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:39.507390 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:39.508425 24987 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53564
I20260709 13:23:39.508617 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-1-root/instance:
uuid: "52a46a1f169e40209e97bdc2eca2fdc8"
format_stamp: "Formatted at 2026-07-09 13:23:39 on dist-test-slave-ll1f"
I20260709 13:23:39.513768 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:23:39.517510 25126 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:39.518424 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:23:39.518764 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-1-root
uuid: "52a46a1f169e40209e97bdc2eca2fdc8"
format_stamp: "Formatted at 2026-07-09 13:23:39 on dist-test-slave-ll1f"
I20260709 13:23:39.519102 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:39.530890 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:39.532123 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:39.533640 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:39.535985 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:39.536221 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:39.536484 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:39.536665 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:39.578467 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.130:33015
I20260709 13:23:39.578596 25188 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.130:33015 every 8 connection(s)
I20260709 13:23:39.583716 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:39.590682 25192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:39.591719 25193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:39.596794 25196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:39.597198 25189 heartbeater.cc:344] Connected to a master server at 127.12.208.190:42833
I20260709 13:23:39.597309 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:39.598027 25189 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:39.598809 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:23:39.598919 25189 heartbeater.cc:507] Master 127.12.208.190:42833 requested a full tablet report, sending...
W20260709 13:23:39.599124 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:39.599426 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603419599402 us; error 0 us; skew 500 ppm
I20260709 13:23:39.600050 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:39.601310 24987 ts_manager.cc:194] Registered new tserver with Master: 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130:33015)
I20260709 13:23:39.602799 13122 webserver.cc:533] Webserver started at http://127.12.208.131:32825/ using document root <none> and password file <none>
I20260709 13:23:39.603125 24987 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53572
I20260709 13:23:39.603428 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:39.603734 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:39.604023 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:39.605449 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-2-root/instance:
uuid: "cb6c52cab8564a5e83565fdf56b8c261"
format_stamp: "Formatted at 2026-07-09 13:23:39 on dist-test-slave-ll1f"
I20260709 13:23:39.610293 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:23:39.613896 25200 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:39.614902 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:23:39.615242 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-2-root
uuid: "cb6c52cab8564a5e83565fdf56b8c261"
format_stamp: "Formatted at 2026-07-09 13:23:39 on dist-test-slave-ll1f"
I20260709 13:23:39.615576 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603003722080-13122-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:39.638144 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:39.639398 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:39.640944 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:39.643527 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:39.643790 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:39.644061 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:39.644250 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:39.689980 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.131:34039
I20260709 13:23:39.690083 25262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.131:34039 every 8 connection(s)
I20260709 13:23:39.704571 25263 heartbeater.cc:344] Connected to a master server at 127.12.208.190:42833
I20260709 13:23:39.704998 25263 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:39.705890 25263 heartbeater.cc:507] Master 127.12.208.190:42833 requested a full tablet report, sending...
I20260709 13:23:39.707834 24987 ts_manager.cc:194] Registered new tserver with Master: cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131:34039)
I20260709 13:23:39.708416 13122 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01490197s
I20260709 13:23:39.709388 24987 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53576
I20260709 13:23:39.734957 24987 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53584:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:39.737356 24987 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:39.796087 25079 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe5db7087724886ae839a95eefc890a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b85be336a5164a63b81de224e79e71b9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:39.796234 25078 tablet_service.cc:1511] Processing CreateTablet for tablet 89ebe84364ea475fbe45832b6053f83c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b85be336a5164a63b81de224e79e71b9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:39.797758 25079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe5db7087724886ae839a95eefc890a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:39.804713 25078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ebe84364ea475fbe45832b6053f83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:39.805094 25228 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe5db7087724886ae839a95eefc890a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b85be336a5164a63b81de224e79e71b9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:39.805405 25227 tablet_service.cc:1511] Processing CreateTablet for tablet 89ebe84364ea475fbe45832b6053f83c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b85be336a5164a63b81de224e79e71b9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:39.806681 25228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe5db7087724886ae839a95eefc890a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:39.806368 25153 tablet_service.cc:1511] Processing CreateTablet for tablet 89ebe84364ea475fbe45832b6053f83c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b85be336a5164a63b81de224e79e71b9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:39.807396 25227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ebe84364ea475fbe45832b6053f83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:39.807766 25153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ebe84364ea475fbe45832b6053f83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:39.807396 25154 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe5db7087724886ae839a95eefc890a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b85be336a5164a63b81de224e79e71b9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:39.808880 25154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe5db7087724886ae839a95eefc890a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:39.840083 25279 tablet_bootstrap.cc:492] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8: Bootstrap starting.
I20260709 13:23:39.848441 25278 tablet_bootstrap.cc:492] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261: Bootstrap starting.
I20260709 13:23:39.849960 25280 tablet_bootstrap.cc:492] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf: Bootstrap starting.
I20260709 13:23:39.850754 25279 tablet_bootstrap.cc:654] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:39.856446 25278 tablet_bootstrap.cc:654] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:39.857623 25280 tablet_bootstrap.cc:654] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:39.857837 25279 tablet_bootstrap.cc:492] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8: No bootstrap required, opened a new log
I20260709 13:23:39.858453 25279 ts_tablet_manager.cc:1403] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:23:39.861423 25279 raft_consensus.cc:359] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.862291 25279 raft_consensus.cc:385] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:39.862414 25278 tablet_bootstrap.cc:492] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261: No bootstrap required, opened a new log
I20260709 13:23:39.862597 25279 raft_consensus.cc:740] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52a46a1f169e40209e97bdc2eca2fdc8, State: Initialized, Role: FOLLOWER
I20260709 13:23:39.863083 25278 ts_tablet_manager.cc:1403] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:23:39.863546 25280 tablet_bootstrap.cc:492] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf: No bootstrap required, opened a new log
I20260709 13:23:39.863551 25279 consensus_queue.cc:260] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.864248 25280 ts_tablet_manager.cc:1403] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:23:39.866179 25189 heartbeater.cc:499] Master 127.12.208.190:42833 was elected leader, sending a full tablet report...
I20260709 13:23:39.866678 25279 ts_tablet_manager.cc:1434] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:39.866340 25278 raft_consensus.cc:359] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.867197 25278 raft_consensus.cc:385] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:39.867517 25278 raft_consensus.cc:740] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb6c52cab8564a5e83565fdf56b8c261, State: Initialized, Role: FOLLOWER
I20260709 13:23:39.867709 25279 tablet_bootstrap.cc:492] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8: Bootstrap starting.
I20260709 13:23:39.867424 25280 raft_consensus.cc:359] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.868331 25280 raft_consensus.cc:385] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:39.868626 25280 raft_consensus.cc:740] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 229cbab44910443fb592ff50d4055dbf, State: Initialized, Role: FOLLOWER
I20260709 13:23:39.868602 25278 consensus_queue.cc:260] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.869956 25280 consensus_queue.cc:260] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.878216 25279 tablet_bootstrap.cc:654] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:39.888643 25263 heartbeater.cc:499] Master 127.12.208.190:42833 was elected leader, sending a full tablet report...
I20260709 13:23:39.889276 25278 ts_tablet_manager.cc:1434] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.016s
I20260709 13:23:39.890098 25114 heartbeater.cc:499] Master 127.12.208.190:42833 was elected leader, sending a full tablet report...
I20260709 13:23:39.890478 25278 tablet_bootstrap.cc:492] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261: Bootstrap starting.
I20260709 13:23:39.891252 25280 ts_tablet_manager.cc:1434] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.016s
I20260709 13:23:39.892398 25280 tablet_bootstrap.cc:492] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf: Bootstrap starting.
I20260709 13:23:39.897568 25279 tablet_bootstrap.cc:492] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8: No bootstrap required, opened a new log
I20260709 13:23:39.898169 25279 ts_tablet_manager.cc:1403] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 13:23:39.898212 25278 tablet_bootstrap.cc:654] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:39.899566 25280 tablet_bootstrap.cc:654] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:39.903177 25286 raft_consensus.cc:493] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:39.904006 25286 raft_consensus.cc:515] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.908913 25279 raft_consensus.cc:359] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.909811 25279 raft_consensus.cc:385] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:39.910153 25279 raft_consensus.cc:740] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52a46a1f169e40209e97bdc2eca2fdc8, State: Initialized, Role: FOLLOWER
I20260709 13:23:39.911223 25279 consensus_queue.cc:260] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.913404 25279 ts_tablet_manager.cc:1434] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:23:39.922294 25286 leader_election.cc:290] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130:33015), cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131:34039)
I20260709 13:23:39.924223 25164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe5db7087724886ae839a95eefc890a" candidate_uuid: "229cbab44910443fb592ff50d4055dbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" is_pre_election: true
I20260709 13:23:39.925050 25164 raft_consensus.cc:2468] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 229cbab44910443fb592ff50d4055dbf in term 0.
I20260709 13:23:39.926326 25280 tablet_bootstrap.cc:492] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf: No bootstrap required, opened a new log
I20260709 13:23:39.927001 25280 ts_tablet_manager.cc:1403] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.004s
I20260709 13:23:39.928200 25054 leader_election.cc:304] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 229cbab44910443fb592ff50d4055dbf, 52a46a1f169e40209e97bdc2eca2fdc8; no voters: 
I20260709 13:23:39.929427 25286 raft_consensus.cc:2804] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:39.929925 25286 raft_consensus.cc:493] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:39.930365 25286 raft_consensus.cc:3060] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:39.930130 25280 raft_consensus.cc:359] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.931016 25280 raft_consensus.cc:385] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:39.931344 25280 raft_consensus.cc:740] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 229cbab44910443fb592ff50d4055dbf, State: Initialized, Role: FOLLOWER
I20260709 13:23:39.932325 25280 consensus_queue.cc:260] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.933084 25278 tablet_bootstrap.cc:492] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261: No bootstrap required, opened a new log
I20260709 13:23:39.933661 25278 ts_tablet_manager.cc:1403] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.018s
I20260709 13:23:39.936955 25278 raft_consensus.cc:359] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.937347 25238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe5db7087724886ae839a95eefc890a" candidate_uuid: "229cbab44910443fb592ff50d4055dbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb6c52cab8564a5e83565fdf56b8c261" is_pre_election: true
I20260709 13:23:39.937810 25278 raft_consensus.cc:385] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:39.938166 25238 raft_consensus.cc:2468] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 229cbab44910443fb592ff50d4055dbf in term 0.
I20260709 13:23:39.938166 25278 raft_consensus.cc:740] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb6c52cab8564a5e83565fdf56b8c261, State: Initialized, Role: FOLLOWER
I20260709 13:23:39.940342 25278 consensus_queue.cc:260] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.941697 25280 ts_tablet_manager.cc:1434] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:23:39.942543 25278 ts_tablet_manager.cc:1434] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:23:39.942952 25286 raft_consensus.cc:515] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.945904 25164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe5db7087724886ae839a95eefc890a" candidate_uuid: "229cbab44910443fb592ff50d4055dbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52a46a1f169e40209e97bdc2eca2fdc8"
I20260709 13:23:39.945937 25286 leader_election.cc:290] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [CANDIDATE]: Term 1 election: Requested vote from peers 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130:33015), cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131:34039)
I20260709 13:23:39.946524 25164 raft_consensus.cc:3060] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:39.947854 25238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe5db7087724886ae839a95eefc890a" candidate_uuid: "229cbab44910443fb592ff50d4055dbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb6c52cab8564a5e83565fdf56b8c261"
I20260709 13:23:39.948546 25238 raft_consensus.cc:3060] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:39.955309 25164 raft_consensus.cc:2468] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 229cbab44910443fb592ff50d4055dbf in term 1.
I20260709 13:23:39.956537 25054 leader_election.cc:304] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 229cbab44910443fb592ff50d4055dbf, 52a46a1f169e40209e97bdc2eca2fdc8; no voters: 
I20260709 13:23:39.957005 25238 raft_consensus.cc:2468] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 229cbab44910443fb592ff50d4055dbf in term 1.
I20260709 13:23:39.957262 25286 raft_consensus.cc:2804] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:39.959013 25286 raft_consensus.cc:697] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 1 LEADER]: Becoming Leader. State: Replica: 229cbab44910443fb592ff50d4055dbf, State: Running, Role: LEADER
I20260709 13:23:39.959717 25286 consensus_queue.cc:237] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:39.968402 24985 catalog_manager.cc:5697] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 229cbab44910443fb592ff50d4055dbf (127.12.208.129). New cstate: current_term: 1 leader_uuid: "229cbab44910443fb592ff50d4055dbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:40.008026 25284 raft_consensus.cc:493] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:40.008594 25284 raft_consensus.cc:515] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.011067 25284 leader_election.cc:290] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 229cbab44910443fb592ff50d4055dbf (127.12.208.129:42463), cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131:34039)
I20260709 13:23:40.015010 25285 raft_consensus.cc:493] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:40.015650 25285 raft_consensus.cc:515] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.021128 25285 leader_election.cc:290] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 229cbab44910443fb592ff50d4055dbf (127.12.208.129:42463), 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130:33015)
I20260709 13:23:40.025044 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebe84364ea475fbe45832b6053f83c" candidate_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "229cbab44910443fb592ff50d4055dbf" is_pre_election: true
I20260709 13:23:40.026333 25089 raft_consensus.cc:2468] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52a46a1f169e40209e97bdc2eca2fdc8 in term 0.
I20260709 13:23:40.028419 25127 leader_election.cc:304] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 229cbab44910443fb592ff50d4055dbf, 52a46a1f169e40209e97bdc2eca2fdc8; no voters: 
I20260709 13:23:40.029956 25284 raft_consensus.cc:2804] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:40.030581 25284 raft_consensus.cc:493] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:40.031093 25284 raft_consensus.cc:3060] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:40.033667 25238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebe84364ea475fbe45832b6053f83c" candidate_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb6c52cab8564a5e83565fdf56b8c261" is_pre_election: true
I20260709 13:23:40.035123 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebe84364ea475fbe45832b6053f83c" candidate_uuid: "cb6c52cab8564a5e83565fdf56b8c261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "229cbab44910443fb592ff50d4055dbf" is_pre_election: true
I20260709 13:23:40.034590 25238 raft_consensus.cc:2468] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52a46a1f169e40209e97bdc2eca2fdc8 in term 0.
I20260709 13:23:40.036003 25089 raft_consensus.cc:2468] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb6c52cab8564a5e83565fdf56b8c261 in term 0.
I20260709 13:23:40.037600 25201 leader_election.cc:304] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 229cbab44910443fb592ff50d4055dbf, cb6c52cab8564a5e83565fdf56b8c261; no voters: 
I20260709 13:23:40.038635 25285 raft_consensus.cc:2804] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:40.039067 25285 raft_consensus.cc:493] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:40.039398 25285 raft_consensus.cc:3060] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:40.042410 25164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebe84364ea475fbe45832b6053f83c" candidate_uuid: "cb6c52cab8564a5e83565fdf56b8c261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" is_pre_election: true
I20260709 13:23:40.043694 25284 raft_consensus.cc:515] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.044993 25164 raft_consensus.cc:2393] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb6c52cab8564a5e83565fdf56b8c261 in current term 1: Already voted for candidate 52a46a1f169e40209e97bdc2eca2fdc8 in this term.
I20260709 13:23:40.046152 25284 leader_election.cc:290] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [CANDIDATE]: Term 1 election: Requested vote from peers 229cbab44910443fb592ff50d4055dbf (127.12.208.129:42463), cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131:34039)
I20260709 13:23:40.047547 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebe84364ea475fbe45832b6053f83c" candidate_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "229cbab44910443fb592ff50d4055dbf"
I20260709 13:23:40.048139 25089 raft_consensus.cc:3060] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:40.047691 25238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebe84364ea475fbe45832b6053f83c" candidate_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb6c52cab8564a5e83565fdf56b8c261"
I20260709 13:23:40.048705 25285 raft_consensus.cc:515] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.049985 25238 raft_consensus.cc:2393] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 52a46a1f169e40209e97bdc2eca2fdc8 in current term 1: Already voted for candidate cb6c52cab8564a5e83565fdf56b8c261 in this term.
I20260709 13:23:40.051533 25285 leader_election.cc:290] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [CANDIDATE]: Term 1 election: Requested vote from peers 229cbab44910443fb592ff50d4055dbf (127.12.208.129:42463), 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130:33015)
I20260709 13:23:40.052085 25088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebe84364ea475fbe45832b6053f83c" candidate_uuid: "cb6c52cab8564a5e83565fdf56b8c261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "229cbab44910443fb592ff50d4055dbf"
I20260709 13:23:40.052187 25164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ebe84364ea475fbe45832b6053f83c" candidate_uuid: "cb6c52cab8564a5e83565fdf56b8c261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52a46a1f169e40209e97bdc2eca2fdc8"
I20260709 13:23:40.053268 25164 raft_consensus.cc:2393] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cb6c52cab8564a5e83565fdf56b8c261 in current term 1: Already voted for candidate 52a46a1f169e40209e97bdc2eca2fdc8 in this term.
I20260709 13:23:40.054415 25203 leader_election.cc:304] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb6c52cab8564a5e83565fdf56b8c261; no voters: 229cbab44910443fb592ff50d4055dbf, 52a46a1f169e40209e97bdc2eca2fdc8
I20260709 13:23:40.055156 25285 raft_consensus.cc:2749] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:23:40.056937 25089 raft_consensus.cc:2468] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52a46a1f169e40209e97bdc2eca2fdc8 in term 1.
I20260709 13:23:40.058125 25127 leader_election.cc:304] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 229cbab44910443fb592ff50d4055dbf, 52a46a1f169e40209e97bdc2eca2fdc8; no voters: cb6c52cab8564a5e83565fdf56b8c261
I20260709 13:23:40.058943 25284 raft_consensus.cc:2804] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:40.060051 25284 raft_consensus.cc:697] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 LEADER]: Becoming Leader. State: Replica: 52a46a1f169e40209e97bdc2eca2fdc8, State: Running, Role: LEADER
I20260709 13:23:40.060792 25284 consensus_queue.cc:237] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.069531 24985 catalog_manager.cc:5697] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:40.123530 24985 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53598:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:40.126044 24985 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:40.150362 25079 tablet_service.cc:1511] Processing CreateTablet for tablet 78b675c05d69416a9c5b69f6164a25ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=162251c07fdb4dc6a710cddd7554760b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:40.151798 25079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b675c05d69416a9c5b69f6164a25ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:40.151412 25153 tablet_service.cc:1511] Processing CreateTablet for tablet 78b675c05d69416a9c5b69f6164a25ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=162251c07fdb4dc6a710cddd7554760b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:40.153280 25228 tablet_service.cc:1511] Processing CreateTablet for tablet 78b675c05d69416a9c5b69f6164a25ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=162251c07fdb4dc6a710cddd7554760b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:40.154116 25153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b675c05d69416a9c5b69f6164a25ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:40.154641 25228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b675c05d69416a9c5b69f6164a25ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:40.156730 25154 tablet_service.cc:1511] Processing CreateTablet for tablet c868a574d32748f9aeb43219844c7c8c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=162251c07fdb4dc6a710cddd7554760b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:40.158067 25154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c868a574d32748f9aeb43219844c7c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:40.158676 25078 tablet_service.cc:1511] Processing CreateTablet for tablet c868a574d32748f9aeb43219844c7c8c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=162251c07fdb4dc6a710cddd7554760b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:40.159988 25078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c868a574d32748f9aeb43219844c7c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:40.170109 25280 tablet_bootstrap.cc:492] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf: Bootstrap starting.
I20260709 13:23:40.172281 25279 tablet_bootstrap.cc:492] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8: Bootstrap starting.
I20260709 13:23:40.175082 25227 tablet_service.cc:1511] Processing CreateTablet for tablet c868a574d32748f9aeb43219844c7c8c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=162251c07fdb4dc6a710cddd7554760b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:40.176664 25227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c868a574d32748f9aeb43219844c7c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:40.177922 25280 tablet_bootstrap.cc:654] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:40.179528 25279 tablet_bootstrap.cc:654] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:40.189356 25279 tablet_bootstrap.cc:492] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8: No bootstrap required, opened a new log
I20260709 13:23:40.189961 25279 ts_tablet_manager.cc:1403] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:23:40.192996 25279 raft_consensus.cc:359] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.194572 25279 raft_consensus.cc:385] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:40.194893 25279 raft_consensus.cc:740] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52a46a1f169e40209e97bdc2eca2fdc8, State: Initialized, Role: FOLLOWER
I20260709 13:23:40.195320 25280 tablet_bootstrap.cc:492] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf: No bootstrap required, opened a new log
I20260709 13:23:40.195881 25280 ts_tablet_manager.cc:1403] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.010s
I20260709 13:23:40.195752 25279 consensus_queue.cc:260] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.196919 25278 tablet_bootstrap.cc:492] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261: Bootstrap starting.
I20260709 13:23:40.200379 25279 ts_tablet_manager.cc:1434] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:23:40.201678 25279 tablet_bootstrap.cc:492] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8: Bootstrap starting.
I20260709 13:23:40.204084 25278 tablet_bootstrap.cc:654] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:40.207650 25280 raft_consensus.cc:359] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.208539 25280 raft_consensus.cc:385] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:40.208837 25280 raft_consensus.cc:740] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 229cbab44910443fb592ff50d4055dbf, State: Initialized, Role: FOLLOWER
I20260709 13:23:40.209226 25279 tablet_bootstrap.cc:654] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:40.209883 25280 consensus_queue.cc:260] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.221314 25280 ts_tablet_manager.cc:1434] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:23:40.221951 25278 tablet_bootstrap.cc:492] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261: No bootstrap required, opened a new log
I20260709 13:23:40.222498 25280 tablet_bootstrap.cc:492] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf: Bootstrap starting.
I20260709 13:23:40.222548 25279 tablet_bootstrap.cc:492] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8: No bootstrap required, opened a new log
I20260709 13:23:40.223284 25279 ts_tablet_manager.cc:1403] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.015s
I20260709 13:23:40.222549 25278 ts_tablet_manager.cc:1403] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.003s
I20260709 13:23:40.226619 25279 raft_consensus.cc:359] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.227486 25279 raft_consensus.cc:385] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:40.227802 25279 raft_consensus.cc:740] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52a46a1f169e40209e97bdc2eca2fdc8, State: Initialized, Role: FOLLOWER
I20260709 13:23:40.228704 25279 consensus_queue.cc:260] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.229920 25280 tablet_bootstrap.cc:654] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:40.230381 25278 raft_consensus.cc:359] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.231065 25279 ts_tablet_manager.cc:1434] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:23:40.231231 25278 raft_consensus.cc:385] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:40.231628 25278 raft_consensus.cc:740] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb6c52cab8564a5e83565fdf56b8c261, State: Initialized, Role: FOLLOWER
I20260709 13:23:40.232509 25278 consensus_queue.cc:260] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.235868 25278 ts_tablet_manager.cc:1434] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:23:40.238647 25278 tablet_bootstrap.cc:492] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261: Bootstrap starting.
I20260709 13:23:40.245723 25278 tablet_bootstrap.cc:654] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:40.248133 25280 tablet_bootstrap.cc:492] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf: No bootstrap required, opened a new log
I20260709 13:23:40.248708 25280 ts_tablet_manager.cc:1403] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 13:23:40.251590 25278 tablet_bootstrap.cc:492] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261: No bootstrap required, opened a new log
I20260709 13:23:40.252144 25278 ts_tablet_manager.cc:1403] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 13:23:40.251606 25280 raft_consensus.cc:359] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.252509 25280 raft_consensus.cc:385] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:40.252787 25280 raft_consensus.cc:740] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 229cbab44910443fb592ff50d4055dbf, State: Initialized, Role: FOLLOWER
I20260709 13:23:40.253439 25280 consensus_queue.cc:260] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.255004 25278 raft_consensus.cc:359] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.255563 25280 ts_tablet_manager.cc:1434] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:23:40.255797 25278 raft_consensus.cc:385] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:40.256160 25278 raft_consensus.cc:740] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb6c52cab8564a5e83565fdf56b8c261, State: Initialized, Role: FOLLOWER
I20260709 13:23:40.256999 25278 consensus_queue.cc:260] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.259269 25278 ts_tablet_manager.cc:1434] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:23:40.305462 25035 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:40.354919 25286 consensus_queue.cc:1048] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:40.367693 25291 consensus_queue.cc:1048] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:40.373436 25284 raft_consensus.cc:493] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:40.374102 25284 raft_consensus.cc:515] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.376798 25284 leader_election.cc:290] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 229cbab44910443fb592ff50d4055dbf (127.12.208.129:42463), cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131:34039)
I20260709 13:23:40.377214 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c868a574d32748f9aeb43219844c7c8c" candidate_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "229cbab44910443fb592ff50d4055dbf" is_pre_election: true
I20260709 13:23:40.377609 25237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c868a574d32748f9aeb43219844c7c8c" candidate_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb6c52cab8564a5e83565fdf56b8c261" is_pre_election: true
I20260709 13:23:40.378018 25089 raft_consensus.cc:2468] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52a46a1f169e40209e97bdc2eca2fdc8 in term 0.
I20260709 13:23:40.378381 25237 raft_consensus.cc:2468] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52a46a1f169e40209e97bdc2eca2fdc8 in term 0.
I20260709 13:23:40.379380 25127 leader_election.cc:304] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 229cbab44910443fb592ff50d4055dbf, 52a46a1f169e40209e97bdc2eca2fdc8; no voters: 
I20260709 13:23:40.380188 25284 raft_consensus.cc:2804] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:40.380518 25284 raft_consensus.cc:493] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:40.380810 25284 raft_consensus.cc:3060] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:40.386449 25284 raft_consensus.cc:515] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.388446 25284 leader_election.cc:290] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [CANDIDATE]: Term 1 election: Requested vote from peers 229cbab44910443fb592ff50d4055dbf (127.12.208.129:42463), cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131:34039)
I20260709 13:23:40.388945 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c868a574d32748f9aeb43219844c7c8c" candidate_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "229cbab44910443fb592ff50d4055dbf"
I20260709 13:23:40.389622 25089 raft_consensus.cc:3060] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:40.389557 25237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c868a574d32748f9aeb43219844c7c8c" candidate_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb6c52cab8564a5e83565fdf56b8c261"
I20260709 13:23:40.390347 25237 raft_consensus.cc:3060] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:40.395517 25089 raft_consensus.cc:2468] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52a46a1f169e40209e97bdc2eca2fdc8 in term 1.
I20260709 13:23:40.396108 25237 raft_consensus.cc:2468] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52a46a1f169e40209e97bdc2eca2fdc8 in term 1.
I20260709 13:23:40.396720 25127 leader_election.cc:304] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 229cbab44910443fb592ff50d4055dbf, 52a46a1f169e40209e97bdc2eca2fdc8; no voters: 
I20260709 13:23:40.397557 25284 raft_consensus.cc:2804] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:40.398061 25284 raft_consensus.cc:697] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 LEADER]: Becoming Leader. State: Replica: 52a46a1f169e40209e97bdc2eca2fdc8, State: Running, Role: LEADER
I20260709 13:23:40.398708 25284 consensus_queue.cc:237] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.406250 24985 catalog_manager.cc:5697] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:40.545303 25285 raft_consensus.cc:493] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:40.545938 25285 raft_consensus.cc:515] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.547740 25285 leader_election.cc:290] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 229cbab44910443fb592ff50d4055dbf (127.12.208.129:42463), 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130:33015)
I20260709 13:23:40.548758 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae" candidate_uuid: "cb6c52cab8564a5e83565fdf56b8c261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "229cbab44910443fb592ff50d4055dbf" is_pre_election: true
I20260709 13:23:40.548853 25164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae" candidate_uuid: "cb6c52cab8564a5e83565fdf56b8c261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" is_pre_election: true
I20260709 13:23:40.549674 25089 raft_consensus.cc:2468] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb6c52cab8564a5e83565fdf56b8c261 in term 0.
I20260709 13:23:40.549676 25164 raft_consensus.cc:2468] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb6c52cab8564a5e83565fdf56b8c261 in term 0.
I20260709 13:23:40.550992 25201 leader_election.cc:304] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 229cbab44910443fb592ff50d4055dbf, cb6c52cab8564a5e83565fdf56b8c261; no voters: 
I20260709 13:23:40.551736 25285 raft_consensus.cc:2804] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:40.552096 25285 raft_consensus.cc:493] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:40.552477 25285 raft_consensus.cc:3060] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:40.558249 25285 raft_consensus.cc:515] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.560148 25285 leader_election.cc:290] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [CANDIDATE]: Term 1 election: Requested vote from peers 229cbab44910443fb592ff50d4055dbf (127.12.208.129:42463), 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130:33015)
I20260709 13:23:40.561144 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae" candidate_uuid: "cb6c52cab8564a5e83565fdf56b8c261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "229cbab44910443fb592ff50d4055dbf"
I20260709 13:23:40.561213 25164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae" candidate_uuid: "cb6c52cab8564a5e83565fdf56b8c261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52a46a1f169e40209e97bdc2eca2fdc8"
I20260709 13:23:40.561898 25089 raft_consensus.cc:3060] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:40.562011 25164 raft_consensus.cc:3060] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:40.567749 25164 raft_consensus.cc:2468] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb6c52cab8564a5e83565fdf56b8c261 in term 1.
I20260709 13:23:40.568002 25089 raft_consensus.cc:2468] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb6c52cab8564a5e83565fdf56b8c261 in term 1.
I20260709 13:23:40.568924 25203 leader_election.cc:304] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52a46a1f169e40209e97bdc2eca2fdc8, cb6c52cab8564a5e83565fdf56b8c261; no voters: 
I20260709 13:23:40.569947 25285 raft_consensus.cc:2804] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:40.571019 25285 raft_consensus.cc:697] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 1 LEADER]: Becoming Leader. State: Replica: cb6c52cab8564a5e83565fdf56b8c261, State: Running, Role: LEADER
I20260709 13:23:40.571746 25285 consensus_queue.cc:237] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.579401 24985 catalog_manager.cc:5697] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "cb6c52cab8564a5e83565fdf56b8c261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:40.599228 25284 consensus_queue.cc:1048] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:40.610960 25319 consensus_queue.cc:1048] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:40.683415 25237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae"
dest_uuid: "cb6c52cab8564a5e83565fdf56b8c261"
mode: GRACEFUL
new_leader_uuid: "229cbab44910443fb592ff50d4055dbf"
 from {username='slave'} at 127.0.0.1:38432
I20260709 13:23:40.683948 25237 raft_consensus.cc:606] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 1 LEADER]: Received request to transfer leadership to TS 229cbab44910443fb592ff50d4055dbf
I20260709 13:23:40.699050 25164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c868a574d32748f9aeb43219844c7c8c"
dest_uuid: "52a46a1f169e40209e97bdc2eca2fdc8"
mode: GRACEFUL
new_leader_uuid: "229cbab44910443fb592ff50d4055dbf"
 from {username='slave'} at 127.0.0.1:49018
I20260709 13:23:40.699738 25164 raft_consensus.cc:606] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 LEADER]: Received request to transfer leadership to TS 229cbab44910443fb592ff50d4055dbf
I20260709 13:23:40.790679 25319 consensus_queue.cc:1048] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:40.797457 25296 raft_consensus.cc:993] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8: : Instructing follower 229cbab44910443fb592ff50d4055dbf to start an election
I20260709 13:23:40.798007 25284 raft_consensus.cc:1081] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 LEADER]: Signalling peer 229cbab44910443fb592ff50d4055dbf to start an election
I20260709 13:23:40.801057 25088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c868a574d32748f9aeb43219844c7c8c"
dest_uuid: "229cbab44910443fb592ff50d4055dbf"
 from {username='slave'} at 127.0.0.1:48188
I20260709 13:23:40.801702 25088 raft_consensus.cc:493] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:40.802114 25088 raft_consensus.cc:3060] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:40.804172 25284 consensus_queue.cc:1048] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:40.820029 25088 raft_consensus.cc:515] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.821269 25089 raft_consensus.cc:1240] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 2 FOLLOWER]: Rejecting Update request from peer 52a46a1f169e40209e97bdc2eca2fdc8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:23:40.823207 25164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c868a574d32748f9aeb43219844c7c8c" candidate_uuid: "229cbab44910443fb592ff50d4055dbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52a46a1f169e40209e97bdc2eca2fdc8"
I20260709 13:23:40.823956 25164 raft_consensus.cc:3055] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:40.824323 25164 raft_consensus.cc:740] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52a46a1f169e40209e97bdc2eca2fdc8, State: Running, Role: LEADER
I20260709 13:23:40.825181 25164 consensus_queue.cc:260] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.826453 25164 raft_consensus.cc:3060] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:40.829886 25296 consensus_queue.cc:1175] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "229cbab44910443fb592ff50d4055dbf" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 52a46a1f169e40209e97bdc2eca2fdc8 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:23:40.830582 25088 leader_election.cc:290] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [CANDIDATE]: Term 2 election: Requested vote from peers 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130:33015), cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131:34039)
I20260709 13:23:40.831758 25237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c868a574d32748f9aeb43219844c7c8c" candidate_uuid: "229cbab44910443fb592ff50d4055dbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb6c52cab8564a5e83565fdf56b8c261"
I20260709 13:23:40.832638 25237 raft_consensus.cc:3060] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:40.837170 25164 raft_consensus.cc:2468] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 229cbab44910443fb592ff50d4055dbf in term 2.
I20260709 13:23:40.838616 25054 leader_election.cc:304] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 229cbab44910443fb592ff50d4055dbf, 52a46a1f169e40209e97bdc2eca2fdc8; no voters: 
I20260709 13:23:40.839493 25291 raft_consensus.cc:2804] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:40.840054 25291 raft_consensus.cc:697] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 2 LEADER]: Becoming Leader. State: Replica: 229cbab44910443fb592ff50d4055dbf, State: Running, Role: LEADER
I20260709 13:23:40.840183 25237 raft_consensus.cc:2468] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 229cbab44910443fb592ff50d4055dbf in term 2.
I20260709 13:23:40.840993 25291 consensus_queue.cc:237] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:40.847450 24987 catalog_manager.cc:5697] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf reported cstate change: term changed from 1 to 2, leader changed from 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130) to 229cbab44910443fb592ff50d4055dbf (127.12.208.129). New cstate: current_term: 2 leader_uuid: "229cbab44910443fb592ff50d4055dbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:41.061187 25285 consensus_queue.cc:1048] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:41.069046 25316 raft_consensus.cc:993] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261: : Instructing follower 229cbab44910443fb592ff50d4055dbf to start an election
I20260709 13:23:41.069867 25285 raft_consensus.cc:1081] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 1 LEADER]: Signalling peer 229cbab44910443fb592ff50d4055dbf to start an election
I20260709 13:23:41.072001 25089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae"
dest_uuid: "229cbab44910443fb592ff50d4055dbf"
 from {username='slave'} at 127.0.0.1:48202
I20260709 13:23:41.072625 25089 raft_consensus.cc:493] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:41.073107 25089 raft_consensus.cc:3060] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:41.075884 25285 consensus_queue.cc:1048] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:41.080772 25089 raft_consensus.cc:515] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:41.083455 25089 leader_election.cc:290] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [CANDIDATE]: Term 2 election: Requested vote from peers 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130:33015), cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131:34039)
I20260709 13:23:41.083902 25163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae" candidate_uuid: "229cbab44910443fb592ff50d4055dbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52a46a1f169e40209e97bdc2eca2fdc8"
I20260709 13:23:41.084744 25237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae" candidate_uuid: "229cbab44910443fb592ff50d4055dbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb6c52cab8564a5e83565fdf56b8c261"
I20260709 13:23:41.085486 25237 raft_consensus.cc:3055] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:41.085893 25237 raft_consensus.cc:740] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb6c52cab8564a5e83565fdf56b8c261, State: Running, Role: LEADER
I20260709 13:23:41.086763 25237 consensus_queue.cc:260] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:41.088013 25237 raft_consensus.cc:3060] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:41.095709 25237 raft_consensus.cc:2468] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 229cbab44910443fb592ff50d4055dbf in term 2.
I20260709 13:23:41.096999 25053 leader_election.cc:304] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 229cbab44910443fb592ff50d4055dbf, cb6c52cab8564a5e83565fdf56b8c261; no voters: 52a46a1f169e40209e97bdc2eca2fdc8
I20260709 13:23:41.098023 25326 raft_consensus.cc:2804] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:41.098460 25326 raft_consensus.cc:697] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 2 LEADER]: Becoming Leader. State: Replica: 229cbab44910443fb592ff50d4055dbf, State: Running, Role: LEADER
I20260709 13:23:41.099125 25326 consensus_queue.cc:237] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:41.105504 24984 catalog_manager.cc:5697] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf reported cstate change: term changed from 1 to 2, leader changed from cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131) to 229cbab44910443fb592ff50d4055dbf (127.12.208.129). New cstate: current_term: 2 leader_uuid: "229cbab44910443fb592ff50d4055dbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:41.157615 13122 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:23:41.159143 13122 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:23:41.159498 13122 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:23:41.172837 25089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae"
dest_uuid: "229cbab44910443fb592ff50d4055dbf"
mode: GRACEFUL
new_leader_uuid: "cb6c52cab8564a5e83565fdf56b8c261"
 from {username='slave'} at 127.0.0.1:48218
I20260709 13:23:41.173465 25089 raft_consensus.cc:606] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 2 LEADER]: Received request to transfer leadership to TS cb6c52cab8564a5e83565fdf56b8c261
I20260709 13:23:41.174867 13122 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:23:41.265157 25237 raft_consensus.cc:1275] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [term 2 FOLLOWER]: Refusing update from remote peer 229cbab44910443fb592ff50d4055dbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:41.266621 25326 consensus_queue.cc:1048] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:41.274711 25164 raft_consensus.cc:1275] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 2 FOLLOWER]: Refusing update from remote peer 229cbab44910443fb592ff50d4055dbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:41.277194 25291 consensus_queue.cc:1048] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:41.478679 25237 raft_consensus.cc:1275] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 2 FOLLOWER]: Refusing update from remote peer 229cbab44910443fb592ff50d4055dbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:41.480096 25291 consensus_queue.cc:1048] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:41.485633 25326 raft_consensus.cc:993] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf: : Instructing follower cb6c52cab8564a5e83565fdf56b8c261 to start an election
I20260709 13:23:41.486261 25311 raft_consensus.cc:1081] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 2 LEADER]: Signalling peer cb6c52cab8564a5e83565fdf56b8c261 to start an election
I20260709 13:23:41.487907 25238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae"
dest_uuid: "cb6c52cab8564a5e83565fdf56b8c261"
 from {username='slave'} at 127.0.0.1:38412
I20260709 13:23:41.489362 25164 raft_consensus.cc:3060] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:41.491022 25238 raft_consensus.cc:493] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:41.491544 25238 raft_consensus.cc:3060] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:41.497642 25164 raft_consensus.cc:1275] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 2 FOLLOWER]: Refusing update from remote peer 229cbab44910443fb592ff50d4055dbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:41.499254 25238 raft_consensus.cc:515] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:41.499477 25291 consensus_queue.cc:1048] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:41.504432 25238 leader_election.cc:290] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [CANDIDATE]: Term 3 election: Requested vote from peers 229cbab44910443fb592ff50d4055dbf (127.12.208.129:42463), 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130:33015)
I20260709 13:23:41.504434 25089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae" candidate_uuid: "cb6c52cab8564a5e83565fdf56b8c261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "229cbab44910443fb592ff50d4055dbf"
I20260709 13:23:41.505560 25089 raft_consensus.cc:3055] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:41.505923 25089 raft_consensus.cc:740] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 229cbab44910443fb592ff50d4055dbf, State: Running, Role: LEADER
I20260709 13:23:41.506656 25089 consensus_queue.cc:260] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
W20260709 13:23:41.507591 25291 consensus_queue.cc:1175] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:23:41.507814 25089 raft_consensus.cc:3060] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:41.508728 25164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b675c05d69416a9c5b69f6164a25ae" candidate_uuid: "cb6c52cab8564a5e83565fdf56b8c261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "52a46a1f169e40209e97bdc2eca2fdc8"
I20260709 13:23:41.509374 25164 raft_consensus.cc:3060] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:41.514321 25089 raft_consensus.cc:2468] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb6c52cab8564a5e83565fdf56b8c261 in term 3.
I20260709 13:23:41.514739 25164 raft_consensus.cc:2468] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb6c52cab8564a5e83565fdf56b8c261 in term 3.
I20260709 13:23:41.515580 25201 leader_election.cc:304] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 229cbab44910443fb592ff50d4055dbf, cb6c52cab8564a5e83565fdf56b8c261; no voters: 
I20260709 13:23:41.516520 25285 raft_consensus.cc:2804] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:41.517030 25285 raft_consensus.cc:697] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 3 LEADER]: Becoming Leader. State: Replica: cb6c52cab8564a5e83565fdf56b8c261, State: Running, Role: LEADER
I20260709 13:23:41.517939 25285 consensus_queue.cc:237] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } }
I20260709 13:23:41.524880 24984 catalog_manager.cc:5697] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 reported cstate change: term changed from 2 to 3, leader changed from 229cbab44910443fb592ff50d4055dbf (127.12.208.129) to cb6c52cab8564a5e83565fdf56b8c261 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "cb6c52cab8564a5e83565fdf56b8c261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "229cbab44910443fb592ff50d4055dbf" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52a46a1f169e40209e97bdc2eca2fdc8" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 33015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb6c52cab8564a5e83565fdf56b8c261" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 34039 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:41.805893 13122 tablet_server.cc:179] TabletServer@127.12.208.129:0 shutting down...
I20260709 13:23:41.829615 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:41.830365 13122 tablet_replica.cc:333] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf: stopping tablet replica
I20260709 13:23:41.830943 13122 raft_consensus.cc:2243] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:41.831785 13122 raft_consensus.cc:2272] T c868a574d32748f9aeb43219844c7c8c P 229cbab44910443fb592ff50d4055dbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:41.834458 13122 tablet_replica.cc:333] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf: stopping tablet replica
I20260709 13:23:41.835039 13122 raft_consensus.cc:2243] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:41.835526 13122 raft_consensus.cc:2272] T 78b675c05d69416a9c5b69f6164a25ae P 229cbab44910443fb592ff50d4055dbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:41.838130 13122 tablet_replica.cc:333] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf: stopping tablet replica
I20260709 13:23:41.838707 13122 raft_consensus.cc:2243] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:41.839123 13122 raft_consensus.cc:2272] T 89ebe84364ea475fbe45832b6053f83c P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:41.841390 13122 tablet_replica.cc:333] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf: stopping tablet replica
I20260709 13:23:41.842006 13122 raft_consensus.cc:2243] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:41.842943 13122 raft_consensus.cc:2272] T 2fe5db7087724886ae839a95eefc890a P 229cbab44910443fb592ff50d4055dbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:41.857869 13122 tablet_server.cc:196] TabletServer@127.12.208.129:0 shutdown complete.
I20260709 13:23:41.871840 13122 tablet_server.cc:179] TabletServer@127.12.208.130:0 shutting down...
I20260709 13:23:41.892189 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:41.892995 13122 tablet_replica.cc:333] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8: stopping tablet replica
I20260709 13:23:41.893724 13122 raft_consensus.cc:2243] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:41.894336 13122 raft_consensus.cc:2272] T c868a574d32748f9aeb43219844c7c8c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:41.896658 13122 tablet_replica.cc:333] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8: stopping tablet replica
I20260709 13:23:41.897253 13122 raft_consensus.cc:2243] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:41.897750 13122 raft_consensus.cc:2272] T 78b675c05d69416a9c5b69f6164a25ae P 52a46a1f169e40209e97bdc2eca2fdc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:41.900221 13122 tablet_replica.cc:333] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8: stopping tablet replica
I20260709 13:23:41.900894 13122 raft_consensus.cc:2243] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:41.901758 13122 raft_consensus.cc:2272] T 89ebe84364ea475fbe45832b6053f83c P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:41.903860 13122 tablet_replica.cc:333] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8: stopping tablet replica
I20260709 13:23:41.904417 13122 raft_consensus.cc:2243] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:41.904889 13122 raft_consensus.cc:2272] T 2fe5db7087724886ae839a95eefc890a P 52a46a1f169e40209e97bdc2eca2fdc8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:41.921722 25203 consensus_peers.cc:597] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 -> Peer 52a46a1f169e40209e97bdc2eca2fdc8 (127.12.208.130:33015): Couldn't send request to peer 52a46a1f169e40209e97bdc2eca2fdc8. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:33015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:41.927737 13122 tablet_server.cc:196] TabletServer@127.12.208.130:0 shutdown complete.
I20260709 13:23:41.940678 13122 tablet_server.cc:179] TabletServer@127.12.208.131:0 shutting down...
I20260709 13:23:41.960418 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:41.961154 13122 tablet_replica.cc:333] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261: stopping tablet replica
I20260709 13:23:41.961776 13122 raft_consensus.cc:2243] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:41.962330 13122 raft_consensus.cc:2272] T c868a574d32748f9aeb43219844c7c8c P cb6c52cab8564a5e83565fdf56b8c261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:41.964630 13122 tablet_replica.cc:333] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261: stopping tablet replica
I20260709 13:23:41.965174 13122 raft_consensus.cc:2243] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:41.965960 13122 pending_rounds.cc:70] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261: Trying to abort 1 pending ops.
I20260709 13:23:41.966173 13122 pending_rounds.cc:77] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305639614545772544 op_type: NO_OP noop_request { }
I20260709 13:23:41.966485 13122 raft_consensus.cc:2889] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:23:41.966769 13122 raft_consensus.cc:2272] T 78b675c05d69416a9c5b69f6164a25ae P cb6c52cab8564a5e83565fdf56b8c261 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:41.969053 13122 tablet_replica.cc:333] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261: stopping tablet replica
I20260709 13:23:41.969584 13122 raft_consensus.cc:2243] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:41.970081 13122 raft_consensus.cc:2272] T 89ebe84364ea475fbe45832b6053f83c P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:41.971885 13122 tablet_replica.cc:333] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261: stopping tablet replica
I20260709 13:23:41.972349 13122 raft_consensus.cc:2243] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:41.972805 13122 raft_consensus.cc:2272] T 2fe5db7087724886ae839a95eefc890a P cb6c52cab8564a5e83565fdf56b8c261 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:41.995641 13122 tablet_server.cc:196] TabletServer@127.12.208.131:0 shutdown complete.
I20260709 13:23:42.008471 13122 master.cc:562] Master@127.12.208.190:42833 shutting down...
I20260709 13:23:42.025540 13122 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:42.026168 13122 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:42.026469 13122 tablet_replica.cc:333] T 00000000000000000000000000000000 P 29c07bcc891041e087081222f213a01b: stopping tablet replica
I20260709 13:23:42.047523 13122 master.cc:584] Master@127.12.208.190:42833 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2917 ms)
[----------] 6 tests from LeaderRebalancerTest (418187 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:23:42.076328 13122 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.208.190:41887
I20260709 13:23:42.077369 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:42.082406 25334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:42.082715 25335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:42.085086 25337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:42.086107 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:42.087096 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:42.087276 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:42.087462 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603422087448 us; error 0 us; skew 500 ppm
I20260709 13:23:42.088043 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:42.090736 13122 webserver.cc:533] Webserver started at http://127.12.208.190:35505/ using document root <none> and password file <none>
I20260709 13:23:42.091310 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:42.091531 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:42.091825 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:42.092905 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/master-0-root/instance:
uuid: "a8c30222f6dc4f9391abb05895b416c9"
format_stamp: "Formatted at 2026-07-09 13:23:42 on dist-test-slave-ll1f"
I20260709 13:23:42.097546 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:23:42.101089 25342 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:42.102097 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:23:42.102370 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/master-0-root
uuid: "a8c30222f6dc4f9391abb05895b416c9"
format_stamp: "Formatted at 2026-07-09 13:23:42 on dist-test-slave-ll1f"
I20260709 13:23:42.102622 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:42.114013 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:42.115047 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:42.151925 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.190:41887
I20260709 13:23:42.152021 25393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.190:41887 every 8 connection(s)
I20260709 13:23:42.156176 25394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.168514 25394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9: Bootstrap starting.
I20260709 13:23:42.173173 25394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:42.177568 25394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9: No bootstrap required, opened a new log
I20260709 13:23:42.179819 25394 raft_consensus.cc:359] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c30222f6dc4f9391abb05895b416c9" member_type: VOTER }
I20260709 13:23:42.180233 25394 raft_consensus.cc:385] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:42.180408 25394 raft_consensus.cc:740] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c30222f6dc4f9391abb05895b416c9, State: Initialized, Role: FOLLOWER
I20260709 13:23:42.181021 25394 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c30222f6dc4f9391abb05895b416c9" member_type: VOTER }
I20260709 13:23:42.181452 25394 raft_consensus.cc:399] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:23:42.181651 25394 raft_consensus.cc:493] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:23:42.181874 25394 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:42.186874 25394 raft_consensus.cc:515] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c30222f6dc4f9391abb05895b416c9" member_type: VOTER }
I20260709 13:23:42.187398 25394 leader_election.cc:304] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8c30222f6dc4f9391abb05895b416c9; no voters: 
I20260709 13:23:42.188573 25394 leader_election.cc:290] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:23:42.188972 25397 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:42.190682 25397 raft_consensus.cc:697] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [term 1 LEADER]: Becoming Leader. State: Replica: a8c30222f6dc4f9391abb05895b416c9, State: Running, Role: LEADER
I20260709 13:23:42.191478 25397 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c30222f6dc4f9391abb05895b416c9" member_type: VOTER }
I20260709 13:23:42.191674 25394 sys_catalog.cc:565] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:23:42.196309 25399 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8c30222f6dc4f9391abb05895b416c9. Latest consensus state: current_term: 1 leader_uuid: "a8c30222f6dc4f9391abb05895b416c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c30222f6dc4f9391abb05895b416c9" member_type: VOTER } }
I20260709 13:23:42.196499 25398 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8c30222f6dc4f9391abb05895b416c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c30222f6dc4f9391abb05895b416c9" member_type: VOTER } }
I20260709 13:23:42.197228 25399 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:42.197484 25398 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:42.200603 25405 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:23:42.205581 25405 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:23:42.209095 13122 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:23:42.214946 25405 catalog_manager.cc:1383] Generated new cluster ID: 46ff2266a52d41b891e7edf75dcd77de
I20260709 13:23:42.215273 25405 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:23:42.249413 25405 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:23:42.250761 25405 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:23:42.266952 25405 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9: Generated new TSK 0
I20260709 13:23:42.267690 25405 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:23:42.276536 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:42.282967 25415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:42.283917 25416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:42.286571 25418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:42.286749 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:42.287832 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:42.288026 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:42.288231 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603422288211 us; error 0 us; skew 500 ppm
I20260709 13:23:42.288798 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:42.291451 13122 webserver.cc:533] Webserver started at http://127.12.208.129:44855/ using document root <none> and password file <none>
I20260709 13:23:42.291987 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:42.292197 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:42.292480 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:42.293746 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-0-root/instance:
uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
format_stamp: "Formatted at 2026-07-09 13:23:42 on dist-test-slave-ll1f"
I20260709 13:23:42.298722 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:23:42.302388 25423 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:42.303381 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:23:42.303741 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-0-root
uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
format_stamp: "Formatted at 2026-07-09 13:23:42 on dist-test-slave-ll1f"
I20260709 13:23:42.304080 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:42.313753 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:42.314989 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:42.316464 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:42.318881 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:42.319113 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:42.319399 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:42.319589 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:42.359469 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.129:46431
I20260709 13:23:42.359568 25485 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.129:46431 every 8 connection(s)
I20260709 13:23:42.364648 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:42.372366 25490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:42.374123 25491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:42.377244 25493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:42.377418 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:42.378674 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:42.378944 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:42.379127 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603422379110 us; error 0 us; skew 500 ppm
I20260709 13:23:42.379323 25486 heartbeater.cc:344] Connected to a master server at 127.12.208.190:41887
I20260709 13:23:42.379776 25486 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:42.379786 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:42.380543 25486 heartbeater.cc:507] Master 127.12.208.190:41887 requested a full tablet report, sending...
I20260709 13:23:42.382545 13122 webserver.cc:533] Webserver started at http://127.12.208.130:39793/ using document root <none> and password file <none>
I20260709 13:23:42.383000 25359 ts_manager.cc:194] Registered new tserver with Master: 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431)
I20260709 13:23:42.383283 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:42.383585 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:42.383912 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:42.385361 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-1-root/instance:
uuid: "8f418eda5a744e39adabe1152fe38eef"
format_stamp: "Formatted at 2026-07-09 13:23:42 on dist-test-slave-ll1f"
I20260709 13:23:42.385528 25359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56482
I20260709 13:23:42.390113 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:23:42.393507 25498 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:42.394335 13122 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:23:42.394595 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-1-root
uuid: "8f418eda5a744e39adabe1152fe38eef"
format_stamp: "Formatted at 2026-07-09 13:23:42 on dist-test-slave-ll1f"
I20260709 13:23:42.394826 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:42.415076 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:42.416109 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:42.417485 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:42.419821 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:42.420023 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:42.420334 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:42.420478 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:42.460755 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.130:35263
I20260709 13:23:42.460875 25560 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.130:35263 every 8 connection(s)
I20260709 13:23:42.465814 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:42.473171 25565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:42.475945 25564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:42.477247 25561 heartbeater.cc:344] Connected to a master server at 127.12.208.190:41887
W20260709 13:23:42.477841 25567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:42.478173 25561 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:42.479592 25561 heartbeater.cc:507] Master 127.12.208.190:41887 requested a full tablet report, sending...
I20260709 13:23:42.481408 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:42.482142 25359 ts_manager.cc:194] Registered new tserver with Master: 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:42.482592 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:42.482928 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:42.483143 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603422483125 us; error 0 us; skew 500 ppm
I20260709 13:23:42.483920 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:42.484136 25359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56498
I20260709 13:23:42.486871 13122 webserver.cc:533] Webserver started at http://127.12.208.131:41887/ using document root <none> and password file <none>
I20260709 13:23:42.487430 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:42.487592 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:42.487798 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:42.488833 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-2-root/instance:
uuid: "6235449a8f444a42b737723170ea15e5"
format_stamp: "Formatted at 2026-07-09 13:23:42 on dist-test-slave-ll1f"
I20260709 13:23:42.493378 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:23:42.497541 25572 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:42.498641 13122 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:23:42.498953 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-2-root
uuid: "6235449a8f444a42b737723170ea15e5"
format_stamp: "Formatted at 2026-07-09 13:23:42 on dist-test-slave-ll1f"
I20260709 13:23:42.499207 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603003722080-13122-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:42.514986 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:42.516047 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:42.517413 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:42.519781 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:42.520000 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:42.520275 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:42.520422 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:42.560042 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.131:35915
I20260709 13:23:42.560159 25634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.131:35915 every 8 connection(s)
I20260709 13:23:42.574024 25635 heartbeater.cc:344] Connected to a master server at 127.12.208.190:41887
I20260709 13:23:42.574383 25635 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:42.575104 25635 heartbeater.cc:507] Master 127.12.208.190:41887 requested a full tablet report, sending...
I20260709 13:23:42.577096 25359 ts_manager.cc:194] Registered new tserver with Master: 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:42.577955 13122 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014752121s
I20260709 13:23:42.578636 25359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56502
I20260709 13:23:42.605072 25359 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56512:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:42.607852 25359 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:42.687611 25600 tablet_service.cc:1511] Processing CreateTablet for tablet ae56321856254a358bd7bd15ceba6ec8 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:42.689235 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae56321856254a358bd7bd15ceba6ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.698438 25526 tablet_service.cc:1511] Processing CreateTablet for tablet ae56321856254a358bd7bd15ceba6ec8 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:42.699757 25599 tablet_service.cc:1511] Processing CreateTablet for tablet 70730a900a2b40de958948985dc2aef2 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:42.702356 25598 tablet_service.cc:1511] Processing CreateTablet for tablet 685bba1876c941668c959daa4cc40501 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:42.703293 25599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70730a900a2b40de958948985dc2aef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.702975 25525 tablet_service.cc:1511] Processing CreateTablet for tablet 70730a900a2b40de958948985dc2aef2 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:42.703061 25451 tablet_service.cc:1511] Processing CreateTablet for tablet ae56321856254a358bd7bd15ceba6ec8 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:42.704697 25451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae56321856254a358bd7bd15ceba6ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.704576 25597 tablet_service.cc:1511] Processing CreateTablet for tablet 0eb931a1552f44b58298f7629ab52f2d (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:42.706518 25523 tablet_service.cc:1511] Processing CreateTablet for tablet 0eb931a1552f44b58298f7629ab52f2d (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:42.707217 25524 tablet_service.cc:1511] Processing CreateTablet for tablet 685bba1876c941668c959daa4cc40501 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:42.709153 25597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eb931a1552f44b58298f7629ab52f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.711480 25449 tablet_service.cc:1511] Processing CreateTablet for tablet 685bba1876c941668c959daa4cc40501 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:42.700194 25526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae56321856254a358bd7bd15ceba6ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.712955 25449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685bba1876c941668c959daa4cc40501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.713542 25524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685bba1876c941668c959daa4cc40501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.714627 25522 tablet_service.cc:1511] Processing CreateTablet for tablet 18d4413e8bb54c7ab58d953e000360d3 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:42.716040 25522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18d4413e8bb54c7ab58d953e000360d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.718390 25523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eb931a1552f44b58298f7629ab52f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.719161 25525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70730a900a2b40de958948985dc2aef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.718506 25450 tablet_service.cc:1511] Processing CreateTablet for tablet 70730a900a2b40de958948985dc2aef2 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:42.720324 25450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70730a900a2b40de958948985dc2aef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.720640 25521 tablet_service.cc:1511] Processing CreateTablet for tablet a4adcbe6288849c6937fe1b60bd6acc8 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:42.718429 25598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685bba1876c941668c959daa4cc40501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.726557 25520 tablet_service.cc:1511] Processing CreateTablet for tablet 4d107e8134ff443cb4cd7a70b42e82f9 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:42.728680 25521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4adcbe6288849c6937fe1b60bd6acc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.731904 25519 tablet_service.cc:1511] Processing CreateTablet for tablet cdfdd407b84a4ed2b51092fa29347c8f (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:42.740084 25518 tablet_service.cc:1511] Processing CreateTablet for tablet 2f07c0848fad411789ec64e41f176757 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:42.743664 25448 tablet_service.cc:1511] Processing CreateTablet for tablet 0eb931a1552f44b58298f7629ab52f2d (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:42.745198 25448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eb931a1552f44b58298f7629ab52f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.741708 25518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f07c0848fad411789ec64e41f176757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.746104 25520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d107e8134ff443cb4cd7a70b42e82f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.747867 25519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdfdd407b84a4ed2b51092fa29347c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.756640 25447 tablet_service.cc:1511] Processing CreateTablet for tablet 18d4413e8bb54c7ab58d953e000360d3 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:42.758412 25447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18d4413e8bb54c7ab58d953e000360d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.763365 25596 tablet_service.cc:1511] Processing CreateTablet for tablet 18d4413e8bb54c7ab58d953e000360d3 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:42.764999 25596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18d4413e8bb54c7ab58d953e000360d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.775040 25446 tablet_service.cc:1511] Processing CreateTablet for tablet a4adcbe6288849c6937fe1b60bd6acc8 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:42.776647 25446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4adcbe6288849c6937fe1b60bd6acc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.776108 25595 tablet_service.cc:1511] Processing CreateTablet for tablet a4adcbe6288849c6937fe1b60bd6acc8 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:42.778450 25595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4adcbe6288849c6937fe1b60bd6acc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.805967 25445 tablet_service.cc:1511] Processing CreateTablet for tablet 4d107e8134ff443cb4cd7a70b42e82f9 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:42.807725 25445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d107e8134ff443cb4cd7a70b42e82f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.807292 25444 tablet_service.cc:1511] Processing CreateTablet for tablet cdfdd407b84a4ed2b51092fa29347c8f (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:42.808944 25444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdfdd407b84a4ed2b51092fa29347c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.809096 25598 tablet_service.cc:1511] Processing CreateTablet for tablet 4d107e8134ff443cb4cd7a70b42e82f9 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:42.810518 25598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d107e8134ff443cb4cd7a70b42e82f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.811338 25443 tablet_service.cc:1511] Processing CreateTablet for tablet 2f07c0848fad411789ec64e41f176757 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:42.807974 25600 tablet_service.cc:1511] Processing CreateTablet for tablet cdfdd407b84a4ed2b51092fa29347c8f (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:42.813105 25443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f07c0848fad411789ec64e41f176757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.813766 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdfdd407b84a4ed2b51092fa29347c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.815321 25594 tablet_service.cc:1511] Processing CreateTablet for tablet 2f07c0848fad411789ec64e41f176757 (DEFAULT_TABLE table=test-workload [id=8127dbb921a7483eba67f2d28ae3ccd1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:42.817030 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f07c0848fad411789ec64e41f176757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:42.818346 25650 tablet_bootstrap.cc:492] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:42.848412 25650 tablet_bootstrap.cc:654] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:42.867681 25651 tablet_bootstrap.cc:492] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:42.867861 25652 tablet_bootstrap.cc:492] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:42.873888 25652 tablet_bootstrap.cc:654] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:42.894055 25651 tablet_bootstrap.cc:654] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:42.897017 25650 tablet_bootstrap.cc:492] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:42.897635 25650 ts_tablet_manager.cc:1403] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.004s
I20260709 13:23:42.900681 25650 raft_consensus.cc:359] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.901407 25650 raft_consensus.cc:385] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:42.901728 25650 raft_consensus.cc:740] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:42.904174 25650 consensus_queue.cc:260] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.908694 25650 ts_tablet_manager.cc:1434] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:23:42.912176 25652 tablet_bootstrap.cc:492] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:42.912909 25635 heartbeater.cc:499] Master 127.12.208.190:41887 was elected leader, sending a full tablet report...
I20260709 13:23:42.913094 25652 ts_tablet_manager.cc:1403] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.019s
I20260709 13:23:42.916432 25652 raft_consensus.cc:359] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.917253 25652 raft_consensus.cc:385] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:42.917621 25652 raft_consensus.cc:740] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:42.918466 25652 consensus_queue.cc:260] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.919981 25651 tablet_bootstrap.cc:492] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:42.920574 25651 ts_tablet_manager.cc:1403] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.005s
I20260709 13:23:42.922989 25650 tablet_bootstrap.cc:492] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:42.923759 25651 raft_consensus.cc:359] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.927789 25651 raft_consensus.cc:385] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:42.928148 25651 raft_consensus.cc:740] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:42.929153 25651 consensus_queue.cc:260] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.934283 25486 heartbeater.cc:499] Master 127.12.208.190:41887 was elected leader, sending a full tablet report...
I20260709 13:23:42.934688 25652 ts_tablet_manager.cc:1434] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.021s	user 0.013s	sys 0.007s
I20260709 13:23:42.935521 25650 tablet_bootstrap.cc:654] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:42.935866 25652 tablet_bootstrap.cc:492] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:42.943254 25652 tablet_bootstrap.cc:654] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:42.943871 25650 tablet_bootstrap.cc:492] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:42.944527 25650 ts_tablet_manager.cc:1403] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 13:23:42.945595 25651 ts_tablet_manager.cc:1434] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:23:42.946707 25561 heartbeater.cc:499] Master 127.12.208.190:41887 was elected leader, sending a full tablet report...
I20260709 13:23:42.947449 25650 raft_consensus.cc:359] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:42.948266 25650 raft_consensus.cc:385] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:42.948557 25650 raft_consensus.cc:740] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:42.949496 25650 consensus_queue.cc:260] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:42.958153 25651 tablet_bootstrap.cc:492] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:42.958894 25650 ts_tablet_manager.cc:1434] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:23:42.962672 25650 tablet_bootstrap.cc:492] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:42.968515 25651 tablet_bootstrap.cc:654] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:42.968883 25650 tablet_bootstrap.cc:654] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:42.981563 25650 tablet_bootstrap.cc:492] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:42.982084 25652 tablet_bootstrap.cc:492] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:42.982129 25650 ts_tablet_manager.cc:1403] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:23:42.982709 25652 ts_tablet_manager.cc:1403] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.025s
I20260709 13:23:42.985109 25650 raft_consensus.cc:359] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.982336 25651 tablet_bootstrap.cc:492] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:42.985699 25650 raft_consensus.cc:385] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:42.986086 25650 raft_consensus.cc:740] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:42.986217 25651 ts_tablet_manager.cc:1403] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.009s
I20260709 13:23:42.985932 25652 raft_consensus.cc:359] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.986809 25652 raft_consensus.cc:385] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:42.987152 25652 raft_consensus.cc:740] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:42.986967 25650 consensus_queue.cc:260] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.988168 25652 consensus_queue.cc:260] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.989328 25650 ts_tablet_manager.cc:1434] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:23:42.989216 25651 raft_consensus.cc:359] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.990114 25651 raft_consensus.cc:385] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:42.990425 25651 raft_consensus.cc:740] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:42.990521 25650 tablet_bootstrap.cc:492] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:42.990676 25652 ts_tablet_manager.cc:1434] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:23:42.991189 25651 consensus_queue.cc:260] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:42.991705 25652 tablet_bootstrap.cc:492] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:42.998258 25650 tablet_bootstrap.cc:654] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:42.998836 25652 tablet_bootstrap.cc:654] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.003450 25651 ts_tablet_manager.cc:1434] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:23:43.014470 25651 tablet_bootstrap.cc:492] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:43.015329 25656 raft_consensus.cc:493] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.016122 25656 raft_consensus.cc:515] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.019737 25656 leader_election.cc:290] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:43.027391 25650 tablet_bootstrap.cc:492] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:43.027873 25651 tablet_bootstrap.cc:654] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.028065 25650 ts_tablet_manager.cc:1403] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.012s
I20260709 13:23:43.031145 25650 raft_consensus.cc:359] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.031929 25650 raft_consensus.cc:385] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.032276 25650 raft_consensus.cc:740] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.033084 25650 consensus_queue.cc:260] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.034293 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685bba1876c941668c959daa4cc40501" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:43.035223 25652 tablet_bootstrap.cc:492] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:43.035339 25650 ts_tablet_manager.cc:1434] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:23:43.035782 25652 ts_tablet_manager.cc:1403] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.023s
I20260709 13:23:43.036399 25650 tablet_bootstrap.cc:492] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:43.038862 25652 raft_consensus.cc:359] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.039583 25652 raft_consensus.cc:385] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.039852 25651 tablet_bootstrap.cc:492] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:43.040442 25651 ts_tablet_manager.cc:1403] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.001s
I20260709 13:23:43.041575 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685bba1876c941668c959daa4cc40501" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:43.042423 25461 raft_consensus.cc:2468] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 0.
I20260709 13:23:43.043367 25650 tablet_bootstrap.cc:654] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.043694 25656 raft_consensus.cc:493] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.043553 25651 raft_consensus.cc:359] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
W20260709 13:23:43.044402 25575 leader_election.cc:343] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.044279 25656 raft_consensus.cc:515] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.044520 25651 raft_consensus.cc:385] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.045267 25651 raft_consensus.cc:740] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.045993 25574 leader_election.cc:304] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:43.046103 25651 consensus_queue.cc:260] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.046639 25656 leader_election.cc:290] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:43.047462 25656 raft_consensus.cc:2804] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:43.047909 25656 raft_consensus.cc:493] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:43.048337 25656 raft_consensus.cc:3060] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.049124 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70730a900a2b40de958948985dc2aef2" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:43.039863 25652 raft_consensus.cc:740] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.050706 25652 consensus_queue.cc:260] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.051556 25651 ts_tablet_manager.cc:1434] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:23:43.052718 25651 tablet_bootstrap.cc:492] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
W20260709 13:23:43.054199 25575 leader_election.cc:343] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.059125 25651 tablet_bootstrap.cc:654] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.063094 25652 ts_tablet_manager.cc:1434] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.004s
I20260709 13:23:43.078722 25658 raft_consensus.cc:493] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.079380 25658 raft_consensus.cc:515] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.082266 25658 leader_election.cc:290] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.079398 25652 tablet_bootstrap.cc:492] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:43.083014 25656 raft_consensus.cc:515] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.088410 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685bba1876c941668c959daa4cc40501" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:43.089133 25460 raft_consensus.cc:3060] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.090251 25652 tablet_bootstrap.cc:654] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.094419 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70730a900a2b40de958948985dc2aef2" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:43.095469 25461 raft_consensus.cc:2468] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 0.
I20260709 13:23:43.098573 25574 leader_election.cc:304] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:43.100399 25668 raft_consensus.cc:2804] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:43.104137 25668 raft_consensus.cc:493] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:43.106179 25668 raft_consensus.cc:3060] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.106441 25651 tablet_bootstrap.cc:492] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:43.097287 25656 leader_election.cc:290] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:43.108891 25651 ts_tablet_manager.cc:1403] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.020s
I20260709 13:23:43.107733 25460 raft_consensus.cc:2468] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 1.
I20260709 13:23:43.110369 25574 leader_election.cc:304] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:43.111349 25656 raft_consensus.cc:2804] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:43.112527 25651 raft_consensus.cc:359] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.113620 25651 raft_consensus.cc:385] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.114059 25651 raft_consensus.cc:740] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.117738 25651 consensus_queue.cc:260] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.121868 25651 ts_tablet_manager.cc:1434] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:23:43.123397 25651 tablet_bootstrap.cc:492] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:43.126814 25650 tablet_bootstrap.cc:492] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:43.127451 25650 ts_tablet_manager.cc:1403] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.039s
I20260709 13:23:43.132508 25651 tablet_bootstrap.cc:654] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.131732 25650 raft_consensus.cc:359] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.134213 25650 raft_consensus.cc:385] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.135401 25650 raft_consensus.cc:740] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.135633 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685bba1876c941668c959daa4cc40501" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:43.136380 25536 raft_consensus.cc:3060] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.136404 25650 consensus_queue.cc:260] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.138209 25652 tablet_bootstrap.cc:492] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:43.140769 25652 ts_tablet_manager.cc:1403] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.020s
I20260709 13:23:43.133761 25656 raft_consensus.cc:697] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Becoming Leader. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:43.143922 25673 raft_consensus.cc:493] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.144526 25673 raft_consensus.cc:515] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:43.144372 25656 consensus_queue.cc:237] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.146489 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdfdd407b84a4ed2b51092fa29347c8f" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:43.146929 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdfdd407b84a4ed2b51092fa29347c8f" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:43.147275 25610 raft_consensus.cc:2468] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 0.
I20260709 13:23:43.149152 25536 raft_consensus.cc:2468] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 1.
I20260709 13:23:43.150985 25668 raft_consensus.cc:515] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.152081 25673 leader_election.cc:290] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431)
I20260709 13:23:43.152527 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae56321856254a358bd7bd15ceba6ec8" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:43.159943 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70730a900a2b40de958948985dc2aef2" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:43.158458 25650 ts_tablet_manager.cc:1434] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.031s	user 0.015s	sys 0.000s
I20260709 13:23:43.160578 25461 raft_consensus.cc:3060] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.161468 25650 tablet_bootstrap.cc:492] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:43.159327 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae56321856254a358bd7bd15ceba6ec8" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
W20260709 13:23:43.155094 25500 leader_election.cc:343] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.166746 25651 tablet_bootstrap.cc:492] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
W20260709 13:23:43.168053 25575 leader_election.cc:343] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.169044 25500 leader_election.cc:304] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 4698e80fcca64adea0ca43b2f2a4ac42
I20260709 13:23:43.169968 25658 raft_consensus.cc:2804] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:43.170341 25658 raft_consensus.cc:493] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:43.170658 25658 raft_consensus.cc:3060] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.153224 25652 raft_consensus.cc:359] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:43.171912 25652 raft_consensus.cc:385] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.167582 25651 ts_tablet_manager.cc:1403] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.019s
I20260709 13:23:43.172317 25652 raft_consensus.cc:740] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.166644 25668 leader_election.cc:290] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:43.175945 25651 raft_consensus.cc:359] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:43.176770 25651 raft_consensus.cc:385] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.177240 25651 raft_consensus.cc:740] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.177287 25652 consensus_queue.cc:260] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:43.178123 25651 consensus_queue.cc:260] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:43.176617 25461 raft_consensus.cc:2468] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 1.
I20260709 13:23:43.178697 25460 raft_consensus.cc:2468] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 0.
I20260709 13:23:43.179009 25658 raft_consensus.cc:515] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.181586 25574 leader_election.cc:304] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:43.181751 25658 leader_election.cc:290] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.192368 25650 tablet_bootstrap.cc:654] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.183287 25668 raft_consensus.cc:2804] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:43.193087 25668 raft_consensus.cc:493] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:43.193476 25668 raft_consensus.cc:3060] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.197611 25650 tablet_bootstrap.cc:492] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:43.184897 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdfdd407b84a4ed2b51092fa29347c8f" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:43.198208 25650 ts_tablet_manager.cc:1403] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.003s
I20260709 13:23:43.185707 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdfdd407b84a4ed2b51092fa29347c8f" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
W20260709 13:23:43.199385 25500 leader_election.cc:343] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.199484 25610 raft_consensus.cc:3060] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.199692 25652 ts_tablet_manager.cc:1434] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.058s	user 0.012s	sys 0.000s
I20260709 13:23:43.200860 25652 tablet_bootstrap.cc:492] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
W20260709 13:23:43.203663 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:43.201603 25650 raft_consensus.cc:359] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.204581 25650 raft_consensus.cc:385] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.205013 25650 raft_consensus.cc:740] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.188236 25651 ts_tablet_manager.cc:1434] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 13:23:43.183322 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70730a900a2b40de958948985dc2aef2" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:43.207341 25651 tablet_bootstrap.cc:492] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:43.185801 25574 leader_election.cc:304] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:43.209151 25652 tablet_bootstrap.cc:654] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:43.211690 25575 leader_election.cc:343] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.213807 25656 raft_consensus.cc:2804] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:43.214648 25656 raft_consensus.cc:697] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Becoming Leader. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:43.215334 25358 catalog_manager.cc:5697] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6235449a8f444a42b737723170ea15e5 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "6235449a8f444a42b737723170ea15e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:43.218282 25651 tablet_bootstrap.cc:654] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.206022 25650 consensus_queue.cc:260] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.222452 25668 raft_consensus.cc:515] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:43.215588 25656 consensus_queue.cc:237] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.225544 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae56321856254a358bd7bd15ceba6ec8" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:43.225426 25650 ts_tablet_manager.cc:1434] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 13:23:43.226317 25535 raft_consensus.cc:3060] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.227133 25650 tablet_bootstrap.cc:492] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:43.205710 25610 raft_consensus.cc:2468] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 1.
I20260709 13:23:43.235118 25500 leader_election.cc:304] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 4698e80fcca64adea0ca43b2f2a4ac42
I20260709 13:23:43.236406 25658 raft_consensus.cc:2804] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:43.236943 25658 raft_consensus.cc:697] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Becoming Leader. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:43.237835 25658 consensus_queue.cc:237] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.240528 25650 tablet_bootstrap.cc:654] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.244297 25535 raft_consensus.cc:2468] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 1.
I20260709 13:23:43.245968 25575 leader_election.cc:304] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:43.247236 25673 raft_consensus.cc:2804] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:43.247816 25673 raft_consensus.cc:697] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Becoming Leader. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:43.248869 25673 consensus_queue.cc:237] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:43.250651 25359 catalog_manager.cc:5697] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f418eda5a744e39adabe1152fe38eef (127.12.208.130). New cstate: current_term: 1 leader_uuid: "8f418eda5a744e39adabe1152fe38eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:43.265100 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae56321856254a358bd7bd15ceba6ec8" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:43.266038 25460 raft_consensus.cc:3060] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.276252 25460 raft_consensus.cc:2468] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 1.
I20260709 13:23:43.282431 25668 leader_election.cc:290] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431)
I20260709 13:23:43.301715 25651 tablet_bootstrap.cc:492] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:43.304733 25650 tablet_bootstrap.cc:492] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:43.305507 25650 ts_tablet_manager.cc:1403] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.079s	user 0.023s	sys 0.013s
I20260709 13:23:43.303593 25651 ts_tablet_manager.cc:1403] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.096s	user 0.050s	sys 0.035s
I20260709 13:23:43.309495 25650 raft_consensus.cc:359] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.310173 25651 raft_consensus.cc:359] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.311088 25651 raft_consensus.cc:385] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.311236 25652 tablet_bootstrap.cc:492] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:43.311430 25651 raft_consensus.cc:740] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.311872 25652 ts_tablet_manager.cc:1403] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.111s	user 0.041s	sys 0.047s
I20260709 13:23:43.312420 25651 consensus_queue.cc:260] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.313446 25650 raft_consensus.cc:385] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.313957 25650 raft_consensus.cc:740] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.314963 25650 consensus_queue.cc:260] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.315165 25651 ts_tablet_manager.cc:1434] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:23:43.315163 25652 raft_consensus.cc:359] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.331152 25652 raft_consensus.cc:385] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.321230 25358 catalog_manager.cc:5697] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6235449a8f444a42b737723170ea15e5 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "6235449a8f444a42b737723170ea15e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:43.331504 25652 raft_consensus.cc:740] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.332710 25650 ts_tablet_manager.cc:1434] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:23:43.333561 25651 tablet_bootstrap.cc:492] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:43.332828 25358 catalog_manager.cc:5697] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6235449a8f444a42b737723170ea15e5 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "6235449a8f444a42b737723170ea15e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:43.335395 25650 tablet_bootstrap.cc:492] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:43.332479 25652 consensus_queue.cc:260] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.340548 25651 tablet_bootstrap.cc:654] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.340778 25652 ts_tablet_manager.cc:1434] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:23:43.342186 25652 tablet_bootstrap.cc:492] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:43.345826 25656 raft_consensus.cc:493] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.346424 25656 raft_consensus.cc:515] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.350554 25650 tablet_bootstrap.cc:654] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.350721 25652 tablet_bootstrap.cc:654] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.351105 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d4413e8bb54c7ab58d953e000360d3" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:43.352828 25651 tablet_bootstrap.cc:492] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:43.353402 25651 ts_tablet_manager.cc:1403] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
W20260709 13:23:43.354452 25575 leader_election.cc:343] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.356225 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d4413e8bb54c7ab58d953e000360d3" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:43.357182 25460 raft_consensus.cc:2468] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 0.
I20260709 13:23:43.357614 25651 raft_consensus.cc:359] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.358867 25651 raft_consensus.cc:385] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.358969 25574 leader_election.cc:304] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:43.359303 25651 raft_consensus.cc:740] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.360383 25673 raft_consensus.cc:2804] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:43.360937 25673 raft_consensus.cc:493] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:43.361450 25673 raft_consensus.cc:3060] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.360625 25651 consensus_queue.cc:260] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.367360 25651 ts_tablet_manager.cc:1434] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:23:43.368192 25668 raft_consensus.cc:493] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.370716 25656 leader_election.cc:290] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:43.372422 25657 raft_consensus.cc:493] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.369032 25668 raft_consensus.cc:515] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.372989 25657 raft_consensus.cc:515] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.375008 25668 leader_election.cc:290] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:43.375736 25657 leader_election.cc:290] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.368528 25651 tablet_bootstrap.cc:492] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:43.379549 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4adcbe6288849c6937fe1b60bd6acc8" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:43.379770 25673 raft_consensus.cc:515] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
W20260709 13:23:43.382820 25575 leader_election.cc:343] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.388239 25651 tablet_bootstrap.cc:654] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.388782 25673 leader_election.cc:290] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:43.391475 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d4413e8bb54c7ab58d953e000360d3" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
W20260709 13:23:43.394795 25575 leader_election.cc:343] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.400764 25650 tablet_bootstrap.cc:492] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:43.401473 25650 ts_tablet_manager.cc:1403] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.023s
I20260709 13:23:43.402290 25652 tablet_bootstrap.cc:492] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:43.402968 25652 ts_tablet_manager.cc:1403] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.009s
I20260709 13:23:43.405421 25650 raft_consensus.cc:359] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.406524 25650 raft_consensus.cc:385] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.406924 25650 raft_consensus.cc:740] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.407069 25652 raft_consensus.cc:359] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.407986 25652 raft_consensus.cc:385] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.407843 25650 consensus_queue.cc:260] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.410636 25650 ts_tablet_manager.cc:1434] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:23:43.411803 25650 tablet_bootstrap.cc:492] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:43.408439 25652 raft_consensus.cc:740] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.415030 25652 consensus_queue.cc:260] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.416348 25651 tablet_bootstrap.cc:492] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:43.417059 25651 ts_tablet_manager.cc:1403] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.013s
I20260709 13:23:43.417812 25652 ts_tablet_manager.cc:1434] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:23:43.417806 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4adcbe6288849c6937fe1b60bd6acc8" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:43.419190 25652 tablet_bootstrap.cc:492] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:43.419662 25460 raft_consensus.cc:2468] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 0.
I20260709 13:23:43.421403 25651 raft_consensus.cc:359] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.423106 25658 raft_consensus.cc:493] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.425320 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb931a1552f44b58298f7629ab52f2d" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:43.425493 25658 raft_consensus.cc:515] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.426134 25535 raft_consensus.cc:2468] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:43.427726 25426 leader_election.cc:304] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:43.428149 25658 leader_election.cc:290] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.428656 25657 raft_consensus.cc:2804] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:43.429114 25657 raft_consensus.cc:493] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:43.429502 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d4413e8bb54c7ab58d953e000360d3" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:43.430239 25460 raft_consensus.cc:3060] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.430423 25651 raft_consensus.cc:385] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.430889 25651 raft_consensus.cc:740] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.431788 25651 consensus_queue.cc:260] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.432186 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f07c0848fad411789ec64e41f176757" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:43.433652 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f07c0848fad411789ec64e41f176757" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
W20260709 13:23:43.435384 25500 leader_election.cc:343] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:43.436931 25500 leader_election.cc:343] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.437194 25650 tablet_bootstrap.cc:654] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.438108 25652 tablet_bootstrap.cc:654] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.434273 25651 ts_tablet_manager.cc:1434] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:23:43.440212 25574 leader_election.cc:304] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:43.441644 25651 tablet_bootstrap.cc:492] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:43.441730 25673 raft_consensus.cc:2804] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:43.442466 25673 raft_consensus.cc:493] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:43.442826 25673 raft_consensus.cc:3060] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.429553 25657 raft_consensus.cc:3060] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.437433 25500 leader_election.cc:304] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f418eda5a744e39adabe1152fe38eef; no voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5
I20260709 13:23:43.450878 25673 raft_consensus.cc:515] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.452859 25658 raft_consensus.cc:2749] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:43.454350 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb931a1552f44b58298f7629ab52f2d" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:43.463217 25610 raft_consensus.cc:2468] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:43.455870 25651 tablet_bootstrap.cc:654] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.456374 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4adcbe6288849c6937fe1b60bd6acc8" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:43.464301 25461 raft_consensus.cc:3060] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.472097 25461 raft_consensus.cc:2468] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 1.
I20260709 13:23:43.460870 25677 raft_consensus.cc:493] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.455570 25460 raft_consensus.cc:2468] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 1.
I20260709 13:23:43.463171 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4adcbe6288849c6937fe1b60bd6acc8" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:43.473681 25677 raft_consensus.cc:515] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.469621 25657 raft_consensus.cc:515] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.476890 25677 leader_election.cc:290] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
W20260709 13:23:43.477743 25575 leader_election.cc:343] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.478264 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb931a1552f44b58298f7629ab52f2d" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:43.479038 25535 raft_consensus.cc:3060] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.480504 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d107e8134ff443cb4cd7a70b42e82f9" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:43.481391 25610 raft_consensus.cc:2468] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 0.
I20260709 13:23:43.481524 25574 leader_election.cc:304] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:43.482457 25668 raft_consensus.cc:2804] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:43.482930 25668 raft_consensus.cc:697] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Becoming Leader. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:43.483037 25500 leader_election.cc:304] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:43.483942 25677 raft_consensus.cc:2804] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:43.483819 25668 consensus_queue.cc:237] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.485181 25574 leader_election.cc:304] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:43.486439 25656 raft_consensus.cc:2804] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:43.486948 25656 raft_consensus.cc:697] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Becoming Leader. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:43.484364 25677 raft_consensus.cc:493] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:43.487643 25677 raft_consensus.cc:3060] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.487815 25656 consensus_queue.cc:237] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.488933 25651 tablet_bootstrap.cc:492] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:43.489720 25651 ts_tablet_manager.cc:1403] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.000s
I20260709 13:23:43.461561 25673 leader_election.cc:290] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:43.480603 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d107e8134ff443cb4cd7a70b42e82f9" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
W20260709 13:23:43.497347 25500 leader_election.cc:343] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.500991 25535 raft_consensus.cc:2468] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:43.502403 25426 leader_election.cc:304] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:43.503525 25658 raft_consensus.cc:493] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.503882 25651 raft_consensus.cc:359] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.504150 25658 raft_consensus.cc:515] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.504920 25699 raft_consensus.cc:2804] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:43.506835 25658 leader_election.cc:290] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.504915 25651 raft_consensus.cc:385] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.507761 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eb931a1552f44b58298f7629ab52f2d" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:43.508134 25651 raft_consensus.cc:740] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.508514 25610 raft_consensus.cc:3060] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.510330 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d4413e8bb54c7ab58d953e000360d3" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:43.510444 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d4413e8bb54c7ab58d953e000360d3" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:43.512794 25460 raft_consensus.cc:2393] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f418eda5a744e39adabe1152fe38eef in current term 1: Already voted for candidate 6235449a8f444a42b737723170ea15e5 in this term.
I20260709 13:23:43.509281 25651 consensus_queue.cc:260] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.514797 25500 leader_election.cc:304] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f418eda5a744e39adabe1152fe38eef; no voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5
I20260709 13:23:43.508366 25356 catalog_manager.cc:5697] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6235449a8f444a42b737723170ea15e5 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "6235449a8f444a42b737723170ea15e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:43.516462 25651 ts_tablet_manager.cc:1434] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:23:43.520123 25658 raft_consensus.cc:3060] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.526146 25657 leader_election.cc:290] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.535899 25610 raft_consensus.cc:2468] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:43.536736 25668 consensus_queue.cc:1048] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:43.543509 25677 raft_consensus.cc:515] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.553360 25650 tablet_bootstrap.cc:492] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:43.554232 25650 ts_tablet_manager.cc:1403] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.143s	user 0.039s	sys 0.038s
I20260709 13:23:43.555095 25699 raft_consensus.cc:697] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:43.556209 25699 consensus_queue.cc:237] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.557694 25650 raft_consensus.cc:359] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.558559 25650 raft_consensus.cc:385] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.558863 25650 raft_consensus.cc:740] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.559746 25650 consensus_queue.cc:260] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.569007 25650 ts_tablet_manager.cc:1434] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:23:43.573201 25652 tablet_bootstrap.cc:492] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:43.548465 25356 catalog_manager.cc:5697] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6235449a8f444a42b737723170ea15e5 (127.12.208.131). New cstate: current_term: 1 leader_uuid: "6235449a8f444a42b737723170ea15e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:43.574136 25652 ts_tablet_manager.cc:1403] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.155s	user 0.033s	sys 0.066s
I20260709 13:23:43.575114 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d107e8134ff443cb4cd7a70b42e82f9" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:43.576155 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d107e8134ff443cb4cd7a70b42e82f9" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:43.579087 25610 raft_consensus.cc:3060] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.578363 25652 raft_consensus.cc:359] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.573252 25677 leader_election.cc:290] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.579622 25652 raft_consensus.cc:385] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.581012 25652 raft_consensus.cc:740] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.582083 25652 consensus_queue.cc:260] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.585353 25652 ts_tablet_manager.cc:1434] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:23:43.586445 25652 tablet_bootstrap.cc:492] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:43.576417 25658 raft_consensus.cc:2749] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:43.588619 25610 raft_consensus.cc:2468] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 1.
I20260709 13:23:43.593581 25500 leader_election.cc:304] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:43.594736 25652 tablet_bootstrap.cc:654] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:43.594954 25500 leader_election.cc:343] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:43.597325 25658 raft_consensus.cc:2804] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:43.598142 25658 raft_consensus.cc:697] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Becoming Leader. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:43.598361 25673 consensus_queue.cc:1048] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:43.599057 25658 consensus_queue.cc:237] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.596122 25359 catalog_manager.cc:5697] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:43.604452 25652 tablet_bootstrap.cc:492] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:43.605362 25652 ts_tablet_manager.cc:1403] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:23:43.610457 25652 raft_consensus.cc:359] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.611654 25652 raft_consensus.cc:385] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.612172 25652 raft_consensus.cc:740] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.613353 25652 consensus_queue.cc:260] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.616505 25652 ts_tablet_manager.cc:1434] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:23:43.618824 25652 tablet_bootstrap.cc:492] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:43.629246 25652 tablet_bootstrap.cc:654] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:43.642743 25652 tablet_bootstrap.cc:492] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:43.643617 25652 ts_tablet_manager.cc:1403] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 13:23:43.646302 25652 raft_consensus.cc:359] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.646921 25652 raft_consensus.cc:385] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:43.647182 25652 raft_consensus.cc:740] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:43.647893 25652 consensus_queue.cc:260] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.650079 25652 ts_tablet_manager.cc:1434] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:23:43.654891 25356 catalog_manager.cc:5697] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f418eda5a744e39adabe1152fe38eef (127.12.208.130). New cstate: current_term: 1 leader_uuid: "8f418eda5a744e39adabe1152fe38eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:43.665148 25673 consensus_queue.cc:1048] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:43.676407 25675 consensus_queue.cc:1048] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:43.701661 25700 raft_consensus.cc:493] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.702163 25700 raft_consensus.cc:515] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.704118 25700 leader_election.cc:290] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.704198 25658 raft_consensus.cc:493] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.704845 25658 raft_consensus.cc:515] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.705116 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f07c0848fad411789ec64e41f176757" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:43.705240 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f07c0848fad411789ec64e41f176757" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:43.705920 25535 raft_consensus.cc:2468] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:43.706105 25610 raft_consensus.cc:2468] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:43.707005 25658 leader_election.cc:290] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.706979 25426 leader_election.cc:304] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:43.708024 25700 raft_consensus.cc:2804] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:43.708412 25700 raft_consensus.cc:493] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:43.708506 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70730a900a2b40de958948985dc2aef2" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:43.708807 25700 raft_consensus.cc:3060] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.708976 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70730a900a2b40de958948985dc2aef2" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:43.709779 25461 raft_consensus.cc:2393] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f418eda5a744e39adabe1152fe38eef in current term 1: Already voted for candidate 6235449a8f444a42b737723170ea15e5 in this term.
I20260709 13:23:43.710804 25500 leader_election.cc:304] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f418eda5a744e39adabe1152fe38eef; no voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5
I20260709 13:23:43.711602 25658 raft_consensus.cc:3060] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.714841 25700 raft_consensus.cc:515] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.716544 25700 leader_election.cc:290] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.716768 25658 raft_consensus.cc:2749] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:43.717465 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f07c0848fad411789ec64e41f176757" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:43.717720 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f07c0848fad411789ec64e41f176757" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:43.718149 25535 raft_consensus.cc:3060] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.718276 25610 raft_consensus.cc:3060] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.725273 25610 raft_consensus.cc:2468] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:43.725273 25535 raft_consensus.cc:2468] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:43.726815 25425 leader_election.cc:304] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:43.727598 25700 raft_consensus.cc:2804] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:43.728080 25700 raft_consensus.cc:697] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:43.728928 25700 consensus_queue.cc:237] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.737099 25359 catalog_manager.cc:5697] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:43.743505 25675 consensus_queue.cc:1048] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:43.754572 25675 consensus_queue.cc:1048] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:43.788975 25700 raft_consensus.cc:493] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.789510 25700 raft_consensus.cc:515] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.791332 25700 leader_election.cc:290] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.792349 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d107e8134ff443cb4cd7a70b42e82f9" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:43.792551 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d107e8134ff443cb4cd7a70b42e82f9" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:43.793363 25610 raft_consensus.cc:2393] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4698e80fcca64adea0ca43b2f2a4ac42 in current term 1: Already voted for candidate 8f418eda5a744e39adabe1152fe38eef in this term.
I20260709 13:23:43.794396 25425 leader_election.cc:304] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42; no voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:43.795054 25700 raft_consensus.cc:3060] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.797118 25461 raft_consensus.cc:3060] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.802630 25700 raft_consensus.cc:2749] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:43.805742 25658 consensus_queue.cc:1048] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:43.818809 25677 consensus_queue.cc:1048] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:43.838028 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae56321856254a358bd7bd15ceba6ec8"
dest_uuid: "6235449a8f444a42b737723170ea15e5"
mode: GRACEFUL
new_leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
 from {username='slave'} at 127.0.0.1:33674
I20260709 13:23:43.838734 25610 raft_consensus.cc:606] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Received request to transfer leadership to TS 4698e80fcca64adea0ca43b2f2a4ac42
I20260709 13:23:43.844729 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70730a900a2b40de958948985dc2aef2"
dest_uuid: "6235449a8f444a42b737723170ea15e5"
mode: GRACEFUL
new_leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
 from {username='slave'} at 127.0.0.1:33674
I20260709 13:23:43.845388 25610 raft_consensus.cc:606] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Received request to transfer leadership to TS 4698e80fcca64adea0ca43b2f2a4ac42
I20260709 13:23:43.850967 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "685bba1876c941668c959daa4cc40501"
dest_uuid: "6235449a8f444a42b737723170ea15e5"
mode: GRACEFUL
new_leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
 from {username='slave'} at 127.0.0.1:33674
I20260709 13:23:43.851442 25610 raft_consensus.cc:606] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Received request to transfer leadership to TS 4698e80fcca64adea0ca43b2f2a4ac42
I20260709 13:23:43.860281 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18d4413e8bb54c7ab58d953e000360d3"
dest_uuid: "6235449a8f444a42b737723170ea15e5"
mode: GRACEFUL
new_leader_uuid: "8f418eda5a744e39adabe1152fe38eef"
 from {username='slave'} at 127.0.0.1:33674
I20260709 13:23:43.860817 25610 raft_consensus.cc:606] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Received request to transfer leadership to TS 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:43.865896 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4adcbe6288849c6937fe1b60bd6acc8"
dest_uuid: "6235449a8f444a42b737723170ea15e5"
mode: GRACEFUL
new_leader_uuid: "8f418eda5a744e39adabe1152fe38eef"
 from {username='slave'} at 127.0.0.1:33674
I20260709 13:23:43.866391 25610 raft_consensus.cc:606] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Received request to transfer leadership to TS 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:43.885934 25461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f07c0848fad411789ec64e41f176757"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
mode: GRACEFUL
new_leader_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:42104
I20260709 13:23:43.886456 25461 raft_consensus.cc:606] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Received request to transfer leadership to TS 6235449a8f444a42b737723170ea15e5
I20260709 13:23:43.901742 25675 consensus_queue.cc:1048] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:43.908977 25673 raft_consensus.cc:993] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5: : Instructing follower 8f418eda5a744e39adabe1152fe38eef to start an election
I20260709 13:23:43.909488 25673 raft_consensus.cc:1081] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Signalling peer 8f418eda5a744e39adabe1152fe38eef to start an election
I20260709 13:23:43.911286 25536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18d4413e8bb54c7ab58d953e000360d3"
dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
 from {username='slave'} at 127.0.0.1:52506
I20260709 13:23:43.912307 25536 raft_consensus.cc:493] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:43.912734 25536 raft_consensus.cc:3060] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:43.915563 25673 consensus_queue.cc:1048] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:43.921965 25536 raft_consensus.cc:515] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.925292 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d4413e8bb54c7ab58d953e000360d3" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:43.925901 25461 raft_consensus.cc:3060] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:43.929522 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18d4413e8bb54c7ab58d953e000360d3" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:43.930280 25610 raft_consensus.cc:3055] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:43.930406 25536 leader_election.cc:290] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 2 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.931151 25610 raft_consensus.cc:740] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:43.932034 25610 consensus_queue.cc:260] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.932783 25461 raft_consensus.cc:2468] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 2.
I20260709 13:23:43.933357 25610 raft_consensus.cc:3060] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:43.934063 25500 leader_election.cc:304] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:43.934931 25718 raft_consensus.cc:2804] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:43.935607 25718 raft_consensus.cc:697] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Becoming Leader. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:43.936599 25718 consensus_queue.cc:237] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.940656 25610 raft_consensus.cc:2468] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 2.
I20260709 13:23:43.944769 25718 raft_consensus.cc:493] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:43.944219 25359 catalog_manager.cc:5697] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef reported cstate change: term changed from 1 to 2, leader changed from 6235449a8f444a42b737723170ea15e5 (127.12.208.131) to 8f418eda5a744e39adabe1152fe38eef (127.12.208.130). New cstate: current_term: 2 leader_uuid: "8f418eda5a744e39adabe1152fe38eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:43.945379 25718 raft_consensus.cc:515] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:43.947157 25718 leader_election.cc:290] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:43.947932 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4adcbe6288849c6937fe1b60bd6acc8" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:43.948437 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4adcbe6288849c6937fe1b60bd6acc8" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:43.948809 25461 raft_consensus.cc:2393] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f418eda5a744e39adabe1152fe38eef in current term 1: Already voted for candidate 6235449a8f444a42b737723170ea15e5 in this term.
I20260709 13:23:43.950281 25500 leader_election.cc:304] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f418eda5a744e39adabe1152fe38eef; no voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5
I20260709 13:23:43.951102 25718 raft_consensus.cc:3060] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:43.957091 25718 raft_consensus.cc:2749] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:43.997450 25673 consensus_queue.cc:1048] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:44.004510 25675 raft_consensus.cc:993] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5: : Instructing follower 8f418eda5a744e39adabe1152fe38eef to start an election
I20260709 13:23:44.005005 25668 raft_consensus.cc:1081] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Signalling peer 8f418eda5a744e39adabe1152fe38eef to start an election
I20260709 13:23:44.006628 25535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4adcbe6288849c6937fe1b60bd6acc8"
dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
 from {username='slave'} at 127.0.0.1:52506
I20260709 13:23:44.007278 25535 raft_consensus.cc:493] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:44.007643 25535 raft_consensus.cc:3060] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.010016 25673 consensus_queue.cc:1048] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:44.015125 25535 raft_consensus.cc:515] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.016557 25536 raft_consensus.cc:1240] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Rejecting Update request from peer 6235449a8f444a42b737723170ea15e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:23:44.019440 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4adcbe6288849c6937fe1b60bd6acc8" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:44.019996 25535 leader_election.cc:290] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 2 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:44.020051 25460 raft_consensus.cc:3060] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.021521 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4adcbe6288849c6937fe1b60bd6acc8" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:44.022241 25610 raft_consensus.cc:3055] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:44.022480 25610 raft_consensus.cc:740] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:44.023185 25610 consensus_queue.cc:260] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.024333 25610 raft_consensus.cc:3060] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.027720 25460 raft_consensus.cc:2468] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 2.
I20260709 13:23:44.029031 25500 leader_election.cc:304] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:44.029914 25718 raft_consensus.cc:2804] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:44.030439 25718 raft_consensus.cc:697] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Becoming Leader. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:44.030474 25610 raft_consensus.cc:2468] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 2.
I20260709 13:23:44.031383 25718 consensus_queue.cc:237] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.038143 25718 consensus_queue.cc:1048] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:44.038113 25359 catalog_manager.cc:5697] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef reported cstate change: term changed from 1 to 2, leader changed from 6235449a8f444a42b737723170ea15e5 (127.12.208.131) to 8f418eda5a744e39adabe1152fe38eef (127.12.208.130). New cstate: current_term: 2 leader_uuid: "8f418eda5a744e39adabe1152fe38eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:44.050940 25677 consensus_queue.cc:1048] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:44.104779 25673 raft_consensus.cc:993] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5: : Instructing follower 4698e80fcca64adea0ca43b2f2a4ac42 to start an election
I20260709 13:23:44.104928 25700 consensus_queue.cc:1048] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:44.105288 25668 raft_consensus.cc:1081] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Signalling peer 4698e80fcca64adea0ca43b2f2a4ac42 to start an election
I20260709 13:23:44.107267 25460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "685bba1876c941668c959daa4cc40501"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
 from {username='slave'} at 127.0.0.1:47802
I20260709 13:23:44.107838 25460 raft_consensus.cc:493] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:44.108204 25460 raft_consensus.cc:3060] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.115979 25460 raft_consensus.cc:515] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.117683 25700 consensus_queue.cc:1048] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:44.118552 25460 leader_election.cc:290] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 2 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:44.118815 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685bba1876c941668c959daa4cc40501" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:44.119428 25535 raft_consensus.cc:3060] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.120551 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685bba1876c941668c959daa4cc40501" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:44.121176 25609 raft_consensus.cc:3055] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:44.121503 25609 raft_consensus.cc:740] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:44.122356 25609 consensus_queue.cc:260] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.123693 25609 raft_consensus.cc:3060] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.127274 25535 raft_consensus.cc:2468] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 2.
I20260709 13:23:44.128742 25426 leader_election.cc:304] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:44.132484 25728 raft_consensus.cc:2804] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:44.133291 25728 raft_consensus.cc:697] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:44.133951 25609 raft_consensus.cc:2468] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 2.
I20260709 13:23:44.134262 25728 consensus_queue.cc:237] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.143428 25359 catalog_manager.cc:5697] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 1 to 2, leader changed from 6235449a8f444a42b737723170ea15e5 (127.12.208.131) to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:44.168666 25675 raft_consensus.cc:993] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5: : Instructing follower 4698e80fcca64adea0ca43b2f2a4ac42 to start an election
I20260709 13:23:44.169198 25668 raft_consensus.cc:1081] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Signalling peer 4698e80fcca64adea0ca43b2f2a4ac42 to start an election
I20260709 13:23:44.170821 25460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70730a900a2b40de958948985dc2aef2"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
 from {username='slave'} at 127.0.0.1:47802
I20260709 13:23:44.171341 25460 raft_consensus.cc:493] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:44.171666 25460 raft_consensus.cc:3060] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.176761 25460 raft_consensus.cc:515] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.178478 25460 leader_election.cc:290] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 2 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:44.179400 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70730a900a2b40de958948985dc2aef2" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:44.179733 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70730a900a2b40de958948985dc2aef2" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:44.180150 25536 raft_consensus.cc:3060] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.180356 25610 raft_consensus.cc:3055] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:44.180721 25610 raft_consensus.cc:740] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:44.181573 25610 consensus_queue.cc:260] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.182934 25610 raft_consensus.cc:3060] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.187968 25536 raft_consensus.cc:2468] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 2.
I20260709 13:23:44.189297 25426 leader_election.cc:304] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:44.190131 25610 raft_consensus.cc:2468] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 2.
I20260709 13:23:44.190138 25728 raft_consensus.cc:2804] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:44.190889 25728 raft_consensus.cc:697] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:44.191735 25728 consensus_queue.cc:237] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.198199 25359 catalog_manager.cc:5697] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 1 to 2, leader changed from 6235449a8f444a42b737723170ea15e5 (127.12.208.131) to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:44.243599 25728 consensus_queue.cc:1048] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:44.250085 25699 raft_consensus.cc:993] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42: : Instructing follower 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:44.250610 25700 raft_consensus.cc:1081] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Signalling peer 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:44.252475 25609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f07c0848fad411789ec64e41f176757"
dest_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:23:44.253942 25609 raft_consensus.cc:493] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:44.254424 25609 raft_consensus.cc:3060] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.255870 25728 consensus_queue.cc:1048] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:44.262363 25609 raft_consensus.cc:515] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.267263 25609 leader_election.cc:290] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 2 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:44.267833 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f07c0848fad411789ec64e41f176757" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:44.268546 25536 raft_consensus.cc:3060] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.269074 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f07c0848fad411789ec64e41f176757" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:44.269771 25460 raft_consensus.cc:3055] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:44.270161 25460 raft_consensus.cc:740] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:44.271023 25460 consensus_queue.cc:260] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.272169 25460 raft_consensus.cc:3060] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.275439 25536 raft_consensus.cc:2468] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 2.
I20260709 13:23:44.276684 25575 leader_election.cc:304] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:44.277521 25668 raft_consensus.cc:2804] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:44.278050 25668 raft_consensus.cc:697] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 2 LEADER]: Becoming Leader. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:44.279031 25460 raft_consensus.cc:2468] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 2.
I20260709 13:23:44.278934 25668 consensus_queue.cc:237] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:44.286211 25356 catalog_manager.cc:5697] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 reported cstate change: term changed from 1 to 2, leader changed from 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129) to 6235449a8f444a42b737723170ea15e5 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "6235449a8f444a42b737723170ea15e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:44.293926 25675 raft_consensus.cc:993] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5: : Instructing follower 4698e80fcca64adea0ca43b2f2a4ac42 to start an election
I20260709 13:23:44.294530 25668 raft_consensus.cc:1081] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Signalling peer 4698e80fcca64adea0ca43b2f2a4ac42 to start an election
I20260709 13:23:44.296160 25460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae56321856254a358bd7bd15ceba6ec8"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
 from {username='slave'} at 127.0.0.1:47802
I20260709 13:23:44.296876 25460 raft_consensus.cc:493] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:44.297308 25460 raft_consensus.cc:3060] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.303953 25460 raft_consensus.cc:515] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:44.305650 25460 leader_election.cc:290] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 2 election: Requested vote from peers 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:44.306584 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae56321856254a358bd7bd15ceba6ec8" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:44.306756 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae56321856254a358bd7bd15ceba6ec8" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:44.307207 25609 raft_consensus.cc:3055] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:44.307428 25536 raft_consensus.cc:3060] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.307559 25609 raft_consensus.cc:740] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:44.308354 25609 consensus_queue.cc:260] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:44.309324 25609 raft_consensus.cc:3060] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:44.312978 25536 raft_consensus.cc:2468] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 2.
I20260709 13:23:44.314281 25426 leader_election.cc:304] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:44.314563 25609 raft_consensus.cc:2468] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 2.
I20260709 13:23:44.315100 25728 raft_consensus.cc:2804] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:44.315689 25728 raft_consensus.cc:697] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:44.316555 25728 consensus_queue.cc:237] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } }
I20260709 13:23:44.323482 25356 catalog_manager.cc:5697] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 1 to 2, leader changed from 6235449a8f444a42b737723170ea15e5 (127.12.208.131) to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:44.438891 25460 raft_consensus.cc:1275] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Refusing update from remote peer 8f418eda5a744e39adabe1152fe38eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.440299 25658 consensus_queue.cc:1048] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:44.448428 25609 raft_consensus.cc:1275] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Refusing update from remote peer 8f418eda5a744e39adabe1152fe38eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.450529 25658 consensus_queue.cc:1048] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:44.489297 25609 raft_consensus.cc:1275] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Refusing update from remote peer 8f418eda5a744e39adabe1152fe38eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.490761 25658 consensus_queue.cc:1048] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:44.499244 25460 raft_consensus.cc:1275] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Refusing update from remote peer 8f418eda5a744e39adabe1152fe38eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.501247 25701 consensus_queue.cc:1048] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:44.630239 25609 raft_consensus.cc:1275] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Refusing update from remote peer 4698e80fcca64adea0ca43b2f2a4ac42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.631696 25728 consensus_queue.cc:1048] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:44.643033 25536 raft_consensus.cc:1275] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Refusing update from remote peer 4698e80fcca64adea0ca43b2f2a4ac42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.645025 25732 consensus_queue.cc:1048] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:44.689999 25610 raft_consensus.cc:1275] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Refusing update from remote peer 4698e80fcca64adea0ca43b2f2a4ac42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.691246 25732 consensus_queue.cc:1048] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:44.694988 25460 raft_consensus.cc:1275] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.696709 25668 consensus_queue.cc:1048] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:44.703028 25536 raft_consensus.cc:1275] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Refusing update from remote peer 4698e80fcca64adea0ca43b2f2a4ac42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.705256 25732 consensus_queue.cc:1048] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:44.713034 25536 raft_consensus.cc:1275] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.716755 25673 consensus_queue.cc:1048] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:44.753001 25610 raft_consensus.cc:1275] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Refusing update from remote peer 4698e80fcca64adea0ca43b2f2a4ac42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.754421 25699 consensus_queue.cc:1048] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:44.763722 25535 raft_consensus.cc:1275] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Refusing update from remote peer 4698e80fcca64adea0ca43b2f2a4ac42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:44.765527 25699 consensus_queue.cc:1048] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:46.969141 25359 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60230:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:46.972138 25359 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:47.035431 25444 tablet_service.cc:1511] Processing CreateTablet for tablet fb0d9c828f0f4c5ea5fad564e4e2cb81 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:47.036720 25521 tablet_service.cc:1511] Processing CreateTablet for tablet fb0d9c828f0f4c5ea5fad564e4e2cb81 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:47.037580 25444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb0d9c828f0f4c5ea5fad564e4e2cb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.038767 25521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb0d9c828f0f4c5ea5fad564e4e2cb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.038550 25594 tablet_service.cc:1511] Processing CreateTablet for tablet fb0d9c828f0f4c5ea5fad564e4e2cb81 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:47.040304 25594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb0d9c828f0f4c5ea5fad564e4e2cb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.041623 25522 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd63eca82844f809edfbf9518d38591 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:47.045886 25522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd63eca82844f809edfbf9518d38591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.047708 25525 tablet_service.cc:1511] Processing CreateTablet for tablet fb22aa501c5d42fa91a2a7a4de4d42e5 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:47.049400 25525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb22aa501c5d42fa91a2a7a4de4d42e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.055279 25526 tablet_service.cc:1511] Processing CreateTablet for tablet 133535ce885e407f8764f0ee126c1a76 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:47.056984 25526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133535ce885e407f8764f0ee126c1a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.050998 25518 tablet_service.cc:1511] Processing CreateTablet for tablet 6becbba25eb54c9b9929e427e4b1f77b (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:47.058655 25518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6becbba25eb54c9b9929e427e4b1f77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.060088 25524 tablet_service.cc:1511] Processing CreateTablet for tablet 9f63b251525b4fe0a86fb59e022f9243 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:47.061539 25524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f63b251525b4fe0a86fb59e022f9243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.064671 25443 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd63eca82844f809edfbf9518d38591 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:47.066296 25443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd63eca82844f809edfbf9518d38591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.067421 25523 tablet_service.cc:1511] Processing CreateTablet for tablet 4f27d52a950f4972826bd75eff981987 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:47.068939 25523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f27d52a950f4972826bd75eff981987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.069913 25520 tablet_service.cc:1511] Processing CreateTablet for tablet 50ea7ccdaa2848038ff5227dd9e277f6 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:47.071465 25520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ea7ccdaa2848038ff5227dd9e277f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.075188 25519 tablet_service.cc:1511] Processing CreateTablet for tablet 7968f5bc7e63452684c95e074230794b (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:47.076828 25519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7968f5bc7e63452684c95e074230794b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.079363 25598 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd63eca82844f809edfbf9518d38591 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:47.080929 25598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd63eca82844f809edfbf9518d38591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.092154 25445 tablet_service.cc:1511] Processing CreateTablet for tablet fb22aa501c5d42fa91a2a7a4de4d42e5 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:47.095211 25597 tablet_service.cc:1511] Processing CreateTablet for tablet fb22aa501c5d42fa91a2a7a4de4d42e5 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:47.096825 25597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb22aa501c5d42fa91a2a7a4de4d42e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.097503 25595 tablet_service.cc:1511] Processing CreateTablet for tablet 133535ce885e407f8764f0ee126c1a76 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:47.098286 25451 tablet_service.cc:1511] Processing CreateTablet for tablet 9f63b251525b4fe0a86fb59e022f9243 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:47.099086 25446 tablet_service.cc:1511] Processing CreateTablet for tablet 6becbba25eb54c9b9929e427e4b1f77b (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:47.099112 25595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133535ce885e407f8764f0ee126c1a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.104199 25450 tablet_service.cc:1511] Processing CreateTablet for tablet 50ea7ccdaa2848038ff5227dd9e277f6 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:47.101675 25445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb22aa501c5d42fa91a2a7a4de4d42e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.106545 25450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ea7ccdaa2848038ff5227dd9e277f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.095284 25447 tablet_service.cc:1511] Processing CreateTablet for tablet 133535ce885e407f8764f0ee126c1a76 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:47.107808 25447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133535ce885e407f8764f0ee126c1a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.110214 25600 tablet_service.cc:1511] Processing CreateTablet for tablet 50ea7ccdaa2848038ff5227dd9e277f6 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:47.111796 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ea7ccdaa2848038ff5227dd9e277f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.102380 25596 tablet_service.cc:1511] Processing CreateTablet for tablet 6becbba25eb54c9b9929e427e4b1f77b (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:47.114790 25596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6becbba25eb54c9b9929e427e4b1f77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.118160 25446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6becbba25eb54c9b9929e427e4b1f77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.120796 25451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f63b251525b4fe0a86fb59e022f9243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.123409 25448 tablet_service.cc:1511] Processing CreateTablet for tablet 4f27d52a950f4972826bd75eff981987 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:47.125075 25448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f27d52a950f4972826bd75eff981987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.104291 25599 tablet_service.cc:1511] Processing CreateTablet for tablet 9f63b251525b4fe0a86fb59e022f9243 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:47.127205 25599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f63b251525b4fe0a86fb59e022f9243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.131669 25593 tablet_service.cc:1511] Processing CreateTablet for tablet 4f27d52a950f4972826bd75eff981987 (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:47.133308 25593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f27d52a950f4972826bd75eff981987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.144135 25449 tablet_service.cc:1511] Processing CreateTablet for tablet 7968f5bc7e63452684c95e074230794b (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:47.145704 25449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7968f5bc7e63452684c95e074230794b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.172252 25592 tablet_service.cc:1511] Processing CreateTablet for tablet 7968f5bc7e63452684c95e074230794b (DEFAULT_TABLE table=soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:47.175827 25592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7968f5bc7e63452684c95e074230794b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:47.182816 25753 tablet_bootstrap.cc:492] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:47.233455 25753 tablet_bootstrap.cc:654] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.235616 25754 tablet_bootstrap.cc:492] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
W20260709 13:23:47.243542 25407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:47.258775 25754 tablet_bootstrap.cc:654] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.258769 25755 tablet_bootstrap.cc:492] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:47.261752 25753 tablet_bootstrap.cc:492] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:47.262495 25753 ts_tablet_manager.cc:1403] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.010s
I20260709 13:23:47.266278 25755 tablet_bootstrap.cc:654] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.266602 25753 raft_consensus.cc:359] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.267611 25753 raft_consensus.cc:385] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.267771 25754 tablet_bootstrap.cc:492] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:47.267954 25753 raft_consensus.cc:740] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.268375 25754 ts_tablet_manager.cc:1403] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.008s
I20260709 13:23:47.269009 25753 consensus_queue.cc:260] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.272217 25753 ts_tablet_manager.cc:1434] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:23:47.272015 25754 raft_consensus.cc:359] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.272857 25755 tablet_bootstrap.cc:492] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:47.272905 25754 raft_consensus.cc:385] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.273370 25753 tablet_bootstrap.cc:492] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:47.273515 25754 raft_consensus.cc:740] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.273726 25755 ts_tablet_manager.cc:1403] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:23:47.274602 25754 consensus_queue.cc:260] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.277294 25755 raft_consensus.cc:359] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.278259 25755 raft_consensus.cc:385] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.278650 25755 raft_consensus.cc:740] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.279937 25754 ts_tablet_manager.cc:1434] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:23:47.281155 25754 tablet_bootstrap.cc:492] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:47.281473 25753 tablet_bootstrap.cc:654] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.284188 25755 consensus_queue.cc:260] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.289896 25754 tablet_bootstrap.cc:654] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.290145 25755 ts_tablet_manager.cc:1434] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.005s
I20260709 13:23:47.291568 25755 tablet_bootstrap.cc:492] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:47.317008 25755 tablet_bootstrap.cc:654] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.317425 25753 tablet_bootstrap.cc:492] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:47.318133 25753 ts_tablet_manager.cc:1403] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.018s
I20260709 13:23:47.322793 25753 raft_consensus.cc:359] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.323938 25753 raft_consensus.cc:385] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.324358 25753 raft_consensus.cc:740] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.325366 25753 consensus_queue.cc:260] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.328686 25753 ts_tablet_manager.cc:1434] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:23:47.330188 25753 tablet_bootstrap.cc:492] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:47.331008 25755 tablet_bootstrap.cc:492] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:47.331580 25755 ts_tablet_manager.cc:1403] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.007s
I20260709 13:23:47.335034 25755 raft_consensus.cc:359] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.335949 25755 raft_consensus.cc:385] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.336254 25755 raft_consensus.cc:740] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.337040 25755 consensus_queue.cc:260] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.337527 25753 tablet_bootstrap.cc:654] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.343060 25755 ts_tablet_manager.cc:1434] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:23:47.344173 25755 tablet_bootstrap.cc:492] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:47.351364 25755 tablet_bootstrap.cc:654] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.357389 25753 tablet_bootstrap.cc:492] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:47.357389 25754 tablet_bootstrap.cc:492] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:47.358201 25753 ts_tablet_manager.cc:1403] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.002s
I20260709 13:23:47.358224 25754 ts_tablet_manager.cc:1403] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.077s	user 0.049s	sys 0.013s
I20260709 13:23:47.361632 25754 raft_consensus.cc:359] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.362063 25753 raft_consensus.cc:359] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.362694 25754 raft_consensus.cc:385] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.362900 25753 raft_consensus.cc:385] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.363345 25754 raft_consensus.cc:740] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.363389 25753 raft_consensus.cc:740] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.364467 25753 consensus_queue.cc:260] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.364526 25754 consensus_queue.cc:260] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.367077 25753 ts_tablet_manager.cc:1434] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:47.368201 25753 tablet_bootstrap.cc:492] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:47.372205 25754 ts_tablet_manager.cc:1434] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:23:47.373031 25755 tablet_bootstrap.cc:492] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:47.373679 25755 ts_tablet_manager.cc:1403] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.004s
I20260709 13:23:47.373700 25754 tablet_bootstrap.cc:492] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:47.375676 25753 tablet_bootstrap.cc:654] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.377024 25755 raft_consensus.cc:359] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.377835 25755 raft_consensus.cc:385] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.378119 25755 raft_consensus.cc:740] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.378891 25755 consensus_queue.cc:260] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.381630 25755 ts_tablet_manager.cc:1434] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:23:47.382400 25740 raft_consensus.cc:493] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.382728 25755 tablet_bootstrap.cc:492] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:47.383040 25740 raft_consensus.cc:515] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.385568 25740 leader_election.cc:290] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.387317 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:47.387629 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.389351 25755 tablet_bootstrap.cc:654] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:47.389442 25500 leader_election.cc:343] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:47.390388 25500 leader_election.cc:343] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:47.390844 25500 leader_election.cc:304] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f418eda5a744e39adabe1152fe38eef; no voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5
I20260709 13:23:47.393079 25740 raft_consensus.cc:2749] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:47.402140 25754 tablet_bootstrap.cc:654] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.402776 25755 tablet_bootstrap.cc:492] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:47.403460 25755 ts_tablet_manager.cc:1403] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:23:47.407351 25755 raft_consensus.cc:359] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.408115 25755 raft_consensus.cc:385] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.408272 25753 tablet_bootstrap.cc:492] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:47.408433 25755 raft_consensus.cc:740] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.408895 25753 ts_tablet_manager.cc:1403] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.001s
I20260709 13:23:47.409312 25755 consensus_queue.cc:260] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.411686 25739 raft_consensus.cc:493] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.411906 25754 tablet_bootstrap.cc:492] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:47.412165 25739 raft_consensus.cc:515] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.412595 25754 ts_tablet_manager.cc:1403] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.008s
I20260709 13:23:47.414875 25739 leader_election.cc:290] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:47.416355 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22aa501c5d42fa91a2a7a4de4d42e5" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:47.416358 25754 raft_consensus.cc:359] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.417699 25754 raft_consensus.cc:385] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.418123 25754 raft_consensus.cc:740] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.418125 25755 ts_tablet_manager.cc:1434] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:23:47.419107 25699 raft_consensus.cc:493] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.419694 25755 tablet_bootstrap.cc:492] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:47.419219 25754 consensus_queue.cc:260] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.419679 25699 raft_consensus.cc:515] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.422138 25754 ts_tablet_manager.cc:1434] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:23:47.423514 25754 tablet_bootstrap.cc:492] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:47.427855 25755 tablet_bootstrap.cc:654] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.423395 25740 raft_consensus.cc:493] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.428960 25740 raft_consensus.cc:515] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.431344 25740 leader_election.cc:290] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.416853 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22aa501c5d42fa91a2a7a4de4d42e5" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:47.432139 25754 tablet_bootstrap.cc:654] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:47.433305 25575 leader_election.cc:343] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:47.436811 25574 leader_election.cc:343] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:47.438314 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb0d9c828f0f4c5ea5fad564e4e2cb81" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.438526 25699 leader_election.cc:290] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.439217 25610 raft_consensus.cc:2468] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 0.
I20260709 13:23:47.436648 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb0d9c828f0f4c5ea5fad564e4e2cb81" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:47.441579 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:47.442216 25461 raft_consensus.cc:2468] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 0.
I20260709 13:23:47.437664 25574 leader_election.cc:304] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6235449a8f444a42b737723170ea15e5; no voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef
W20260709 13:23:47.444161 25426 leader_election.cc:343] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:47.447010 25739 raft_consensus.cc:2749] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:47.451035 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.453511 25500 leader_election.cc:304] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
W20260709 13:23:47.456966 25425 leader_election.cc:343] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:47.457719 25425 leader_election.cc:304] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42; no voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:47.457115 25770 raft_consensus.cc:2804] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:47.460035 25761 raft_consensus.cc:2749] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:47.459168 25770 raft_consensus.cc:493] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:47.412266 25753 raft_consensus.cc:359] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.464237 25753 raft_consensus.cc:385] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.464599 25753 raft_consensus.cc:740] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.465425 25753 consensus_queue.cc:260] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.468864 25753 ts_tablet_manager.cc:1434] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 13:23:47.461588 25770 raft_consensus.cc:3060] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.470021 25753 tablet_bootstrap.cc:492] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:47.477216 25753 tablet_bootstrap.cc:654] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.486876 25755 tablet_bootstrap.cc:492] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:47.487782 25755 ts_tablet_manager.cc:1403] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.068s	user 0.023s	sys 0.021s
I20260709 13:23:47.491106 25755 raft_consensus.cc:359] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.491636 25754 tablet_bootstrap.cc:492] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:47.492009 25755 raft_consensus.cc:385] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.492238 25754 ts_tablet_manager.cc:1403] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.069s	user 0.036s	sys 0.028s
I20260709 13:23:47.492511 25753 tablet_bootstrap.cc:492] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:47.492415 25755 raft_consensus.cc:740] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.493145 25753 ts_tablet_manager.cc:1403] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 13:23:47.493621 25770 raft_consensus.cc:515] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.493649 25755 consensus_queue.cc:260] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.495887 25754 raft_consensus.cc:359] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.496610 25754 raft_consensus.cc:385] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.496574 25753 raft_consensus.cc:359] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.496953 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb0d9c828f0f4c5ea5fad564e4e2cb81" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:47.497220 25754 raft_consensus.cc:740] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.497386 25753 raft_consensus.cc:385] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.497579 25461 raft_consensus.cc:3060] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.498005 25753 raft_consensus.cc:740] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.498124 25754 consensus_queue.cc:260] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.498986 25753 consensus_queue.cc:260] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.500682 25754 ts_tablet_manager.cc:1434] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.005s
I20260709 13:23:47.501487 25753 ts_tablet_manager.cc:1434] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:47.501814 25754 tablet_bootstrap.cc:492] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:47.509996 25753 tablet_bootstrap.cc:492] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:47.510211 25754 tablet_bootstrap.cc:654] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.510443 25461 raft_consensus.cc:2468] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 1.
I20260709 13:23:47.512969 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb0d9c828f0f4c5ea5fad564e4e2cb81" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:47.513935 25610 raft_consensus.cc:3060] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.515180 25770 leader_election.cc:290] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.515475 25755 ts_tablet_manager.cc:1434] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:23:47.517112 25755 tablet_bootstrap.cc:492] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:47.524689 25755 tablet_bootstrap.cc:654] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.524760 25754 tablet_bootstrap.cc:492] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:47.525427 25754 ts_tablet_manager.cc:1403] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.009s
I20260709 13:23:47.528669 25754 raft_consensus.cc:359] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.529453 25754 raft_consensus.cc:385] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.529764 25754 raft_consensus.cc:740] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.530560 25754 consensus_queue.cc:260] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.532557 25754 ts_tablet_manager.cc:1434] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:23:47.533058 25753 tablet_bootstrap.cc:654] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.533599 25754 tablet_bootstrap.cc:492] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:47.535754 25610 raft_consensus.cc:2468] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 1.
I20260709 13:23:47.537249 25500 leader_election.cc:304] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:47.538160 25740 raft_consensus.cc:2804] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:47.538728 25740 raft_consensus.cc:697] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Becoming Leader. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:47.539680 25740 consensus_queue.cc:237] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.541728 25754 tablet_bootstrap.cc:654] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.550638 25755 tablet_bootstrap.cc:492] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:47.551343 25755 ts_tablet_manager.cc:1403] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.003s
I20260709 13:23:47.554697 25755 raft_consensus.cc:359] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.555442 25755 raft_consensus.cc:385] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.555735 25755 raft_consensus.cc:740] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.556566 25753 tablet_bootstrap.cc:492] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:47.556651 25755 consensus_queue.cc:260] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.557587 25753 ts_tablet_manager.cc:1403] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.007s
I20260709 13:23:47.559854 25755 ts_tablet_manager.cc:1434] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:47.560928 25755 tablet_bootstrap.cc:492] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:47.562259 25753 raft_consensus.cc:359] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.563486 25753 raft_consensus.cc:385] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.565076 25753 raft_consensus.cc:740] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.565999 25753 consensus_queue.cc:260] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.568049 25755 tablet_bootstrap.cc:654] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.568708 25753 ts_tablet_manager.cc:1434] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:23:47.570106 25753 tablet_bootstrap.cc:492] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:47.557826 25357 catalog_manager.cc:5697] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f418eda5a744e39adabe1152fe38eef (127.12.208.130). New cstate: current_term: 1 leader_uuid: "8f418eda5a744e39adabe1152fe38eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:47.576960 25753 tablet_bootstrap.cc:654] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.580693 25755 tablet_bootstrap.cc:492] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:47.581377 25755 ts_tablet_manager.cc:1403] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 13:23:47.566875 25754 tablet_bootstrap.cc:492] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:47.584627 25754 ts_tablet_manager.cc:1403] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.008s
I20260709 13:23:47.589015 25754 raft_consensus.cc:359] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.590101 25754 raft_consensus.cc:385] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.590021 25755 raft_consensus.cc:359] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.590998 25754 raft_consensus.cc:740] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.591420 25755 raft_consensus.cc:385] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.591902 25755 raft_consensus.cc:740] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.592154 25754 consensus_queue.cc:260] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.593014 25755 consensus_queue.cc:260] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.595770 25755 ts_tablet_manager.cc:1434] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:23:47.596151 25754 ts_tablet_manager.cc:1434] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:23:47.597770 25754 tablet_bootstrap.cc:492] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:47.601521 25739 raft_consensus.cc:493] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.602375 25739 raft_consensus.cc:515] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.607051 25755 tablet_bootstrap.cc:492] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:47.607136 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ea7ccdaa2848038ff5227dd9e277f6" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:47.608505 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ea7ccdaa2848038ff5227dd9e277f6" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:47.607084 25754 tablet_bootstrap.cc:654] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.608780 25753 tablet_bootstrap.cc:492] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:47.609483 25753 ts_tablet_manager.cc:1403] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.040s	user 0.005s	sys 0.030s
W20260709 13:23:47.610201 25575 leader_election.cc:343] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:47.611315 25574 leader_election.cc:343] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:47.611930 25574 leader_election.cc:304] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6235449a8f444a42b737723170ea15e5; no voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:47.615075 25699 raft_consensus.cc:493] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.615638 25699 raft_consensus.cc:515] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.616001 25753 raft_consensus.cc:359] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.616578 25755 tablet_bootstrap.cc:654] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.616725 25753 raft_consensus.cc:385] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.617303 25753 raft_consensus.cc:740] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.618208 25699 leader_election.cc:290] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.618132 25753 consensus_queue.cc:260] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.621259 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f63b251525b4fe0a86fb59e022f9243" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.622167 25610 raft_consensus.cc:2468] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:47.622603 25754 tablet_bootstrap.cc:492] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:47.623343 25754 ts_tablet_manager.cc:1403] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.011s
I20260709 13:23:47.623528 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f63b251525b4fe0a86fb59e022f9243" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
W20260709 13:23:47.625685 25426 leader_election.cc:343] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:47.626983 25753 ts_tablet_manager.cc:1434] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.005s
I20260709 13:23:47.627548 25754 raft_consensus.cc:359] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.628428 25754 raft_consensus.cc:385] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.628751 25754 raft_consensus.cc:740] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.629766 25755 tablet_bootstrap.cc:492] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:47.629696 25754 consensus_queue.cc:260] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.628086 25753 tablet_bootstrap.cc:492] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:47.630470 25755 ts_tablet_manager.cc:1403] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 13:23:47.627022 25425 leader_election.cc:304] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:47.632230 25754 ts_tablet_manager.cc:1434] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:47.633140 25699 raft_consensus.cc:2804] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:47.633589 25699 raft_consensus.cc:493] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:47.634004 25699 raft_consensus.cc:3060] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.634022 25755 raft_consensus.cc:359] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.635794 25755 raft_consensus.cc:385] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.636204 25755 raft_consensus.cc:740] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.637171 25753 tablet_bootstrap.cc:654] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.615619 25739 leader_election.cc:290] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:47.635324 25754 tablet_bootstrap.cc:492] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:47.637955 25739 raft_consensus.cc:2749] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:47.644966 25754 tablet_bootstrap.cc:654] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.636972 25755 consensus_queue.cc:260] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.647279 25755 ts_tablet_manager.cc:1434] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:23:47.648679 25755 tablet_bootstrap.cc:492] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5: Bootstrap starting.
I20260709 13:23:47.657835 25755 tablet_bootstrap.cc:654] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:47.673815 25574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.208.129:46431, user_credentials={real_user=slave}} blocked reactor thread for 62530.5us
I20260709 13:23:47.683554 25699 raft_consensus.cc:515] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.684342 25753 tablet_bootstrap.cc:492] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:47.684900 25753 ts_tablet_manager.cc:1403] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.007s
I20260709 13:23:47.686977 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f63b251525b4fe0a86fb59e022f9243" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:47.687988 25753 raft_consensus.cc:359] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
W20260709 13:23:47.688536 25426 leader_election.cc:343] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:47.688860 25753 raft_consensus.cc:385] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.689152 25753 raft_consensus.cc:740] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.689888 25753 consensus_queue.cc:260] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.692093 25753 ts_tablet_manager.cc:1434] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:23:47.693428 25753 tablet_bootstrap.cc:492] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42: Bootstrap starting.
I20260709 13:23:47.700140 25753 tablet_bootstrap.cc:654] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.701944 25699 leader_election.cc:290] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.704635 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f63b251525b4fe0a86fb59e022f9243" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:47.705320 25610 raft_consensus.cc:3060] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.707329 25754 tablet_bootstrap.cc:492] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:47.707860 25754 ts_tablet_manager.cc:1403] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.044s
I20260709 13:23:47.710726 25754 raft_consensus.cc:359] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.711419 25754 raft_consensus.cc:385] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.711678 25754 raft_consensus.cc:740] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.712697 25755 tablet_bootstrap.cc:492] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5: No bootstrap required, opened a new log
I20260709 13:23:47.713301 25755 ts_tablet_manager.cc:1403] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.023s
I20260709 13:23:47.716193 25755 raft_consensus.cc:359] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.716863 25755 raft_consensus.cc:385] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.717129 25755 raft_consensus.cc:740] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.717749 25755 consensus_queue.cc:260] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.720196 25755 ts_tablet_manager.cc:1434] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:23:47.712332 25754 consensus_queue.cc:260] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.723035 25753 tablet_bootstrap.cc:492] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42: No bootstrap required, opened a new log
I20260709 13:23:47.724381 25753 ts_tablet_manager.cc:1403] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.004s
I20260709 13:23:47.725092 25754 ts_tablet_manager.cc:1434] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:23:47.726289 25754 tablet_bootstrap.cc:492] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef: Bootstrap starting.
I20260709 13:23:47.727218 25753 raft_consensus.cc:359] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.727975 25753 raft_consensus.cc:385] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.728247 25753 raft_consensus.cc:740] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.728938 25753 consensus_queue.cc:260] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.731127 25753 ts_tablet_manager.cc:1434] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:23:47.734153 25699 raft_consensus.cc:493] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.734771 25754 tablet_bootstrap.cc:654] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:47.734632 25699 raft_consensus.cc:515] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.737097 25699 leader_election.cc:290] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.737907 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22aa501c5d42fa91a2a7a4de4d42e5" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:47.738647 25536 raft_consensus.cc:2468] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:47.739225 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22aa501c5d42fa91a2a7a4de4d42e5" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.739846 25426 leader_election.cc:304] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:47.740134 25609 raft_consensus.cc:2468] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:47.741400 25699 raft_consensus.cc:2804] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:47.741837 25699 raft_consensus.cc:493] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:47.742305 25699 raft_consensus.cc:3060] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.743101 25754 tablet_bootstrap.cc:492] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef: No bootstrap required, opened a new log
I20260709 13:23:47.743666 25754 ts_tablet_manager.cc:1403] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:23:47.723579 25610 raft_consensus.cc:2468] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:47.746542 25754 raft_consensus.cc:359] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.747233 25754 raft_consensus.cc:385] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:47.747552 25754 raft_consensus.cc:740] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Initialized, Role: FOLLOWER
I20260709 13:23:47.747260 25425 leader_election.cc:304] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:47.748159 25754 consensus_queue.cc:260] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.748296 25761 raft_consensus.cc:2804] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:47.748893 25761 raft_consensus.cc:697] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:47.750106 25754 ts_tablet_manager.cc:1434] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:47.749732 25761 consensus_queue.cc:237] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.752768 25699 raft_consensus.cc:515] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.755738 25699 leader_election.cc:290] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.756093 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22aa501c5d42fa91a2a7a4de4d42e5" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:47.756764 25536 raft_consensus.cc:3060] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.757107 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb22aa501c5d42fa91a2a7a4de4d42e5" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:47.757728 25609 raft_consensus.cc:3060] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.763655 25536 raft_consensus.cc:2468] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:47.764115 25609 raft_consensus.cc:2468] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:47.765141 25426 leader_election.cc:304] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:47.766268 25699 raft_consensus.cc:2804] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:47.765837 25357 catalog_manager.cc:5697] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:47.766896 25699 raft_consensus.cc:697] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:47.767906 25699 consensus_queue.cc:237] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.780474 25356 catalog_manager.cc:5697] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:47.798906 25699 raft_consensus.cc:493] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.799582 25699 raft_consensus.cc:515] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.801755 25699 leader_election.cc:290] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.802840 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7968f5bc7e63452684c95e074230794b" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.802723 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7968f5bc7e63452684c95e074230794b" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:47.803686 25609 raft_consensus.cc:2468] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:47.803823 25536 raft_consensus.cc:2468] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:47.805136 25425 leader_election.cc:304] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:47.805895 25699 raft_consensus.cc:2804] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:47.806280 25699 raft_consensus.cc:493] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:47.806609 25699 raft_consensus.cc:3060] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.808688 25761 raft_consensus.cc:493] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.809316 25761 raft_consensus.cc:515] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.812610 25770 raft_consensus.cc:493] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.812878 25761 leader_election.cc:290] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.813274 25770 raft_consensus.cc:515] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.813481 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:47.814265 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.814232 25699 raft_consensus.cc:515] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.814391 25536 raft_consensus.cc:2468] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:47.815275 25609 raft_consensus.cc:2468] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:47.816052 25426 leader_election.cc:304] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:47.816630 25699 leader_election.cc:290] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.817133 25770 leader_election.cc:290] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.817276 25699 raft_consensus.cc:2804] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:47.818076 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:47.818311 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.818835 25461 raft_consensus.cc:2468] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 0.
I20260709 13:23:47.819020 25609 raft_consensus.cc:2468] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 0.
I20260709 13:23:47.819523 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7968f5bc7e63452684c95e074230794b" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:47.819576 25699 raft_consensus.cc:493] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:47.820071 25500 leader_election.cc:304] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:47.818930 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7968f5bc7e63452684c95e074230794b" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:47.820322 25536 raft_consensus.cc:3060] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.820317 25699 raft_consensus.cc:3060] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.821657 25770 raft_consensus.cc:2804] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:47.821033 25610 raft_consensus.cc:3060] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.822122 25770 raft_consensus.cc:493] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:47.822585 25770 raft_consensus.cc:3060] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.829335 25699 raft_consensus.cc:515] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.830905 25610 raft_consensus.cc:2468] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:47.830899 25770 raft_consensus.cc:515] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.832100 25699 leader_election.cc:290] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.832895 25425 leader_election.cc:304] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:47.832916 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:47.833572 25536 raft_consensus.cc:2468] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:47.833684 25699 raft_consensus.cc:2804] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:47.833773 25535 raft_consensus.cc:3060] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.834491 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:47.835091 25610 raft_consensus.cc:3060] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.836294 25770 leader_election.cc:290] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.837584 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:47.837678 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:47.838483 25609 raft_consensus.cc:3060] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.838567 25461 raft_consensus.cc:3060] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.839003 25699 raft_consensus.cc:697] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:47.840029 25699 consensus_queue.cc:237] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.843127 25610 raft_consensus.cc:2468] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:47.844527 25425 leader_election.cc:304] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:47.845444 25761 raft_consensus.cc:2804] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:47.845984 25761 raft_consensus.cc:697] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:47.846833 25761 consensus_queue.cc:237] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.850232 25461 raft_consensus.cc:2468] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 1.
I20260709 13:23:47.854552 25535 raft_consensus.cc:2468] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:47.855963 25742 raft_consensus.cc:493] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.856817 25742 raft_consensus.cc:515] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.858656 25739 raft_consensus.cc:493] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.859237 25739 raft_consensus.cc:515] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.860872 25742 leader_election.cc:290] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.861575 25739 leader_election.cc:290] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:47.861961 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:47.862469 25500 leader_election.cc:304] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:47.862674 25535 raft_consensus.cc:2468] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:47.862771 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.863487 25610 raft_consensus.cc:2468] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:47.863981 25770 raft_consensus.cc:2804] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:47.864034 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:47.864670 25425 leader_election.cc:304] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:47.865329 25461 raft_consensus.cc:2468] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 0.
I20260709 13:23:47.864598 25770 raft_consensus.cc:697] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Becoming Leader. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:47.865644 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:47.867130 25742 raft_consensus.cc:2804] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:47.866952 25770 consensus_queue.cc:237] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.867583 25742 raft_consensus.cc:493] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:47.867718 25609 raft_consensus.cc:2468] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 1.
I20260709 13:23:47.868122 25742 raft_consensus.cc:3060] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.866670 25535 raft_consensus.cc:2468] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 0.
I20260709 13:23:47.870803 25574 leader_election.cc:304] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:47.878043 25356 catalog_manager.cc:5697] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:47.879441 25739 raft_consensus.cc:2804] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:47.880012 25739 raft_consensus.cc:493] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:47.880409 25739 raft_consensus.cc:3060] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.881603 25742 raft_consensus.cc:515] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.882815 25357 catalog_manager.cc:5697] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f418eda5a744e39adabe1152fe38eef (127.12.208.130). New cstate: current_term: 1 leader_uuid: "8f418eda5a744e39adabe1152fe38eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:47.884807 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:47.885443 25535 raft_consensus.cc:3060] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.886297 25742 leader_election.cc:290] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.887413 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:47.888069 25742 raft_consensus.cc:493] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.888470 25742 raft_consensus.cc:515] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.890240 25742 leader_election.cc:290] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.890987 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becbba25eb54c9b9929e427e4b1f77b" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef" is_pre_election: true
I20260709 13:23:47.891593 25536 raft_consensus.cc:2468] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:47.892735 25426 leader_election.cc:304] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:47.893711 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becbba25eb54c9b9929e427e4b1f77b" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.894454 25609 raft_consensus.cc:2468] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 0.
I20260709 13:23:47.895066 25742 raft_consensus.cc:2804] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:47.895582 25742 raft_consensus.cc:493] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:47.895982 25742 raft_consensus.cc:3060] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.898332 25739 raft_consensus.cc:515] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.899623 25610 raft_consensus.cc:2393] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4698e80fcca64adea0ca43b2f2a4ac42 in current term 1: Already voted for candidate 6235449a8f444a42b737723170ea15e5 in this term.
I20260709 13:23:47.900919 25535 raft_consensus.cc:2468] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:47.902230 25426 leader_election.cc:304] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:47.902374 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:47.903342 25461 raft_consensus.cc:2393] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6235449a8f444a42b737723170ea15e5 in current term 1: Already voted for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in this term.
I20260709 13:23:47.903766 25699 raft_consensus.cc:2804] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:47.904300 25699 raft_consensus.cc:697] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:47.905071 25699 consensus_queue.cc:237] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.906162 25356 catalog_manager.cc:5697] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:47.911574 25742 raft_consensus.cc:515] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.913968 25742 leader_election.cc:290] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.914701 25770 raft_consensus.cc:493] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.914942 25739 leader_election.cc:290] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:47.915268 25770 raft_consensus.cc:515] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.915804 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becbba25eb54c9b9929e427e4b1f77b" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:47.916265 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:47.916419 25610 raft_consensus.cc:3060] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.917104 25536 raft_consensus.cc:2393] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6235449a8f444a42b737723170ea15e5 in current term 1: Already voted for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in this term.
I20260709 13:23:47.918273 25575 leader_election.cc:304] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6235449a8f444a42b737723170ea15e5; no voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:47.918641 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6becbba25eb54c9b9929e427e4b1f77b" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:47.919332 25535 raft_consensus.cc:3060] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.919581 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ea7ccdaa2848038ff5227dd9e277f6" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:47.920220 25461 raft_consensus.cc:2468] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 0.
I20260709 13:23:47.921451 25500 leader_election.cc:304] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:47.922353 25740 raft_consensus.cc:2804] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:47.922727 25740 raft_consensus.cc:493] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:47.923077 25740 raft_consensus.cc:3060] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.924252 25357 catalog_manager.cc:5697] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:47.924307 25610 raft_consensus.cc:2468] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:47.926977 25425 leader_election.cc:304] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:47.927860 25742 raft_consensus.cc:2804] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:47.928565 25742 raft_consensus.cc:697] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:47.926977 25535 raft_consensus.cc:2468] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 1.
I20260709 13:23:47.928606 25739 raft_consensus.cc:2749] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:23:47.929656 25770 leader_election.cc:290] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.929688 25742 consensus_queue.cc:237] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.931710 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ea7ccdaa2848038ff5227dd9e277f6" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.932330 25610 raft_consensus.cc:2468] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 0.
I20260709 13:23:47.937259 25740 raft_consensus.cc:515] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.939584 25740 leader_election.cc:290] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.940323 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ea7ccdaa2848038ff5227dd9e277f6" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:47.940656 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ea7ccdaa2848038ff5227dd9e277f6" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:47.941058 25461 raft_consensus.cc:3060] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.941237 25610 raft_consensus.cc:3060] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.943317 25357 catalog_manager.cc:5697] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 1 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:47.946614 25610 raft_consensus.cc:2468] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 1.
I20260709 13:23:47.947873 25500 leader_election.cc:304] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:47.948439 25461 raft_consensus.cc:2468] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 1.
I20260709 13:23:47.948751 25740 raft_consensus.cc:2804] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:47.949342 25740 raft_consensus.cc:697] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Becoming Leader. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:47.950217 25740 consensus_queue.cc:237] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.958616 25357 catalog_manager.cc:5697] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f418eda5a744e39adabe1152fe38eef (127.12.208.130). New cstate: current_term: 1 leader_uuid: "8f418eda5a744e39adabe1152fe38eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:47.978365 25770 raft_consensus.cc:493] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:47.978935 25770 raft_consensus.cc:515] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:47.980934 25770 leader_election.cc:290] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:47.981918 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f63b251525b4fe0a86fb59e022f9243" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6235449a8f444a42b737723170ea15e5" is_pre_election: true
I20260709 13:23:47.981931 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f63b251525b4fe0a86fb59e022f9243" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" is_pre_election: true
I20260709 13:23:47.981983 25770 consensus_queue.cc:1048] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:47.982681 25610 raft_consensus.cc:2393] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f418eda5a744e39adabe1152fe38eef in current term 1: Already voted for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in this term.
I20260709 13:23:47.984766 25500 leader_election.cc:304] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f418eda5a744e39adabe1152fe38eef; no voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5
I20260709 13:23:47.985633 25770 raft_consensus.cc:3060] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:47.988452 25740 consensus_queue.cc:1048] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:47.994575 25770 raft_consensus.cc:2749] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:48.138310 25535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb0d9c828f0f4c5ea5fad564e4e2cb81"
dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
mode: GRACEFUL
new_leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
 from {username='slave'} at 127.0.0.1:56432
I20260709 13:23:48.138993 25535 raft_consensus.cc:606] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Received request to transfer leadership to TS 4698e80fcca64adea0ca43b2f2a4ac42
I20260709 13:23:48.144285 25535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591"
dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
mode: GRACEFUL
new_leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
 from {username='slave'} at 127.0.0.1:56432
I20260709 13:23:48.144848 25535 raft_consensus.cc:606] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Received request to transfer leadership to TS 4698e80fcca64adea0ca43b2f2a4ac42
I20260709 13:23:48.156262 25461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
mode: GRACEFUL
new_leader_uuid: "8f418eda5a744e39adabe1152fe38eef"
 from {username='slave'} at 127.0.0.1:42104
I20260709 13:23:48.156879 25461 raft_consensus.cc:606] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Received request to transfer leadership to TS 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:48.162855 25461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f63b251525b4fe0a86fb59e022f9243"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
mode: GRACEFUL
new_leader_uuid: "8f418eda5a744e39adabe1152fe38eef"
 from {username='slave'} at 127.0.0.1:42104
I20260709 13:23:48.163414 25461 raft_consensus.cc:606] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Received request to transfer leadership to TS 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:48.169503 25742 consensus_queue.cc:1048] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.172696 25461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f27d52a950f4972826bd75eff981987"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
mode: GRACEFUL
new_leader_uuid: "8f418eda5a744e39adabe1152fe38eef"
 from {username='slave'} at 127.0.0.1:42104
I20260709 13:23:48.173277 25461 raft_consensus.cc:606] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Received request to transfer leadership to TS 8f418eda5a744e39adabe1152fe38eef
I20260709 13:23:48.180994 25699 consensus_queue.cc:1048] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.184028 25461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7968f5bc7e63452684c95e074230794b"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
mode: GRACEFUL
new_leader_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:42104
I20260709 13:23:48.184762 25461 raft_consensus.cc:606] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Received request to transfer leadership to TS 6235449a8f444a42b737723170ea15e5
I20260709 13:23:48.260792 25699 consensus_queue.cc:1048] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.272779 25699 consensus_queue.cc:1048] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:48.283195 25810 raft_consensus.cc:993] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42: : Instructing follower 8f418eda5a744e39adabe1152fe38eef to start an election
I20260709 13:23:48.283697 25699 raft_consensus.cc:1081] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Signalling peer 8f418eda5a744e39adabe1152fe38eef to start an election
I20260709 13:23:48.285504 25535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f63b251525b4fe0a86fb59e022f9243"
dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
 from {username='slave'} at 127.0.0.1:52516
I20260709 13:23:48.286149 25535 raft_consensus.cc:493] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:48.286542 25535 raft_consensus.cc:3060] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.292711 25535 raft_consensus.cc:515] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.293722 25699 consensus_queue.cc:1048] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.294596 25535 leader_election.cc:290] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 2 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:48.295732 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f63b251525b4fe0a86fb59e022f9243" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:48.296144 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f63b251525b4fe0a86fb59e022f9243" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:48.296489 25609 raft_consensus.cc:3060] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.296797 25461 raft_consensus.cc:3055] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:48.297117 25461 raft_consensus.cc:740] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:48.298007 25461 consensus_queue.cc:260] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.299154 25461 raft_consensus.cc:3060] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.304067 25742 raft_consensus.cc:993] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42: : Instructing follower 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:48.304679 25761 raft_consensus.cc:1081] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Signalling peer 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:48.310904 25610 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7968f5bc7e63452684c95e074230794b"
dest_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:23:48.313694 25610 raft_consensus.cc:493] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:48.313864 25609 raft_consensus.cc:2468] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 2.
I20260709 13:23:48.314119 25610 raft_consensus.cc:3060] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.315033 25500 leader_election.cc:304] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:48.315861 25802 raft_consensus.cc:2804] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:48.316365 25802 raft_consensus.cc:697] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Becoming Leader. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:48.317219 25802 consensus_queue.cc:237] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.318622 25742 consensus_queue.cc:1048] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.324563 25802 consensus_queue.cc:1048] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.311587 25461 raft_consensus.cc:2468] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 2.
I20260709 13:23:48.328323 25357 catalog_manager.cc:5697] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef reported cstate change: term changed from 1 to 2, leader changed from 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129) to 8f418eda5a744e39adabe1152fe38eef (127.12.208.130). New cstate: current_term: 2 leader_uuid: "8f418eda5a744e39adabe1152fe38eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:48.331211 25610 raft_consensus.cc:515] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.334244 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7968f5bc7e63452684c95e074230794b" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:48.334939 25770 raft_consensus.cc:993] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef: : Instructing follower 4698e80fcca64adea0ca43b2f2a4ac42 to start an election
I20260709 13:23:48.335511 25770 raft_consensus.cc:1081] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Signalling peer 4698e80fcca64adea0ca43b2f2a4ac42 to start an election
I20260709 13:23:48.337322 25460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
 from {username='slave'} at 127.0.0.1:47810
I20260709 13:23:48.339658 25460 raft_consensus.cc:493] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:48.340122 25460 raft_consensus.cc:3060] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.341177 25461 raft_consensus.cc:3055] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:48.341662 25461 raft_consensus.cc:740] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:48.341348 25610 leader_election.cc:290] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 2 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:48.342794 25461 consensus_queue.cc:260] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.344532 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7968f5bc7e63452684c95e074230794b" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:48.345146 25535 raft_consensus.cc:3060] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.345180 25802 consensus_queue.cc:1048] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:48.345772 25461 raft_consensus.cc:3060] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.352478 25535 raft_consensus.cc:2468] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 2.
I20260709 13:23:48.354360 25460 raft_consensus.cc:515] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.358843 25461 raft_consensus.cc:2468] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 2.
I20260709 13:23:48.359951 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:48.358881 25460 leader_election.cc:290] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 2 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:48.360682 25609 raft_consensus.cc:3060] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.361707 25575 leader_election.cc:304] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:48.364547 25739 raft_consensus.cc:2804] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:48.364951 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:48.365701 25536 raft_consensus.cc:3055] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:48.366034 25536 raft_consensus.cc:740] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:48.366827 25536 consensus_queue.cc:260] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.368238 25536 raft_consensus.cc:3060] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.369452 25739 raft_consensus.cc:697] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 2 LEADER]: Becoming Leader. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:48.370478 25739 consensus_queue.cc:237] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.370958 25609 raft_consensus.cc:2468] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 2.
I20260709 13:23:48.374403 25425 leader_election.cc:304] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:48.375197 25699 raft_consensus.cc:2804] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:48.375723 25699 raft_consensus.cc:697] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:48.376536 25699 consensus_queue.cc:237] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.379240 25536 raft_consensus.cc:2468] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 2.
I20260709 13:23:48.382145 25699 consensus_queue.cc:1048] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.385089 25357 catalog_manager.cc:5697] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 1 to 2, leader changed from 8f418eda5a744e39adabe1152fe38eef (127.12.208.130) to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:48.385924 25358 catalog_manager.cc:5697] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 reported cstate change: term changed from 1 to 2, leader changed from 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129) to 6235449a8f444a42b737723170ea15e5 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "6235449a8f444a42b737723170ea15e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:48.395018 25810 consensus_queue.cc:1048] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.404778 25699 raft_consensus.cc:993] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42: : Instructing follower 8f418eda5a744e39adabe1152fe38eef to start an election
I20260709 13:23:48.405298 25810 raft_consensus.cc:1081] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Signalling peer 8f418eda5a744e39adabe1152fe38eef to start an election
I20260709 13:23:48.407043 25536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76"
dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
 from {username='slave'} at 127.0.0.1:52516
I20260709 13:23:48.407567 25536 raft_consensus.cc:493] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:48.407968 25536 raft_consensus.cc:3060] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.413931 25536 raft_consensus.cc:515] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.415946 25536 leader_election.cc:290] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 2 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:48.418123 25461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:48.418522 25609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:48.418779 25461 raft_consensus.cc:3055] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:48.419165 25609 raft_consensus.cc:3060] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.419171 25461 raft_consensus.cc:740] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:48.420495 25461 consensus_queue.cc:260] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.424367 25461 raft_consensus.cc:3060] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.427091 25609 raft_consensus.cc:2468] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 2.
I20260709 13:23:48.428587 25500 leader_election.cc:304] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:48.429342 25802 raft_consensus.cc:2804] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:48.429920 25802 raft_consensus.cc:697] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Becoming Leader. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:48.430862 25461 raft_consensus.cc:2468] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 2.
I20260709 13:23:48.430771 25802 consensus_queue.cc:237] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.436869 25810 consensus_queue.cc:1048] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.439244 25356 catalog_manager.cc:5697] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef reported cstate change: term changed from 1 to 2, leader changed from 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129) to 8f418eda5a744e39adabe1152fe38eef (127.12.208.130). New cstate: current_term: 2 leader_uuid: "8f418eda5a744e39adabe1152fe38eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:48.451511 25699 consensus_queue.cc:1048] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.462778 25761 raft_consensus.cc:993] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42: : Instructing follower 8f418eda5a744e39adabe1152fe38eef to start an election
I20260709 13:23:48.463269 25742 raft_consensus.cc:1081] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Signalling peer 8f418eda5a744e39adabe1152fe38eef to start an election
I20260709 13:23:48.465368 25742 consensus_queue.cc:1048] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:48.465353 25536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f27d52a950f4972826bd75eff981987"
dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
 from {username='slave'} at 127.0.0.1:52516
I20260709 13:23:48.467448 25536 raft_consensus.cc:493] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:48.470631 25770 consensus_queue.cc:1048] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:48.477428 25761 consensus_queue.cc:1048] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.482414 25770 consensus_queue.cc:1048] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:48.467852 25536 raft_consensus.cc:3060] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.502405 25536 raft_consensus.cc:515] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.505041 25536 leader_election.cc:290] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 2 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:48.505147 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:48.505832 25460 raft_consensus.cc:3055] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:48.506145 25460 raft_consensus.cc:740] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:48.506304 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f27d52a950f4972826bd75eff981987" candidate_uuid: "8f418eda5a744e39adabe1152fe38eef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:48.506907 25610 raft_consensus.cc:3060] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.506886 25460 consensus_queue.cc:260] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.508401 25460 raft_consensus.cc:3060] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.513964 25460 raft_consensus.cc:2468] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 2.
I20260709 13:23:48.515296 25610 raft_consensus.cc:2468] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f418eda5a744e39adabe1152fe38eef in term 2.
I20260709 13:23:48.515648 25500 leader_election.cc:304] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:48.517082 25802 raft_consensus.cc:2804] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:48.517609 25802 raft_consensus.cc:697] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Becoming Leader. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:48.518446 25802 consensus_queue.cc:237] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.528852 25356 catalog_manager.cc:5697] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef reported cstate change: term changed from 1 to 2, leader changed from 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129) to 8f418eda5a744e39adabe1152fe38eef (127.12.208.130). New cstate: current_term: 2 leader_uuid: "8f418eda5a744e39adabe1152fe38eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:48.607685 25770 raft_consensus.cc:993] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef: : Instructing follower 4698e80fcca64adea0ca43b2f2a4ac42 to start an election
I20260709 13:23:48.608192 25802 raft_consensus.cc:1081] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Signalling peer 4698e80fcca64adea0ca43b2f2a4ac42 to start an election
I20260709 13:23:48.609756 25461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb0d9c828f0f4c5ea5fad564e4e2cb81"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
 from {username='slave'} at 127.0.0.1:47810
I20260709 13:23:48.610225 25461 raft_consensus.cc:493] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:48.610497 25461 raft_consensus.cc:3060] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.615295 25461 raft_consensus.cc:515] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.616757 25461 leader_election.cc:290] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 2 election: Requested vote from peers 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263), 6235449a8f444a42b737723170ea15e5 (127.12.208.131:35915)
I20260709 13:23:48.617740 25536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb0d9c828f0f4c5ea5fad564e4e2cb81" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:48.617954 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb0d9c828f0f4c5ea5fad564e4e2cb81" candidate_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6235449a8f444a42b737723170ea15e5"
I20260709 13:23:48.618429 25536 raft_consensus.cc:3055] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:48.618526 25610 raft_consensus.cc:3060] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.618777 25536 raft_consensus.cc:740] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:48.619623 25536 consensus_queue.cc:260] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.620602 25536 raft_consensus.cc:3060] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:48.623500 25610 raft_consensus.cc:2468] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 2.
I20260709 13:23:48.624615 25425 leader_election.cc:304] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:48.625313 25761 raft_consensus.cc:2804] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:48.625479 25536 raft_consensus.cc:2468] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4698e80fcca64adea0ca43b2f2a4ac42 in term 2.
I20260709 13:23:48.625725 25761 raft_consensus.cc:697] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Becoming Leader. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:48.626784 25761 consensus_queue.cc:237] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:48.633575 25356 catalog_manager.cc:5697] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 reported cstate change: term changed from 1 to 2, leader changed from 8f418eda5a744e39adabe1152fe38eef (127.12.208.130) to 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129). New cstate: current_term: 2 leader_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:48.790645 25536 raft_consensus.cc:1275] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Refusing update from remote peer 4698e80fcca64adea0ca43b2f2a4ac42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:48.792125 25761 consensus_queue.cc:1048] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:48.801553 25610 raft_consensus.cc:1275] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Refusing update from remote peer 4698e80fcca64adea0ca43b2f2a4ac42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:48.803825 25810 consensus_queue.cc:1048] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:48.823339 25461 raft_consensus.cc:1275] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:48.824532 25739 consensus_queue.cc:1048] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:48.832728 25536 raft_consensus.cc:1275] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:48.834703 25739 consensus_queue.cc:1048] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:48.858103 25610 raft_consensus.cc:1275] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Refusing update from remote peer 8f418eda5a744e39adabe1152fe38eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:48.859694 25802 consensus_queue.cc:1048] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:48.867388 25461 raft_consensus.cc:1275] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Refusing update from remote peer 8f418eda5a744e39adabe1152fe38eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:48.869688 25802 consensus_queue.cc:1048] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:48.897455 25461 raft_consensus.cc:1275] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Refusing update from remote peer 8f418eda5a744e39adabe1152fe38eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:48.898762 25802 consensus_queue.cc:1048] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:48.906277 25610 raft_consensus.cc:1275] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Refusing update from remote peer 8f418eda5a744e39adabe1152fe38eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:48.907796 25802 consensus_queue.cc:1048] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:48.943020 25461 raft_consensus.cc:1275] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Refusing update from remote peer 8f418eda5a744e39adabe1152fe38eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:48.944350 25802 consensus_queue.cc:1048] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:48.951884 25610 raft_consensus.cc:1275] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Refusing update from remote peer 8f418eda5a744e39adabe1152fe38eef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:48.953744 25770 consensus_queue.cc:1048] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:49.038786 25610 raft_consensus.cc:1275] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Refusing update from remote peer 4698e80fcca64adea0ca43b2f2a4ac42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:49.040091 25810 consensus_queue.cc:1048] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:49.049314 25536 raft_consensus.cc:1275] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Refusing update from remote peer 4698e80fcca64adea0ca43b2f2a4ac42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:49.050904 25761 consensus_queue.cc:1048] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:51.188704 25358 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60230:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:23:51.209141 25358 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60230:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:23:51.244654 13122 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:23:51.327163 25870 tablet.cc:1724] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.373673 25875 tablet.cc:1724] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.378499 25881 tablet.cc:1724] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.394836 25872 tablet.cc:1724] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.398830 25871 tablet.cc:1724] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.416949 25883 tablet.cc:1724] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.417506 25887 tablet.cc:1724] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.421211 25890 tablet.cc:1724] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.434023 25532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76"
dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
mode: GRACEFUL
new_leader_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:56442
I20260709 13:23:51.444516 25889 tablet.cc:1724] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.442739 25532 raft_consensus.cc:606] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Received request to transfer leadership to TS 6235449a8f444a42b737723170ea15e5
W20260709 13:23:51.479820 25575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:35263, user_credentials={real_user=slave}} blocked reactor thread for 53229.3us
I20260709 13:23:51.483922 25892 tablet.cc:1724] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.485194 25881 tablet.cc:1724] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.502526 25893 tablet.cc:1724] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.520224 25870 tablet.cc:1724] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.538030 25883 tablet.cc:1724] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:23:51.539867 25636 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:133535ce885e407f8764f0ee126c1a76)
W20260709 13:23:51.553264 25636 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:133535ce885e407f8764f0ee126c1a76)
W20260709 13:23:51.557948 25636 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:133535ce885e407f8764f0ee126c1a76)
I20260709 13:23:51.564369 25899 tablet.cc:1724] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.532703 25875 tablet.cc:1724] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.612004 25881 tablet.cc:1724] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.626719 25892 tablet.cc:1724] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.599864 25872 tablet.cc:1724] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.631109 25871 tablet.cc:1724] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.634460 25461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
mode: GRACEFUL
new_leader_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:42120
I20260709 13:23:51.635339 25461 raft_consensus.cc:606] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Received request to transfer leadership to TS 6235449a8f444a42b737723170ea15e5
I20260709 13:23:51.639043 13122 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:23:51.643949 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:51.649896 25870 tablet.cc:1724] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.660441 25461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70730a900a2b40de958948985dc2aef2"
dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
mode: GRACEFUL
new_leader_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:42120
I20260709 13:23:51.661142 25461 raft_consensus.cc:606] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Received request to transfer leadership to TS 6235449a8f444a42b737723170ea15e5
I20260709 13:23:51.664495 25535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdfdd407b84a4ed2b51092fa29347c8f"
dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
mode: GRACEFUL
new_leader_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:56442
I20260709 13:23:51.665097 25535 raft_consensus.cc:606] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Received request to transfer leadership to TS 6235449a8f444a42b737723170ea15e5
I20260709 13:23:51.667848 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:51.668586 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:51.669901 25890 tablet.cc:1724] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.602407 25899 tablet.cc:1724] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.675381 25883 tablet.cc:1724] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.688351 25881 tablet.cc:1724] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.704746 25892 tablet.cc:1724] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.712692 25893 tablet.cc:1724] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:23:51.756493 25359 catalog_manager.cc:6242] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9: soft_deleted_table [id=ec0513c91ae344f9b245e045ac0089ee] alter complete (version 1)
I20260709 13:23:51.769268 25896 raft_consensus.cc:993] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef: : Instructing follower 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:51.769899 25891 raft_consensus.cc:1081] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Signalling peer 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:51.771374 25609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76"
dest_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:58492
I20260709 13:23:51.771812 25609 raft_consensus.cc:493] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:51.772051 25609 raft_consensus.cc:3060] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:51.776670 25609 raft_consensus.cc:515] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:51.778549 25609 leader_election.cc:290] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 3 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:51.779299 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:51.779681 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133535ce885e407f8764f0ee126c1a76" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:51.780076 25460 raft_consensus.cc:3060] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:51.780252 25535 raft_consensus.cc:3055] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:51.780617 25535 raft_consensus.cc:740] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:51.781373 25535 consensus_queue.cc:260] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:51.782624 25535 raft_consensus.cc:3060] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:51.787271 25460 raft_consensus.cc:2468] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 3.
I20260709 13:23:51.788648 25574 leader_election.cc:304] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:51.789510 25535 raft_consensus.cc:2468] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 3.
I20260709 13:23:51.789615 25895 raft_consensus.cc:2804] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:51.790460 25895 raft_consensus.cc:697] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 3 LEADER]: Becoming Leader. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:51.791388 25895 consensus_queue.cc:237] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:51.799041 25358 catalog_manager.cc:5697] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 reported cstate change: term changed from 2 to 3, leader changed from 8f418eda5a744e39adabe1152fe38eef (127.12.208.130) to 6235449a8f444a42b737723170ea15e5 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "6235449a8f444a42b737723170ea15e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:51.849742 25896 raft_consensus.cc:993] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef: : Instructing follower 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:51.850272 25891 raft_consensus.cc:1081] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Signalling peer 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:51.851754 25609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdfdd407b84a4ed2b51092fa29347c8f"
dest_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:58492
I20260709 13:23:51.852193 25609 raft_consensus.cc:493] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:51.852423 25609 raft_consensus.cc:3060] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:51.858661 25609 raft_consensus.cc:515] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:51.860332 25609 leader_election.cc:290] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 2 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:51.861275 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdfdd407b84a4ed2b51092fa29347c8f" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:51.861368 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdfdd407b84a4ed2b51092fa29347c8f" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:51.862079 25460 raft_consensus.cc:3060] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:51.862144 25535 raft_consensus.cc:3055] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:51.862614 25535 raft_consensus.cc:740] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f418eda5a744e39adabe1152fe38eef, State: Running, Role: LEADER
I20260709 13:23:51.863361 25535 consensus_queue.cc:260] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:51.864398 25535 raft_consensus.cc:3060] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:51.868270 25460 raft_consensus.cc:2468] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 2.
I20260709 13:23:51.869379 25574 leader_election.cc:304] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4698e80fcca64adea0ca43b2f2a4ac42, 6235449a8f444a42b737723170ea15e5; no voters: 
I20260709 13:23:51.869768 25535 raft_consensus.cc:2468] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 2.
I20260709 13:23:51.870182 25895 raft_consensus.cc:2804] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:51.870747 25895 raft_consensus.cc:697] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 2 LEADER]: Becoming Leader. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:51.871668 25895 consensus_queue.cc:237] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:51.879437 25358 catalog_manager.cc:5697] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 reported cstate change: term changed from 1 to 2, leader changed from 8f418eda5a744e39adabe1152fe38eef (127.12.208.130) to 6235449a8f444a42b737723170ea15e5 (127.12.208.131). New cstate: current_term: 2 leader_uuid: "6235449a8f444a42b737723170ea15e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:51.991374 25852 raft_consensus.cc:993] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42: : Instructing follower 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:51.992014 25832 raft_consensus.cc:1081] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Signalling peer 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:51.993542 25609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591"
dest_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:23:51.994144 25609 raft_consensus.cc:493] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:51.994446 25609 raft_consensus.cc:3060] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:52.000209 25609 raft_consensus.cc:515] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:52.002316 25609 leader_election.cc:290] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 3 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:52.003216 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:52.003480 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd63eca82844f809edfbf9518d38591" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:52.003921 25460 raft_consensus.cc:3055] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:52.003996 25535 raft_consensus.cc:3060] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:52.004333 25460 raft_consensus.cc:740] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:52.005139 25460 consensus_queue.cc:260] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:52.006340 25460 raft_consensus.cc:3060] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:52.011233 25535 raft_consensus.cc:2468] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 3.
I20260709 13:23:52.012404 25575 leader_election.cc:304] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:52.012899 25460 raft_consensus.cc:2468] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 3.
I20260709 13:23:52.013193 25895 raft_consensus.cc:2804] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:52.013887 25895 raft_consensus.cc:697] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 3 LEADER]: Becoming Leader. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:52.014740 25895 consensus_queue.cc:237] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:52.021552 25358 catalog_manager.cc:5697] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 reported cstate change: term changed from 2 to 3, leader changed from 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129) to 6235449a8f444a42b737723170ea15e5 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "6235449a8f444a42b737723170ea15e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:52.156073 25852 raft_consensus.cc:993] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42: : Instructing follower 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:52.156548 25832 raft_consensus.cc:1081] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Signalling peer 6235449a8f444a42b737723170ea15e5 to start an election
I20260709 13:23:52.158069 25609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70730a900a2b40de958948985dc2aef2"
dest_uuid: "6235449a8f444a42b737723170ea15e5"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:23:52.158615 25609 raft_consensus.cc:493] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:52.158901 25609 raft_consensus.cc:3060] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:52.163688 25609 raft_consensus.cc:515] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:52.165452 25609 leader_election.cc:290] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 3 election: Requested vote from peers 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431), 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263)
I20260709 13:23:52.166615 25535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70730a900a2b40de958948985dc2aef2" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f418eda5a744e39adabe1152fe38eef"
I20260709 13:23:52.166500 25460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70730a900a2b40de958948985dc2aef2" candidate_uuid: "6235449a8f444a42b737723170ea15e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4698e80fcca64adea0ca43b2f2a4ac42"
I20260709 13:23:52.167338 25535 raft_consensus.cc:3060] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:52.167418 25460 raft_consensus.cc:3055] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:52.167996 25460 raft_consensus.cc:740] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4698e80fcca64adea0ca43b2f2a4ac42, State: Running, Role: LEADER
I20260709 13:23:52.168870 25460 consensus_queue.cc:260] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:52.169936 25460 raft_consensus.cc:3060] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:52.173493 25535 raft_consensus.cc:2468] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 3.
I20260709 13:23:52.174693 25575 leader_election.cc:304] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6235449a8f444a42b737723170ea15e5, 8f418eda5a744e39adabe1152fe38eef; no voters: 
I20260709 13:23:52.175496 25895 raft_consensus.cc:2804] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:52.176023 25895 raft_consensus.cc:697] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 3 LEADER]: Becoming Leader. State: Replica: 6235449a8f444a42b737723170ea15e5, State: Running, Role: LEADER
I20260709 13:23:52.176939 25895 consensus_queue.cc:237] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } }
I20260709 13:23:52.177194 25460 raft_consensus.cc:2468] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6235449a8f444a42b737723170ea15e5 in term 3.
I20260709 13:23:52.185091 25358 catalog_manager.cc:5697] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 reported cstate change: term changed from 2 to 3, leader changed from 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129) to 6235449a8f444a42b737723170ea15e5 (127.12.208.131). New cstate: current_term: 3 leader_uuid: "6235449a8f444a42b737723170ea15e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6235449a8f444a42b737723170ea15e5" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35915 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:52.273270 25460 raft_consensus.cc:1275] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:23:52.274655 25895 consensus_queue.cc:1048] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:23:52.283195 25535 raft_consensus.cc:1275] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:23:52.285012 25895 consensus_queue.cc:1048] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:23:52.300055 25535 raft_consensus.cc:1275] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:52.301625 25829 consensus_queue.cc:1048] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:52.311204 25460 raft_consensus.cc:1275] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:52.313031 25829 consensus_queue.cc:1048] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:52.411667 25535 raft_consensus.cc:1275] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:23:52.413100 25915 consensus_queue.cc:1048] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:23:52.421670 25460 raft_consensus.cc:1275] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:23:52.425046 25915 consensus_queue.cc:1048] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:23:52.570283 25535 raft_consensus.cc:1275] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:52.571574 25915 consensus_queue.cc:1048] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f418eda5a744e39adabe1152fe38eef" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 35263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:52.580816 25460 raft_consensus.cc:1275] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Refusing update from remote peer 6235449a8f444a42b737723170ea15e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:52.582736 25915 consensus_queue.cc:1048] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4698e80fcca64adea0ca43b2f2a4ac42" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:52.738476 13122 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:23:52.744494 13122 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:23:52.745003 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:52.749930 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:23:52.750385 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:53.782341 13122 tablet_server.cc:179] TabletServer@127.12.208.129:0 shutting down...
I20260709 13:23:53.812240 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:53.813061 13122 tablet_replica.cc:333] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.813933 13122 raft_consensus.cc:2243] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:53.814921 13122 raft_consensus.cc:2272] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:53.815999 25500 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 13:23:53.816990 13122 tablet_replica.cc:333] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.817832 13122 raft_consensus.cc:2243] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:53.818713 13122 raft_consensus.cc:2272] T 6becbba25eb54c9b9929e427e4b1f77b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:53.819387 25500 consensus_peers.cc:597] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef -> Peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Couldn't send request to peer 4698e80fcca64adea0ca43b2f2a4ac42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:53.820776 13122 tablet_replica.cc:333] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.821496 13122 raft_consensus.cc:2243] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.822052 13122 raft_consensus.cc:2272] T 9f63b251525b4fe0a86fb59e022f9243 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.824301 13122 tablet_replica.cc:333] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.824976 13122 raft_consensus.cc:2243] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:53.825764 13122 raft_consensus.cc:2272] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.827788 13122 tablet_replica.cc:333] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.828500 13122 raft_consensus.cc:2243] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.828967 13122 raft_consensus.cc:2272] T 7968f5bc7e63452684c95e074230794b P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.831089 13122 tablet_replica.cc:333] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.831794 13122 raft_consensus.cc:2243] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:23:53.832010 25500 consensus_peers.cc:597] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef -> Peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Couldn't send request to peer 4698e80fcca64adea0ca43b2f2a4ac42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:53.832306 13122 raft_consensus.cc:2272] T cdfdd407b84a4ed2b51092fa29347c8f P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.834805 13122 tablet_replica.cc:333] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.835451 13122 raft_consensus.cc:2243] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.835979 13122 raft_consensus.cc:2272] T 2f07c0848fad411789ec64e41f176757 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.838425 13122 tablet_replica.cc:333] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.839079 13122 raft_consensus.cc:2243] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.839555 13122 raft_consensus.cc:2272] T 70730a900a2b40de958948985dc2aef2 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.841912 13122 tablet_replica.cc:333] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.842492 13122 raft_consensus.cc:2243] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.842952 13122 raft_consensus.cc:2272] T 4d107e8134ff443cb4cd7a70b42e82f9 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.845147 13122 tablet_replica.cc:333] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.845758 13122 raft_consensus.cc:2243] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.846278 13122 raft_consensus.cc:2272] T 6bd63eca82844f809edfbf9518d38591 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.848129 13122 tablet_replica.cc:333] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.848716 13122 raft_consensus.cc:2243] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:53.849562 13122 raft_consensus.cc:2272] T ae56321856254a358bd7bd15ceba6ec8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.851707 13122 tablet_replica.cc:333] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.852411 13122 raft_consensus.cc:2243] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.852905 13122 raft_consensus.cc:2272] T a4adcbe6288849c6937fe1b60bd6acc8 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.855700 13122 tablet_replica.cc:333] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.856174 13122 raft_consensus.cc:2243] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.856555 13122 raft_consensus.cc:2272] T 50ea7ccdaa2848038ff5227dd9e277f6 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.858350 13122 tablet_replica.cc:333] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.858857 13122 raft_consensus.cc:2243] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.859254 13122 raft_consensus.cc:2272] T 18d4413e8bb54c7ab58d953e000360d3 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.861588 13122 tablet_replica.cc:333] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.862246 13122 raft_consensus.cc:2243] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.862715 13122 raft_consensus.cc:2272] T 4f27d52a950f4972826bd75eff981987 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.865181 13122 tablet_replica.cc:333] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.865994 13122 raft_consensus.cc:2243] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.866642 13122 raft_consensus.cc:2272] T 133535ce885e407f8764f0ee126c1a76 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:53.867295 25574 consensus_peers.cc:597] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 -> Peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Couldn't send request to peer 4698e80fcca64adea0ca43b2f2a4ac42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:53.868335 25500 consensus_peers.cc:597] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef -> Peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Couldn't send request to peer 4698e80fcca64adea0ca43b2f2a4ac42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:53.869195 13122 tablet_replica.cc:333] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.870122 13122 raft_consensus.cc:2243] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:23:53.870780 25574 consensus_peers.cc:597] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 -> Peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Couldn't send request to peer 4698e80fcca64adea0ca43b2f2a4ac42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:53.871125 13122 raft_consensus.cc:2272] T 0eb931a1552f44b58298f7629ab52f2d P 4698e80fcca64adea0ca43b2f2a4ac42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.873432 13122 tablet_replica.cc:333] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42: stopping tablet replica
I20260709 13:23:53.874029 13122 raft_consensus.cc:2243] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:53.874886 13122 raft_consensus.cc:2272] T 685bba1876c941668c959daa4cc40501 P 4698e80fcca64adea0ca43b2f2a4ac42 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:53.881714 25574 consensus_peers.cc:597] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 -> Peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Couldn't send request to peer 4698e80fcca64adea0ca43b2f2a4ac42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:53.918792 13122 tablet_server.cc:196] TabletServer@127.12.208.129:0 shutdown complete.
I20260709 13:23:53.951164 13122 tablet_server.cc:179] TabletServer@127.12.208.130:0 shutting down...
W20260709 13:23:53.954433 25500 consensus_peers.cc:597] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef -> Peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Couldn't send request to peer 4698e80fcca64adea0ca43b2f2a4ac42. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:46431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:53.978845 25575 consensus_peers.cc:597] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 -> Peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Couldn't send request to peer 8f418eda5a744e39adabe1152fe38eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:53.984854 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:53.985687 13122 tablet_replica.cc:333] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:53.986389 13122 raft_consensus.cc:2243] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:53.987236 13122 raft_consensus.cc:2272] T 9f63b251525b4fe0a86fb59e022f9243 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.989161 13122 tablet_replica.cc:333] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:53.989737 13122 raft_consensus.cc:2243] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.990305 13122 raft_consensus.cc:2272] T 7968f5bc7e63452684c95e074230794b P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.992147 13122 tablet_replica.cc:333] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:53.992723 13122 raft_consensus.cc:2243] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.993485 13122 raft_consensus.cc:2272] T 6becbba25eb54c9b9929e427e4b1f77b P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:53.995612 13122 tablet_replica.cc:333] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:53.996464 13122 raft_consensus.cc:2243] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:53.997052 13122 raft_consensus.cc:2272] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:53.998060 25500 consensus_peers.cc:597] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef -> Peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Couldn't send request to peer 4698e80fcca64adea0ca43b2f2a4ac42. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:46431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:53.999358 13122 tablet_replica.cc:333] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:53.999996 13122 raft_consensus.cc:2243] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.000473 13122 raft_consensus.cc:2272] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.002521 13122 tablet_replica.cc:333] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.003116 13122 raft_consensus.cc:2243] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.003641 13122 raft_consensus.cc:2272] T 133535ce885e407f8764f0ee126c1a76 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.005620 13122 tablet_replica.cc:333] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.006240 13122 raft_consensus.cc:2243] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.006649 13122 raft_consensus.cc:2272] T 0eb931a1552f44b58298f7629ab52f2d P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.008716 13122 tablet_replica.cc:333] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.009219 13122 raft_consensus.cc:2243] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.010052 13122 raft_consensus.cc:2272] T 4f27d52a950f4972826bd75eff981987 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.011824 13122 tablet_replica.cc:333] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.012336 13122 raft_consensus.cc:2243] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.012727 13122 raft_consensus.cc:2272] T 6bd63eca82844f809edfbf9518d38591 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.014559 13122 tablet_replica.cc:333] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.015098 13122 raft_consensus.cc:2243] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.015491 13122 raft_consensus.cc:2272] T ae56321856254a358bd7bd15ceba6ec8 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.017560 13122 tablet_replica.cc:333] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.018131 13122 raft_consensus.cc:2243] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.018841 13122 raft_consensus.cc:2272] T a4adcbe6288849c6937fe1b60bd6acc8 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.020861 13122 tablet_replica.cc:333] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.021361 13122 raft_consensus.cc:2243] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.022186 13122 raft_consensus.cc:2272] T 50ea7ccdaa2848038ff5227dd9e277f6 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.023957 13122 tablet_replica.cc:333] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.024503 13122 raft_consensus.cc:2243] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.025290 13122 raft_consensus.cc:2272] T 18d4413e8bb54c7ab58d953e000360d3 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.027374 13122 tablet_replica.cc:333] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.027892 13122 raft_consensus.cc:2243] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.028290 13122 raft_consensus.cc:2272] T 685bba1876c941668c959daa4cc40501 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.031236 13122 tablet_replica.cc:333] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.031831 13122 raft_consensus.cc:2243] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.032857 13122 raft_consensus.cc:2272] T 4d107e8134ff443cb4cd7a70b42e82f9 P 8f418eda5a744e39adabe1152fe38eef [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:54.035159 25575 consensus_peers.cc:597] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 -> Peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Couldn't send request to peer 8f418eda5a744e39adabe1152fe38eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:54.035714 13122 tablet_replica.cc:333] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.036351 13122 raft_consensus.cc:2243] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.036886 13122 raft_consensus.cc:2272] T 70730a900a2b40de958948985dc2aef2 P 8f418eda5a744e39adabe1152fe38eef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.039669 13122 tablet_replica.cc:333] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.040374 13122 raft_consensus.cc:2243] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:23:54.040576 25575 consensus_peers.cc:597] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 -> Peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Couldn't send request to peer 8f418eda5a744e39adabe1152fe38eef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:54.040953 13122 raft_consensus.cc:2272] T 2f07c0848fad411789ec64e41f176757 P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.043797 13122 tablet_replica.cc:333] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef: stopping tablet replica
I20260709 13:23:54.044337 13122 raft_consensus.cc:2243] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.044732 13122 raft_consensus.cc:2272] T cdfdd407b84a4ed2b51092fa29347c8f P 8f418eda5a744e39adabe1152fe38eef [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:54.066622 25574 consensus_peers.cc:597] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 -> Peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Couldn't send request to peer 4698e80fcca64adea0ca43b2f2a4ac42. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:46431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:54.082864 25574 consensus_peers.cc:597] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 -> Peer 4698e80fcca64adea0ca43b2f2a4ac42 (127.12.208.129:46431): Couldn't send request to peer 4698e80fcca64adea0ca43b2f2a4ac42. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:46431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:54.085934 13122 tablet_server.cc:196] TabletServer@127.12.208.130:0 shutdown complete.
I20260709 13:23:54.117728 13122 tablet_server.cc:179] TabletServer@127.12.208.131:0 shutting down...
W20260709 13:23:54.139446 25575 consensus_peers.cc:597] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 -> Peer 8f418eda5a744e39adabe1152fe38eef (127.12.208.130:35263): Couldn't send request to peer 8f418eda5a744e39adabe1152fe38eef. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:35263: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:54.151325 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:54.152227 13122 tablet_replica.cc:333] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.153028 13122 raft_consensus.cc:2243] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.153553 13122 raft_consensus.cc:2272] T 6becbba25eb54c9b9929e427e4b1f77b P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.155665 13122 tablet_replica.cc:333] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.156250 13122 raft_consensus.cc:2243] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.157050 13122 raft_consensus.cc:2272] T 7968f5bc7e63452684c95e074230794b P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.159003 13122 tablet_replica.cc:333] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.159592 13122 raft_consensus.cc:2243] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.160053 13122 raft_consensus.cc:2272] T fb0d9c828f0f4c5ea5fad564e4e2cb81 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.162101 13122 tablet_replica.cc:333] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.162665 13122 raft_consensus.cc:2243] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.163125 13122 raft_consensus.cc:2272] T 9f63b251525b4fe0a86fb59e022f9243 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.165030 13122 tablet_replica.cc:333] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.165611 13122 raft_consensus.cc:2243] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.166092 13122 raft_consensus.cc:2272] T fb22aa501c5d42fa91a2a7a4de4d42e5 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.168121 13122 tablet_replica.cc:333] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.168763 13122 raft_consensus.cc:2243] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.169580 13122 raft_consensus.cc:2272] T 70730a900a2b40de958948985dc2aef2 P 6235449a8f444a42b737723170ea15e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.171654 13122 tablet_replica.cc:333] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.172258 13122 raft_consensus.cc:2243] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.172739 13122 raft_consensus.cc:2272] T 4d107e8134ff443cb4cd7a70b42e82f9 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.174959 13122 tablet_replica.cc:333] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.175563 13122 raft_consensus.cc:2243] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.176039 13122 raft_consensus.cc:2272] T 50ea7ccdaa2848038ff5227dd9e277f6 P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.177944 13122 tablet_replica.cc:333] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.178552 13122 raft_consensus.cc:2243] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.179037 13122 raft_consensus.cc:2272] T 18d4413e8bb54c7ab58d953e000360d3 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.181154 13122 tablet_replica.cc:333] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.181732 13122 raft_consensus.cc:2243] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.182592 13122 raft_consensus.cc:2272] T 6bd63eca82844f809edfbf9518d38591 P 6235449a8f444a42b737723170ea15e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.184491 13122 tablet_replica.cc:333] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.185072 13122 raft_consensus.cc:2243] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.185580 13122 raft_consensus.cc:2272] T ae56321856254a358bd7bd15ceba6ec8 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.187548 13122 tablet_replica.cc:333] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.188086 13122 raft_consensus.cc:2243] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.188558 13122 raft_consensus.cc:2272] T a4adcbe6288849c6937fe1b60bd6acc8 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.190624 13122 tablet_replica.cc:333] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.191485 13122 raft_consensus.cc:2243] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.192462 13122 raft_consensus.cc:2272] T 2f07c0848fad411789ec64e41f176757 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.195122 13122 tablet_replica.cc:333] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.195861 13122 raft_consensus.cc:2243] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.196765 13122 raft_consensus.cc:2272] T cdfdd407b84a4ed2b51092fa29347c8f P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.199028 13122 tablet_replica.cc:333] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.199616 13122 raft_consensus.cc:2243] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.200518 13122 raft_consensus.cc:2272] T 133535ce885e407f8764f0ee126c1a76 P 6235449a8f444a42b737723170ea15e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.202759 13122 tablet_replica.cc:333] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.203331 13122 raft_consensus.cc:2243] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.203910 13122 raft_consensus.cc:2272] T 4f27d52a950f4972826bd75eff981987 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.206131 13122 tablet_replica.cc:333] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.206717 13122 raft_consensus.cc:2243] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.207247 13122 raft_consensus.cc:2272] T 0eb931a1552f44b58298f7629ab52f2d P 6235449a8f444a42b737723170ea15e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.209379 13122 tablet_replica.cc:333] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5: stopping tablet replica
I20260709 13:23:54.209920 13122 raft_consensus.cc:2243] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:54.210464 13122 raft_consensus.cc:2272] T 685bba1876c941668c959daa4cc40501 P 6235449a8f444a42b737723170ea15e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.252750 13122 tablet_server.cc:196] TabletServer@127.12.208.131:0 shutdown complete.
I20260709 13:23:54.285523 13122 master.cc:562] Master@127.12.208.190:41887 shutting down...
I20260709 13:23:54.311002 13122 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:54.311697 13122 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:54.312117 13122 tablet_replica.cc:333] T 00000000000000000000000000000000 P a8c30222f6dc4f9391abb05895b416c9: stopping tablet replica
I20260709 13:23:54.334236 13122 master.cc:584] Master@127.12.208.190:41887 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12316 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:23:54.392725 13122 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.208.190:37191
I20260709 13:23:54.393959 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:54.399930 25924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:54.401342 25925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:54.401393 13122 server_base.cc:1061] running on GCE node
W20260709 13:23:54.401511 25927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:54.402940 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:54.403180 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:54.403374 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603434403356 us; error 0 us; skew 500 ppm
I20260709 13:23:54.403924 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:54.406805 13122 webserver.cc:533] Webserver started at http://127.12.208.190:38373/ using document root <none> and password file <none>
I20260709 13:23:54.407339 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:54.407552 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:54.407832 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:54.408986 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/master-0-root/instance:
uuid: "f310c8f5ea7645e6b35ae3977f40229c"
format_stamp: "Formatted at 2026-07-09 13:23:54 on dist-test-slave-ll1f"
I20260709 13:23:54.413725 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:23:54.417419 25932 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:54.418516 13122 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:23:54.418793 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/master-0-root
uuid: "f310c8f5ea7645e6b35ae3977f40229c"
format_stamp: "Formatted at 2026-07-09 13:23:54 on dist-test-slave-ll1f"
I20260709 13:23:54.419062 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:54.432013 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:54.433252 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:54.476094 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.190:37191
I20260709 13:23:54.476236 25983 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.190:37191 every 8 connection(s)
I20260709 13:23:54.480509 25984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:54.492244 25984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c: Bootstrap starting.
I20260709 13:23:54.497092 25984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:54.501758 25984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c: No bootstrap required, opened a new log
I20260709 13:23:54.504184 25984 raft_consensus.cc:359] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f310c8f5ea7645e6b35ae3977f40229c" member_type: VOTER }
I20260709 13:23:54.504628 25984 raft_consensus.cc:385] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:54.504818 25984 raft_consensus.cc:740] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f310c8f5ea7645e6b35ae3977f40229c, State: Initialized, Role: FOLLOWER
I20260709 13:23:54.505496 25984 consensus_queue.cc:260] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f310c8f5ea7645e6b35ae3977f40229c" member_type: VOTER }
I20260709 13:23:54.505942 25984 raft_consensus.cc:399] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:23:54.506131 25984 raft_consensus.cc:493] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:23:54.506335 25984 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:54.511427 25984 raft_consensus.cc:515] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f310c8f5ea7645e6b35ae3977f40229c" member_type: VOTER }
I20260709 13:23:54.511952 25984 leader_election.cc:304] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f310c8f5ea7645e6b35ae3977f40229c; no voters: 
I20260709 13:23:54.513185 25984 leader_election.cc:290] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:23:54.513594 25987 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:54.515149 25987 raft_consensus.cc:697] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [term 1 LEADER]: Becoming Leader. State: Replica: f310c8f5ea7645e6b35ae3977f40229c, State: Running, Role: LEADER
I20260709 13:23:54.515861 25987 consensus_queue.cc:237] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f310c8f5ea7645e6b35ae3977f40229c" member_type: VOTER }
I20260709 13:23:54.516219 25984 sys_catalog.cc:565] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:23:54.520351 25988 sys_catalog.cc:455] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f310c8f5ea7645e6b35ae3977f40229c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f310c8f5ea7645e6b35ae3977f40229c" member_type: VOTER } }
I20260709 13:23:54.521169 25988 sys_catalog.cc:458] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:54.522369 25989 sys_catalog.cc:455] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f310c8f5ea7645e6b35ae3977f40229c. Latest consensus state: current_term: 1 leader_uuid: "f310c8f5ea7645e6b35ae3977f40229c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f310c8f5ea7645e6b35ae3977f40229c" member_type: VOTER } }
I20260709 13:23:54.523010 25989 sys_catalog.cc:458] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:54.524681 25995 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:23:54.533192 25995 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:23:54.534371 13122 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:23:54.542862 25995 catalog_manager.cc:1383] Generated new cluster ID: 0120ab10da19419cb9ce01e10139d1cb
I20260709 13:23:54.543216 25995 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:23:54.567065 25995 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:23:54.568542 25995 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:23:54.582196 25995 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c: Generated new TSK 0
I20260709 13:23:54.582969 25995 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:23:54.602247 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:54.608989 26005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:54.610114 26006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:54.612959 13122 server_base.cc:1061] running on GCE node
W20260709 13:23:54.612989 26008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:54.614394 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:54.614632 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:54.614848 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603434614825 us; error 0 us; skew 500 ppm
I20260709 13:23:54.615520 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:54.618506 13122 webserver.cc:533] Webserver started at http://127.12.208.129:43081/ using document root <none> and password file <none>
I20260709 13:23:54.619026 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:54.619239 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:54.619580 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:54.620939 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-0-root/instance:
uuid: "eec7b18e6128402fb44865333f59bece"
format_stamp: "Formatted at 2026-07-09 13:23:54 on dist-test-slave-ll1f"
I20260709 13:23:54.625926 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:23:54.630092 26013 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:54.631052 13122 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:23:54.631413 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-0-root
uuid: "eec7b18e6128402fb44865333f59bece"
format_stamp: "Formatted at 2026-07-09 13:23:54 on dist-test-slave-ll1f"
I20260709 13:23:54.631711 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:54.658914 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:54.660502 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:54.666078 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:54.669586 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:54.669872 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:23:54.670193 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:54.670358 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:54.712554 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.129:42371
I20260709 13:23:54.712759 26075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.129:42371 every 8 connection(s)
I20260709 13:23:54.717509 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:54.725380 26080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:54.727746 26081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:54.729074 26083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:54.731805 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:54.732177 26076 heartbeater.cc:344] Connected to a master server at 127.12.208.190:37191
I20260709 13:23:54.732769 26076 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:54.733182 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:54.733476 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:54.733661 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603434733647 us; error 0 us; skew 500 ppm
I20260709 13:23:54.733778 26076 heartbeater.cc:507] Master 127.12.208.190:37191 requested a full tablet report, sending...
I20260709 13:23:54.734344 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:54.736580 25949 ts_manager.cc:194] Registered new tserver with Master: eec7b18e6128402fb44865333f59bece (127.12.208.129:42371)
I20260709 13:23:54.737545 13122 webserver.cc:533] Webserver started at http://127.12.208.130:43067/ using document root <none> and password file <none>
I20260709 13:23:54.738373 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:54.738646 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:54.738983 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:54.739449 25949 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36168
I20260709 13:23:54.740615 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-1-root/instance:
uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
format_stamp: "Formatted at 2026-07-09 13:23:54 on dist-test-slave-ll1f"
I20260709 13:23:54.747562 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:23:54.751443 26088 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:54.752507 13122 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:23:54.752785 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-1-root
uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
format_stamp: "Formatted at 2026-07-09 13:23:54 on dist-test-slave-ll1f"
I20260709 13:23:54.753034 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:54.807137 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:54.808544 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:54.810317 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:54.812851 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:54.813050 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:54.813395 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:54.813551 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:54.858927 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.130:43485
I20260709 13:23:54.859061 26150 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.130:43485 every 8 connection(s)
I20260709 13:23:54.864061 13122 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:54.872706 26155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:54.874009 26154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:54.876454 26157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:54.876654 13122 server_base.cc:1061] running on GCE node
I20260709 13:23:54.878011 13122 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:54.878214 13122 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:54.878441 13122 hybrid_clock.cc:648] HybridClock initialized: now 1783603434878403 us; error 0 us; skew 500 ppm
I20260709 13:23:54.878847 26151 heartbeater.cc:344] Connected to a master server at 127.12.208.190:37191
I20260709 13:23:54.879191 13122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:54.879338 26151 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:54.880373 26151 heartbeater.cc:507] Master 127.12.208.190:37191 requested a full tablet report, sending...
I20260709 13:23:54.882227 13122 webserver.cc:533] Webserver started at http://127.12.208.131:46117/ using document root <none> and password file <none>
I20260709 13:23:54.882973 13122 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:54.883052 25949 ts_manager.cc:194] Registered new tserver with Master: 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:23:54.883199 13122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:54.883688 13122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:54.884742 25949 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36184
I20260709 13:23:54.884915 13122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-2-root/instance:
uuid: "d55319a034b9440882722bc321b6c4dc"
format_stamp: "Formatted at 2026-07-09 13:23:54 on dist-test-slave-ll1f"
I20260709 13:23:54.890058 13122 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:23:54.893901 26162 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:54.894922 13122 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:23:54.895217 13122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-2-root
uuid: "d55319a034b9440882722bc321b6c4dc"
format_stamp: "Formatted at 2026-07-09 13:23:54 on dist-test-slave-ll1f"
I20260709 13:23:54.895468 13122 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskl3sprN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603003722080-13122-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:54.913450 13122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:54.914731 13122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:54.916216 13122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:54.918522 13122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:54.918763 13122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:54.919036 13122 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:54.919226 13122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:54.963708 13122 rpc_server.cc:307] RPC server started. Bound to: 127.12.208.131:35147
I20260709 13:23:54.963860 26224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.208.131:35147 every 8 connection(s)
I20260709 13:23:54.979300 26225 heartbeater.cc:344] Connected to a master server at 127.12.208.190:37191
I20260709 13:23:54.979851 26225 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:54.980700 26225 heartbeater.cc:507] Master 127.12.208.190:37191 requested a full tablet report, sending...
I20260709 13:23:54.982858 25949 ts_manager.cc:194] Registered new tserver with Master: d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:54.983531 13122 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016324015s
I20260709 13:23:54.984431 25949 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36186
I20260709 13:23:55.012272 25949 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36194:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:55.015013 25949 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:55.100769 26039 tablet_service.cc:1511] Processing CreateTablet for tablet 4b7f9b500a5e45dea9d6c7c729c903b0 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:55.102392 26039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7f9b500a5e45dea9d6c7c729c903b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.102541 26114 tablet_service.cc:1511] Processing CreateTablet for tablet 4b7f9b500a5e45dea9d6c7c729c903b0 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:55.103972 26114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7f9b500a5e45dea9d6c7c729c903b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.105151 26189 tablet_service.cc:1511] Processing CreateTablet for tablet 08d38135a9654f0abdb0bdcfd4237913 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:55.106769 26189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d38135a9654f0abdb0bdcfd4237913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.106873 26190 tablet_service.cc:1511] Processing CreateTablet for tablet 9e47bde09bc649a59a8c062c8785c304 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:55.108425 26190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e47bde09bc649a59a8c062c8785c304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.108053 26115 tablet_service.cc:1511] Processing CreateTablet for tablet 08d38135a9654f0abdb0bdcfd4237913 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:55.109561 26115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d38135a9654f0abdb0bdcfd4237913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.111613 26188 tablet_service.cc:1511] Processing CreateTablet for tablet 4b7f9b500a5e45dea9d6c7c729c903b0 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:55.113174 26188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b7f9b500a5e45dea9d6c7c729c903b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.114977 26113 tablet_service.cc:1511] Processing CreateTablet for tablet 43ea4b85fae24ec0aff5cb58a3b8da08 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:55.116560 26113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ea4b85fae24ec0aff5cb58a3b8da08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.116626 26112 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2cbc4350464c9996fc4b0ecb93229e (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:55.117295 26040 tablet_service.cc:1511] Processing CreateTablet for tablet 08d38135a9654f0abdb0bdcfd4237913 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:55.117504 26111 tablet_service.cc:1511] Processing CreateTablet for tablet 9deaf8b4cf754e5bbb3f87eed11b3e54 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:55.106925 26116 tablet_service.cc:1511] Processing CreateTablet for tablet 9e47bde09bc649a59a8c062c8785c304 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:55.118345 26112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2cbc4350464c9996fc4b0ecb93229e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.118871 26040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d38135a9654f0abdb0bdcfd4237913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.119215 26116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e47bde09bc649a59a8c062c8785c304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.120056 26110 tablet_service.cc:1511] Processing CreateTablet for tablet fb3d976451f843b4ac6f6f21690ae17f (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:55.121498 26110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3d976451f843b4ac6f6f21690ae17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.114981 26187 tablet_service.cc:1511] Processing CreateTablet for tablet 43ea4b85fae24ec0aff5cb58a3b8da08 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:55.121526 26038 tablet_service.cc:1511] Processing CreateTablet for tablet 43ea4b85fae24ec0aff5cb58a3b8da08 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:55.122677 26186 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2cbc4350464c9996fc4b0ecb93229e (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:55.123389 26187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ea4b85fae24ec0aff5cb58a3b8da08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.123690 26111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9deaf8b4cf754e5bbb3f87eed11b3e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.124177 26186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2cbc4350464c9996fc4b0ecb93229e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.127007 26185 tablet_service.cc:1511] Processing CreateTablet for tablet 9deaf8b4cf754e5bbb3f87eed11b3e54 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:55.128577 26185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9deaf8b4cf754e5bbb3f87eed11b3e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.131381 26041 tablet_service.cc:1511] Processing CreateTablet for tablet 9e47bde09bc649a59a8c062c8785c304 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:55.132251 26036 tablet_service.cc:1511] Processing CreateTablet for tablet 9deaf8b4cf754e5bbb3f87eed11b3e54 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:55.132579 26037 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2cbc4350464c9996fc4b0ecb93229e (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:55.134219 26038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ea4b85fae24ec0aff5cb58a3b8da08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.134826 26035 tablet_service.cc:1511] Processing CreateTablet for tablet fb3d976451f843b4ac6f6f21690ae17f (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:55.136310 26035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3d976451f843b4ac6f6f21690ae17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.138218 26041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e47bde09bc649a59a8c062c8785c304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.138967 26037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2cbc4350464c9996fc4b0ecb93229e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.142143 26036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9deaf8b4cf754e5bbb3f87eed11b3e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.200940 26184 tablet_service.cc:1511] Processing CreateTablet for tablet fb3d976451f843b4ac6f6f21690ae17f (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:55.211973 26184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3d976451f843b4ac6f6f21690ae17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.204803 26183 tablet_service.cc:1511] Processing CreateTablet for tablet 910cec7145844e7aa2700e4bb54a3bc7 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:55.206625 26041 tablet_service.cc:1511] Processing CreateTablet for tablet 910cec7145844e7aa2700e4bb54a3bc7 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:55.214929 26041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910cec7145844e7aa2700e4bb54a3bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.215410 26183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910cec7145844e7aa2700e4bb54a3bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.205440 26109 tablet_service.cc:1511] Processing CreateTablet for tablet 910cec7145844e7aa2700e4bb54a3bc7 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:55.217924 26109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910cec7145844e7aa2700e4bb54a3bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.249774 26034 tablet_service.cc:1511] Processing CreateTablet for tablet e225ed8fa1204dd2a51e8bf31d03dd50 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:55.256512 26034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e225ed8fa1204dd2a51e8bf31d03dd50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.269703 26108 tablet_service.cc:1511] Processing CreateTablet for tablet e225ed8fa1204dd2a51e8bf31d03dd50 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:55.271526 26108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e225ed8fa1204dd2a51e8bf31d03dd50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.283480 26240 tablet_bootstrap.cc:492] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:55.290057 26190 tablet_service.cc:1511] Processing CreateTablet for tablet e225ed8fa1204dd2a51e8bf31d03dd50 (DEFAULT_TABLE table=test-workload [id=ab898859b6314c21b23b4860b48b328a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:55.291457 26190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e225ed8fa1204dd2a51e8bf31d03dd50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:55.304212 26241 tablet_bootstrap.cc:492] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:55.328939 26241 tablet_bootstrap.cc:654] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.330004 26240 tablet_bootstrap.cc:654] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.331115 26242 tablet_bootstrap.cc:492] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:55.346213 26242 tablet_bootstrap.cc:654] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.352013 26241 tablet_bootstrap.cc:492] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:55.352111 26242 tablet_bootstrap.cc:492] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:55.352013 26240 tablet_bootstrap.cc:492] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:55.352680 26241 ts_tablet_manager.cc:1403] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.008s
I20260709 13:23:55.353049 26240 ts_tablet_manager.cc:1403] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.070s	user 0.006s	sys 0.007s
I20260709 13:23:55.353058 26242 ts_tablet_manager.cc:1403] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:23:55.356010 26241 raft_consensus.cc:359] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.356305 26242 raft_consensus.cc:359] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } }
I20260709 13:23:55.356827 26241 raft_consensus.cc:385] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.357151 26242 raft_consensus.cc:385] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.357196 26241 raft_consensus.cc:740] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.357810 26242 raft_consensus.cc:740] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.358532 26241 consensus_queue.cc:260] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.358801 26242 consensus_queue.cc:260] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } }
I20260709 13:23:55.358980 26240 raft_consensus.cc:359] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.359809 26240 raft_consensus.cc:385] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.360275 26240 raft_consensus.cc:740] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.361294 26240 consensus_queue.cc:260] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.361831 26241 ts_tablet_manager.cc:1434] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:23:55.361573 26225 heartbeater.cc:499] Master 127.12.208.190:37191 was elected leader, sending a full tablet report...
I20260709 13:23:55.364337 26076 heartbeater.cc:499] Master 127.12.208.190:37191 was elected leader, sending a full tablet report...
I20260709 13:23:55.367238 26240 ts_tablet_manager.cc:1434] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:23:55.368135 26241 tablet_bootstrap.cc:492] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:55.368924 26240 tablet_bootstrap.cc:492] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:55.375866 26241 tablet_bootstrap.cc:654] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.379010 26151 heartbeater.cc:499] Master 127.12.208.190:37191 was elected leader, sending a full tablet report...
I20260709 13:23:55.379671 26242 ts_tablet_manager.cc:1434] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.026s	user 0.019s	sys 0.006s
I20260709 13:23:55.380924 26242 tablet_bootstrap.cc:492] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:55.386065 26240 tablet_bootstrap.cc:654] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.387876 26241 tablet_bootstrap.cc:492] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:55.388307 26242 tablet_bootstrap.cc:654] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.388535 26241 ts_tablet_manager.cc:1403] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:23:55.391999 26241 raft_consensus.cc:359] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } }
I20260709 13:23:55.392952 26241 raft_consensus.cc:385] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.393360 26241 raft_consensus.cc:740] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.394366 26241 consensus_queue.cc:260] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } }
I20260709 13:23:55.397204 26241 ts_tablet_manager.cc:1434] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:55.398398 26241 tablet_bootstrap.cc:492] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:55.405697 26241 tablet_bootstrap.cc:654] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.417873 26241 tablet_bootstrap.cc:492] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:55.418557 26241 ts_tablet_manager.cc:1403] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:23:55.422046 26241 raft_consensus.cc:359] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.422963 26241 raft_consensus.cc:385] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.423381 26241 raft_consensus.cc:740] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.424466 26241 consensus_queue.cc:260] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.427342 26241 ts_tablet_manager.cc:1434] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:23:55.428614 26241 tablet_bootstrap.cc:492] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:55.435487 26241 tablet_bootstrap.cc:654] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.448303 26241 tablet_bootstrap.cc:492] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:55.448982 26241 ts_tablet_manager.cc:1403] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:23:55.452224 26241 raft_consensus.cc:359] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.453226 26241 raft_consensus.cc:385] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.453615 26241 raft_consensus.cc:740] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.454633 26241 consensus_queue.cc:260] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.457602 26241 ts_tablet_manager.cc:1434] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:55.458868 26241 tablet_bootstrap.cc:492] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:55.459022 26242 tablet_bootstrap.cc:492] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:55.459386 26240 tablet_bootstrap.cc:492] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:55.459805 26242 ts_tablet_manager.cc:1403] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.079s	user 0.029s	sys 0.048s
I20260709 13:23:55.460052 26240 ts_tablet_manager.cc:1403] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.068s
I20260709 13:23:55.463508 26242 raft_consensus.cc:359] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.463824 26240 raft_consensus.cc:359] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } }
I20260709 13:23:55.464463 26242 raft_consensus.cc:385] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.464851 26240 raft_consensus.cc:385] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.465282 26240 raft_consensus.cc:740] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.465135 26242 raft_consensus.cc:740] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.467003 26241 tablet_bootstrap.cc:654] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.466610 26242 consensus_queue.cc:260] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.466394 26240 consensus_queue.cc:260] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } }
I20260709 13:23:55.469815 26240 ts_tablet_manager.cc:1434] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:23:55.471083 26240 tablet_bootstrap.cc:492] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:55.473489 26241 tablet_bootstrap.cc:492] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:55.474243 26241 ts_tablet_manager.cc:1403] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 13:23:55.474849 26242 ts_tablet_manager.cc:1434] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:23:55.476015 26242 tablet_bootstrap.cc:492] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:55.477866 26241 raft_consensus.cc:359] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.478441 26240 tablet_bootstrap.cc:654] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.478871 26241 raft_consensus.cc:385] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.479254 26241 raft_consensus.cc:740] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.480471 26241 consensus_queue.cc:260] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.482604 26242 tablet_bootstrap.cc:654] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.484109 26241 ts_tablet_manager.cc:1434] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:23:55.485553 26248 raft_consensus.cc:493] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:55.485747 26241 tablet_bootstrap.cc:492] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:55.486311 26248 raft_consensus.cc:515] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } }
I20260709 13:23:55.494797 26246 raft_consensus.cc:493] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:55.495657 26246 raft_consensus.cc:515] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.498704 26248 leader_election.cc:290] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:55.506055 26246 leader_election.cc:290] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
W20260709 13:23:55.528451 25997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:55.529711 26241 tablet_bootstrap.cc:654] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.531257 26240 tablet_bootstrap.cc:492] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:55.532049 26240 ts_tablet_manager.cc:1403] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.045s
I20260709 13:23:55.535741 26240 raft_consensus.cc:359] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.536644 26240 raft_consensus.cc:385] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.537045 26240 raft_consensus.cc:740] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.537998 26240 consensus_queue.cc:260] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.542655 26240 ts_tablet_manager.cc:1434] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:23:55.543900 26240 tablet_bootstrap.cc:492] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:55.551644 26242 tablet_bootstrap.cc:492] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:55.552695 26242 ts_tablet_manager.cc:1403] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.033s
I20260709 13:23:55.554150 26240 tablet_bootstrap.cc:654] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.554919 26051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2cbc4350464c9996fc4b0ecb93229e" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:23:55.556412 26247 raft_consensus.cc:493] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:23:55.557029 26163 leader_election.cc:343] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.557185 26247 raft_consensus.cc:515] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } }
I20260709 13:23:55.567111 26247 leader_election.cc:290] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147), eec7b18e6128402fb44865333f59bece (127.12.208.129:42371)
I20260709 13:23:55.567381 26240 tablet_bootstrap.cc:492] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:55.568225 26240 ts_tablet_manager.cc:1403] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 13:23:55.569499 26241 tablet_bootstrap.cc:492] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:55.570144 26241 ts_tablet_manager.cc:1403] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.085s	user 0.028s	sys 0.021s
I20260709 13:23:55.571925 26240 raft_consensus.cc:359] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.572875 26240 raft_consensus.cc:385] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.573237 26240 raft_consensus.cc:740] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.574404 26240 consensus_queue.cc:260] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.575479 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2cbc4350464c9996fc4b0ecb93229e" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
W20260709 13:23:55.577440 26164 leader_election.cc:343] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.578011 26164 leader_election.cc:304] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d55319a034b9440882722bc321b6c4dc; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece
I20260709 13:23:55.579200 26246 raft_consensus.cc:2749] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:55.579730 26242 raft_consensus.cc:359] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.580688 26242 raft_consensus.cc:385] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.580996 26242 raft_consensus.cc:740] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.573536 26241 raft_consensus.cc:359] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.582314 26241 raft_consensus.cc:385] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.582365 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47bde09bc649a59a8c062c8785c304" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:23:55.582729 26241 raft_consensus.cc:740] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.583151 26126 raft_consensus.cc:2468] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:23:55.583604 26241 consensus_queue.cc:260] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.584969 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47bde09bc649a59a8c062c8785c304" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:55.585737 26200 raft_consensus.cc:2468] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:23:55.586006 26240 ts_tablet_manager.cc:1434] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:23:55.586158 26241 ts_tablet_manager.cc:1434] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:23:55.587370 26015 leader_election.cc:304] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:55.583698 26242 consensus_queue.cc:260] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.588572 26248 raft_consensus.cc:2804] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:55.588953 26248 raft_consensus.cc:493] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:55.589279 26248 raft_consensus.cc:3060] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.589385 26241 tablet_bootstrap.cc:492] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:55.594336 26246 raft_consensus.cc:493] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:55.594961 26246 raft_consensus.cc:515] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.597895 26246 leader_election.cc:290] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:23:55.602626 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47bde09bc649a59a8c062c8785c304" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:55.603066 26241 tablet_bootstrap.cc:654] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.603384 26200 raft_consensus.cc:2468] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 0.
I20260709 13:23:55.604687 26090 leader_election.cc:304] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc; no voters: 
I20260709 13:23:55.598321 26242 ts_tablet_manager.cc:1434] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.003s
I20260709 13:23:55.598961 26247 raft_consensus.cc:493] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:55.605994 26247 raft_consensus.cc:515] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.607867 26241 tablet_bootstrap.cc:492] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:55.598836 26051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3d976451f843b4ac6f6f21690ae17f" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:23:55.608227 26247 leader_election.cc:290] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:55.601135 26240 tablet_bootstrap.cc:492] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:55.608758 26051 raft_consensus.cc:2468] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 0.
I20260709 13:23:55.608589 26248 raft_consensus.cc:515] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } }
I20260709 13:23:55.608927 26247 raft_consensus.cc:2804] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:55.601224 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3d976451f843b4ac6f6f21690ae17f" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:23:55.609477 26247 raft_consensus.cc:493] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:55.610045 26247 raft_consensus.cc:3060] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.610839 26163 leader_election.cc:304] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:55.611543 26242 tablet_bootstrap.cc:492] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
W20260709 13:23:55.612484 26164 leader_election.cc:343] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.613579 26246 raft_consensus.cc:2804] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:55.614051 26246 raft_consensus.cc:493] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:55.614384 26246 raft_consensus.cc:3060] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.608369 26241 ts_tablet_manager.cc:1403] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.008s
I20260709 13:23:55.616025 26240 tablet_bootstrap.cc:654] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.623136 26241 raft_consensus.cc:359] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.624425 26241 raft_consensus.cc:385] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.624851 26241 raft_consensus.cc:740] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.628232 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47bde09bc649a59a8c062c8785c304" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:55.628331 26248 leader_election.cc:290] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Requested vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:55.637171 26242 tablet_bootstrap.cc:654] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.637307 26200 raft_consensus.cc:3060] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.629179 26246 raft_consensus.cc:515] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.631729 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47bde09bc649a59a8c062c8785c304" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:23:55.632257 26240 tablet_bootstrap.cc:492] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:55.641067 26240 ts_tablet_manager.cc:1403] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.001s
I20260709 13:23:55.632789 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:55.641706 26051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3d976451f843b4ac6f6f21690ae17f" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:23:55.642191 26199 raft_consensus.cc:2468] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 0.
I20260709 13:23:55.642467 26051 raft_consensus.cc:3060] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.644222 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3d976451f843b4ac6f6f21690ae17f" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:23:55.644447 26240 raft_consensus.cc:359] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.645220 26240 raft_consensus.cc:385] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.645979 26090 leader_election.cc:304] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc; no voters: 
I20260709 13:23:55.648195 26240 raft_consensus.cc:740] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.648790 26268 raft_consensus.cc:2804] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:55.640017 26246 leader_election.cc:290] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
W20260709 13:23:55.646211 26164 leader_election.cc:343] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.646562 26200 raft_consensus.cc:2468] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:23:55.632175 26241 consensus_queue.cc:260] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.650964 26051 raft_consensus.cc:2468] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 1.
I20260709 13:23:55.651429 26015 leader_election.cc:304] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:55.652199 26241 ts_tablet_manager.cc:1434] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:23:55.652264 26163 leader_election.cc:304] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:23:55.653043 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47bde09bc649a59a8c062c8785c304" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:23:55.653455 26241 tablet_bootstrap.cc:492] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:55.652518 26248 raft_consensus.cc:2804] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:55.625758 26247 raft_consensus.cc:515] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } }
I20260709 13:23:55.656692 26246 raft_consensus.cc:2804] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:55.649199 26268 raft_consensus.cc:493] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:55.662190 26268 raft_consensus.cc:3060] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.663071 26051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:23:55.664721 26242 tablet_bootstrap.cc:492] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:55.664371 26049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47bde09bc649a59a8c062c8785c304" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:23:55.665315 26242 ts_tablet_manager.cc:1403] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.003s
I20260709 13:23:55.658666 26126 raft_consensus.cc:2393] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eec7b18e6128402fb44865333f59bece in current term 1: Already voted for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in this term.
W20260709 13:23:55.666607 26089 leader_election.cc:343] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.660646 26247 leader_election.cc:290] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 election: Requested vote from peers d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147), eec7b18e6128402fb44865333f59bece (127.12.208.129:42371)
I20260709 13:23:55.661521 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47bde09bc649a59a8c062c8785c304" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:55.661435 26241 tablet_bootstrap.cc:654] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.667923 26199 raft_consensus.cc:2393] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in current term 1: Already voted for candidate eec7b18e6128402fb44865333f59bece in this term.
I20260709 13:23:55.649075 26240 consensus_queue.cc:260] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.669377 26090 leader_election.cc:304] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4; no voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece
I20260709 13:23:55.669163 26242 raft_consensus.cc:359] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.658851 26272 raft_consensus.cc:493] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:55.670468 26272 raft_consensus.cc:515] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.671591 26247 raft_consensus.cc:2749] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:23:55.673760 26049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
W20260709 13:23:55.675470 26163 leader_election.cc:343] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.675829 26268 raft_consensus.cc:515] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.676256 26241 tablet_bootstrap.cc:492] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:55.677098 26241 ts_tablet_manager.cc:1403] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.005s
I20260709 13:23:55.678006 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:23:55.679744 26049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece"
W20260709 13:23:55.681267 26164 leader_election.cc:343] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.681849 26164 leader_election.cc:304] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d55319a034b9440882722bc321b6c4dc; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece
I20260709 13:23:55.684597 26272 leader_election.cc:290] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:23:55.687126 26272 raft_consensus.cc:2749] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:55.688639 26240 ts_tablet_manager.cc:1434] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.047s	user 0.014s	sys 0.002s
I20260709 13:23:55.680907 26241 raft_consensus.cc:359] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.689603 26241 raft_consensus.cc:385] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.690081 26240 tablet_bootstrap.cc:492] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:55.690150 26241 raft_consensus.cc:740] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.692106 26246 raft_consensus.cc:697] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Becoming Leader. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:23:55.694078 26246 consensus_queue.cc:237] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.694310 26241 consensus_queue.cc:260] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.688619 26242 raft_consensus.cc:385] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:23:55.692020 26089 leader_election.cc:343] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.700286 26274 raft_consensus.cc:493] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:55.701493 26274 raft_consensus.cc:515] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.697677 26240 tablet_bootstrap.cc:654] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.704174 26248 raft_consensus.cc:697] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Leader. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:23:55.703981 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:55.705102 26200 raft_consensus.cc:3060] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.705281 26268 leader_election.cc:290] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:55.698284 26242 raft_consensus.cc:740] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.706993 26242 consensus_queue.cc:260] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.707492 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d38135a9654f0abdb0bdcfd4237913" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
W20260709 13:23:55.709273 26015 leader_election.cc:343] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.710315 26248 consensus_queue.cc:237] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } }
I20260709 13:23:55.710881 26274 leader_election.cc:290] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:55.713068 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d38135a9654f0abdb0bdcfd4237913" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:55.716902 26199 raft_consensus.cc:2468] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:23:55.713462 26241 ts_tablet_manager.cc:1434] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 13:23:55.715865 26200 raft_consensus.cc:2468] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 1.
I20260709 13:23:55.722579 26090 leader_election.cc:304] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc; no voters: eec7b18e6128402fb44865333f59bece
I20260709 13:23:55.720885 26242 ts_tablet_manager.cc:1434] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:23:55.721169 26241 tablet_bootstrap.cc:492] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:55.723809 26268 raft_consensus.cc:2804] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:55.723354 25948 catalog_manager.cc:5697] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc reported cstate change: term changed from 0 to 1, leader changed from <none> to d55319a034b9440882722bc321b6c4dc (127.12.208.131). New cstate: current_term: 1 leader_uuid: "d55319a034b9440882722bc321b6c4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:55.724471 26015 leader_election.cc:304] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:23:55.725718 26242 tablet_bootstrap.cc:492] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:55.724647 26268 raft_consensus.cc:697] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 LEADER]: Becoming Leader. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Running, Role: LEADER
I20260709 13:23:55.728195 26268 consensus_queue.cc:237] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.731928 26246 raft_consensus.cc:493] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:55.732204 26241 tablet_bootstrap.cc:654] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.732632 26248 raft_consensus.cc:2804] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:55.732599 26246 raft_consensus.cc:515] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.733322 26242 tablet_bootstrap.cc:654] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.733203 26248 raft_consensus.cc:493] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:55.733968 26248 raft_consensus.cc:3060] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.735133 26246 leader_election.cc:290] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:23:55.737044 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e225ed8fa1204dd2a51e8bf31d03dd50" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:23:55.737761 26050 raft_consensus.cc:2468] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 0.
I20260709 13:23:55.739228 26163 leader_election.cc:304] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:55.729676 25946 catalog_manager.cc:5697] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece reported cstate change: term changed from 0 to 1, leader changed from <none> to eec7b18e6128402fb44865333f59bece (127.12.208.129). New cstate: current_term: 1 leader_uuid: "eec7b18e6128402fb44865333f59bece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:55.742503 26248 raft_consensus.cc:515] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.743777 26246 raft_consensus.cc:2804] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:55.744302 26246 raft_consensus.cc:493] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:55.744665 26246 raft_consensus.cc:3060] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.746096 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d38135a9654f0abdb0bdcfd4237913" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
W20260709 13:23:55.747874 26015 leader_election.cc:343] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.749506 26248 leader_election.cc:290] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Requested vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:55.751322 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e225ed8fa1204dd2a51e8bf31d03dd50" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:23:55.751401 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d38135a9654f0abdb0bdcfd4237913" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:55.753659 26200 raft_consensus.cc:3060] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.758116 26241 tablet_bootstrap.cc:492] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:55.758738 26241 ts_tablet_manager.cc:1403] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.003s
I20260709 13:23:55.762190 26200 raft_consensus.cc:2468] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:23:55.763557 26015 leader_election.cc:304] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:23:55.764824 26248 raft_consensus.cc:2804] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:55.735234 26240 tablet_bootstrap.cc:492] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:55.765333 26248 raft_consensus.cc:697] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Leader. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:23:55.765573 26240 ts_tablet_manager.cc:1403] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.076s	user 0.006s	sys 0.008s
I20260709 13:23:55.766273 26248 consensus_queue.cc:237] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.769248 26240 raft_consensus.cc:359] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.770345 26240 raft_consensus.cc:385] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.770260 26246 raft_consensus.cc:515] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.771220 26240 raft_consensus.cc:740] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.772785 26240 consensus_queue.cc:260] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
W20260709 13:23:55.770495 26164 leader_election.cc:343] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.774336 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e225ed8fa1204dd2a51e8bf31d03dd50" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:23:55.775048 26050 raft_consensus.cc:3060] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.776679 26242 tablet_bootstrap.cc:492] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:55.777297 26242 ts_tablet_manager.cc:1403] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.023s
I20260709 13:23:55.778575 26246 leader_election.cc:290] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:23:55.777442 26241 raft_consensus.cc:359] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.781541 26241 raft_consensus.cc:385] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.781849 26241 raft_consensus.cc:740] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.782544 26241 consensus_queue.cc:260] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.783565 26050 raft_consensus.cc:2468] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 1.
I20260709 13:23:55.783294 26242 raft_consensus.cc:359] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.776868 26240 ts_tablet_manager.cc:1434] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:23:55.784192 26242 raft_consensus.cc:385] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.784741 26242 raft_consensus.cc:740] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.784749 26241 ts_tablet_manager.cc:1434] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:23:55.785468 26240 tablet_bootstrap.cc:492] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:55.785718 26242 consensus_queue.cc:260] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.786757 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e225ed8fa1204dd2a51e8bf31d03dd50" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:23:55.788335 26242 ts_tablet_manager.cc:1434] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
W20260709 13:23:55.788475 26164 leader_election.cc:343] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.789608 26242 tablet_bootstrap.cc:492] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:55.789641 26163 leader_election.cc:304] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:23:55.791075 26246 raft_consensus.cc:2804] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:55.791594 26246 raft_consensus.cc:697] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Becoming Leader. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:23:55.792445 26246 consensus_queue.cc:237] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.793464 26240 tablet_bootstrap.cc:654] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.799657 26242 tablet_bootstrap.cc:654] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.805210 26240 tablet_bootstrap.cc:492] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:55.805822 26240 ts_tablet_manager.cc:1403] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.003s
I20260709 13:23:55.810132 25949 catalog_manager.cc:5697] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:55.811385 26240 raft_consensus.cc:359] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.812219 26240 raft_consensus.cc:385] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.812532 26240 raft_consensus.cc:740] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.812618 26242 tablet_bootstrap.cc:492] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:55.813388 26240 consensus_queue.cc:260] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.813930 26242 ts_tablet_manager.cc:1403] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.003s
I20260709 13:23:55.815999 26240 ts_tablet_manager.cc:1434] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:23:55.817073 26240 tablet_bootstrap.cc:492] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:55.817358 26242 raft_consensus.cc:359] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.818246 26242 raft_consensus.cc:385] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.818576 26242 raft_consensus.cc:740] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.818967 25946 catalog_manager.cc:5697] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc reported cstate change: term changed from 0 to 1, leader changed from <none> to d55319a034b9440882722bc321b6c4dc (127.12.208.131). New cstate: current_term: 1 leader_uuid: "d55319a034b9440882722bc321b6c4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:55.819510 26242 consensus_queue.cc:260] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.822644 26242 ts_tablet_manager.cc:1434] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:23:55.823833 26242 tablet_bootstrap.cc:492] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:55.824791 26240 tablet_bootstrap.cc:654] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.828088 26248 raft_consensus.cc:493] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:55.828681 26248 raft_consensus.cc:515] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.831122 26248 leader_election.cc:290] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:55.831396 26242 tablet_bootstrap.cc:654] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.833658 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:23:55.834441 26126 raft_consensus.cc:2468] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:23:55.835572 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:55.836331 26200 raft_consensus.cc:2468] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:23:55.839143 26015 leader_election.cc:304] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:55.842226 26246 raft_consensus.cc:493] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:55.843075 26246 raft_consensus.cc:515] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.844013 26240 tablet_bootstrap.cc:492] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:55.844646 26240 ts_tablet_manager.cc:1403] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.012s
I20260709 13:23:55.847223 26240 raft_consensus.cc:359] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.847306 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7f9b500a5e45dea9d6c7c729c903b0" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:23:55.847836 26240 raft_consensus.cc:385] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.848559 26240 raft_consensus.cc:740] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.848685 26246 leader_election.cc:290] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:23:55.849444 26248 raft_consensus.cc:2804] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:55.849906 26248 raft_consensus.cc:493] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:55.850268 26248 raft_consensus.cc:3060] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.850082 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7f9b500a5e45dea9d6c7c729c903b0" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
W20260709 13:23:55.852056 26164 leader_election.cc:343] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.852555 26240 consensus_queue.cc:260] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.854024 26050 raft_consensus.cc:2468] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 0.
I20260709 13:23:55.855389 25948 catalog_manager.cc:5697] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece reported cstate change: term changed from 0 to 1, leader changed from <none> to eec7b18e6128402fb44865333f59bece (127.12.208.129). New cstate: current_term: 1 leader_uuid: "eec7b18e6128402fb44865333f59bece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:55.856693 26163 leader_election.cc:304] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:23:55.858197 26248 raft_consensus.cc:515] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.858785 26246 raft_consensus.cc:2804] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:55.859378 26246 raft_consensus.cc:493] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:55.860107 26246 raft_consensus.cc:3060] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.860355 26248 leader_election.cc:290] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Requested vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:55.865979 26240 ts_tablet_manager.cc:1434] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.002s
I20260709 13:23:55.867058 26240 tablet_bootstrap.cc:492] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:55.869423 26242 tablet_bootstrap.cc:492] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:55.870137 26242 ts_tablet_manager.cc:1403] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.047s	user 0.030s	sys 0.006s
I20260709 13:23:55.872637 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:55.872423 26246 raft_consensus.cc:515] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.873133 26240 tablet_bootstrap.cc:654] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.873443 26200 raft_consensus.cc:3060] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.873943 26242 raft_consensus.cc:359] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.874758 26242 raft_consensus.cc:385] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.875063 26242 raft_consensus.cc:740] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.875874 26242 consensus_queue.cc:260] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.876379 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7f9b500a5e45dea9d6c7c729c903b0" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:23:55.877164 26050 raft_consensus.cc:3060] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.878317 26242 ts_tablet_manager.cc:1434] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:55.879518 26242 tablet_bootstrap.cc:492] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:55.880820 26268 raft_consensus.cc:493] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:55.881335 26268 raft_consensus.cc:515] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.881711 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:23:55.882469 26126 raft_consensus.cc:3060] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.883791 26268 leader_election.cc:290] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:55.884613 26049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910cec7145844e7aa2700e4bb54a3bc7" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:23:55.885329 26049 raft_consensus.cc:2468] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 0.
I20260709 13:23:55.885885 26242 tablet_bootstrap.cc:654] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.887130 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910cec7145844e7aa2700e4bb54a3bc7" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:55.887810 26199 raft_consensus.cc:2468] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 0.
I20260709 13:23:55.890305 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7f9b500a5e45dea9d6c7c729c903b0" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:23:55.890307 26089 leader_election.cc:304] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:55.893321 26268 raft_consensus.cc:2804] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:55.893896 26268 raft_consensus.cc:493] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:55.895025 26268 raft_consensus.cc:3060] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:55.895063 26164 leader_election.cc:343] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:55.896265 26246 leader_election.cc:290] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:23:55.899106 26050 raft_consensus.cc:2468] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 1.
I20260709 13:23:55.901101 26163 leader_election.cc:304] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:23:55.902907 26246 raft_consensus.cc:2804] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:55.904814 26246 raft_consensus.cc:697] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Becoming Leader. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:23:55.906186 26246 consensus_queue.cc:237] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.917934 26240 tablet_bootstrap.cc:492] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:55.918628 26240 ts_tablet_manager.cc:1403] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.016s
I20260709 13:23:55.918705 26268 raft_consensus.cc:515] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.921707 26240 raft_consensus.cc:359] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.922565 26240 raft_consensus.cc:385] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.922909 26240 raft_consensus.cc:740] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.923256 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910cec7145844e7aa2700e4bb54a3bc7" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:23:55.924294 26050 raft_consensus.cc:3060] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.923799 26240 consensus_queue.cc:260] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.929484 26240 ts_tablet_manager.cc:1434] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:23:55.931191 26268 leader_election.cc:290] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:55.930951 25946 catalog_manager.cc:5697] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc reported cstate change: term changed from 0 to 1, leader changed from <none> to d55319a034b9440882722bc321b6c4dc (127.12.208.131). New cstate: current_term: 1 leader_uuid: "d55319a034b9440882722bc321b6c4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:55.934787 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910cec7145844e7aa2700e4bb54a3bc7" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:55.935577 26199 raft_consensus.cc:3060] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.943871 26199 raft_consensus.cc:2468] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 1.
I20260709 13:23:55.944566 26200 raft_consensus.cc:2468] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:23:55.945587 26090 leader_election.cc:304] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc; no voters: 
I20260709 13:23:55.948643 26268 raft_consensus.cc:2804] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:55.949011 26015 leader_election.cc:304] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:55.949985 26248 raft_consensus.cc:2804] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:55.950558 26248 raft_consensus.cc:697] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Leader. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:23:55.949956 26268 raft_consensus.cc:697] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 LEADER]: Becoming Leader. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Running, Role: LEADER
I20260709 13:23:55.951321 26126 raft_consensus.cc:2468] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:23:55.951383 26248 consensus_queue.cc:237] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.951854 26268 consensus_queue.cc:237] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.953552 26242 tablet_bootstrap.cc:492] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:55.954051 26242 ts_tablet_manager.cc:1403] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.075s	user 0.031s	sys 0.036s
I20260709 13:23:55.947438 26050 raft_consensus.cc:2468] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 1.
I20260709 13:23:55.956190 26242 raft_consensus.cc:359] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.956857 26242 raft_consensus.cc:385] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.957122 26242 raft_consensus.cc:740] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.957832 26242 consensus_queue.cc:260] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.959455 26242 ts_tablet_manager.cc:1434] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:55.960352 26242 tablet_bootstrap.cc:492] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:55.964749 26242 tablet_bootstrap.cc:654] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:55.966142 26268 raft_consensus.cc:493] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:55.966737 26268 raft_consensus.cc:515] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.969777 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7f9b500a5e45dea9d6c7c729c903b0" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:23:55.969995 26242 tablet_bootstrap.cc:492] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:55.970590 26050 raft_consensus.cc:2393] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in current term 1: Already voted for candidate d55319a034b9440882722bc321b6c4dc in this term.
I20260709 13:23:55.971441 26242 ts_tablet_manager.cc:1403] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:23:55.973989 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7f9b500a5e45dea9d6c7c729c903b0" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:55.974066 25949 catalog_manager.cc:5697] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece reported cstate change: term changed from 0 to 1, leader changed from <none> to eec7b18e6128402fb44865333f59bece (127.12.208.129). New cstate: current_term: 1 leader_uuid: "eec7b18e6128402fb44865333f59bece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:55.976022 26090 leader_election.cc:304] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4; no voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece
I20260709 13:23:55.976951 26247 raft_consensus.cc:3060] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:55.974176 25946 catalog_manager.cc:5697] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:55.977773 26242 raft_consensus.cc:359] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.978670 26242 raft_consensus.cc:385] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:55.979004 26242 raft_consensus.cc:740] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:55.979753 26242 consensus_queue.cc:260] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:55.974035 26268 leader_election.cc:290] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:55.984625 26247 raft_consensus.cc:2749] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:55.988940 26242 ts_tablet_manager.cc:1434] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.006s
I20260709 13:23:56.007341 26299 raft_consensus.cc:493] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:56.007930 26299 raft_consensus.cc:515] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.009692 26299 leader_election.cc:290] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:56.010986 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2cbc4350464c9996fc4b0ecb93229e" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:23:56.011078 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2cbc4350464c9996fc4b0ecb93229e" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:56.011806 26050 raft_consensus.cc:2468] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 0.
I20260709 13:23:56.011912 26200 raft_consensus.cc:2468] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 0.
I20260709 13:23:56.013052 26089 leader_election.cc:304] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:56.014163 26299 raft_consensus.cc:2804] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:56.014492 26299 raft_consensus.cc:493] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:56.014797 26299 raft_consensus.cc:3060] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:56.020222 26299 raft_consensus.cc:515] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.022024 26299 leader_election.cc:290] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:56.022967 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2cbc4350464c9996fc4b0ecb93229e" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:23:56.023105 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2cbc4350464c9996fc4b0ecb93229e" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:56.023566 26050 raft_consensus.cc:3060] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:56.023727 26200 raft_consensus.cc:3060] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:56.029165 26200 raft_consensus.cc:2468] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 1.
I20260709 13:23:56.029397 26050 raft_consensus.cc:2468] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 1.
I20260709 13:23:56.030360 26090 leader_election.cc:304] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc; no voters: 
I20260709 13:23:56.031244 26299 raft_consensus.cc:2804] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:56.031663 26299 raft_consensus.cc:697] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 LEADER]: Becoming Leader. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Running, Role: LEADER
I20260709 13:23:56.032390 26299 consensus_queue.cc:237] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.039660 25946 catalog_manager.cc:5697] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130). New cstate: current_term: 1 leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:56.130492 26248 consensus_queue.cc:1048] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.136034 26299 raft_consensus.cc:493] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:56.136651 26299 raft_consensus.cc:515] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.140568 26299 leader_election.cc:290] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:56.140836 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d38135a9654f0abdb0bdcfd4237913" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:23:56.142112 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08d38135a9654f0abdb0bdcfd4237913" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:56.142828 26199 raft_consensus.cc:2393] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in current term 1: Already voted for candidate eec7b18e6128402fb44865333f59bece in this term.
I20260709 13:23:56.143572 26248 consensus_queue.cc:1048] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.144095 26090 leader_election.cc:304] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4; no voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece
I20260709 13:23:56.145018 26299 raft_consensus.cc:3060] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:56.150560 26247 raft_consensus.cc:493] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:56.151243 26247 raft_consensus.cc:515] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.153503 26247 leader_election.cc:290] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:56.155507 26299 raft_consensus.cc:2749] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:56.156054 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3d976451f843b4ac6f6f21690ae17f" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:56.159618 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3d976451f843b4ac6f6f21690ae17f" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:23:56.160493 26050 raft_consensus.cc:2393] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in current term 1: Already voted for candidate d55319a034b9440882722bc321b6c4dc in this term.
I20260709 13:23:56.161729 26089 leader_election.cc:304] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4; no voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece
I20260709 13:23:56.162541 26299 raft_consensus.cc:3060] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:56.168526 26299 raft_consensus.cc:2749] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:56.204638 26246 consensus_queue.cc:1048] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.215756 26246 consensus_queue.cc:1048] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.225113 26248 consensus_queue.cc:1048] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.241554 26274 consensus_queue.cc:1048] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.256706 26274 raft_consensus.cc:493] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:56.257256 26274 raft_consensus.cc:515] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.260301 26274 leader_election.cc:290] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:56.262565 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:56.263489 26199 raft_consensus.cc:2393] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eec7b18e6128402fb44865333f59bece in current term 1: Already voted for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in this term.
I20260709 13:23:56.262441 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:23:56.265058 26015 leader_election.cc:304] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc
I20260709 13:23:56.265879 26274 raft_consensus.cc:3060] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:56.271994 26199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b7f9b500a5e45dea9d6c7c729c903b0"
dest_uuid: "d55319a034b9440882722bc321b6c4dc"
mode: GRACEFUL
new_leader_uuid: "eec7b18e6128402fb44865333f59bece"
 from {username='slave'} at 127.0.0.1:44786
I20260709 13:23:56.272756 26199 raft_consensus.cc:606] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Received request to transfer leadership to TS eec7b18e6128402fb44865333f59bece
I20260709 13:23:56.272953 26274 raft_consensus.cc:2749] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:56.275009 26299 consensus_queue.cc:1048] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.291278 26126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08"
dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
mode: GRACEFUL
new_leader_uuid: "eec7b18e6128402fb44865333f59bece"
 from {username='slave'} at 127.0.0.1:49654
I20260709 13:23:56.291960 26126 raft_consensus.cc:606] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 LEADER]: Received request to transfer leadership to TS eec7b18e6128402fb44865333f59bece
I20260709 13:23:56.294593 26268 consensus_queue.cc:1048] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.316519 26050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54"
dest_uuid: "eec7b18e6128402fb44865333f59bece"
mode: GRACEFUL
new_leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:44936
I20260709 13:23:56.317106 26050 raft_consensus.cc:606] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Received request to transfer leadership to TS 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:23:56.322819 26199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb3d976451f843b4ac6f6f21690ae17f"
dest_uuid: "d55319a034b9440882722bc321b6c4dc"
mode: GRACEFUL
new_leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:44786
I20260709 13:23:56.323386 26199 raft_consensus.cc:606] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Received request to transfer leadership to TS 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:23:56.344980 26307 consensus_queue.cc:1048] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.356151 26246 consensus_queue.cc:1048] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.364699 26246 raft_consensus.cc:993] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc: : Instructing follower eec7b18e6128402fb44865333f59bece to start an election
I20260709 13:23:56.365238 26276 raft_consensus.cc:1081] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Signalling peer eec7b18e6128402fb44865333f59bece to start an election
I20260709 13:23:56.366950 26050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b7f9b500a5e45dea9d6c7c729c903b0"
dest_uuid: "eec7b18e6128402fb44865333f59bece"
 from {username='slave'} at 127.0.0.1:44912
I20260709 13:23:56.367697 26050 raft_consensus.cc:493] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:56.368206 26050 raft_consensus.cc:3060] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.374181 26050 raft_consensus.cc:515] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.376710 26050 leader_election.cc:290] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 2 election: Requested vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:56.377910 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7f9b500a5e45dea9d6c7c729c903b0" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:56.377933 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b7f9b500a5e45dea9d6c7c729c903b0" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:23:56.378650 26199 raft_consensus.cc:3055] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:56.379222 26199 raft_consensus.cc:740] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:23:56.379247 26126 raft_consensus.cc:3060] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.380227 26199 consensus_queue.cc:260] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.381628 26199 raft_consensus.cc:3060] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.381870 26125 raft_consensus.cc:3060] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:56.386457 26276 consensus_queue.cc:1048] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:56.391853 26199 raft_consensus.cc:2468] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 2.
I20260709 13:23:56.391789 26126 raft_consensus.cc:2468] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 2.
I20260709 13:23:56.393335 26276 consensus_queue.cc:1048] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:56.394299 26015 leader_election.cc:304] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:56.395509 26274 raft_consensus.cc:2804] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:56.396057 26274 raft_consensus.cc:697] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 2 LEADER]: Becoming Leader. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:23:56.396975 26274 consensus_queue.cc:237] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.408259 25948 catalog_manager.cc:5697] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece reported cstate change: term changed from 1 to 2, leader changed from d55319a034b9440882722bc321b6c4dc (127.12.208.131) to eec7b18e6128402fb44865333f59bece (127.12.208.129). New cstate: current_term: 2 leader_uuid: "eec7b18e6128402fb44865333f59bece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:56.425901 26268 consensus_queue.cc:1048] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.438876 26299 consensus_queue.cc:1048] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.486119 26274 consensus_queue.cc:1048] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.497804 26271 consensus_queue.cc:1048] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.506032 26271 raft_consensus.cc:993] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece: : Instructing follower 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:23:56.506614 26324 raft_consensus.cc:1081] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Signalling peer 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:23:56.508320 26125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54"
dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:49634
I20260709 13:23:56.508888 26125 raft_consensus.cc:493] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:56.509205 26125 raft_consensus.cc:3060] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.514562 26125 raft_consensus.cc:515] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.517020 26125 leader_election.cc:290] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:56.517518 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:23:56.517747 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:56.518340 26050 raft_consensus.cc:3055] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:56.518580 26199 raft_consensus.cc:3060] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.518759 26050 raft_consensus.cc:740] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:23:56.519711 26050 consensus_queue.cc:260] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.521130 26050 raft_consensus.cc:3060] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.524716 26199 raft_consensus.cc:2468] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:23:56.526008 26090 leader_election.cc:304] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc; no voters: 
I20260709 13:23:56.526786 26299 raft_consensus.cc:2804] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:56.527268 26299 raft_consensus.cc:697] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Running, Role: LEADER
I20260709 13:23:56.527521 26050 raft_consensus.cc:2468] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:23:56.527978 26299 consensus_queue.cc:237] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.534801 26299 consensus_queue.cc:1048] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:56.535570 25949 catalog_manager.cc:5697] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 reported cstate change: term changed from 1 to 2, leader changed from eec7b18e6128402fb44865333f59bece (127.12.208.129) to 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:56.550130 26327 consensus_queue.cc:1048] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:23:56.696236 26307 raft_consensus.cc:993] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc: : Instructing follower 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:23:56.696815 26246 raft_consensus.cc:1081] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Signalling peer 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:23:56.699570 26125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb3d976451f843b4ac6f6f21690ae17f"
dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:49640
I20260709 13:23:56.700174 26125 raft_consensus.cc:493] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:56.700562 26125 raft_consensus.cc:3060] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.708472 26125 raft_consensus.cc:515] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.710383 26125 leader_election.cc:290] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:56.711694 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3d976451f843b4ac6f6f21690ae17f" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:23:56.711565 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3d976451f843b4ac6f6f21690ae17f" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:56.712595 26050 raft_consensus.cc:3060] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.712657 26199 raft_consensus.cc:3055] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:56.713131 26199 raft_consensus.cc:740] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:23:56.714077 26199 consensus_queue.cc:260] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.715382 26199 raft_consensus.cc:3060] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.721267 26050 raft_consensus.cc:2468] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:23:56.722930 26199 raft_consensus.cc:2468] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:23:56.722909 26089 leader_election.cc:304] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:56.724157 26327 raft_consensus.cc:2804] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:56.724561 26327 raft_consensus.cc:697] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Running, Role: LEADER
I20260709 13:23:56.725239 26327 consensus_queue.cc:237] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.732198 25949 catalog_manager.cc:5697] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 reported cstate change: term changed from 1 to 2, leader changed from d55319a034b9440882722bc321b6c4dc (127.12.208.131) to 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:56.757699 26299 raft_consensus.cc:993] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4: : Instructing follower eec7b18e6128402fb44865333f59bece to start an election
I20260709 13:23:56.758242 26327 raft_consensus.cc:1081] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 LEADER]: Signalling peer eec7b18e6128402fb44865333f59bece to start an election
I20260709 13:23:56.759954 26050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08"
dest_uuid: "eec7b18e6128402fb44865333f59bece"
 from {username='slave'} at 127.0.0.1:44928
I20260709 13:23:56.760492 26050 raft_consensus.cc:493] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:56.760865 26050 raft_consensus.cc:3060] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.766844 26050 raft_consensus.cc:515] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.768762 26050 leader_election.cc:290] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 2 election: Requested vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:56.769714 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:23:56.770010 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:56.770587 26199 raft_consensus.cc:3060] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.770596 26125 raft_consensus.cc:3055] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:56.771207 26125 raft_consensus.cc:740] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Running, Role: LEADER
I20260709 13:23:56.772290 26125 consensus_queue.cc:260] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.773644 26125 raft_consensus.cc:3060] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:56.778882 26199 raft_consensus.cc:2468] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 2.
I20260709 13:23:56.780364 26015 leader_election.cc:304] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:56.781095 26125 raft_consensus.cc:2468] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 2.
I20260709 13:23:56.781193 26324 raft_consensus.cc:2804] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:56.781985 26324 raft_consensus.cc:697] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 2 LEADER]: Becoming Leader. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:23:56.782812 26324 consensus_queue.cc:237] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:56.789561 25949 catalog_manager.cc:5697] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece reported cstate change: term changed from 1 to 2, leader changed from 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130) to eec7b18e6128402fb44865333f59bece (127.12.208.129). New cstate: current_term: 2 leader_uuid: "eec7b18e6128402fb44865333f59bece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:56.817371 26199 raft_consensus.cc:1275] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Refusing update from remote peer eec7b18e6128402fb44865333f59bece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:56.818924 26324 consensus_queue.cc:1048] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:56.829492 26126 raft_consensus.cc:1275] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Refusing update from remote peer eec7b18e6128402fb44865333f59bece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:56.831163 26324 consensus_queue.cc:1048] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:56.989670 26199 raft_consensus.cc:1275] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:56.993613 26327 consensus_queue.cc:1048] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:57.016319 26050 raft_consensus.cc:1275] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:57.018461 26327 consensus_queue.cc:1048] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:57.196722 26199 raft_consensus.cc:1275] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Refusing update from remote peer eec7b18e6128402fb44865333f59bece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:57.199115 26324 consensus_queue.cc:1048] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:57.211628 26126 raft_consensus.cc:1275] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Refusing update from remote peer eec7b18e6128402fb44865333f59bece: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:57.213855 26324 consensus_queue.cc:1048] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:57.262135 26050 raft_consensus.cc:1275] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:57.264299 26327 consensus_queue.cc:1048] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:57.276427 26199 raft_consensus.cc:1275] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:57.278940 26327 consensus_queue.cc:1048] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.364694 25946 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36198:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:59.368017 25946 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:59.427294 26038 tablet_service.cc:1511] Processing CreateTablet for tablet 81f5c6c9d2554e1aa7e6a5392a34f0f2 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:59.428802 26108 tablet_service.cc:1511] Processing CreateTablet for tablet 81f5c6c9d2554e1aa7e6a5392a34f0f2 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:59.430634 26108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f5c6c9d2554e1aa7e6a5392a34f0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.431278 26183 tablet_service.cc:1511] Processing CreateTablet for tablet 81f5c6c9d2554e1aa7e6a5392a34f0f2 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:59.431764 26039 tablet_service.cc:1511] Processing CreateTablet for tablet 4729e5bf9e774735b3c2244f4494f7fa (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:59.434892 26114 tablet_service.cc:1511] Processing CreateTablet for tablet 4729e5bf9e774735b3c2244f4494f7fa (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:59.435889 26188 tablet_service.cc:1511] Processing CreateTablet for tablet 4729e5bf9e774735b3c2244f4494f7fa (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:59.436533 26114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4729e5bf9e774735b3c2244f4494f7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.433280 26183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f5c6c9d2554e1aa7e6a5392a34f0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.438639 26188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4729e5bf9e774735b3c2244f4494f7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.442224 26036 tablet_service.cc:1511] Processing CreateTablet for tablet c2b24e5d3b424a87988cc14649cb9788 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:59.429387 26038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f5c6c9d2554e1aa7e6a5392a34f0f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.444685 26115 tablet_service.cc:1511] Processing CreateTablet for tablet c2b24e5d3b424a87988cc14649cb9788 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:59.446030 26036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b24e5d3b424a87988cc14649cb9788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.446498 26115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b24e5d3b424a87988cc14649cb9788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.450246 26039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4729e5bf9e774735b3c2244f4494f7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.459954 26037 tablet_service.cc:1511] Processing CreateTablet for tablet 5301f01783194b9491c77a347b6be610 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:59.461541 26037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5301f01783194b9491c77a347b6be610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.464097 26041 tablet_service.cc:1511] Processing CreateTablet for tablet cef3019ab907487cb989b3efba3b0c77 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:59.470253 26190 tablet_service.cc:1511] Processing CreateTablet for tablet c2b24e5d3b424a87988cc14649cb9788 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:59.471946 26190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b24e5d3b424a87988cc14649cb9788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.474272 26111 tablet_service.cc:1511] Processing CreateTablet for tablet 5301f01783194b9491c77a347b6be610 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:59.475934 26111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5301f01783194b9491c77a347b6be610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.478255 26116 tablet_service.cc:1511] Processing CreateTablet for tablet cef3019ab907487cb989b3efba3b0c77 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:59.479828 26116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef3019ab907487cb989b3efba3b0c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.487648 26040 tablet_service.cc:1511] Processing CreateTablet for tablet 6387eb6ba2e44184b62088cf10d32c9b (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:59.491195 26035 tablet_service.cc:1511] Processing CreateTablet for tablet 37fdeac3318a480d9ab250244e190248 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:59.496696 26112 tablet_service.cc:1511] Processing CreateTablet for tablet 4afb32fab6c54886841869cdc5aeab1e (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:59.507133 26189 tablet_service.cc:1511] Processing CreateTablet for tablet 4afb32fab6c54886841869cdc5aeab1e (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:59.507498 26185 tablet_service.cc:1511] Processing CreateTablet for tablet 37fdeac3318a480d9ab250244e190248 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:59.508015 26112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afb32fab6c54886841869cdc5aeab1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.508818 26189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afb32fab6c54886841869cdc5aeab1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.509596 26185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fdeac3318a480d9ab250244e190248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.511178 26033 tablet_service.cc:1511] Processing CreateTablet for tablet 53cae0f3abde4e8e84ee34b6bebe1e22 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:59.485246 26034 tablet_service.cc:1511] Processing CreateTablet for tablet 4afb32fab6c54886841869cdc5aeab1e (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:59.512894 26033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53cae0f3abde4e8e84ee34b6bebe1e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.513715 26034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afb32fab6c54886841869cdc5aeab1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.504676 26184 tablet_service.cc:1511] Processing CreateTablet for tablet cef3019ab907487cb989b3efba3b0c77 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:59.516839 26184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef3019ab907487cb989b3efba3b0c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.505136 26187 tablet_service.cc:1511] Processing CreateTablet for tablet 5301f01783194b9491c77a347b6be610 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:59.518667 26187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5301f01783194b9491c77a347b6be610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.522188 26041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef3019ab907487cb989b3efba3b0c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.523559 26343 tablet_bootstrap.cc:492] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:59.499734 26110 tablet_service.cc:1511] Processing CreateTablet for tablet 37fdeac3318a480d9ab250244e190248 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:59.534025 26110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fdeac3318a480d9ab250244e190248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.534706 26108 tablet_service.cc:1511] Processing CreateTablet for tablet 6387eb6ba2e44184b62088cf10d32c9b (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:59.530393 26113 tablet_service.cc:1511] Processing CreateTablet for tablet 53cae0f3abde4e8e84ee34b6bebe1e22 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:59.536754 26113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53cae0f3abde4e8e84ee34b6bebe1e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.531535 26035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fdeac3318a480d9ab250244e190248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.554260 26344 tablet_bootstrap.cc:492] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:59.568514 26188 tablet_service.cc:1511] Processing CreateTablet for tablet 6387eb6ba2e44184b62088cf10d32c9b (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:59.568748 26040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6387eb6ba2e44184b62088cf10d32c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.571698 26186 tablet_service.cc:1511] Processing CreateTablet for tablet 53cae0f3abde4e8e84ee34b6bebe1e22 (DEFAULT_TABLE table=soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:59.573312 26186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53cae0f3abde4e8e84ee34b6bebe1e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.575314 26188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6387eb6ba2e44184b62088cf10d32c9b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:23:59.578513 25997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:59.551930 26108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6387eb6ba2e44184b62088cf10d32c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:59.586280 26345 tablet_bootstrap.cc:492] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:59.645273 26343 tablet_bootstrap.cc:654] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.646793 26344 tablet_bootstrap.cc:654] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.693481 26344 tablet_bootstrap.cc:492] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:59.694141 26344 ts_tablet_manager.cc:1403] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.140s	user 0.010s	sys 0.009s
I20260709 13:23:59.698377 26345 tablet_bootstrap.cc:654] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.700562 26344 raft_consensus.cc:359] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.705771 26344 raft_consensus.cc:385] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.706184 26344 raft_consensus.cc:740] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.707157 26344 consensus_queue.cc:260] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.708290 26343 tablet_bootstrap.cc:492] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:59.708998 26343 ts_tablet_manager.cc:1403] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.186s	user 0.011s	sys 0.018s
I20260709 13:23:59.709707 26344 ts_tablet_manager.cc:1434] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:23:59.708290 26345 tablet_bootstrap.cc:492] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:59.710705 26345 ts_tablet_manager.cc:1403] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.000s
I20260709 13:23:59.711326 26344 tablet_bootstrap.cc:492] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:59.712258 26343 raft_consensus.cc:359] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.713096 26343 raft_consensus.cc:385] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.713400 26343 raft_consensus.cc:740] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.714102 26345 raft_consensus.cc:359] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.714334 26343 consensus_queue.cc:260] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.715032 26345 raft_consensus.cc:385] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.715413 26345 raft_consensus.cc:740] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.716313 26345 consensus_queue.cc:260] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.717531 26343 ts_tablet_manager.cc:1434] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:59.718914 26343 tablet_bootstrap.cc:492] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:59.719290 26345 ts_tablet_manager.cc:1434] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:23:59.720467 26345 tablet_bootstrap.cc:492] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:59.721676 26344 tablet_bootstrap.cc:654] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.725890 26343 tablet_bootstrap.cc:654] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.728577 26345 tablet_bootstrap.cc:654] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.744194 26345 tablet_bootstrap.cc:492] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:59.745064 26345 ts_tablet_manager.cc:1403] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.016s
I20260709 13:23:59.749646 26345 raft_consensus.cc:359] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.750876 26345 raft_consensus.cc:385] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.751353 26345 raft_consensus.cc:740] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.752679 26345 consensus_queue.cc:260] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.756774 26324 raft_consensus.cc:493] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:59.757616 26324 raft_consensus.cc:515] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.762818 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f5c6c9d2554e1aa7e6a5392a34f0f2" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:23:59.763929 26126 raft_consensus.cc:2468] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:23:59.766568 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f5c6c9d2554e1aa7e6a5392a34f0f2" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:59.768888 26324 leader_election.cc:290] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:59.774514 26345 ts_tablet_manager.cc:1434] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:23:59.776917 26345 tablet_bootstrap.cc:492] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
W20260709 13:23:59.783087 26077 tablet.cc:2406] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:23:59.811987 26345 tablet_bootstrap.cc:654] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.815702 26343 tablet_bootstrap.cc:492] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:59.797108 26324 raft_consensus.cc:493] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:59.816399 26343 ts_tablet_manager.cc:1403] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.098s	user 0.036s	sys 0.040s
I20260709 13:23:59.816399 26324 raft_consensus.cc:515] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.819607 26324 leader_election.cc:290] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:59.823900 26015 leader_election.cc:304] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:59.824349 26344 tablet_bootstrap.cc:492] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:59.824997 26344 ts_tablet_manager.cc:1403] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.114s	user 0.035s	sys 0.038s
W20260709 13:23:59.825116 26015 leader_election.cc:343] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:59.826301 26324 raft_consensus.cc:2804] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:59.826678 26324 raft_consensus.cc:493] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:59.827059 26324 raft_consensus.cc:3060] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:59.826870 26343 raft_consensus.cc:359] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.827807 26343 raft_consensus.cc:385] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.828140 26343 raft_consensus.cc:740] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.828601 26344 raft_consensus.cc:359] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.829357 26344 raft_consensus.cc:385] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.828977 26343 consensus_queue.cc:260] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.829639 26344 raft_consensus.cc:740] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.831285 26344 consensus_queue.cc:260] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.832803 26343 ts_tablet_manager.cc:1434] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:23:59.833978 26344 ts_tablet_manager.cc:1434] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:23:59.834111 26343 tablet_bootstrap.cc:492] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:59.835377 26344 tablet_bootstrap.cc:492] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:59.840758 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729e5bf9e774735b3c2244f4494f7fa" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:23:59.841486 26126 raft_consensus.cc:2468] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:23:59.842358 26343 tablet_bootstrap.cc:654] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.842492 26344 tablet_bootstrap.cc:654] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.843842 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729e5bf9e774735b3c2244f4494f7fa" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:23:59.844641 26200 raft_consensus.cc:2468] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:23:59.846343 26015 leader_election.cc:304] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:59.853225 26324 raft_consensus.cc:515] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.855152 26352 raft_consensus.cc:2804] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:59.855907 26352 raft_consensus.cc:493] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:59.856503 26352 raft_consensus.cc:3060] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:59.863225 26345 tablet_bootstrap.cc:492] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:59.863901 26345 ts_tablet_manager.cc:1403] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.087s	user 0.007s	sys 0.008s
I20260709 13:23:59.867239 26345 raft_consensus.cc:359] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.867995 26345 raft_consensus.cc:385] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.868279 26345 raft_consensus.cc:740] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.868894 26352 raft_consensus.cc:515] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.869024 26345 consensus_queue.cc:260] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.854689 26344 tablet_bootstrap.cc:492] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:59.873157 26345 ts_tablet_manager.cc:1434] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:23:59.873989 26324 leader_election.cc:290] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Requested vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:59.874109 26352 leader_election.cc:290] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Requested vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:23:59.877642 26343 tablet_bootstrap.cc:492] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:59.875698 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f5c6c9d2554e1aa7e6a5392a34f0f2" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:23:59.878275 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81f5c6c9d2554e1aa7e6a5392a34f0f2" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:59.874889 26344 ts_tablet_manager.cc:1403] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.011s
I20260709 13:23:59.877698 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729e5bf9e774735b3c2244f4494f7fa" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:23:59.879496 26126 raft_consensus.cc:3060] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:59.879611 26200 raft_consensus.cc:3060] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:59.880029 26125 raft_consensus.cc:3060] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:59.881649 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729e5bf9e774735b3c2244f4494f7fa" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:23:59.882355 26199 raft_consensus.cc:3060] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:59.874336 26345 tablet_bootstrap.cc:492] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:59.889552 26344 raft_consensus.cc:359] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.894008 26344 raft_consensus.cc:385] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.894348 26344 raft_consensus.cc:740] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.893064 26125 raft_consensus.cc:2468] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:23:59.895169 26344 consensus_queue.cc:260] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.896183 26200 raft_consensus.cc:2468] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:23:59.893455 26345 tablet_bootstrap.cc:654] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.896489 26015 leader_election.cc:304] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:59.879573 26343 ts_tablet_manager.cc:1403] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.046s	user 0.031s	sys 0.011s
I20260709 13:23:59.898150 26015 leader_election.cc:304] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:23:59.899341 26353 raft_consensus.cc:2804] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:59.900836 26344 ts_tablet_manager.cc:1434] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:23:59.900583 26343 raft_consensus.cc:359] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.901165 26126 raft_consensus.cc:2468] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:23:59.901427 26343 raft_consensus.cc:385] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.901762 26343 raft_consensus.cc:740] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.902068 26344 tablet_bootstrap.cc:492] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:59.902581 26343 consensus_queue.cc:260] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.903995 26199 raft_consensus.cc:2468] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:23:59.907750 26324 raft_consensus.cc:2804] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:59.916029 26353 raft_consensus.cc:697] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Leader. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:23:59.917567 26353 consensus_queue.cc:237] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.925599 26344 tablet_bootstrap.cc:654] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.926106 26324 raft_consensus.cc:697] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Leader. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:23:59.929095 26343 ts_tablet_manager.cc:1434] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.004s
I20260709 13:23:59.929646 26324 consensus_queue.cc:237] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.930437 26343 tablet_bootstrap.cc:492] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:59.947052 26343 tablet_bootstrap.cc:654] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.952236 26345 tablet_bootstrap.cc:492] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:23:59.952819 26345 ts_tablet_manager.cc:1403] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.009s
I20260709 13:23:59.956557 26345 raft_consensus.cc:359] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.957641 26345 raft_consensus.cc:385] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.958078 26345 raft_consensus.cc:740] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.960299 26345 consensus_queue.cc:260] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.962304 26343 tablet_bootstrap.cc:492] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:23:59.963181 26343 ts_tablet_manager.cc:1403] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.005s
I20260709 13:23:59.965533 26344 tablet_bootstrap.cc:492] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:23:59.966816 26344 ts_tablet_manager.cc:1403] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.011s
I20260709 13:23:59.968149 26343 raft_consensus.cc:359] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.969019 26343 raft_consensus.cc:385] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.969301 26343 raft_consensus.cc:740] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.973670 26344 raft_consensus.cc:359] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.973068 26343 consensus_queue.cc:260] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.974853 26344 raft_consensus.cc:385] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:59.975198 26344 raft_consensus.cc:740] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:23:59.976001 26344 consensus_queue.cc:260] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:23:59.976646 26343 ts_tablet_manager.cc:1434] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:23:59.978034 26343 tablet_bootstrap.cc:492] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:23:59.978498 26344 ts_tablet_manager.cc:1434] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 13:23:59.979646 26344 tablet_bootstrap.cc:492] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:23:59.973241 26345 ts_tablet_manager.cc:1434] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 13:23:59.982467 26345 tablet_bootstrap.cc:492] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:23:59.985174 26343 tablet_bootstrap.cc:654] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.992026 26345 tablet_bootstrap.cc:654] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:59.976063 25946 catalog_manager.cc:5697] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece reported cstate change: term changed from 0 to 1, leader changed from <none> to eec7b18e6128402fb44865333f59bece (127.12.208.129). New cstate: current_term: 1 leader_uuid: "eec7b18e6128402fb44865333f59bece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:00.002218 26344 tablet_bootstrap.cc:654] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.014979 26343 tablet_bootstrap.cc:492] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:24:00.015815 26343 ts_tablet_manager.cc:1403] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.019s
I20260709 13:24:00.020480 26343 raft_consensus.cc:359] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.021365 26345 tablet_bootstrap.cc:492] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:24:00.022148 26345 ts_tablet_manager.cc:1403] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.020s
I20260709 13:24:00.021366 26343 raft_consensus.cc:385] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.023130 26343 raft_consensus.cc:740] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.024152 26343 consensus_queue.cc:260] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.024725 26344 tablet_bootstrap.cc:492] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:24:00.026154 26345 raft_consensus.cc:359] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.025823 26344 ts_tablet_manager.cc:1403] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.019s
I20260709 13:24:00.027163 26343 ts_tablet_manager.cc:1434] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:24:00.028426 26343 tablet_bootstrap.cc:492] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:24:00.030239 26344 raft_consensus.cc:359] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.027168 26345 raft_consensus.cc:385] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.031728 26345 raft_consensus.cc:740] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.032473 26345 consensus_queue.cc:260] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.035028 26345 ts_tablet_manager.cc:1434] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:24:00.035840 26343 tablet_bootstrap.cc:654] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.036681 26345 tablet_bootstrap.cc:492] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:24:00.035777 26344 raft_consensus.cc:385] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.037978 26344 raft_consensus.cc:740] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.038831 26344 consensus_queue.cc:260] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.041502 26344 ts_tablet_manager.cc:1434] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:24:00.044492 26345 tablet_bootstrap.cc:654] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.047422 25948 catalog_manager.cc:5697] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece reported cstate change: term changed from 0 to 1, leader changed from <none> to eec7b18e6128402fb44865333f59bece (127.12.208.129). New cstate: current_term: 1 leader_uuid: "eec7b18e6128402fb44865333f59bece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:00.055300 26353 raft_consensus.cc:493] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.055992 26353 raft_consensus.cc:515] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.058118 26354 raft_consensus.cc:493] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.059273 26344 tablet_bootstrap.cc:492] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:24:00.059005 26354 raft_consensus.cc:515] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.060222 26327 raft_consensus.cc:493] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.060799 26327 raft_consensus.cc:515] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.063135 26327 leader_election.cc:290] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.065114 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b24e5d3b424a87988cc14649cb9788" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:24:00.065907 26125 raft_consensus.cc:2468] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:24:00.066744 26049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b24e5d3b424a87988cc14649cb9788" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:24:00.059710 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b24e5d3b424a87988cc14649cb9788" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:24:00.067509 26049 raft_consensus.cc:2468] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 0.
I20260709 13:24:00.067422 26344 tablet_bootstrap.cc:654] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.065594 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b24e5d3b424a87988cc14649cb9788" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:24:00.058177 26353 leader_election.cc:290] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.068040 26199 raft_consensus.cc:2468] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:24:00.063373 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef3019ab907487cb989b3efba3b0c77" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:24:00.070861 26089 leader_election.cc:304] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:00.072485 26354 leader_election.cc:290] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.074210 26354 raft_consensus.cc:2804] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:00.076337 26354 raft_consensus.cc:493] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:00.076805 26354 raft_consensus.cc:3060] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.077067 26345 tablet_bootstrap.cc:492] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:24:00.077611 26343 tablet_bootstrap.cc:492] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:24:00.078105 26345 ts_tablet_manager.cc:1403] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.042s	user 0.028s	sys 0.005s
I20260709 13:24:00.078362 26343 ts_tablet_manager.cc:1403] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.008s
I20260709 13:24:00.078840 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef3019ab907487cb989b3efba3b0c77" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:24:00.067348 26015 leader_election.cc:304] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:00.080566 26353 raft_consensus.cc:2804] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:00.080928 26353 raft_consensus.cc:493] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:00.081251 26353 raft_consensus.cc:3060] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:24:00.081910 26090 leader_election.cc:343] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:00.081704 26345 raft_consensus.cc:359] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.082614 26345 raft_consensus.cc:385] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:24:00.082631 26089 leader_election.cc:343] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:00.083062 26345 raft_consensus.cc:740] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.083303 26089 leader_election.cc:304] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4; no voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece
I20260709 13:24:00.084252 26327 raft_consensus.cc:2749] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:24:00.085067 26345 consensus_queue.cc:260] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.085983 26343 raft_consensus.cc:359] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.086836 26343 raft_consensus.cc:385] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.087141 26343 raft_consensus.cc:740] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.088011 26345 ts_tablet_manager.cc:1434] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:24:00.088403 26344 tablet_bootstrap.cc:492] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:24:00.089013 26344 ts_tablet_manager.cc:1403] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.007s
I20260709 13:24:00.089186 26345 tablet_bootstrap.cc:492] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:24:00.088057 26343 consensus_queue.cc:260] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.092264 26344 raft_consensus.cc:359] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.093026 26344 raft_consensus.cc:385] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.093312 26344 raft_consensus.cc:740] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.094142 26344 consensus_queue.cc:260] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.096469 26327 raft_consensus.cc:493] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.096863 26345 tablet_bootstrap.cc:654] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.097041 26327 raft_consensus.cc:515] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.101332 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5301f01783194b9491c77a347b6be610" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:24:00.102492 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5301f01783194b9491c77a347b6be610" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
W20260709 13:24:00.104094 26089 leader_election.cc:343] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:24:00.105382 26090 leader_election.cc:343] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:00.105635 26343 ts_tablet_manager.cc:1434] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:24:00.105867 26090 leader_election.cc:304] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4; no voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece
I20260709 13:24:00.106920 26327 leader_election.cc:290] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.107762 26327 raft_consensus.cc:2749] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:24:00.109301 26344 ts_tablet_manager.cc:1434] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:24:00.110136 26343 tablet_bootstrap.cc:492] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:24:00.122015 26344 tablet_bootstrap.cc:492] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:24:00.091177 26353 raft_consensus.cc:515] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.131017 26344 tablet_bootstrap.cc:654] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.135982 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b24e5d3b424a87988cc14649cb9788" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:24:00.136920 26199 raft_consensus.cc:3060] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.141542 26353 leader_election.cc:290] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Requested vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.143601 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b24e5d3b424a87988cc14649cb9788" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:24:00.145361 26354 raft_consensus.cc:515] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.147102 26125 raft_consensus.cc:2393] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eec7b18e6128402fb44865333f59bece in current term 1: Already voted for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in this term.
I20260709 13:24:00.145920 26344 tablet_bootstrap.cc:492] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:24:00.132982 26343 tablet_bootstrap.cc:654] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.147773 26344 ts_tablet_manager.cc:1403] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.007s
I20260709 13:24:00.149060 26354 leader_election.cc:290] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.145718 26199 raft_consensus.cc:2468] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:24:00.149461 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b24e5d3b424a87988cc14649cb9788" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:24:00.150594 26200 raft_consensus.cc:2393] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in current term 1: Already voted for candidate eec7b18e6128402fb44865333f59bece in this term.
I20260709 13:24:00.151135 26246 raft_consensus.cc:493] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.151242 26344 raft_consensus.cc:359] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.152137 26344 raft_consensus.cc:385] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.151803 26246 raft_consensus.cc:515] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.152354 26344 raft_consensus.cc:740] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.153075 26344 consensus_queue.cc:260] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.149139 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b24e5d3b424a87988cc14649cb9788" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:24:00.155375 26015 leader_election.cc:304] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:24:00.156210 26345 tablet_bootstrap.cc:492] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:24:00.157094 26345 ts_tablet_manager.cc:1403] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.068s	user 0.032s	sys 0.027s
I20260709 13:24:00.157238 26050 raft_consensus.cc:2393] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in current term 1: Already voted for candidate eec7b18e6128402fb44865333f59bece in this term.
I20260709 13:24:00.158064 26353 raft_consensus.cc:2804] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:00.159703 26353 raft_consensus.cc:697] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Leader. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:24:00.162735 26345 raft_consensus.cc:359] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.163929 26345 raft_consensus.cc:385] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.164340 26345 raft_consensus.cc:740] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.164266 26089 leader_election.cc:304] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4; no voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece
I20260709 13:24:00.165990 26354 raft_consensus.cc:2749] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:24:00.165867 26345 consensus_queue.cc:260] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.169750 26345 ts_tablet_manager.cc:1434] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:24:00.170533 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afb32fab6c54886841869cdc5aeab1e" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:24:00.171320 26345 tablet_bootstrap.cc:492] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:24:00.160877 26353 consensus_queue.cc:237] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.175828 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afb32fab6c54886841869cdc5aeab1e" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:24:00.176990 26125 raft_consensus.cc:2468] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 0.
I20260709 13:24:00.179530 26164 leader_election.cc:304] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc; no voters: 
I20260709 13:24:00.181694 26246 leader_election.cc:290] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
W20260709 13:24:00.183817 26163 leader_election.cc:343] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:00.182329 26345 tablet_bootstrap.cc:654] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.187844 26246 raft_consensus.cc:2804] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:00.188402 26246 raft_consensus.cc:493] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:00.206142 26345 tablet_bootstrap.cc:492] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:24:00.207157 26345 ts_tablet_manager.cc:1403] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.016s
I20260709 13:24:00.211170 26345 raft_consensus.cc:359] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.212347 26345 raft_consensus.cc:385] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.188751 26246 raft_consensus.cc:3060] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.212774 26345 raft_consensus.cc:740] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.214025 26345 consensus_queue.cc:260] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.217442 26345 ts_tablet_manager.cc:1434] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:24:00.219040 26345 tablet_bootstrap.cc:492] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece: Bootstrap starting.
I20260709 13:24:00.219851 26324 raft_consensus.cc:493] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.220695 26324 raft_consensus.cc:515] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.223884 26324 leader_election.cc:290] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.226137 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fdeac3318a480d9ab250244e190248" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
W20260709 13:24:00.229377 26015 leader_election.cc:343] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:00.230854 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fdeac3318a480d9ab250244e190248" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:24:00.232008 26199 raft_consensus.cc:2468] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:24:00.233893 26015 leader_election.cc:304] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:24:00.235281 26324 raft_consensus.cc:2804] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:00.235821 26324 raft_consensus.cc:493] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:00.236260 26324 raft_consensus.cc:3060] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.242982 25947 catalog_manager.cc:5697] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece reported cstate change: term changed from 0 to 1, leader changed from <none> to eec7b18e6128402fb44865333f59bece (127.12.208.129). New cstate: current_term: 1 leader_uuid: "eec7b18e6128402fb44865333f59bece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:00.247999 26246 raft_consensus.cc:515] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.250936 26344 ts_tablet_manager.cc:1434] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.103s	user 0.043s	sys 0.058s
I20260709 13:24:00.251888 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afb32fab6c54886841869cdc5aeab1e" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:24:00.252604 26344 tablet_bootstrap.cc:492] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
W20260709 13:24:00.253587 26163 leader_election.cc:343] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:00.256820 26345 tablet_bootstrap.cc:654] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.254433 26324 raft_consensus.cc:515] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.261178 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afb32fab6c54886841869cdc5aeab1e" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:24:00.261960 26125 raft_consensus.cc:3060] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.262702 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fdeac3318a480d9ab250244e190248" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
W20260709 13:24:00.264346 26015 leader_election.cc:343] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:00.265530 26344 tablet_bootstrap.cc:654] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.266642 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fdeac3318a480d9ab250244e190248" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:24:00.267274 26199 raft_consensus.cc:3060] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.270581 26125 raft_consensus.cc:2468] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 1.
I20260709 13:24:00.272195 26164 leader_election.cc:304] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc; no voters: eec7b18e6128402fb44865333f59bece
I20260709 13:24:00.273280 26379 raft_consensus.cc:493] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.273753 26379 raft_consensus.cc:515] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.275875 26343 tablet_bootstrap.cc:492] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:24:00.276501 26343 ts_tablet_manager.cc:1403] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.170s	user 0.048s	sys 0.031s
I20260709 13:24:00.276847 26199 raft_consensus.cc:2468] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:24:00.277217 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6387eb6ba2e44184b62088cf10d32c9b" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:24:00.277369 26324 leader_election.cc:290] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Requested vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.277277 26344 tablet_bootstrap.cc:492] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:24:00.279054 26344 ts_tablet_manager.cc:1403] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.007s
I20260709 13:24:00.279800 26015 leader_election.cc:304] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:24:00.278302 26050 raft_consensus.cc:2468] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 0.
I20260709 13:24:00.280674 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6387eb6ba2e44184b62088cf10d32c9b" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:24:00.281170 26324 raft_consensus.cc:2804] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:00.281927 26163 leader_election.cc:304] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:00.278306 26379 leader_election.cc:290] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:24:00.283010 26379 raft_consensus.cc:2804] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:00.282295 26344 raft_consensus.cc:359] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.283259 26380 raft_consensus.cc:2804] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:24:00.283643 26164 leader_election.cc:343] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:00.284088 26345 tablet_bootstrap.cc:492] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece: No bootstrap required, opened a new log
I20260709 13:24:00.283715 26344 raft_consensus.cc:385] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.285526 26344 raft_consensus.cc:740] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.285717 26345 ts_tablet_manager.cc:1403] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.005s
I20260709 13:24:00.284063 26246 leader_election.cc:290] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:24:00.286309 26380 raft_consensus.cc:493] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:00.286748 26380 raft_consensus.cc:3060] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.286549 26344 consensus_queue.cc:260] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.283710 26379 raft_consensus.cc:697] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Becoming Leader. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:24:00.288358 26379 consensus_queue.cc:237] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.288863 26344 ts_tablet_manager.cc:1434] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:24:00.288686 26345 raft_consensus.cc:359] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.289455 26345 raft_consensus.cc:385] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.289772 26345 raft_consensus.cc:740] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.290052 26344 tablet_bootstrap.cc:492] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc: Bootstrap starting.
I20260709 13:24:00.290508 26345 consensus_queue.cc:260] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.281975 26324 raft_consensus.cc:697] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Leader. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:24:00.292973 26345 ts_tablet_manager.cc:1434] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:24:00.279800 26343 raft_consensus.cc:359] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.294009 26343 raft_consensus.cc:385] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.294338 26343 raft_consensus.cc:740] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.292606 26324 consensus_queue.cc:237] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.295693 26380 raft_consensus.cc:515] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.297159 26344 tablet_bootstrap.cc:654] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.295902 26343 consensus_queue.cc:260] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.298717 26380 leader_election.cc:290] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:24:00.299772 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6387eb6ba2e44184b62088cf10d32c9b" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:24:00.300391 26050 raft_consensus.cc:3060] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.300979 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6387eb6ba2e44184b62088cf10d32c9b" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:24:00.302398 26343 ts_tablet_manager.cc:1434] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.002s
I20260709 13:24:00.303710 26343 tablet_bootstrap.cc:492] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
W20260709 13:24:00.303860 26164 leader_election.cc:343] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:00.308723 26050 raft_consensus.cc:2468] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 1.
I20260709 13:24:00.310213 26163 leader_election.cc:304] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:24:00.311581 26380 raft_consensus.cc:2804] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:00.314559 26343 tablet_bootstrap.cc:654] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.316736 26353 consensus_queue.cc:1048] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:00.318383 26380 raft_consensus.cc:697] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Becoming Leader. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:24:00.327136 26380 consensus_queue.cc:237] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.330900 26343 tablet_bootstrap.cc:492] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:24:00.331802 26343 ts_tablet_manager.cc:1403] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.007s
I20260709 13:24:00.336272 26343 raft_consensus.cc:359] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.337334 26343 raft_consensus.cc:385] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.337697 26343 raft_consensus.cc:740] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.348989 26343 consensus_queue.cc:260] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.366106 26343 ts_tablet_manager.cc:1434] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.034s	user 0.021s	sys 0.001s
I20260709 13:24:00.369005 25948 catalog_manager.cc:5697] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece reported cstate change: term changed from 0 to 1, leader changed from <none> to eec7b18e6128402fb44865333f59bece (127.12.208.129). New cstate: current_term: 1 leader_uuid: "eec7b18e6128402fb44865333f59bece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:00.372452 26343 tablet_bootstrap.cc:492] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Bootstrap starting.
I20260709 13:24:00.389609 26343 tablet_bootstrap.cc:654] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:00.390280 26353 raft_consensus.cc:493] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.390856 26353 raft_consensus.cc:515] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.393031 26353 leader_election.cc:290] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.395360 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cae0f3abde4e8e84ee34b6bebe1e22" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:24:00.396742 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cae0f3abde4e8e84ee34b6bebe1e22" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:24:00.397550 26200 raft_consensus.cc:2468] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
W20260709 13:24:00.400029 26015 leader_election.cc:343] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:00.400753 26015 leader_election.cc:304] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:24:00.403838 26354 raft_consensus.cc:493] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.404439 26354 raft_consensus.cc:515] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.408260 26353 raft_consensus.cc:2804] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:00.408758 26353 raft_consensus.cc:493] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:00.409108 26353 raft_consensus.cc:3060] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.410843 26359 consensus_queue.cc:1048] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:00.411597 25948 catalog_manager.cc:5697] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc reported cstate change: term changed from 0 to 1, leader changed from <none> to d55319a034b9440882722bc321b6c4dc (127.12.208.131). New cstate: current_term: 1 leader_uuid: "d55319a034b9440882722bc321b6c4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:00.421012 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6387eb6ba2e44184b62088cf10d32c9b" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:24:00.422322 26050 raft_consensus.cc:2393] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in current term 1: Already voted for candidate d55319a034b9440882722bc321b6c4dc in this term.
I20260709 13:24:00.426685 26354 leader_election.cc:290] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.429592 26200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6387eb6ba2e44184b62088cf10d32c9b" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:24:00.431821 26090 leader_election.cc:304] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4; no voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece
I20260709 13:24:00.434114 26353 raft_consensus.cc:515] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.438894 26375 raft_consensus.cc:3060] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.438033 26324 consensus_queue.cc:1048] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:24:00.455416 26353 leader_election.cc:290] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Requested vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.456228 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cae0f3abde4e8e84ee34b6bebe1e22" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:24:00.457177 26199 raft_consensus.cc:3060] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.461097 26343 tablet_bootstrap.cc:492] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4: No bootstrap required, opened a new log
I20260709 13:24:00.461970 26343 ts_tablet_manager.cc:1403] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent bootstrapping tablet: real 0.090s	user 0.035s	sys 0.042s
I20260709 13:24:00.465448 26343 raft_consensus.cc:359] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.467204 26343 raft_consensus.cc:385] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.467522 26343 raft_consensus.cc:740] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.468436 26343 consensus_queue.cc:260] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.471026 26353 raft_consensus.cc:493] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.471675 26353 raft_consensus.cc:515] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.474139 26353 leader_election.cc:290] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.474416 26343 ts_tablet_manager.cc:1434] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:24:00.478679 26327 raft_consensus.cc:493] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.479455 26327 raft_consensus.cc:515] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.482733 26327 leader_election.cc:290] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.484956 26344 tablet_bootstrap.cc:492] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc: No bootstrap required, opened a new log
I20260709 13:24:00.485670 26344 ts_tablet_manager.cc:1403] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc: Time spent bootstrapping tablet: real 0.196s	user 0.044s	sys 0.064s
I20260709 13:24:00.487293 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cae0f3abde4e8e84ee34b6bebe1e22" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:24:00.488404 26126 raft_consensus.cc:3060] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.489070 26344 raft_consensus.cc:359] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.489903 26344 raft_consensus.cc:385] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:00.490222 26344 raft_consensus.cc:740] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Initialized, Role: FOLLOWER
I20260709 13:24:00.490950 26344 consensus_queue.cc:260] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.492055 26198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fdeac3318a480d9ab250244e190248" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:24:00.492635 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fdeac3318a480d9ab250244e190248" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:24:00.493206 26344 ts_tablet_manager.cc:1434] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:24:00.493417 26198 raft_consensus.cc:2393] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in current term 1: Already voted for candidate eec7b18e6128402fb44865333f59bece in this term.
I20260709 13:24:00.502393 26380 raft_consensus.cc:493] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.502727 26197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afb32fab6c54886841869cdc5aeab1e" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:24:00.503050 26380 raft_consensus.cc:515] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.505089 26380 leader_election.cc:290] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:24:00.505972 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef3019ab907487cb989b3efba3b0c77" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece" is_pre_election: true
I20260709 13:24:00.506736 26050 raft_consensus.cc:2468] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 0.
I20260709 13:24:00.507185 26124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef3019ab907487cb989b3efba3b0c77" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:24:00.508018 26124 raft_consensus.cc:2468] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 0.
I20260709 13:24:00.508111 26163 leader_election.cc:304] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:00.510317 26380 raft_consensus.cc:2804] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:00.510747 26380 raft_consensus.cc:493] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:00.511096 26380 raft_consensus.cc:3060] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.513636 26124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afb32fab6c54886841869cdc5aeab1e" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:24:00.514701 26124 raft_consensus.cc:2393] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eec7b18e6128402fb44865333f59bece in current term 1: Already voted for candidate d55319a034b9440882722bc321b6c4dc in this term.
I20260709 13:24:00.518217 26015 leader_election.cc:304] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eec7b18e6128402fb44865333f59bece; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc
I20260709 13:24:00.520992 26353 raft_consensus.cc:3060] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.525759 26199 raft_consensus.cc:2468] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:24:00.537062 26126 raft_consensus.cc:2468] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:24:00.552175 26375 raft_consensus.cc:2749] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:24:00.564065 26090 leader_election.cc:304] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4; no voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece
I20260709 13:24:00.575783 26393 raft_consensus.cc:493] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:00.576531 26393 raft_consensus.cc:515] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.579106 26393 leader_election.cc:290] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.579855 26375 raft_consensus.cc:3060] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.611491 26375 raft_consensus.cc:2749] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:24:00.589573 25997 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:24:00.626871 26353 raft_consensus.cc:2749] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:24:00.631194 26015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.130:43485, user_credentials={real_user=slave}} blocked reactor thread for 101672us
I20260709 13:24:00.641692 26199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5301f01783194b9491c77a347b6be610" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc" is_pre_election: true
I20260709 13:24:00.642450 26199 raft_consensus.cc:2468] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:24:00.650923 26015 leader_election.cc:304] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:00.652149 26359 raft_consensus.cc:2804] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:00.653115 26380 raft_consensus.cc:515] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.655961 26359 raft_consensus.cc:697] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Leader. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:24:00.657037 26359 consensus_queue.cc:237] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.661550 26015 leader_election.cc:304] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:00.661892 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5301f01783194b9491c77a347b6be610" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" is_pre_election: true
I20260709 13:24:00.662619 26125 raft_consensus.cc:2468] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 0.
I20260709 13:24:00.664013 26324 raft_consensus.cc:2804] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:00.664593 26324 raft_consensus.cc:493] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:00.664399 26393 consensus_queue.cc:1048] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:00.665071 26324 raft_consensus.cc:3060] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.667564 26393 consensus_queue.cc:1048] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:00.673350 26397 consensus_queue.cc:1048] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:00.675191 26324 raft_consensus.cc:515] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.676513 25949 catalog_manager.cc:5697] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc reported cstate change: term changed from 0 to 1, leader changed from <none> to d55319a034b9440882722bc321b6c4dc (127.12.208.131). New cstate: current_term: 1 leader_uuid: "d55319a034b9440882722bc321b6c4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:00.695219 26123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5301f01783194b9491c77a347b6be610" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:24:00.696004 26123 raft_consensus.cc:3060] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.696537 26380 leader_election.cc:290] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:24:00.715556 26324 leader_election.cc:290] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Requested vote from peers 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:00.730139 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef3019ab907487cb989b3efba3b0c77" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:24:00.731063 26050 raft_consensus.cc:3060] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.724503 26123 raft_consensus.cc:2468] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:24:00.736452 26379 consensus_queue.cc:1048] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:00.748565 26246 consensus_queue.cc:1048] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:00.756148 26050 raft_consensus.cc:2468] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 1.
I20260709 13:24:00.758086 26163 leader_election.cc:304] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:00.764653 26246 raft_consensus.cc:2804] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:00.765424 26246 raft_consensus.cc:697] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Becoming Leader. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:24:00.766631 26246 consensus_queue.cc:237] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.775658 26015 leader_election.cc:304] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:00.779510 26396 raft_consensus.cc:2804] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:00.780716 26396 raft_consensus.cc:697] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Leader. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:24:00.781980 26396 consensus_queue.cc:237] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:00.791998 26196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5301f01783194b9491c77a347b6be610" candidate_uuid: "eec7b18e6128402fb44865333f59bece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:24:00.792924 26196 raft_consensus.cc:3060] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.806754 26126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef3019ab907487cb989b3efba3b0c77" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:24:00.807189 26379 consensus_queue.cc:1048] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:00.809568 26126 raft_consensus.cc:3060] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:00.820077 26126 raft_consensus.cc:2468] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 1.
I20260709 13:24:00.829030 26393 consensus_queue.cc:1048] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:00.830276 26196 raft_consensus.cc:2468] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec7b18e6128402fb44865333f59bece in term 1.
I20260709 13:24:00.844154 26406 consensus_queue.cc:1048] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:00.847430 25948 catalog_manager.cc:5697] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece reported cstate change: term changed from 0 to 1, leader changed from <none> to eec7b18e6128402fb44865333f59bece (127.12.208.129). New cstate: current_term: 1 leader_uuid: "eec7b18e6128402fb44865333f59bece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:00.869504 26359 consensus_queue.cc:1048] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:00.879770 25949 catalog_manager.cc:5697] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc reported cstate change: term changed from 0 to 1, leader changed from <none> to d55319a034b9440882722bc321b6c4dc (127.12.208.131). New cstate: current_term: 1 leader_uuid: "d55319a034b9440882722bc321b6c4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:00.902343 25948 catalog_manager.cc:5697] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece reported cstate change: term changed from 0 to 1, leader changed from <none> to eec7b18e6128402fb44865333f59bece (127.12.208.129). New cstate: current_term: 1 leader_uuid: "eec7b18e6128402fb44865333f59bece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:00.987413 26196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cef3019ab907487cb989b3efba3b0c77"
dest_uuid: "d55319a034b9440882722bc321b6c4dc"
mode: GRACEFUL
new_leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:44786
I20260709 13:24:00.988067 26196 raft_consensus.cc:606] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Received request to transfer leadership to TS 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:24:00.993000 26196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4afb32fab6c54886841869cdc5aeab1e"
dest_uuid: "d55319a034b9440882722bc321b6c4dc"
mode: GRACEFUL
new_leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:44786
I20260709 13:24:00.993548 26196 raft_consensus.cc:606] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Received request to transfer leadership to TS 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:24:00.998705 26049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37fdeac3318a480d9ab250244e190248"
dest_uuid: "eec7b18e6128402fb44865333f59bece"
mode: GRACEFUL
new_leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:44936
I20260709 13:24:00.999359 26049 raft_consensus.cc:606] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Received request to transfer leadership to TS 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:24:01.004788 26196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6387eb6ba2e44184b62088cf10d32c9b"
dest_uuid: "d55319a034b9440882722bc321b6c4dc"
mode: GRACEFUL
new_leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:44786
I20260709 13:24:01.005367 26196 raft_consensus.cc:606] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Received request to transfer leadership to TS 8b23e09dfdb041ae842f5dd1f6bb54c4
I20260709 13:24:01.010959 26049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53cae0f3abde4e8e84ee34b6bebe1e22"
dest_uuid: "eec7b18e6128402fb44865333f59bece"
mode: GRACEFUL
new_leader_uuid: "d55319a034b9440882722bc321b6c4dc"
 from {username='slave'} at 127.0.0.1:44936
I20260709 13:24:01.011699 26049 raft_consensus.cc:606] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Received request to transfer leadership to TS d55319a034b9440882722bc321b6c4dc
I20260709 13:24:01.061129 26324 consensus_queue.cc:1048] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:01.068475 26359 raft_consensus.cc:993] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece: : Instructing follower d55319a034b9440882722bc321b6c4dc to start an election
I20260709 13:24:01.069113 26359 raft_consensus.cc:1081] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Signalling peer d55319a034b9440882722bc321b6c4dc to start an election
I20260709 13:24:01.070900 26198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53cae0f3abde4e8e84ee34b6bebe1e22"
dest_uuid: "d55319a034b9440882722bc321b6c4dc"
 from {username='slave'} at 127.0.0.1:44774
I20260709 13:24:01.071672 26198 raft_consensus.cc:493] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:01.072045 26198 raft_consensus.cc:3060] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.074406 26324 consensus_queue.cc:1048] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:01.080734 26198 raft_consensus.cc:515] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.081965 26196 raft_consensus.cc:1240] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Rejecting Update request from peer eec7b18e6128402fb44865333f59bece for earlier term 1. Current term is 2. Ops: []
I20260709 13:24:01.083690 26049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cae0f3abde4e8e84ee34b6bebe1e22" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:24:01.084408 26049 raft_consensus.cc:3055] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:01.084749 26049 raft_consensus.cc:740] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:24:01.085584 26049 consensus_queue.cc:260] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.086153 26198 leader_election.cc:290] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 2 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:24:01.087113 26049 raft_consensus.cc:3060] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.087432 26125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cae0f3abde4e8e84ee34b6bebe1e22" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:24:01.088129 26125 raft_consensus.cc:3060] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:24:01.087504 26353 consensus_queue.cc:1175] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d55319a034b9440882722bc321b6c4dc" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer eec7b18e6128402fb44865333f59bece for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:24:01.094317 26125 raft_consensus.cc:2468] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 2.
I20260709 13:24:01.095676 26164 leader_election.cc:304] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc; no voters: 
I20260709 13:24:01.096040 26049 raft_consensus.cc:2468] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 2.
I20260709 13:24:01.096580 26380 raft_consensus.cc:2804] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:01.097216 26380 raft_consensus.cc:697] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 2 LEADER]: Becoming Leader. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:24:01.098023 26380 consensus_queue.cc:237] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.105289 25947 catalog_manager.cc:5697] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc reported cstate change: term changed from 1 to 2, leader changed from eec7b18e6128402fb44865333f59bece (127.12.208.129) to d55319a034b9440882722bc321b6c4dc (127.12.208.131). New cstate: current_term: 2 leader_uuid: "d55319a034b9440882722bc321b6c4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:01.196657 26380 consensus_queue.cc:1048] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:01.201623 26353 consensus_queue.cc:1048] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:01.210032 26379 consensus_queue.cc:1048] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:01.217294 26396 consensus_queue.cc:1048] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:01.227852 26379 raft_consensus.cc:993] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc: : Instructing follower 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:24:01.228322 26379 raft_consensus.cc:1081] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Signalling peer 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:24:01.230965 26126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cef3019ab907487cb989b3efba3b0c77"
dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:49640
I20260709 13:24:01.231701 26126 raft_consensus.cc:493] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:01.232046 26126 raft_consensus.cc:3060] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.235798 26379 raft_consensus.cc:993] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc: : Instructing follower 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:24:01.236495 26379 raft_consensus.cc:1081] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Signalling peer 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:24:01.238947 26125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6387eb6ba2e44184b62088cf10d32c9b"
dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:49640
I20260709 13:24:01.239550 26125 raft_consensus.cc:493] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:01.239943 26125 raft_consensus.cc:3060] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.240172 26126 raft_consensus.cc:515] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.244616 26126 leader_election.cc:290] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:01.245484 26049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef3019ab907487cb989b3efba3b0c77" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:24:01.246244 26049 raft_consensus.cc:3060] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.246692 26196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef3019ab907487cb989b3efba3b0c77" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:24:01.247247 26196 raft_consensus.cc:3055] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:01.247607 26196 raft_consensus.cc:740] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:24:01.247344 26125 raft_consensus.cc:515] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.249008 26196 consensus_queue.cc:260] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.250404 26196 raft_consensus.cc:3060] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.250831 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6387eb6ba2e44184b62088cf10d32c9b" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:24:01.251209 26125 leader_election.cc:290] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:01.251437 26050 raft_consensus.cc:3060] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.255759 26198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6387eb6ba2e44184b62088cf10d32c9b" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:24:01.256429 26198 raft_consensus.cc:3055] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:01.256799 26198 raft_consensus.cc:740] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:24:01.257725 26198 consensus_queue.cc:260] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.258335 26049 raft_consensus.cc:2468] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:24:01.259235 26198 raft_consensus.cc:3060] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.259975 26089 leader_election.cc:304] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:01.261031 26354 raft_consensus.cc:2804] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:01.261479 26354 raft_consensus.cc:697] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Running, Role: LEADER
I20260709 13:24:01.262955 26196 raft_consensus.cc:2468] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:24:01.265704 26050 raft_consensus.cc:2468] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:24:01.262622 26354 consensus_queue.cc:237] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.267138 26089 leader_election.cc:304] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:01.267961 26375 raft_consensus.cc:2804] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:01.273147 26198 raft_consensus.cc:2468] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:24:01.274735 26375 raft_consensus.cc:697] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Running, Role: LEADER
I20260709 13:24:01.275436 25948 catalog_manager.cc:5697] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 reported cstate change: term changed from 1 to 2, leader changed from d55319a034b9440882722bc321b6c4dc (127.12.208.131) to 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:01.275763 26375 consensus_queue.cc:237] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.283018 26246 raft_consensus.cc:993] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc: : Instructing follower 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:24:01.283563 26380 raft_consensus.cc:1081] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Signalling peer 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:24:01.285405 26125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4afb32fab6c54886841869cdc5aeab1e"
dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:49640
I20260709 13:24:01.286028 26125 raft_consensus.cc:493] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:01.286379 26125 raft_consensus.cc:3060] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.290304 25948 catalog_manager.cc:5697] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 reported cstate change: term changed from 1 to 2, leader changed from d55319a034b9440882722bc321b6c4dc (127.12.208.131) to 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:01.293675 26125 raft_consensus.cc:515] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.296307 26125 leader_election.cc:290] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:01.296831 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afb32fab6c54886841869cdc5aeab1e" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:24:01.297683 26050 raft_consensus.cc:3060] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.297078 26198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afb32fab6c54886841869cdc5aeab1e" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:24:01.298739 26198 raft_consensus.cc:3055] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:01.299122 26198 raft_consensus.cc:740] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:24:01.300066 26198 consensus_queue.cc:260] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.301470 26198 raft_consensus.cc:3060] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.306259 26050 raft_consensus.cc:2468] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:24:01.307590 26089 leader_election.cc:304] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:01.308338 26375 raft_consensus.cc:2804] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:01.308912 26375 raft_consensus.cc:697] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Running, Role: LEADER
I20260709 13:24:01.309877 26198 raft_consensus.cc:2468] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:24:01.309877 26375 consensus_queue.cc:237] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.317523 25948 catalog_manager.cc:5697] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 reported cstate change: term changed from 1 to 2, leader changed from d55319a034b9440882722bc321b6c4dc (127.12.208.131) to 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:01.390015 26353 raft_consensus.cc:993] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece: : Instructing follower 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:24:01.390560 26396 raft_consensus.cc:1081] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Signalling peer 8b23e09dfdb041ae842f5dd1f6bb54c4 to start an election
I20260709 13:24:01.392251 26125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37fdeac3318a480d9ab250244e190248"
dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
 from {username='slave'} at 127.0.0.1:49634
I20260709 13:24:01.392875 26125 raft_consensus.cc:493] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:01.393239 26125 raft_consensus.cc:3060] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.401161 26125 raft_consensus.cc:515] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.403611 26125 leader_election.cc:290] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), d55319a034b9440882722bc321b6c4dc (127.12.208.131:35147)
I20260709 13:24:01.403926 26050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fdeac3318a480d9ab250244e190248" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:24:01.404297 26198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fdeac3318a480d9ab250244e190248" candidate_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55319a034b9440882722bc321b6c4dc"
I20260709 13:24:01.404695 26050 raft_consensus.cc:3055] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:01.404953 26198 raft_consensus.cc:3060] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.405076 26050 raft_consensus.cc:740] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:24:01.405953 26050 consensus_queue.cc:260] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.407388 26050 raft_consensus.cc:3060] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:01.412765 26198 raft_consensus.cc:2468] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:24:01.414247 26050 raft_consensus.cc:2468] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b23e09dfdb041ae842f5dd1f6bb54c4 in term 2.
I20260709 13:24:01.414302 26090 leader_election.cc:304] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc; no voters: 
I20260709 13:24:01.415275 26375 raft_consensus.cc:2804] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:01.415688 26375 raft_consensus.cc:697] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Becoming Leader. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Running, Role: LEADER
I20260709 13:24:01.416322 26375 consensus_queue.cc:237] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:01.423795 25948 catalog_manager.cc:5697] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 reported cstate change: term changed from 1 to 2, leader changed from eec7b18e6128402fb44865333f59bece (127.12.208.129) to 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130). New cstate: current_term: 2 leader_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:01.513329 26050 raft_consensus.cc:1275] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Refusing update from remote peer d55319a034b9440882722bc321b6c4dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:01.514897 26380 consensus_queue.cc:1048] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:01.522744 26125 raft_consensus.cc:1275] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Refusing update from remote peer d55319a034b9440882722bc321b6c4dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:01.524729 26380 consensus_queue.cc:1048] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:01.675539 26050 raft_consensus.cc:1275] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:01.677071 26375 consensus_queue.cc:1048] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:01.685415 26198 raft_consensus.cc:1275] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:01.690965 26354 consensus_queue.cc:1048] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:01.710247 26050 raft_consensus.cc:1275] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:01.711577 26354 consensus_queue.cc:1048] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:01.719743 26196 raft_consensus.cc:1275] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:01.721530 26420 consensus_queue.cc:1048] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:01.728425 26198 raft_consensus.cc:1275] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:01.730718 26354 consensus_queue.cc:1048] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:01.734944 26050 raft_consensus.cc:1275] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:01.736655 26354 consensus_queue.cc:1048] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:24:01.787748 26147 debug-util.cc:398] Leaking SignalData structure 0x7b080009b540 after lost signal to thread 13125
W20260709 13:24:01.788928 26147 debug-util.cc:398] Leaking SignalData structure 0x7b0800390ea0 after lost signal to thread 25983
W20260709 13:24:01.790215 26147 debug-util.cc:398] Leaking SignalData structure 0x7b080015d5a0 after lost signal to thread 26075
W20260709 13:24:01.791258 26147 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2c40 after lost signal to thread 26150
W20260709 13:24:01.792356 26147 debug-util.cc:398] Leaking SignalData structure 0x7b08000fa380 after lost signal to thread 26224
I20260709 13:24:01.965274 26198 raft_consensus.cc:1275] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:01.966928 26420 consensus_queue.cc:1048] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:01.982378 26050 raft_consensus.cc:1275] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Refusing update from remote peer 8b23e09dfdb041ae842f5dd1f6bb54c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:01.984144 26354 consensus_queue.cc:1048] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:04.015214 25947 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36198:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:24:04.039184 25947 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36198:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:24:04.067641 13122 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:24:04.366298 26476 tablet.cc:1724] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:24:04.394759 26015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:35147, user_credentials={real_user=slave}} blocked reactor thread for 68426.4us
I20260709 13:24:04.441381 26051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08"
dest_uuid: "eec7b18e6128402fb44865333f59bece"
mode: GRACEFUL
new_leader_uuid: "d55319a034b9440882722bc321b6c4dc"
 from {username='slave'} at 127.0.0.1:55336
I20260709 13:24:04.442164 26051 raft_consensus.cc:606] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 2 LEADER]: Received request to transfer leadership to TS d55319a034b9440882722bc321b6c4dc
I20260709 13:24:04.410609 26480 tablet.cc:1724] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.415360 26478 tablet.cc:1724] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.406183 26477 tablet.cc:1724] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.488103 26491 tablet.cc:1724] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.474622 26485 tablet.cc:1724] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.452630 26481 tablet.cc:1724] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.504886 26476 tablet.cc:1724] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.491034 26486 tablet.cc:1724] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.462261 26484 tablet.cc:1724] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.510358 26493 tablet.cc:1724] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.474932 26487 tablet.cc:1724] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.493039 26488 tablet.cc:1724] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.540071 26480 tablet.cc:1724] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.544386 26477 tablet.cc:1724] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:24:04.556396 26015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:35147, user_credentials={real_user=slave}} blocked reactor thread for 96168.2us
I20260709 13:24:04.569530 26493 tablet.cc:1724] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.574704 26124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54"
dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
mode: GRACEFUL
new_leader_uuid: "d55319a034b9440882722bc321b6c4dc"
 from {username='slave'} at 127.0.0.1:52780
I20260709 13:24:04.591514 26124 raft_consensus.cc:606] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Received request to transfer leadership to TS d55319a034b9440882722bc321b6c4dc
I20260709 13:24:04.593190 13122 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:24:04.594063 13122 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:24:04.574946 26486 tablet.cc:1724] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.591970 26487 tablet.cc:1724] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.579761 26491 tablet.cc:1724] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.603106 26484 tablet.cc:1724] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:24:04.615085 26015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.208.131:35147, user_credentials={real_user=slave}} blocked reactor thread for 52762.6us
I20260709 13:24:04.620599 26480 tablet.cc:1724] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.641045 26422 raft_consensus.cc:993] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece: : Instructing follower d55319a034b9440882722bc321b6c4dc to start an election
I20260709 13:24:04.641635 26422 raft_consensus.cc:1081] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 2 LEADER]: Signalling peer d55319a034b9440882722bc321b6c4dc to start an election
I20260709 13:24:04.643527 26485 tablet.cc:1724] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.646271 26196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08"
dest_uuid: "d55319a034b9440882722bc321b6c4dc"
 from {username='slave'} at 127.0.0.1:44774
I20260709 13:24:04.646981 26196 raft_consensus.cc:493] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:04.647436 26196 raft_consensus.cc:3060] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:04.646778 26481 tablet.cc:1724] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.650960 26487 tablet.cc:1724] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.653928 26493 tablet.cc:1724] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.656246 26486 tablet.cc:1724] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.668206 26478 tablet.cc:1724] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:04.660760 26196 raft_consensus.cc:515] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:04.689306 26048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:24:04.689456 26124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ea4b85fae24ec0aff5cb58a3b8da08" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:24:04.690065 26048 raft_consensus.cc:3055] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:24:04.690285 26124 raft_consensus.cc:3060] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:04.690467 26048 raft_consensus.cc:740] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eec7b18e6128402fb44865333f59bece, State: Running, Role: LEADER
I20260709 13:24:04.691427 26048 consensus_queue.cc:260] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:04.692607 26048 raft_consensus.cc:3060] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:04.698045 26124 raft_consensus.cc:2468] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 3.
I20260709 13:24:04.699095 26196 leader_election.cc:290] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 3 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:24:04.699608 26164 leader_election.cc:304] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, d55319a034b9440882722bc321b6c4dc; no voters: 
I20260709 13:24:04.703179 26459 raft_consensus.cc:2804] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:24:04.703694 26459 raft_consensus.cc:697] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 3 LEADER]: Becoming Leader. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:24:04.704556 26459 consensus_queue.cc:237] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:04.706738 26048 raft_consensus.cc:2468] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 3.
I20260709 13:24:04.726039 25949 catalog_manager.cc:5697] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc reported cstate change: term changed from 2 to 3, leader changed from eec7b18e6128402fb44865333f59bece (127.12.208.129) to d55319a034b9440882722bc321b6c4dc (127.12.208.131). New cstate: current_term: 3 leader_uuid: "d55319a034b9440882722bc321b6c4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:04.742151 25947 catalog_manager.cc:6242] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c: soft_deleted_table [id=05369319ea4448e698b5007c6c57cf19] alter complete (version 1)
I20260709 13:24:04.815220 26467 raft_consensus.cc:993] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4: : Instructing follower d55319a034b9440882722bc321b6c4dc to start an election
I20260709 13:24:04.815871 26466 raft_consensus.cc:1081] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Signalling peer d55319a034b9440882722bc321b6c4dc to start an election
I20260709 13:24:04.817967 26196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54"
dest_uuid: "d55319a034b9440882722bc321b6c4dc"
 from {username='slave'} at 127.0.0.1:44784
I20260709 13:24:04.818519 26196 raft_consensus.cc:493] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:04.818825 26196 raft_consensus.cc:3060] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:04.824203 26196 raft_consensus.cc:515] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:04.826045 26196 leader_election.cc:290] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 3 election: Requested vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
I20260709 13:24:04.826908 26048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eec7b18e6128402fb44865333f59bece"
I20260709 13:24:04.827322 26124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deaf8b4cf754e5bbb3f87eed11b3e54" candidate_uuid: "d55319a034b9440882722bc321b6c4dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4"
I20260709 13:24:04.827783 26048 raft_consensus.cc:3060] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:04.827999 26124 raft_consensus.cc:3055] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:24:04.828437 26124 raft_consensus.cc:740] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b23e09dfdb041ae842f5dd1f6bb54c4, State: Running, Role: LEADER
I20260709 13:24:04.829159 26124 consensus_queue.cc:260] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:04.830265 26124 raft_consensus.cc:3060] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:04.835764 26124 raft_consensus.cc:2468] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 3.
I20260709 13:24:04.836095 26048 raft_consensus.cc:2468] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55319a034b9440882722bc321b6c4dc in term 3.
I20260709 13:24:04.837600 26163 leader_election.cc:304] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d55319a034b9440882722bc321b6c4dc, eec7b18e6128402fb44865333f59bece; no voters: 
I20260709 13:24:04.838548 26459 raft_consensus.cc:2804] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:24:04.839109 26459 raft_consensus.cc:697] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 3 LEADER]: Becoming Leader. State: Replica: d55319a034b9440882722bc321b6c4dc, State: Running, Role: LEADER
I20260709 13:24:04.840010 26459 consensus_queue.cc:237] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:04.850454 25949 catalog_manager.cc:5697] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc reported cstate change: term changed from 2 to 3, leader changed from 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130) to d55319a034b9440882722bc321b6c4dc (127.12.208.131). New cstate: current_term: 3 leader_uuid: "d55319a034b9440882722bc321b6c4dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:05.137158 26124 raft_consensus.cc:1275] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 3 FOLLOWER]: Refusing update from remote peer d55319a034b9440882722bc321b6c4dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:24:05.138732 26459 consensus_queue.cc:1048] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:24:05.155130 26048 raft_consensus.cc:1275] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 3 FOLLOWER]: Refusing update from remote peer d55319a034b9440882722bc321b6c4dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:24:05.158628 26459 consensus_queue.cc:1048] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:24:05.275514 26124 raft_consensus.cc:1275] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 3 FOLLOWER]: Refusing update from remote peer d55319a034b9440882722bc321b6c4dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:24:05.277026 26425 consensus_queue.cc:1048] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:24:05.287393 26049 raft_consensus.cc:1275] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 3 FOLLOWER]: Refusing update from remote peer d55319a034b9440882722bc321b6c4dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:24:05.289247 26459 consensus_queue.cc:1048] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:24:05.661103 13122 tablet_server.cc:179] TabletServer@127.12.208.129:0 shutting down...
I20260709 13:24:05.699874 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:24:05.700853 13122 tablet_replica.cc:333] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.701768 13122 raft_consensus.cc:2243] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.702414 13122 raft_consensus.cc:2272] T 4afb32fab6c54886841869cdc5aeab1e P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.705291 13122 tablet_replica.cc:333] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.706248 13122 raft_consensus.cc:2243] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.706851 13122 raft_consensus.cc:2272] T 6387eb6ba2e44184b62088cf10d32c9b P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.709604 13122 tablet_replica.cc:333] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.710565 13122 raft_consensus.cc:2243] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.711158 13122 raft_consensus.cc:2272] T cef3019ab907487cb989b3efba3b0c77 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.714074 13122 tablet_replica.cc:333] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.714931 13122 raft_consensus.cc:2243] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.715515 13122 raft_consensus.cc:2272] T 53cae0f3abde4e8e84ee34b6bebe1e22 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:05.716884 26089 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20260709 13:24:05.718283 13122 tablet_replica.cc:333] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.719340 13122 raft_consensus.cc:2243] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:24:05.720098 26089 consensus_peers.cc:597] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 -> Peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Couldn't send request to peer eec7b18e6128402fb44865333f59bece. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.720434 13122 raft_consensus.cc:2272] T 4729e5bf9e774735b3c2244f4494f7fa P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.723376 13122 tablet_replica.cc:333] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.724303 13122 raft_consensus.cc:2243] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.725342 13122 raft_consensus.cc:2272] T 4b7f9b500a5e45dea9d6c7c729c903b0 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.728420 13122 tablet_replica.cc:333] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.729314 13122 raft_consensus.cc:2243] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:24:05.729637 26089 consensus_peers.cc:597] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 -> Peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Couldn't send request to peer eec7b18e6128402fb44865333f59bece. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.730381 13122 raft_consensus.cc:2272] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.733289 13122 tablet_replica.cc:333] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.734237 13122 raft_consensus.cc:2243] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.734881 13122 raft_consensus.cc:2272] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P eec7b18e6128402fb44865333f59bece [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.738400 13122 tablet_replica.cc:333] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.739326 13122 raft_consensus.cc:2243] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.740507 13122 raft_consensus.cc:2272] T 08d38135a9654f0abdb0bdcfd4237913 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.743844 13122 tablet_replica.cc:333] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.744731 13122 raft_consensus.cc:2243] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.745342 13122 raft_consensus.cc:2272] T 7a2cbc4350464c9996fc4b0ecb93229e P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.748384 13122 tablet_replica.cc:333] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.749204 13122 raft_consensus.cc:2243] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.749850 13122 raft_consensus.cc:2272] T 37fdeac3318a480d9ab250244e190248 P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.752614 13122 tablet_replica.cc:333] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.753415 13122 raft_consensus.cc:2243] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.754109 13122 raft_consensus.cc:2272] T 910cec7145844e7aa2700e4bb54a3bc7 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.757236 13122 tablet_replica.cc:333] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.758049 13122 raft_consensus.cc:2243] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.759099 13122 raft_consensus.cc:2272] T 5301f01783194b9491c77a347b6be610 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.761464 13122 tablet_replica.cc:333] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.762733 13122 raft_consensus.cc:2243] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.763465 13122 raft_consensus.cc:2272] T 43ea4b85fae24ec0aff5cb58a3b8da08 P eec7b18e6128402fb44865333f59bece [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:05.765573 26163 consensus_peers.cc:597] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc -> Peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Couldn't send request to peer eec7b18e6128402fb44865333f59bece. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.767576 13122 tablet_replica.cc:333] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.768311 13122 raft_consensus.cc:2243] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.768814 13122 raft_consensus.cc:2272] T e225ed8fa1204dd2a51e8bf31d03dd50 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.771288 13122 tablet_replica.cc:333] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.771870 13122 raft_consensus.cc:2243] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.772342 13122 raft_consensus.cc:2272] T fb3d976451f843b4ac6f6f21690ae17f P eec7b18e6128402fb44865333f59bece [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.774690 13122 tablet_replica.cc:333] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.775197 13122 raft_consensus.cc:2243] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.776021 13122 raft_consensus.cc:2272] T c2b24e5d3b424a87988cc14649cb9788 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.778033 13122 tablet_replica.cc:333] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece: stopping tablet replica
I20260709 13:24:05.778573 13122 raft_consensus.cc:2243] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.779640 13122 raft_consensus.cc:2272] T 9e47bde09bc649a59a8c062c8785c304 P eec7b18e6128402fb44865333f59bece [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:05.785152 26163 consensus_peers.cc:597] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc -> Peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Couldn't send request to peer eec7b18e6128402fb44865333f59bece. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.827142 13122 tablet_server.cc:196] TabletServer@127.12.208.129:0 shutdown complete.
I20260709 13:24:05.862236 13122 tablet_server.cc:179] TabletServer@127.12.208.130:0 shutting down...
W20260709 13:24:05.875872 26089 consensus_peers.cc:597] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 -> Peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Couldn't send request to peer eec7b18e6128402fb44865333f59bece. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:42371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:05.881208 26089 consensus_peers.cc:597] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 -> Peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Couldn't send request to peer eec7b18e6128402fb44865333f59bece. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:42371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.908840 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:24:05.909994 13122 tablet_replica.cc:333] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.911007 13122 raft_consensus.cc:2243] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.911648 13122 raft_consensus.cc:2272] T 53cae0f3abde4e8e84ee34b6bebe1e22 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.914456 13122 tablet_replica.cc:333] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.915328 13122 raft_consensus.cc:2243] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.916440 13122 raft_consensus.cc:2272] T 6387eb6ba2e44184b62088cf10d32c9b P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.919497 13122 tablet_replica.cc:333] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.920504 13122 raft_consensus.cc:2243] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.921638 13122 raft_consensus.cc:2272] T 4afb32fab6c54886841869cdc5aeab1e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.924500 13122 tablet_replica.cc:333] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.925434 13122 raft_consensus.cc:2243] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.926568 13122 raft_consensus.cc:2272] T cef3019ab907487cb989b3efba3b0c77 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.929334 13122 tablet_replica.cc:333] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.930191 13122 raft_consensus.cc:2243] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.930779 13122 raft_consensus.cc:2272] T 4729e5bf9e774735b3c2244f4494f7fa P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.933478 13122 tablet_replica.cc:333] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.934279 13122 raft_consensus.cc:2243] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.934881 13122 raft_consensus.cc:2272] T 4b7f9b500a5e45dea9d6c7c729c903b0 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.937865 13122 tablet_replica.cc:333] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.938735 13122 raft_consensus.cc:2243] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.939880 13122 raft_consensus.cc:2272] T 7a2cbc4350464c9996fc4b0ecb93229e P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.942881 13122 tablet_replica.cc:333] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.943670 13122 raft_consensus.cc:2243] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.944267 13122 raft_consensus.cc:2272] T 08d38135a9654f0abdb0bdcfd4237913 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.947387 13122 tablet_replica.cc:333] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.948246 13122 raft_consensus.cc:2243] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.948889 13122 raft_consensus.cc:2272] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.951565 13122 tablet_replica.cc:333] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.952406 13122 raft_consensus.cc:2243] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.952967 13122 raft_consensus.cc:2272] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.956518 13122 tablet_replica.cc:333] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.957479 13122 raft_consensus.cc:2243] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.958688 13122 raft_consensus.cc:2272] T fb3d976451f843b4ac6f6f21690ae17f P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:05.960136 26163 consensus_peers.cc:597] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc -> Peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Couldn't send request to peer eec7b18e6128402fb44865333f59bece. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:42371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.962049 13122 tablet_replica.cc:333] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.963007 13122 raft_consensus.cc:2243] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.964130 13122 raft_consensus.cc:2272] T 37fdeac3318a480d9ab250244e190248 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.966965 13122 tablet_replica.cc:333] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.967777 13122 raft_consensus.cc:2243] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.969282 13122 raft_consensus.cc:2272] T 910cec7145844e7aa2700e4bb54a3bc7 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.972826 13122 tablet_replica.cc:333] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.973958 13122 raft_consensus.cc:2243] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.974736 13122 raft_consensus.cc:2272] T e225ed8fa1204dd2a51e8bf31d03dd50 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.978149 13122 tablet_replica.cc:333] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.979050 13122 raft_consensus.cc:2243] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.979717 13122 raft_consensus.cc:2272] T 5301f01783194b9491c77a347b6be610 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.982690 13122 tablet_replica.cc:333] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.983546 13122 raft_consensus.cc:2243] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.984217 13122 raft_consensus.cc:2272] T 43ea4b85fae24ec0aff5cb58a3b8da08 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.987825 13122 tablet_replica.cc:333] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.988408 13122 raft_consensus.cc:2243] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.988894 13122 raft_consensus.cc:2272] T c2b24e5d3b424a87988cc14649cb9788 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.990855 13122 tablet_replica.cc:333] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4: stopping tablet replica
I20260709 13:24:05.991354 13122 raft_consensus.cc:2243] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.991806 13122 raft_consensus.cc:2272] T 9e47bde09bc649a59a8c062c8785c304 P 8b23e09dfdb041ae842f5dd1f6bb54c4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:06.041016 26164 consensus_peers.cc:597] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc -> Peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Couldn't send request to peer 8b23e09dfdb041ae842f5dd1f6bb54c4. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:43485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:06.067059 26163 consensus_peers.cc:597] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc -> Peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Couldn't send request to peer eec7b18e6128402fb44865333f59bece. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.129:42371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:06.093448 26164 consensus_peers.cc:597] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc -> Peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Couldn't send request to peer 8b23e09dfdb041ae842f5dd1f6bb54c4. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:43485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:06.140172 26164 consensus_peers.cc:597] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc -> Peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Couldn't send request to peer 8b23e09dfdb041ae842f5dd1f6bb54c4. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:43485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:06.244745 26164 consensus_peers.cc:597] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc -> Peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Couldn't send request to peer 8b23e09dfdb041ae842f5dd1f6bb54c4. Status: Network error: Client connection negotiation failed: client connection to 127.12.208.130:43485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:06.765345 13122 tablet_server.cc:196] TabletServer@127.12.208.130:0 shutdown complete.
I20260709 13:24:06.768980 26459 raft_consensus.cc:493] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eec7b18e6128402fb44865333f59bece)
I20260709 13:24:06.769662 26459 raft_consensus.cc:515] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:06.772243 26459 leader_election.cc:290] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
W20260709 13:24:06.779800 26163 leader_election.cc:336] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Network error: Client connection negotiation failed: client connection to 127.12.208.129:42371: connect: Connection refused (error 111)
W20260709 13:24:06.783056 26164 leader_election.cc:336] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Network error: Client connection negotiation failed: client connection to 127.12.208.130:43485: connect: Connection refused (error 111)
I20260709 13:24:06.783527 26164 leader_election.cc:304] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d55319a034b9440882722bc321b6c4dc; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece
I20260709 13:24:06.784332 26459 raft_consensus.cc:2749] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:24:06.806852 13122 tablet_server.cc:179] TabletServer@127.12.208.131:0 shutting down...
I20260709 13:24:06.830361 26459 raft_consensus.cc:493] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eec7b18e6128402fb44865333f59bece)
I20260709 13:24:06.831364 26459 raft_consensus.cc:515] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec7b18e6128402fb44865333f59bece" member_type: VOTER last_known_addr { host: "127.12.208.129" port: 42371 } } peers { permanent_uuid: "8b23e09dfdb041ae842f5dd1f6bb54c4" member_type: VOTER last_known_addr { host: "127.12.208.130" port: 43485 } } peers { permanent_uuid: "d55319a034b9440882722bc321b6c4dc" member_type: VOTER last_known_addr { host: "127.12.208.131" port: 35147 } }
I20260709 13:24:06.834849 26459 leader_election.cc:290] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eec7b18e6128402fb44865333f59bece (127.12.208.129:42371), 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485)
W20260709 13:24:06.838887 26163 leader_election.cc:336] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eec7b18e6128402fb44865333f59bece (127.12.208.129:42371): Network error: Client connection negotiation failed: client connection to 127.12.208.129:42371: connect: Connection refused (error 111)
W20260709 13:24:06.839672 26164 leader_election.cc:336] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8b23e09dfdb041ae842f5dd1f6bb54c4 (127.12.208.130:43485): Network error: Client connection negotiation failed: client connection to 127.12.208.130:43485: connect: Connection refused (error 111)
I20260709 13:24:06.840062 13122 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:24:06.840056 26164 leader_election.cc:304] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d55319a034b9440882722bc321b6c4dc; no voters: 8b23e09dfdb041ae842f5dd1f6bb54c4, eec7b18e6128402fb44865333f59bece
I20260709 13:24:06.840941 13122 tablet_replica.cc:333] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.841009 26459 raft_consensus.cc:2749] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:24:06.841924 13122 raft_consensus.cc:2243] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.842444 13122 raft_consensus.cc:2272] T cef3019ab907487cb989b3efba3b0c77 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.844381 13122 tablet_replica.cc:333] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.844959 13122 raft_consensus.cc:2243] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:06.845712 13122 raft_consensus.cc:2272] T 53cae0f3abde4e8e84ee34b6bebe1e22 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.847579 13122 tablet_replica.cc:333] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.848119 13122 raft_consensus.cc:2243] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.848555 13122 raft_consensus.cc:2272] T 6387eb6ba2e44184b62088cf10d32c9b P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.850369 13122 tablet_replica.cc:333] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.850893 13122 raft_consensus.cc:2243] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.851317 13122 raft_consensus.cc:2272] T 4afb32fab6c54886841869cdc5aeab1e P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.853034 13122 tablet_replica.cc:333] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.853549 13122 raft_consensus.cc:2243] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.854017 13122 raft_consensus.cc:2272] T 4729e5bf9e774735b3c2244f4494f7fa P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.855757 13122 tablet_replica.cc:333] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.856233 13122 raft_consensus.cc:2243] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:24:06.856950 13122 raft_consensus.cc:2272] T 9deaf8b4cf754e5bbb3f87eed11b3e54 P d55319a034b9440882722bc321b6c4dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.859040 13122 tablet_replica.cc:333] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.859514 13122 raft_consensus.cc:2243] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.859892 13122 raft_consensus.cc:2272] T 81f5c6c9d2554e1aa7e6a5392a34f0f2 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.861665 13122 tablet_replica.cc:333] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.862198 13122 raft_consensus.cc:2243] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.862586 13122 raft_consensus.cc:2272] T 37fdeac3318a480d9ab250244e190248 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.864253 13122 tablet_replica.cc:333] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.864720 13122 raft_consensus.cc:2243] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.865072 13122 raft_consensus.cc:2272] T 910cec7145844e7aa2700e4bb54a3bc7 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.867022 13122 tablet_replica.cc:333] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.867563 13122 raft_consensus.cc:2243] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.867944 13122 raft_consensus.cc:2272] T 4b7f9b500a5e45dea9d6c7c729c903b0 P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.870352 13122 tablet_replica.cc:333] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.870846 13122 raft_consensus.cc:2243] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:06.871589 13122 raft_consensus.cc:2272] T e225ed8fa1204dd2a51e8bf31d03dd50 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.873481 13122 tablet_replica.cc:333] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.874017 13122 raft_consensus.cc:2243] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.874401 13122 raft_consensus.cc:2272] T 5301f01783194b9491c77a347b6be610 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.876048 13122 tablet_replica.cc:333] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.876499 13122 raft_consensus.cc:2243] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:24:06.877234 13122 raft_consensus.cc:2272] T 43ea4b85fae24ec0aff5cb58a3b8da08 P d55319a034b9440882722bc321b6c4dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.879215 13122 tablet_replica.cc:333] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.879721 13122 raft_consensus.cc:2243] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.880087 13122 raft_consensus.cc:2272] T fb3d976451f843b4ac6f6f21690ae17f P d55319a034b9440882722bc321b6c4dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.881978 13122 tablet_replica.cc:333] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.882468 13122 raft_consensus.cc:2243] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.882848 13122 raft_consensus.cc:2272] T 08d38135a9654f0abdb0bdcfd4237913 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.884742 13122 tablet_replica.cc:333] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.885172 13122 raft_consensus.cc:2243] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.885667 13122 raft_consensus.cc:2272] T 7a2cbc4350464c9996fc4b0ecb93229e P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.887631 13122 tablet_replica.cc:333] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.888055 13122 raft_consensus.cc:2243] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.888427 13122 raft_consensus.cc:2272] T c2b24e5d3b424a87988cc14649cb9788 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.890256 13122 tablet_replica.cc:333] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc: stopping tablet replica
I20260709 13:24:06.890651 13122 raft_consensus.cc:2243] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:06.890985 13122 raft_consensus.cc:2272] T 9e47bde09bc649a59a8c062c8785c304 P d55319a034b9440882722bc321b6c4dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.931520 13122 tablet_server.cc:196] TabletServer@127.12.208.131:0 shutdown complete.
I20260709 13:24:06.962656 13122 master.cc:562] Master@127.12.208.190:37191 shutting down...
I20260709 13:24:06.983713 13122 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:06.984259 13122 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:06.984546 13122 tablet_replica.cc:333] T 00000000000000000000000000000000 P f310c8f5ea7645e6b35ae3977f40229c: stopping tablet replica
I20260709 13:24:07.031100 13122 master.cc:584] Master@127.12.208.190:37191 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12722 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25038 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (443226 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:24:07.118455 13122 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 428 messages since previous log ~15 seconds ago
I20260709 13:24:07.118670 13122 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 426 messages since previous log ~15 seconds ago
I20260709 13:24:07.118813 13122 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 424 messages since previous log ~15 seconds ago
I20260709 13:24:07.118974 13122 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:24:07.119122 13122 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:24:07.119309 13122 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~196 seconds ago
I20260709 13:24:07.119534 13122 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 24 messages since previous log ~1 seconds ago
I20260709 13:24:07.119823 13122 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~7 seconds ago
